2024-09-12T03:20:10.264 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T03:20:10.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T03:20:10.372 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quota} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901690' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAIlkSOXC/hztZIUYaBivh1iuDRdnZ7ayPYoc6nIoJ5ErKACsCraDM6IKWcvPg/0DSBgg8WSlmhlNlYoWVy1s/s= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXU3bpALQENa/aG72l4fBJayGA0nbWEbLQYDEfiy5gCAE5dkAbrJISrZJGEO9ACCzPCkNK4zSh6R1BWVO+wu4g= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T03:20:10.372 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T03:20:10.373 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T03:20:10.373 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T03:20:10.374 INFO:teuthology.task.internal:Checking packages... 2024-09-12T03:20:10.395 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T03:20:10.395 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T03:20:10.396 INFO:teuthology.packaging:ref: None 2024-09-12T03:20:10.396 INFO:teuthology.packaging:tag: None 2024-09-12T03:20:10.396 INFO:teuthology.packaging:branch: squid 2024-09-12T03:20:10.396 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T03:20:10.396 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-12T03:20:10.605 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314-g086c737f-1jammy 2024-09-12T03:20:10.607 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T03:20:10.614 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T03:20:10.614 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T03:20:10.629 INFO:teuthology.task.internal:Saving configuration 2024-09-12T03:20:10.645 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T03:20:10.652 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T03:20:10.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 03:14:37.197653', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILbsIhMJpb49zb/te51o5HoBuEvcS7iD2RGbOLhKntC2'} 2024-09-12T03:20:10.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 03:14:37.199246', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM6MhRU1/YCyOMMlgPrKohho1SO7/yMoLxfWFbSbQtND'} 2024-09-12T03:20:10.703 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T03:20:10.709 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-12T03:20:10.709 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-12T03:20:10.709 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T03:20:10.771 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd9189730a0>, signals=[15]) 2024-09-12T03:20:10.771 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T03:20:10.778 INFO:teuthology.task.internal:Opening connections... 2024-09-12T03:20:10.778 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:20:10.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:20:10.859 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:20:10.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:20:10.943 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T03:20:11.984 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-12T03:20:11.990 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-12T03:20:11.991 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-12T03:20:12.040 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T03:20:12.040 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-09-12T03:20:12.040 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2024-09-12T03:20:12.040 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T03:20:12.040 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2024-09-12T03:20:12.041 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-09-12T03:20:12.041 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-09-12T03:20:12.041 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T03:20:12.041 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T03:20:12.041 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T03:20:12.041 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T03:20:12.041 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2024-09-12T03:20:12.042 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-12T03:20:12.061 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-09-12T03:20:12.068 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-09-12T03:20:12.068 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-09-12T03:20:12.114 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T03:20:12.114 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04" 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T03:20:12.115 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy 2024-09-12T03:20:12.115 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-09-12T03:20:12.138 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T03:20:12.959 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T03:20:13.433 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T03:20:13.433 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-12T03:20:13.436 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-09-12T03:20:13.440 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T03:20:13.764 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T03:20:13.764 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-12T03:20:13.766 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-09-12T03:20:13.783 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T03:20:14.012 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T03:20:14.086 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T03:20:14.086 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T03:20:14.087 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T03:20:14.087 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T03:20:14.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:20:14.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:20:14.094 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-12T03:20:14.094 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-12T03:20:14.144 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-56-generic 2024-09-12T03:20:14.144 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.15.0-56-generic 2024-09-12T03:20:14.144 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-09-12T03:20:14.146 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2024-09-12T03:20:14.146 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.15.0-56-generic 2024-09-12T03:20:14.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-12T03:20:14.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-12T03:20:14.291 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-12T03:20:14.408 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T03:20:14.423 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T03:20:14.433 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T03:20:14.501 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T03:20:14.524 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T03:20:14.538 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T03:20:14.605 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T03:20:14.618 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T03:20:14.685 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T03:20:14.720 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T03:20:14.724 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T03:20:14.726 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T03:20:14.727 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T03:20:14.727 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T03:20:14.747 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T03:20:14.751 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T03:20:14.752 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T03:20:14.759 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T03:20:14.766 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T03:20:14.768 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T03:20:14.769 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T03:20:14.769 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T03:20:14.784 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T03:20:14.787 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T03:20:14.787 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T03:20:14.788 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T03:20:14.791 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T03:20:14.791 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T03:20:14.810 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T03:20:14.810 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T03:20:14.813 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T03:20:14.813 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T03:20:14.818 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T03:20:14.824 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T03:20:14.826 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T03:20:14.827 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T03:20:14.847 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T03:20:14.847 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T03:20:14.847 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T03:20:14.848 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T03:20:14.848 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T03:20:14.848 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T03:20:14.858 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T03:20:14.859 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T03:20:14.875 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T03:20:14.876 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T03:20:14.876 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T03:20:14.962 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T03:20:14.973 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T03:20:15.101 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T03:20:15.391 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T03:20:15.408 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T03:20:15.417 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T03:20:15.417 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T03:20:15.417 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T03:20:15.418 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T03:20:15.452 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T03:20:15.467 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T03:20:15.468 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T03:20:15.515 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T03:20:15.527 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T03:20:15.527 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T03:20:15.534 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T03:20:15.537 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T03:20:15.549 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T03:20:15.549 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T03:20:15.554 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T03:20:15.568 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T03:20:15.574 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T03:20:15.575 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T03:20:15.575 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T03:20:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T03:20:15.585 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T03:20:15.605 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T03:20:15.610 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T03:20:15.611 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T03:20:15.613 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T03:20:15.655 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T03:20:15.664 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T03:20:15.665 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T03:20:15.665 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T03:20:15.667 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T03:20:15.695 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T03:20:15.696 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T03:20:15.696 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T03:20:15.697 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T03:20:15.698 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T03:20:15.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T03:20:21.210 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 15.8 MB in 2s (7,302 kB/s) 2024-09-12T03:20:21.216 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 15.8 MB in 2s (7,434 kB/s) 2024-09-12T03:20:22.571 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T03:20:22.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T03:20:22.656 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T03:20:22.699 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T03:20:22.718 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T03:20:22.780 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T03:20:22.865 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T03:20:22.865 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T03:20:22.995 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T03:20:22.995 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T03:20:23.056 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:20:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:20:23.056 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:20:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:20:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T03:20:23.057 INFO:teuthology.orchestra.run.smithi073.stdout: python2.7-minimal 2024-09-12T03:20:23.057 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:20:23.058 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-12T03:20:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T03:20:23.058 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T03:20:23.059 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T03:20:23.060 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-12T03:20:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T03:20:23.060 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-12T03:20:23.060 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2024-09-12T03:20:23.113 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-12T03:20:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T03:20:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T03:20:23.114 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T03:20:23.115 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-12T03:20:23.116 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T03:20:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T03:20:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 113 MB of archives. 2024-09-12T03:20:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T03:20:23.169 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T03:20:23.175 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:20:23.176 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:20:23.176 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:20:23.176 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:20:23.176 INFO:teuthology.orchestra.run.smithi150.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T03:20:23.176 INFO:teuthology.orchestra.run.smithi150.stdout: python2.7-minimal 2024-09-12T03:20:23.177 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:20:23.177 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-12T03:20:23.177 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T03:20:23.178 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T03:20:23.178 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T03:20:23.179 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-12T03:20:23.179 INFO:teuthology.orchestra.run.smithi150.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T03:20:23.179 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-09-12T03:20:23.179 INFO:teuthology.orchestra.run.smithi150.stdout: thermald 2024-09-12T03:20:23.239 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-12T03:20:23.239 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T03:20:23.240 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T03:20:23.240 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T03:20:23.241 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2024-09-12T03:20:23.242 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T03:20:23.421 INFO:teuthology.orchestra.run.smithi150.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T03:20:23.422 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 113 MB of archives. 2024-09-12T03:20:23.422 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T03:20:23.422 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T03:20:23.583 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T03:20:23.680 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T03:20:24.489 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T03:20:24.489 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T03:20:24.489 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T03:20:24.610 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T03:20:24.632 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T03:20:24.869 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T03:20:25.112 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 113 MB in 2s (72.0 MB/s) 2024-09-12T03:20:25.260 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T03:20:25.273 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T03:20:27.274 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T03:20:27.279 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:27.342 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:27.424 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T03:20:27.425 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T03:20:27.425 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T03:20:27.794 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T03:20:27.877 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T03:20:28.292 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-12T03:20:28.628 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T03:20:29.944 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T03:20:29.965 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:30.051 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T03:20:30.476 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:30.513 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:30.701 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T03:20:30.705 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:30.834 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:33.230 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T03:20:33.252 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:33.536 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:34.015 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T03:20:34.029 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:34.080 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:36.719 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T03:20:36.844 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T03:20:37.151 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T03:20:37.272 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T03:20:37.550 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T03:20:37.573 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T03:20:37.617 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T03:20:40.548 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T03:20:40.675 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T03:20:41.015 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T03:20:41.137 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T03:20:41.465 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T03:20:41.487 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T03:20:41.531 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T03:20:43.044 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T03:20:43.081 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:43.227 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:45.880 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T03:20:46.006 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T03:20:46.339 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T03:20:46.452 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:46.578 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T03:20:46.707 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:47.478 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T03:20:47.515 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T03:20:47.552 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:48.027 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T03:20:48.027 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T03:20:48.027 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T03:20:48.027 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T03:20:48.167 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:50.202 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:51.309 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T03:20:51.449 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T03:20:51.756 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T03:20:51.846 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T03:20:51.912 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:51.972 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T03:20:52.038 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T03:20:52.098 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:52.163 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T03:20:52.163 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T03:20:52.188 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:53.519 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T03:20:53.519 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T03:20:53.519 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T03:20:53.519 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T03:20:53.676 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:55.119 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:57.012 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T03:20:57.138 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T03:20:57.290 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T03:20:57.359 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T03:20:57.359 INFO:teuthology.orchestra.run.smithi150.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T03:21:06.553 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T03:21:06.554 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2024-09-12T03:21:06.567 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T03:21:06.591 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2024-09-12T03:21:06.939 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T03:21:06.952 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T03:21:07.332 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T03:21:07.338 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T03:21:07.417 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T03:21:07.423 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T03:21:07.601 INFO:teuthology.orchestra.run.smithi073.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T03:21:07.601 INFO:teuthology.orchestra.run.smithi073.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T03:21:07.601 INFO:teuthology.orchestra.run.smithi073.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T03:21:07.649 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-09-12T03:21:08.099 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-12T03:21:08.122 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.119.119 2024-09-12T03:21:08.123 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T03:21:08.123 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T03:21:08.123 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-12T03:21:08.123 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-12T03:21:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-12T03:21:08.123 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-12T03:21:08.123 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T03:21:08.123 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T03:21:08.123 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T03:21:08.124 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T03:21:08.124 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T03:21:08.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-12T03:21:08.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-12T03:21:08.508 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T03:21:08.630 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T03:21:08.714 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T03:21:08.792 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T03:21:09.970 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T03:21:09.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T03:21:10.055 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T03:21:10.267 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T03:21:10.268 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T03:21:10.460 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T03:21:10.460 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:21:10.461 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:21:10.461 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:21:10.461 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:21:10.461 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T03:21:10.461 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T03:21:10.461 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:21:10.504 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T03:21:10.506 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-12T03:21:10.518 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.119.119 2024-09-12T03:21:10.519 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T03:21:10.520 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T03:21:10.520 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-12T03:21:10.520 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-12T03:21:10.520 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-12T03:21:10.520 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-12T03:21:10.520 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T03:21:10.565 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.MBZWZvi7US 2024-09-12T03:21:10.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MBZWZvi7US 2024-09-12T03:21:10.621 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.MBZWZvi7US 2024-09-12T03:21:10.743 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.MBZWZvi7US is 10KB 2024-09-12T03:21:10.757 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.MBZWZvi7US 2024-09-12T03:21:10.763 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T03:21:10.818 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:21:10.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T03:21:10.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T03:21:10.885 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T03:21:10.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2024-09-12T03:21:11.223 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T03:21:11.224 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub' 2024-09-12T03:21:11.236 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T03:21:11.272 INFO:teuthology.orchestra.run.smithi150.stdout:Generating grub configuration file ... 2024-09-12T03:21:11.584 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T03:21:11.603 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T03:21:11.924 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T03:21:11.933 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T03:21:11.997 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T03:21:12.002 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T03:21:12.158 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-09-12T03:21:12.159 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T03:21:12.161 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-12T03:21:12.187 INFO:teuthology.orchestra.run.smithi150.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T03:21:12.187 INFO:teuthology.orchestra.run.smithi150.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T03:21:12.187 INFO:teuthology.orchestra.run.smithi150.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T03:21:12.227 INFO:teuthology.orchestra.run.smithi150.stdout:done 2024-09-12T03:21:12.353 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T03:21:12.360 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T03:21:12.653 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T03:21:12.659 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T03:21:12.701 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T03:21:12.706 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T03:21:12.711 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.119.119 2024-09-12T03:21:12.733 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T03:21:12.734 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T03:21:12.734 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-09-12T03:21:12.734 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-09-12T03:21:12.734 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-09-12T03:21:12.734 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-09-12T03:21:12.734 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T03:21:12.734 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T03:21:12.734 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T03:21:12.734 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T03:21:12.734 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T03:21:12.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2024-09-12T03:21:12.839 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T03:21:12.839 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T03:21:12.839 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T03:21:12.852 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-12T03:21:12.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-12T03:21:12.913 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-12T03:21:13.027 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T03:21:13.147 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T03:21:13.230 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T03:21:13.584 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T03:21:13.769 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 128 kB in 1s (184 kB/s) 2024-09-12T03:21:14.791 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T03:21:14.809 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T03:21:14.861 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T03:21:15.046 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T03:21:15.047 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T03:21:15.217 INFO:teuthology.orchestra.run.smithi150.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T03:21:15.217 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:21:15.217 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:21:15.217 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:21:15.217 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:21:15.217 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T03:21:15.218 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T03:21:15.218 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:21:15.258 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T03:21:15.260 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 21 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.119.119 2024-09-12T03:21:15.316 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T03:21:15.317 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T03:21:15.317 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2024-09-12T03:21:15.317 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2024-09-12T03:21:15.317 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2024-09-12T03:21:15.317 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2024-09-12T03:21:15.317 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-12T03:21:15.361 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.JC53p8DbVF 2024-09-12T03:21:15.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub/grub.cfg /tmp/tmp.JC53p8DbVF 2024-09-12T03:21:15.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.JC53p8DbVF 2024-09-12T03:21:15.540 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.JC53p8DbVF is 10KB 2024-09-12T03:21:15.551 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.JC53p8DbVF 2024-09-12T03:21:15.557 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T03:21:15.613 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:21:15.613 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T03:21:15.613 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T03:21:15.695 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T03:21:15.695 DEBUG:teuthology.orchestra.run.smithi150:> sudo update-grub 2024-09-12T03:21:17.109 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2024-09-12T03:21:17.110 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T03:21:17.114 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2024-09-12T03:21:17.319 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T03:21:17.325 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T03:21:17.589 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T03:21:17.594 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T03:21:17.636 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T03:21:17.641 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T03:21:17.795 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T03:21:17.795 INFO:teuthology.orchestra.run.smithi150.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T03:21:17.795 INFO:teuthology.orchestra.run.smithi150.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T03:21:17.815 INFO:teuthology.orchestra.run.smithi150.stderr:done 2024-09-12T03:21:17.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2024-09-12T03:21:42.887 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T03:21:42.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T03:21:42.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:21:47.825 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T03:21:47.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:21:47.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:22:06.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-12T03:22:15.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:22:15.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:22:18.337 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-12T03:22:30.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:22:30.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:22:42.903 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T03:22:48.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-12T03:22:51.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T03:22:51.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:22:52.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-12T03:23:03.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:23:03.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:23:03.801 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-09-12T03:23:04.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T03:23:04.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:23:05.311 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-12T03:23:05.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T03:23:05.870 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T03:23:05.870 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-12T03:23:05.915 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-119-generic 2024-09-12T03:23:05.915 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T03:23:05.915 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T03:23:05.915 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T03:23:06.916 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T03:23:06.916 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T03:23:06.997 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-12T03:23:07.024 DEBUG:teuthology.parallel:result is None 2024-09-12T03:23:21.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:23:21.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:23:22.380 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-12T03:23:22.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:23:22.964 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T03:23:22.965 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2024-09-12T03:23:23.011 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-119-generic 2024-09-12T03:23:23.012 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T03:23:23.012 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T03:23:23.012 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T03:23:24.013 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T03:23:24.014 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T03:23:24.410 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2024-09-12T03:23:24.445 DEBUG:teuthology.parallel:result is None 2024-09-12T03:23:24.446 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T03:23:24.454 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T03:23:24.454 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T03:23:24.456 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T03:23:24.462 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T03:23:24.472 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T03:23:24.480 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T03:23:24.480 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T03:23:24.504 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T03:23:24.596 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T03:23:24.602 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T03:23:24.603 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T03:23:24.605 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T03:23:24.626 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T03:23:24.632 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T03:23:24.635 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T03:23:24.639 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T03:23:24.641 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T03:23:24.648 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T03:23:24.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T03:23:24.680 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T03:23:24.696 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T03:23:24.705 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T03:23:24.705 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T03:23:24.736 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T03:23:24.743 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T03:23:24.787 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T03:23:24.835 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:23:24.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T03:23:24.906 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T03:23:24.912 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T03:23:24.960 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:23:24.960 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T03:23:25.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-12T03:23:25.072 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-09-12T03:23:25.107 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T03:23:25.119 INFO:teuthology.task.internal:Starting timer... 2024-09-12T03:23:25.119 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T03:23:25.130 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T03:23:25.140 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-09-12T03:23:25.140 DEBUG:teuthology.task.selinux:Excluding smithi150: OS 'ubuntu' does not support SELinux 2024-09-12T03:23:25.140 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T03:23:25.140 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T03:23:25.140 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T03:23:25.140 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T03:23:25.149 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T03:23:25.161 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T03:23:25.162 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi150.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T03:30:54.412 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com')] 2024-09-12T03:30:54.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T03:30:54.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:30:54.534 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-12T03:30:54.613 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-12T03:30:54.613 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:30:54.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T03:30:54.702 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-09-12T03:30:54.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-09-12T03:30:54.781 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T03:30:54.791 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T03:30:54.792 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T03:30:54.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:30:54.795 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T03:30:54.795 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:30:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T03:30:54.824 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Command line: ntpd -gq 2024-09-12T03:30:54.824 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: ---------------------------------------------------- 2024-09-12T03:30:54.824 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T03:30:54.824 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T03:30:54.824 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: corporation. Support and training for ntp-4 are 2024-09-12T03:30:54.824 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: available at https://www.nwtime.org/support 2024-09-12T03:30:54.825 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: ---------------------------------------------------- 2024-09-12T03:30:54.826 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: proto: precision = 0.061 usec (-24) 2024-09-12T03:30:54.827 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: basedate set to 2022-02-04 2024-09-12T03:30:54.827 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: gps base set to 2022-02-06 (week 2196) 2024-09-12T03:30:54.827 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T03:30:54.827 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T03:30:54.828 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T03:30:54.829 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T03:30:54.830 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T03:30:54.830 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T03:30:54.830 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T03:30:54.830 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-09-12T03:30:54.830 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Listen normally on 4 lo [::1]:123 2024-09-12T03:30:54.830 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-09-12T03:30:54.830 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:30:54 ntpd[18505]: Listening on routing socket on fd #22 for interface updates 2024-09-12T03:30:54.851 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T03:30:54.852 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Command line: ntpd -gq 2024-09-12T03:30:54.852 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: ---------------------------------------------------- 2024-09-12T03:30:54.852 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T03:30:54.852 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T03:30:54.852 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: corporation. Support and training for ntp-4 are 2024-09-12T03:30:54.853 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: available at https://www.nwtime.org/support 2024-09-12T03:30:54.853 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: ---------------------------------------------------- 2024-09-12T03:30:54.854 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: proto: precision = 0.044 usec (-24) 2024-09-12T03:30:54.854 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: basedate set to 2022-02-04 2024-09-12T03:30:54.854 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: gps base set to 2022-02-06 (week 2196) 2024-09-12T03:30:54.855 INFO:teuthology.orchestra.run.smithi150.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T03:30:54.855 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T03:30:54.855 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T03:30:54.856 INFO:teuthology.orchestra.run.smithi150.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T03:30:54.857 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T03:30:54.857 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T03:30:54.858 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T03:30:54.858 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Listen normally on 3 enp3s0f1 172.21.15.150:123 2024-09-12T03:30:54.858 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Listen normally on 4 lo [::1]:123 2024-09-12T03:30:54.858 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e35%5]:123 2024-09-12T03:30:54.858 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:30:54 ntpd[18536]: Listening on routing socket on fd #22 for interface updates 2024-09-12T03:30:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:55 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:55 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:55 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:55.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:55 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:55.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:55 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:55.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:55 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:55.852 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:55 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:55.852 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:55 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:55.852 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:55 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:55.852 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:55 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:55.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:55 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:55.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:55 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:56.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:56 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:56.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:56 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:56.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:56 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:56.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:56 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:56.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:56 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:56.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:56 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:57 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:57 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:57 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:57 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:57 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:57 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:57.852 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:57.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:57 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:58 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:59.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:59.829 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:30:59 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:59.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:30:59.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:30:59 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:31:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:00 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:00 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:00 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:00 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:00 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:31:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:00 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:31:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:31:01.825 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:31:01.825 INFO:teuthology.orchestra.run.smithi073.stdout:12 Sep 03:31:01 ntpd[18505]: ntpd: time slew -0.002537 s 2024-09-12T03:31:01.825 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.002537s 2024-09-12T03:31:01.826 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T03:31:01.826 INFO:teuthology.orchestra.run.smithi073.stderr:12 Sep 03:31:01 ntpd[18505]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:31:01.853 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stdout:12 Sep 03:31:01 ntpd[18536]: ntpd: time slew +0.003970 s 2024-09-12T03:31:01.854 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time slew +0.003970s 2024-09-12T03:31:01.855 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T03:31:01.855 INFO:teuthology.orchestra.run.smithi150.stderr:12 Sep 03:31:01 ntpd[18536]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T03:31:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T03:31:01.876 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-12T03:31:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.876 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.902 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T03:31:01.902 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-09-12T03:31:01.902 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.902 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.902 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.902 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:31:01.904 INFO:teuthology.run_tasks:Running task install... 2024-09-12T03:31:01.912 DEBUG:teuthology.task.install:project ceph 2024-09-12T03:31:01.912 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T03:31:01.913 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T03:31:01.913 INFO:teuthology.task.install:Using flavor: default 2024-09-12T03:31:01.918 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T03:31:01.918 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T03:31:01.919 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-09-12T03:31:01.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-key list | grep Ceph 2024-09-12T03:31:01.975 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T03:31:01.999 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T03:31:02.003 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T03:31:02.003 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T03:31:02.004 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-12T03:31:02.004 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-12T03:31:02.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T03:31:02.028 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T03:31:02.028 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T03:31:02.029 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-12T03:31:02.029 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-12T03:31:02.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T03:31:02.159 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-12T03:31:02.159 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:31:02.178 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-12T03:31:02.178 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:31:02.284 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:31:02.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T03:31:02.295 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:31:02.295 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T03:31:02.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-12T03:31:02.309 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2024-09-12T03:31:02.470 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T03:31:02.470 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T03:31:02.481 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T03:31:02.499 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T03:31:02.525 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T03:31:02.535 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T03:31:02.548 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-12T03:31:02.557 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-12T03:31:02.570 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T03:31:02.584 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T03:31:02.591 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-12T03:31:02.618 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T03:31:02.618 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T03:31:02.618 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-12T03:31:02.619 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-12T03:31:02.641 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-12T03:31:02.683 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T03:31:02.764 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T03:31:02.814 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 29.0 kB in 0s (87.2 kB/s) 2024-09-12T03:31:02.985 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 29.0 kB in 0s (58.9 kB/s) 2024-09-12T03:31:03.786 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T03:31:03.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:31:03.857 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T03:31:04.035 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T03:31:04.052 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T03:31:04.053 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy cephfs-shell=19.1.1-298-gb53b6d3e-1jammy cephfs-top=19.1.1-298-gb53b6d3e-1jammy cephfs-mirror=19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:31:04.053 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T03:31:04.114 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T03:31:04.235 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:31:04.235 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:31:04.235 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:31:04.236 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:31:04.236 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T03:31:04.236 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T03:31:04.236 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:31:04.237 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-12T03:31:04.237 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T03:31:04.237 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T03:31:04.237 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T03:31:04.237 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T03:31:04.238 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T03:31:04.238 INFO:teuthology.orchestra.run.smithi073.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-12T03:31:04.239 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T03:31:04.240 INFO:teuthology.orchestra.run.smithi073.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T03:31:04.241 INFO:teuthology.orchestra.run.smithi073.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T03:31:04.241 INFO:teuthology.orchestra.run.smithi073.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T03:31:04.241 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T03:31:04.241 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T03:31:04.241 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-12T03:31:04.241 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-09-12T03:31:04.323 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T03:31:04.324 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T03:31:04.348 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-12T03:31:04.348 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T03:31:04.348 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T03:31:04.348 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-12T03:31:04.348 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-12T03:31:04.349 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T03:31:04.349 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-12T03:31:04.349 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T03:31:04.350 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-12T03:31:04.351 INFO:teuthology.orchestra.run.smithi073.stdout: socat unzip xmlstarlet zip 2024-09-12T03:31:04.495 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T03:31:04.496 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 181 MB of archives. 2024-09-12T03:31:04.496 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-12T03:31:04.496 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-12T03:31:04.517 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:31:04.517 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:31:04.517 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:31:04.517 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:31:04.518 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T03:31:04.518 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T03:31:04.518 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:31:04.519 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-12T03:31:04.519 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T03:31:04.519 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T03:31:04.520 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T03:31:04.520 INFO:teuthology.orchestra.run.smithi150.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T03:31:04.520 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T03:31:04.520 INFO:teuthology.orchestra.run.smithi150.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-12T03:31:04.521 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T03:31:04.522 INFO:teuthology.orchestra.run.smithi150.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T03:31:04.523 INFO:teuthology.orchestra.run.smithi150.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T03:31:04.523 INFO:teuthology.orchestra.run.smithi150.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T03:31:04.523 INFO:teuthology.orchestra.run.smithi150.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T03:31:04.523 INFO:teuthology.orchestra.run.smithi150.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T03:31:04.523 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T03:31:04.523 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2024-09-12T03:31:04.523 INFO:teuthology.orchestra.run.smithi150.stdout: btrfs-tools 2024-09-12T03:31:04.538 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-12T03:31:04.621 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T03:31:04.631 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-12T03:31:04.631 INFO:teuthology.orchestra.run.smithi150.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T03:31:04.631 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T03:31:04.631 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-12T03:31:04.631 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T03:31:04.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-12T03:31:04.634 INFO:teuthology.orchestra.run.smithi150.stdout: socat unzip xmlstarlet zip 2024-09-12T03:31:04.666 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-12T03:31:04.692 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-12T03:31:04.699 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 124 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T03:31:04.699 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 181 MB of archives. 2024-09-12T03:31:04.699 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-12T03:31:04.700 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-12T03:31:04.718 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T03:31:04.728 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-12T03:31:04.738 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-12T03:31:04.748 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-12T03:31:04.754 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-12T03:31:04.754 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-12T03:31:04.757 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-12T03:31:04.758 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-12T03:31:04.764 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-12T03:31:04.769 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T03:31:04.791 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T03:31:04.793 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T03:31:04.805 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T03:31:04.850 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-12T03:31:04.855 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T03:31:04.860 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T03:31:04.861 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T03:31:04.870 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T03:31:04.874 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T03:31:04.874 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T03:31:04.879 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-12T03:31:04.881 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-12T03:31:04.882 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T03:31:04.884 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T03:31:04.886 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T03:31:04.887 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-12T03:31:04.888 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T03:31:04.888 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T03:31:04.894 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T03:31:04.896 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T03:31:04.898 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T03:31:04.911 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T03:31:04.912 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T03:31:04.912 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T03:31:04.913 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T03:31:04.913 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T03:31:04.913 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T03:31:04.914 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T03:31:04.929 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T03:31:04.929 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T03:31:04.931 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T03:31:04.950 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T03:31:04.950 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T03:31:04.950 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T03:31:04.950 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T03:31:04.951 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T03:31:04.951 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T03:31:04.951 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T03:31:04.953 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T03:31:04.963 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T03:31:04.964 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T03:31:04.966 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T03:31:04.969 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T03:31:04.981 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T03:31:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T03:31:04.982 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T03:31:04.983 INFO:teuthology.orchestra.run.smithi150.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T03:31:04.985 INFO:teuthology.orchestra.run.smithi150.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T03:31:04.986 INFO:teuthology.orchestra.run.smithi150.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T03:31:04.987 INFO:teuthology.orchestra.run.smithi150.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T03:31:04.999 INFO:teuthology.orchestra.run.smithi150.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T03:31:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T03:31:05.001 INFO:teuthology.orchestra.run.smithi150.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T03:31:05.015 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T03:31:05.016 INFO:teuthology.orchestra.run.smithi150.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T03:31:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T03:31:05.071 INFO:teuthology.orchestra.run.smithi150.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T03:31:05.072 INFO:teuthology.orchestra.run.smithi150.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T03:31:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T03:31:05.073 INFO:teuthology.orchestra.run.smithi150.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T03:31:05.074 INFO:teuthology.orchestra.run.smithi150.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T03:31:05.092 INFO:teuthology.orchestra.run.smithi150.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T03:31:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T03:31:05.094 INFO:teuthology.orchestra.run.smithi150.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T03:31:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T03:31:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T03:31:05.109 INFO:teuthology.orchestra.run.smithi150.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T03:31:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T03:31:05.110 INFO:teuthology.orchestra.run.smithi150.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T03:31:05.111 INFO:teuthology.orchestra.run.smithi150.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T03:31:05.125 INFO:teuthology.orchestra.run.smithi150.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T03:31:05.125 INFO:teuthology.orchestra.run.smithi150.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T03:31:05.128 INFO:teuthology.orchestra.run.smithi150.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T03:31:05.142 INFO:teuthology.orchestra.run.smithi150.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T03:31:05.143 INFO:teuthology.orchestra.run.smithi150.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T03:31:05.144 INFO:teuthology.orchestra.run.smithi150.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T03:31:05.147 INFO:teuthology.orchestra.run.smithi150.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T03:31:05.149 INFO:teuthology.orchestra.run.smithi150.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-12T03:31:05.150 INFO:teuthology.orchestra.run.smithi150.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T03:31:05.150 INFO:teuthology.orchestra.run.smithi150.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T03:31:05.159 INFO:teuthology.orchestra.run.smithi150.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T03:31:05.164 INFO:teuthology.orchestra.run.smithi150.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T03:31:05.164 INFO:teuthology.orchestra.run.smithi150.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T03:31:05.177 INFO:teuthology.orchestra.run.smithi150.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T03:31:05.177 INFO:teuthology.orchestra.run.smithi150.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T03:31:05.177 INFO:teuthology.orchestra.run.smithi150.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T03:31:05.178 INFO:teuthology.orchestra.run.smithi150.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T03:31:05.179 INFO:teuthology.orchestra.run.smithi150.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T03:31:05.180 INFO:teuthology.orchestra.run.smithi150.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T03:31:05.186 INFO:teuthology.orchestra.run.smithi150.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T03:31:05.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T03:31:05.194 INFO:teuthology.orchestra.run.smithi150.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T03:31:05.194 INFO:teuthology.orchestra.run.smithi150.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T03:31:05.196 INFO:teuthology.orchestra.run.smithi150.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T03:31:05.198 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T03:31:05.211 INFO:teuthology.orchestra.run.smithi150.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T03:31:05.224 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T03:31:05.233 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T03:31:05.234 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T03:31:05.252 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T03:31:05.256 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T03:31:05.261 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T03:31:05.263 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T03:31:05.273 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T03:31:05.345 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T03:31:05.395 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T03:31:05.472 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T03:31:05.472 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-12T03:31:05.473 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T03:31:05.474 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T03:31:05.476 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T03:31:05.477 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T03:31:05.478 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T03:31:05.479 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T03:31:05.480 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T03:31:05.539 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-12T03:31:05.541 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-12T03:31:05.543 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-12T03:31:05.554 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T03:31:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-12T03:31:05.562 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T03:31:05.567 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T03:31:05.569 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T03:31:05.570 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T03:31:05.570 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T03:31:05.572 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T03:31:05.573 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T03:31:05.574 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T03:31:05.638 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T03:31:05.655 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-12T03:31:05.718 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T03:31:05.719 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T03:31:05.729 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T03:31:05.730 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T03:31:05.731 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T03:31:05.732 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T03:31:05.735 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T03:31:05.738 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T03:31:05.799 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T03:31:05.802 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T03:31:05.822 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T03:31:05.826 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T03:31:05.827 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T03:31:05.881 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T03:31:05.885 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T03:31:05.968 INFO:teuthology.orchestra.run.smithi150.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-12T03:31:06.050 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T03:31:06.052 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T03:31:06.054 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T03:31:06.126 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T03:31:06.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T03:31:06.190 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-12T03:31:06.190 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-12T03:31:06.203 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-12T03:31:06.236 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-12T03:31:06.237 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T03:31:06.241 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T03:31:06.242 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T03:31:06.246 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-12T03:31:06.248 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-12T03:31:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-12T03:31:06.269 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-12T03:31:06.284 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T03:31:06.319 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T03:31:06.330 INFO:teuthology.orchestra.run.smithi150.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-12T03:31:06.373 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T03:31:06.380 INFO:teuthology.orchestra.run.smithi150.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-12T03:31:06.381 INFO:teuthology.orchestra.run.smithi150.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-12T03:31:06.396 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T03:31:06.418 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T03:31:06.424 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-12T03:31:06.425 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-12T03:31:06.429 INFO:teuthology.orchestra.run.smithi150.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-12T03:31:06.433 INFO:teuthology.orchestra.run.smithi150.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-12T03:31:06.442 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T03:31:06.462 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T03:31:06.473 INFO:teuthology.orchestra.run.smithi150.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-12T03:31:06.486 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T03:31:06.551 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T03:31:06.574 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T03:31:06.598 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T03:31:06.620 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T03:31:06.649 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T03:31:06.673 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-12T03:31:06.692 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T03:31:06.712 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T03:31:06.730 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T03:31:06.760 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T03:31:06.779 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T03:31:06.804 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T03:31:06.822 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T03:31:06.841 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T03:31:06.859 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T03:31:06.881 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T03:31:06.901 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T03:31:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T03:31:07.018 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T03:31:07.036 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T03:31:07.058 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T03:31:07.078 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T03:31:07.106 INFO:teuthology.orchestra.run.smithi150.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-12T03:31:07.108 INFO:teuthology.orchestra.run.smithi150.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-12T03:31:07.164 INFO:teuthology.orchestra.run.smithi150.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-12T03:31:07.757 INFO:teuthology.orchestra.run.smithi073.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-12T03:31:07.760 INFO:teuthology.orchestra.run.smithi073.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-12T03:31:07.765 INFO:teuthology.orchestra.run.smithi073.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-12T03:31:07.766 INFO:teuthology.orchestra.run.smithi073.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-12T03:31:07.767 INFO:teuthology.orchestra.run.smithi073.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-12T03:31:07.768 INFO:teuthology.orchestra.run.smithi073.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-12T03:31:08.119 INFO:teuthology.orchestra.run.smithi150.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-12T03:31:08.119 INFO:teuthology.orchestra.run.smithi073.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-12T03:31:08.198 INFO:teuthology.orchestra.run.smithi150.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-12T03:31:08.200 INFO:teuthology.orchestra.run.smithi150.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-12T03:31:08.202 INFO:teuthology.orchestra.run.smithi150.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-12T03:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-12T03:31:08.301 INFO:teuthology.orchestra.run.smithi150.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-12T03:31:08.737 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 181 MB in 4s (48.2 MB/s) 2024-09-12T03:31:08.749 INFO:teuthology.orchestra.run.smithi150.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-12T03:31:08.749 INFO:teuthology.orchestra.run.smithi150.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-12T03:31:08.759 INFO:teuthology.orchestra.run.smithi150.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-12T03:31:08.787 INFO:teuthology.orchestra.run.smithi150.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-12T03:31:08.795 INFO:teuthology.orchestra.run.smithi150.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-12T03:31:08.797 INFO:teuthology.orchestra.run.smithi150.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-12T03:31:08.817 INFO:teuthology.orchestra.run.smithi150.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-12T03:31:08.854 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-12T03:31:08.911 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T03:31:08.916 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-12T03:31:08.953 INFO:teuthology.orchestra.run.smithi150.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-12T03:31:08.954 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-12T03:31:08.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-12T03:31:09.282 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T03:31:09.308 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T03:31:09.348 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T03:31:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cmd2. 2024-09-12T03:31:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-12T03:31:09.702 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-12T03:31:10.021 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T03:31:10.036 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T03:31:10.043 INFO:teuthology.orchestra.run.smithi150.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-12T03:31:10.046 INFO:teuthology.orchestra.run.smithi150.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-298-gb53b6d3e-1jammy [237 kB] 2024-09-12T03:31:10.051 INFO:teuthology.orchestra.run.smithi150.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-298-gb53b6d3e-1jammy [34.0 kB] 2024-09-12T03:31:10.052 INFO:teuthology.orchestra.run.smithi150.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-298-gb53b6d3e-1jammy [23.5 kB] 2024-09-12T03:31:10.053 INFO:teuthology.orchestra.run.smithi150.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-12T03:31:10.054 INFO:teuthology.orchestra.run.smithi150.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-12T03:31:10.113 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T03:31:10.244 INFO:teuthology.orchestra.run.smithi150.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-12T03:31:10.467 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T03:31:10.494 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T03:31:10.533 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T03:31:10.858 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 181 MB in 6s (32.4 MB/s) 2024-09-12T03:31:10.887 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T03:31:10.913 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T03:31:10.953 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T03:31:10.997 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-12T03:31:11.096 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T03:31:11.101 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-12T03:31:11.145 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-12T03:31:11.340 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T03:31:11.367 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T03:31:11.407 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:31:11.464 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T03:31:11.490 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T03:31:11.531 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T03:31:11.810 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T03:31:11.817 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cmd2. 2024-09-12T03:31:11.837 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T03:31:11.843 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-12T03:31:11.877 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:31:11.883 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-12T03:31:12.212 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T03:31:12.230 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T03:31:12.238 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T03:31:12.257 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T03:31:12.296 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:31:12.320 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T03:31:12.608 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T03:31:12.624 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T03:31:12.665 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T03:31:12.666 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T03:31:12.691 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T03:31:12.732 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T03:31:13.004 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2024-09-12T03:31:13.030 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:13.077 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T03:31:13.096 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:13.103 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T03:31:13.151 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T03:31:13.514 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2024-09-12T03:31:13.540 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:13.563 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T03:31:13.572 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:13.590 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T03:31:13.638 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:31:14.026 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T03:31:14.050 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T03:31:14.052 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:14.076 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T03:31:14.092 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:14.116 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:31:14.378 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-09-12T03:31:14.404 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:14.428 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T03:31:14.444 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:14.454 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T03:31:14.494 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:31:14.722 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T03:31:14.749 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:14.781 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:14.847 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T03:31:14.873 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T03:31:14.914 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T03:31:15.000 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T03:31:15.015 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:15.058 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:15.233 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librados2. 2024-09-12T03:31:15.260 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../010-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:15.308 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:15.378 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T03:31:15.405 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:15.444 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:15.736 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librbd1. 2024-09-12T03:31:15.751 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../011-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:15.786 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:15.798 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T03:31:15.824 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T03:31:15.864 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T03:31:16.142 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T03:31:16.157 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:16.209 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:16.214 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T03:31:16.240 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:16.280 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:16.566 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rados. 2024-09-12T03:31:16.581 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../013-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:16.624 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:16.628 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T03:31:16.655 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T03:31:16.703 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T03:31:16.981 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T03:31:16.986 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T03:31:16.996 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T03:31:17.012 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:17.039 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T03:31:17.052 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:17.280 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T03:31:17.306 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:17.338 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:17.351 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T03:31:17.377 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T03:31:17.417 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T03:31:17.674 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T03:31:17.700 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:17.813 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua5.1. 2024-09-12T03:31:17.839 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T03:31:17.887 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T03:31:17.941 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:18.224 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-any. 2024-09-12T03:31:18.250 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-12T03:31:18.261 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T03:31:18.287 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T03:31:18.290 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T03:31:18.327 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T03:31:18.543 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package zip. 2024-09-12T03:31:18.563 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T03:31:18.569 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-12T03:31:18.578 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:18.610 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T03:31:18.613 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:18.958 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T03:31:18.984 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T03:31:19.022 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package unzip. 2024-09-12T03:31:19.025 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T03:31:19.048 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T03:31:19.097 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T03:31:19.318 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T03:31:19.334 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T03:31:19.393 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T03:31:19.525 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package luarocks. 2024-09-12T03:31:19.552 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T03:31:19.600 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T03:31:19.704 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T03:31:19.731 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T03:31:19.771 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T03:31:19.975 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-09-12T03:31:20.002 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:20.042 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:20.058 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua5.1. 2024-09-12T03:31:20.085 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T03:31:20.124 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T03:31:20.444 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-any. 2024-09-12T03:31:20.470 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-12T03:31:20.511 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T03:31:20.594 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T03:31:20.610 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:20.644 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:20.755 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package zip. 2024-09-12T03:31:20.770 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-12T03:31:20.830 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T03:31:20.914 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T03:31:20.940 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T03:31:20.981 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T03:31:21.124 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package unzip. 2024-09-12T03:31:21.151 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T03:31:21.191 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T03:31:21.300 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T03:31:21.326 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:21.367 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:21.587 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package luarocks. 2024-09-12T03:31:21.613 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T03:31:21.653 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T03:31:21.804 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-09-12T03:31:21.830 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:21.870 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:22.045 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librgw2. 2024-09-12T03:31:22.071 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../027-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:22.111 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:22.672 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T03:31:22.698 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:22.738 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:23.283 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T03:31:23.310 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T03:31:23.350 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T03:31:23.442 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-09-12T03:31:23.469 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:23.527 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:23.678 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T03:31:23.705 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:23.744 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:24.106 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T03:31:24.132 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T03:31:24.172 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T03:31:24.181 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-common. 2024-09-12T03:31:24.207 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../031-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:24.247 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:24.475 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T03:31:24.501 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T03:31:24.541 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T03:31:24.837 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T03:31:24.863 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T03:31:24.903 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T03:31:25.190 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T03:31:25.216 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T03:31:25.256 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T03:31:25.559 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T03:31:25.585 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T03:31:25.611 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-base. 2024-09-12T03:31:25.637 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../032-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:25.650 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T03:31:25.686 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:25.954 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T03:31:25.980 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T03:31:26.020 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T03:31:26.240 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T03:31:26.267 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T03:31:26.273 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2024-09-12T03:31:26.300 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-12T03:31:26.306 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T03:31:26.331 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T03:31:26.618 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T03:31:26.634 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T03:31:26.644 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T03:31:26.661 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T03:31:26.684 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T03:31:26.701 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T03:31:26.987 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T03:31:26.995 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T03:31:27.014 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T03:31:27.022 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T03:31:27.054 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T03:31:27.062 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T03:31:27.323 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T03:31:27.339 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T03:31:27.373 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T03:31:27.374 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T03:31:27.401 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T03:31:27.432 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T03:31:27.626 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T03:31:27.652 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T03:31:27.693 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T03:31:27.752 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T03:31:27.779 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T03:31:27.819 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T03:31:27.971 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T03:31:27.997 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T03:31:28.037 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T03:31:28.105 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T03:31:28.132 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T03:31:28.172 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T03:31:28.417 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-09-12T03:31:28.432 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T03:31:28.466 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T03:31:28.590 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-portend. 2024-09-12T03:31:28.616 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-12T03:31:28.656 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T03:31:28.786 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T03:31:28.813 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T03:31:28.853 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T03:31:28.959 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T03:31:28.985 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T03:31:29.026 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T03:31:29.173 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T03:31:29.199 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T03:31:29.239 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T03:31:29.304 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T03:31:29.319 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T03:31:29.354 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T03:31:29.542 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-09-12T03:31:29.568 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T03:31:29.609 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T03:31:29.657 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T03:31:29.672 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T03:31:29.715 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T03:31:29.945 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T03:31:29.960 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T03:31:29.998 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T03:31:30.035 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T03:31:30.062 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T03:31:30.102 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T03:31:30.256 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T03:31:30.272 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T03:31:30.315 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T03:31:30.405 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T03:31:30.431 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T03:31:30.471 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T03:31:30.618 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-09-12T03:31:30.644 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T03:31:30.684 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T03:31:30.749 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-mako. 2024-09-12T03:31:30.775 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T03:31:30.815 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T03:31:30.963 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T03:31:30.978 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T03:31:31.012 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T03:31:31.102 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T03:31:31.117 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T03:31:31.160 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T03:31:31.307 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T03:31:31.334 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T03:31:31.373 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T03:31:31.446 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T03:31:31.473 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T03:31:31.513 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T03:31:31.677 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T03:31:31.703 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T03:31:31.752 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T03:31:31.816 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webob. 2024-09-12T03:31:31.842 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T03:31:31.874 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T03:31:32.038 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T03:31:32.065 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T03:31:32.105 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T03:31:32.185 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T03:31:32.212 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T03:31:32.255 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T03:31:32.468 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T03:31:32.495 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T03:31:32.529 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T03:31:32.597 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T03:31:32.623 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T03:31:32.663 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T03:31:32.856 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2024-09-12T03:31:32.883 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T03:31:32.923 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T03:31:32.949 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-paste. 2024-09-12T03:31:32.976 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T03:31:33.016 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T03:31:33.226 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T03:31:33.252 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T03:31:33.292 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T03:31:33.321 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T03:31:33.326 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T03:31:33.369 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T03:31:33.620 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2024-09-12T03:31:33.647 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T03:31:33.663 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T03:31:33.686 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T03:31:33.690 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T03:31:33.738 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T03:31:33.973 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T03:31:34.000 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T03:31:34.039 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T03:31:34.041 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T03:31:34.068 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T03:31:34.108 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T03:31:34.342 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T03:31:34.358 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:34.400 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:34.427 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T03:31:34.454 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T03:31:34.494 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T03:31:34.806 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T03:31:34.833 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:34.857 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T03:31:34.872 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:34.883 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T03:31:34.923 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T03:31:35.192 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T03:31:35.218 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-idna. 2024-09-12T03:31:35.219 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T03:31:35.233 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T03:31:35.258 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T03:31:35.268 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T03:31:35.561 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T03:31:35.579 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T03:31:35.588 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T03:31:35.605 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T03:31:35.649 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T03:31:35.652 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T03:31:35.964 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T03:31:35.982 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests. 2024-09-12T03:31:35.990 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:36.009 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T03:31:36.030 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:36.048 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T03:31:36.410 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T03:31:36.425 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T03:31:36.436 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T03:31:36.452 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:36.476 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T03:31:36.491 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:36.763 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T03:31:36.778 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:36.821 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:37.095 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T03:31:37.122 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:37.161 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:37.175 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T03:31:37.191 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:37.225 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:37.529 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T03:31:37.556 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T03:31:37.595 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T03:31:38.983 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T03:31:39.009 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T03:31:39.055 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T03:31:39.357 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-09-12T03:31:39.359 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T03:31:39.372 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:39.387 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:39.415 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:39.426 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:39.734 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T03:31:39.761 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:39.788 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T03:31:39.800 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:39.815 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:39.854 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:40.179 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T03:31:40.206 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:40.245 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:40.483 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T03:31:40.510 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:40.549 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:40.648 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-09-12T03:31:40.675 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:40.715 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:40.992 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T03:31:41.008 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T03:31:41.050 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T03:31:41.353 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T03:31:41.380 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T03:31:41.420 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T03:31:41.586 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph. 2024-09-12T03:31:41.613 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../068-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:41.653 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:41.913 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T03:31:41.929 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:41.963 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:42.341 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T03:31:42.368 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:42.408 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:42.475 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2024-09-12T03:31:42.502 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T03:31:42.541 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T03:31:42.828 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephadm. 2024-09-12T03:31:42.854 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../071-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T03:31:42.894 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:42.896 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T03:31:42.935 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T03:31:43.172 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T03:31:43.198 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T03:31:43.238 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T03:31:43.297 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T03:31:43.324 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:43.363 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:43.591 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T03:31:43.619 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T03:31:43.657 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T03:31:43.708 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T03:31:43.736 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T03:31:43.775 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T03:31:44.086 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-09-12T03:31:44.113 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T03:31:44.152 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T03:31:44.481 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T03:31:44.508 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:44.547 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:44.729 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-babel. 2024-09-12T03:31:44.757 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T03:31:44.796 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T03:31:45.116 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T03:31:45.143 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T03:31:45.182 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T03:31:45.510 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T03:31:45.537 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:45.576 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:45.835 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T03:31:45.852 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T03:31:45.894 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T03:31:45.957 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T03:31:45.984 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T03:31:46.023 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T03:31:46.326 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-routes. 2024-09-12T03:31:46.353 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T03:31:46.392 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T03:31:46.398 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T03:31:46.424 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T03:31:46.464 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T03:31:46.737 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T03:31:46.764 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:46.803 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:46.825 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T03:31:46.853 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T03:31:46.986 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T03:31:47.297 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T03:31:47.324 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T03:31:47.363 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T03:31:48.048 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T03:31:48.064 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:48.097 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:48.100 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T03:31:48.116 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T03:31:48.159 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T03:31:48.662 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T03:31:48.689 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T03:31:48.729 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T03:31:49.042 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T03:31:49.070 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T03:31:49.091 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T03:31:49.108 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T03:31:49.117 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T03:31:49.434 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T03:31:49.620 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T03:31:49.647 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T03:31:49.686 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T03:31:49.745 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T03:31:49.772 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T03:31:49.811 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T03:31:49.973 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T03:31:50.001 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T03:31:50.039 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T03:31:50.351 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T03:31:50.378 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-12T03:31:50.417 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T03:31:50.479 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T03:31:50.507 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:50.545 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:50.729 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T03:31:50.757 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T03:31:50.796 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T03:31:51.116 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T03:31:51.143 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T03:31:51.182 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T03:31:51.452 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T03:31:51.480 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T03:31:51.510 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T03:31:51.607 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T03:31:51.634 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T03:31:51.665 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T03:31:51.822 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T03:31:51.849 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T03:31:51.888 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T03:31:51.951 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T03:31:51.979 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T03:31:52.018 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T03:31:52.346 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T03:31:52.373 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T03:31:52.412 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T03:31:52.527 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T03:31:52.543 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:52.585 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:52.724 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T03:31:52.752 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-12T03:31:52.790 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T03:31:52.904 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T03:31:52.932 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T03:31:52.980 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T03:31:53.077 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T03:31:53.093 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T03:31:53.127 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T03:31:53.274 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T03:31:53.302 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T03:31:53.332 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T03:31:53.364 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T03:31:53.380 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T03:31:53.413 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T03:31:53.585 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-09-12T03:31:53.612 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T03:31:53.651 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T03:31:53.725 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T03:31:53.752 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T03:31:53.799 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T03:31:53.887 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-09-12T03:31:53.915 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T03:31:53.954 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T03:31:54.120 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T03:31:54.149 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T03:31:54.186 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T03:31:54.257 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T03:31:54.285 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T03:31:54.324 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T03:31:54.783 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T03:31:54.799 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:54.833 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:54.895 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-09-12T03:31:54.923 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:54.961 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:55.136 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T03:31:55.164 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T03:31:55.203 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T03:31:55.573 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T03:31:55.600 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T03:31:55.639 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T03:31:55.875 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package jq. 2024-09-12T03:31:55.891 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T03:31:55.925 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T03:31:56.152 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package socat. 2024-09-12T03:31:56.179 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T03:31:56.219 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T03:31:56.530 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T03:31:56.546 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T03:31:56.597 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T03:31:56.943 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-test. 2024-09-12T03:31:56.959 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../099-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:57.001 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:57.216 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T03:31:57.232 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:57.265 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:57.661 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-12T03:31:57.689 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:57.727 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:58.047 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-colorama. 2024-09-12T03:31:58.075 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-12T03:31:58.114 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-12T03:31:58.358 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-shell. 2024-09-12T03:31:58.374 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:58.416 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:58.644 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-top. 2024-09-12T03:31:58.672 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:58.710 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:58.988 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T03:31:59.015 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:59.054 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:59.463 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T03:31:59.473 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T03:31:59.491 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:31:59.501 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T03:31:59.530 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:31:59.532 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T03:31:59.853 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T03:31:59.881 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T03:31:59.909 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-12T03:31:59.919 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T03:31:59.937 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:31:59.975 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:00.257 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T03:32:00.279 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-colorama. 2024-09-12T03:32:00.284 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T03:32:00.307 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-12T03:32:00.323 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T03:32:00.345 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-12T03:32:00.597 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-shell. 2024-09-12T03:32:00.618 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:32:00.647 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:00.712 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pkg-config. 2024-09-12T03:32:00.740 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T03:32:00.778 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T03:32:00.875 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-top. 2024-09-12T03:32:00.891 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-12T03:32:00.925 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:01.048 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T03:32:01.064 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T03:32:01.106 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T03:32:01.160 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T03:32:01.176 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:32:01.218 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:01.509 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T03:32:01.537 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T03:32:01.546 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T03:32:01.574 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T03:32:01.575 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T03:32:01.613 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T03:32:01.862 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T03:32:01.890 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T03:32:01.928 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T03:32:01.951 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T03:32:01.978 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T03:32:02.017 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T03:32:02.273 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T03:32:02.301 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T03:32:02.313 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T03:32:02.339 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T03:32:02.340 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T03:32:02.371 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T03:32:02.618 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T03:32:02.646 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T03:32:02.675 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T03:32:02.759 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package pkg-config. 2024-09-12T03:32:02.787 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T03:32:02.826 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T03:32:03.045 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-09-12T03:32:03.073 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-12T03:32:03.112 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T03:32:03.120 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T03:32:03.140 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T03:32:03.178 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T03:32:03.474 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T03:32:03.502 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T03:32:03.540 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T03:32:03.590 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T03:32:03.618 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T03:32:03.656 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T03:32:03.976 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T03:32:04.003 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T03:32:04.036 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T03:32:04.042 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T03:32:04.064 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T03:32:04.110 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T03:32:04.371 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T03:32:04.398 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T03:32:04.437 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T03:32:04.480 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2024-09-12T03:32:04.509 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-12T03:32:04.555 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T03:32:04.875 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T03:32:04.903 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T03:32:04.941 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T03:32:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T03:32:05.076 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T03:32:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T03:32:05.435 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-py. 2024-09-12T03:32:05.462 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-12T03:32:05.501 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T03:32:05.611 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T03:32:05.639 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T03:32:05.669 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T03:32:05.779 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T03:32:05.795 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T03:32:05.829 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T03:32:05.905 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T03:32:05.921 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T03:32:05.964 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T03:32:06.267 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T03:32:06.283 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T03:32:06.316 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T03:32:06.586 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-toml. 2024-09-12T03:32:06.602 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-12T03:32:06.644 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T03:32:06.785 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-09-12T03:32:06.812 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:32:06.859 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:06.939 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T03:32:06.967 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T03:32:07.005 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T03:32:07.342 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T03:32:07.370 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T03:32:07.409 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T03:32:07.645 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T03:32:07.661 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T03:32:07.695 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T03:32:07.720 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T03:32:07.736 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:32:07.779 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:08.092 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T03:32:08.359 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T03:32:08.441 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package radosgw. 2024-09-12T03:32:08.468 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../122-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:32:08.507 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:08.510 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T03:32:08.769 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T03:32:09.140 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T03:32:09.335 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T03:32:09.363 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-12T03:32:09.406 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:09.592 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T03:32:09.662 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:09.707 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T03:32:09.966 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T03:32:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T03:32:10.211 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-09-12T03:32:10.347 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T03:32:10.367 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T03:32:10.659 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T03:32:10.685 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T03:32:10.945 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T03:32:11.071 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T03:32:11.072 INFO:teuthology.orchestra.run.smithi150.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T03:32:11.143 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:11.331 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T03:32:11.582 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T03:32:11.601 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user cephadm....done 2024-09-12T03:32:11.708 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T03:32:11.757 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T03:32:12.010 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T03:32:12.025 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T03:32:12.268 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T03:32:12.362 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T03:32:12.394 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T03:32:12.621 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-12T03:32:12.645 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T03:32:12.881 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T03:32:12.896 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T03:32:13.023 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T03:32:13.174 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T03:32:13.332 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T03:32:13.425 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T03:32:13.676 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T03:32:13.700 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T03:32:13.927 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T03:32:13.943 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-12T03:32:14.203 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T03:32:14.270 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:14.479 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T03:32:14.529 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T03:32:14.656 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T03:32:14.789 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T03:32:14.806 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-12T03:32:15.082 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T03:32:15.083 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T03:32:15.209 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T03:32:15.342 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T03:32:15.451 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T03:32:15.626 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:15.851 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T03:32:15.877 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T03:32:15.884 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T03:32:15.963 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T03:32:16.003 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T03:32:16.108 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T03:32:16.129 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-12T03:32:16.380 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T03:32:16.483 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T03:32:16.514 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T03:32:16.593 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T03:32:16.774 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T03:32:16.836 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T03:32:17.087 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T03:32:17.162 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T03:32:17.197 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T03:32:17.264 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T03:32:17.386 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T03:32:17.413 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T03:32:17.539 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T03:32:17.763 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T03:32:17.863 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T03:32:18.115 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T03:32:18.191 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T03:32:18.407 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T03:32:18.467 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T03:32:18.618 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T03:32:18.700 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T03:32:18.744 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T03:32:18.826 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T03:32:19.062 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T03:32:19.462 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T03:32:19.471 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T03:32:19.713 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T03:32:19.731 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T03:32:19.814 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T03:32:19.932 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T03:32:20.124 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T03:32:20.233 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T03:32:20.417 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-12T03:32:20.617 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T03:32:20.860 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T03:32:21.035 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T03:32:21.228 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T03:32:21.386 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T03:32:21.513 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-12T03:32:21.654 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T03:32:21.780 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:21.797 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T03:32:22.098 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T03:32:22.124 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T03:32:22.408 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T03:32:22.433 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T03:32:22.534 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:22.827 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T03:32:23.145 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T03:32:23.638 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T03:32:23.924 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:32:24.083 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T03:32:24.309 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T03:32:24.367 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T03:32:24.493 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T03:32:24.544 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:32:24.619 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T03:32:24.678 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T03:32:24.921 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T03:32:24.963 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T03:32:25.064 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T03:32:25.182 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T03:32:25.197 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T03:32:25.475 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T03:32:25.490 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:32:25.649 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T03:32:25.734 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T03:32:25.959 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T03:32:25.985 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:32:26.137 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T03:32:26.227 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T03:32:26.446 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T03:32:26.503 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T03:32:26.689 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T03:32:26.779 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T03:32:26.957 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T03:32:27.030 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T03:32:27.224 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T03:32:27.315 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T03:32:27.466 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T03:32:27.475 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T03:32:27.743 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T03:32:27.767 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T03:32:27.861 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T03:32:27.893 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T03:32:28.154 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T03:32:28.186 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T03:32:28.263 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T03:32:28.487 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T03:32:28.531 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T03:32:28.771 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T03:32:28.824 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T03:32:28.939 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T03:32:29.083 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T03:32:29.092 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T03:32:29.180 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T03:32:29.218 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T03:32:29.327 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T03:32:29.399 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T03:32:29.417 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T03:32:29.543 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T03:32:29.637 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T03:32:29.746 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T03:32:29.928 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T03:32:30.123 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T03:32:30.214 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T03:32:30.668 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T03:32:30.668 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T03:32:30.668 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T03:32:30.668 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:32:30.782 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T03:32:30.784 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T03:32:30.894 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T03:32:31.092 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T03:32:31.212 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T03:32:31.434 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T03:32:31.530 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T03:32:31.702 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T03:32:31.789 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T03:32:31.914 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T03:32:32.011 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T03:32:32.207 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T03:32:32.279 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T03:32:32.492 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T03:32:32.547 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T03:32:32.768 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T03:32:32.798 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T03:32:33.153 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T03:32:33.174 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T03:32:33.446 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T03:32:33.493 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T03:32:33.815 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T03:32:33.820 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T03:32:33.930 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:33.966 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:34.031 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:34.126 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:34.140 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T03:32:34.252 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T03:32:34.485 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:34.588 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:34.611 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:34.722 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:34.737 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T03:32:34.873 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T03:32:35.013 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:35.139 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:35.175 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:35.265 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:35.301 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:35.428 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:35.479 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T03:32:35.480 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T03:32:35.682 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T03:32:35.682 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T03:32:35.984 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.110 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.162 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.236 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.305 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.362 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.430 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.490 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T03:32:36.581 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-top (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:36.741 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T03:32:37.724 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:37.851 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:37.920 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:37.977 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.070 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.103 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.221 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.228 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.355 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.372 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.507 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-shell (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.633 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:38.823 INFO:teuthology.orchestra.run.smithi150.stdout:Adding group ceph....done 2024-09-12T03:32:39.174 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user ceph....done 2024-09-12T03:32:39.209 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-09-12T03:32:39.309 INFO:teuthology.orchestra.run.smithi150.stdout:Setting system user ceph properties....done 2024-09-12T03:32:39.326 INFO:teuthology.orchestra.run.smithi150.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T03:32:39.459 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T03:32:39.653 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-09-12T03:32:39.762 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T03:32:39.821 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-09-12T03:32:39.839 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T03:32:39.972 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T03:32:40.239 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:40.290 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T03:32:40.433 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T03:32:40.433 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T03:32:40.801 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-mirror (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:40.899 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:41.025 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T03:32:41.089 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-12T03:32:41.516 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T03:32:41.516 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T03:32:41.594 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:41.745 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:41.977 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:42.225 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T03:32:42.226 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T03:32:42.333 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T03:32:42.705 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:42.779 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:43.005 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T03:32:43.006 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T03:32:43.082 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T03:32:43.456 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:43.574 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:43.688 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T03:32:43.688 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T03:32:43.822 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T03:32:43.822 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T03:32:44.157 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:44.317 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:44.415 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T03:32:44.415 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T03:32:44.529 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T03:32:44.529 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T03:32:44.901 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:44.985 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:45.010 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:45.144 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:45.261 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T03:32:45.261 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T03:32:45.355 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T03:32:45.355 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T03:32:45.753 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:45.812 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:45.888 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:45.955 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:46.056 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:46.107 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:46.250 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:46.269 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T03:32:46.269 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T03:32:46.603 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T03:32:46.704 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T03:32:46.816 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:46.856 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T03:32:46.976 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:47.127 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:47.278 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-12T03:32:47.639 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T03:32:47.748 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T03:32:47.857 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T03:32:47.901 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T03:32:48.492 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T03:32:48.495 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-12T03:32:48.551 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2024-09-12T03:32:48.761 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2024-09-12T03:32:48.761 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2024-09-12T03:32:48.951 INFO:teuthology.orchestra.run.smithi150.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-12T03:32:48.952 INFO:teuthology.orchestra.run.smithi150.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T03:32:48.952 INFO:teuthology.orchestra.run.smithi150.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T03:32:48.952 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:32:48.952 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:32:48.952 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:32:48.952 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:32:48.953 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T03:32:48.953 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T03:32:48.953 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:32:48.953 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2024-09-12T03:32:48.954 INFO:teuthology.orchestra.run.smithi150.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-12T03:32:48.954 INFO:teuthology.orchestra.run.smithi150.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-12T03:32:48.954 INFO:teuthology.orchestra.run.smithi150.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-12T03:32:48.954 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-12T03:32:48.954 INFO:teuthology.orchestra.run.smithi150.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T03:32:48.955 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2024-09-12T03:32:48.956 INFO:teuthology.orchestra.run.smithi150.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-12T03:32:48.956 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-12T03:32:48.956 INFO:teuthology.orchestra.run.smithi150.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-12T03:32:48.996 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2024-09-12T03:32:48.997 INFO:teuthology.orchestra.run.smithi150.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-12T03:32:48.997 INFO:teuthology.orchestra.run.smithi150.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-12T03:32:48.997 INFO:teuthology.orchestra.run.smithi150.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-12T03:32:48.997 INFO:teuthology.orchestra.run.smithi150.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-12T03:32:48.998 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-12T03:32:48.998 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-12T03:32:48.998 INFO:teuthology.orchestra.run.smithi150.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T03:32:48.998 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2024-09-12T03:32:48.999 INFO:teuthology.orchestra.run.smithi150.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-12T03:32:49.050 INFO:teuthology.orchestra.run.smithi150.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-12T03:32:49.050 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 55.8 MB of archives. 2024-09-12T03:32:49.050 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-12T03:32:49.050 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-12T03:32:49.085 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T03:32:49.185 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T03:32:49.192 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T03:32:49.231 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T03:32:49.231 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T03:32:49.232 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T03:32:49.243 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-12T03:32:49.243 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-12T03:32:49.246 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-12T03:32:49.247 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T03:32:49.247 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-12T03:32:49.249 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T03:32:49.250 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T03:32:49.266 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T03:32:49.266 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-12T03:32:49.267 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-12T03:32:49.577 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-12T03:32:49.578 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-12T03:32:49.579 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-12T03:32:49.581 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-12T03:32:49.582 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-12T03:32:49.586 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-12T03:32:49.588 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-12T03:32:49.598 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-12T03:32:49.598 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T03:32:49.617 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-12T03:32:49.617 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-12T03:32:49.627 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-12T03:32:49.645 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-12T03:32:49.648 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-12T03:32:49.649 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-12T03:32:49.649 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-12T03:32:49.650 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-12T03:32:49.660 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-12T03:32:49.661 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-12T03:32:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T03:32:49.739 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-12T03:32:49.846 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-12T03:32:49.855 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-12T03:32:49.855 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-12T03:32:49.855 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-12T03:32:49.855 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-12T03:32:49.856 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-12T03:32:49.856 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-12T03:32:49.867 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-12T03:32:49.867 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-12T03:32:50.059 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-12T03:32:50.060 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-12T03:32:50.260 INFO:teuthology.orchestra.run.smithi073.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-12T03:32:50.261 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-12T03:32:50.261 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-12T03:32:50.261 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T03:32:50.261 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T03:32:50.261 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T03:32:50.261 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T03:32:50.261 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T03:32:50.262 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T03:32:50.262 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T03:32:50.262 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-12T03:32:50.262 INFO:teuthology.orchestra.run.smithi073.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-12T03:32:50.262 INFO:teuthology.orchestra.run.smithi073.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-12T03:32:50.263 INFO:teuthology.orchestra.run.smithi073.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-12T03:32:50.263 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-12T03:32:50.263 INFO:teuthology.orchestra.run.smithi073.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T03:32:50.264 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-12T03:32:50.264 INFO:teuthology.orchestra.run.smithi073.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-12T03:32:50.264 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-12T03:32:50.264 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-12T03:32:50.275 INFO:teuthology.orchestra.run.smithi150.stdout:Preconfiguring packages ... 2024-09-12T03:32:50.304 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-12T03:32:50.305 INFO:teuthology.orchestra.run.smithi073.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-12T03:32:50.305 INFO:teuthology.orchestra.run.smithi073.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-12T03:32:50.305 INFO:teuthology.orchestra.run.smithi073.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-12T03:32:50.305 INFO:teuthology.orchestra.run.smithi073.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-12T03:32:50.306 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-12T03:32:50.306 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-12T03:32:50.306 INFO:teuthology.orchestra.run.smithi073.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-12T03:32:50.306 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-12T03:32:50.308 INFO:teuthology.orchestra.run.smithi073.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-12T03:32:50.358 INFO:teuthology.orchestra.run.smithi073.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-12T03:32:50.359 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 55.8 MB of archives. 2024-09-12T03:32:50.359 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-12T03:32:50.359 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-12T03:32:50.425 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 55.8 MB in 1s (64.7 MB/s) 2024-09-12T03:32:50.493 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-12T03:32:50.500 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-12T03:32:50.539 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-12T03:32:50.539 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-12T03:32:50.540 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-12T03:32:50.551 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-12T03:32:50.552 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-12T03:32:50.554 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-12T03:32:50.555 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-12T03:32:50.556 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-12T03:32:50.557 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-12T03:32:50.558 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-12T03:32:50.579 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-12T03:32:50.579 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-12T03:32:50.580 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-12T03:32:50.744 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-12T03:32:50.750 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T03:32:50.905 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T03:32:50.953 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-12T03:32:50.955 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-12T03:32:50.955 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-12T03:32:50.958 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-12T03:32:50.958 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-12T03:32:50.962 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-12T03:32:50.964 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-12T03:32:50.971 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-12T03:32:50.971 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-12T03:32:50.993 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-12T03:32:50.993 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-12T03:32:51.002 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-12T03:32:51.022 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-12T03:32:51.025 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-12T03:32:51.026 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-12T03:32:51.026 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-12T03:32:51.027 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-12T03:32:51.037 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-12T03:32:51.039 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-12T03:32:51.240 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-12T03:32:51.240 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-12T03:32:51.241 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-12T03:32:51.241 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-12T03:32:51.241 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-12T03:32:51.241 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-12T03:32:51.252 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-12T03:32:51.253 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-12T03:32:51.619 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-12T03:32:51.662 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2024-09-12T03:32:51.809 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 55.8 MB in 1s (59.4 MB/s) 2024-09-12T03:32:52.567 INFO:teuthology.orchestra.run.smithi150.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-12T03:32:52.612 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-12T03:32:52.618 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T03:32:52.758 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T03:32:52.843 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package flex. 2024-09-12T03:32:52.937 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-12T03:32:52.943 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T03:32:52.992 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T03:32:53.395 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-12T03:32:53.525 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T03:32:53.698 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T03:32:54.117 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T03:32:54.287 INFO:teuthology.orchestra.run.smithi073.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-12T03:32:54.562 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package flex. 2024-09-12T03:32:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173985 files and directories currently installed.) 2024-09-12T03:32:54.627 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-12T03:32:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-12T03:32:54.633 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T03:32:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-12T03:32:54.764 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T03:32:55.156 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T03:32:55.210 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T03:32:55.279 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T03:32:55.383 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-12T03:32:55.581 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T03:32:55.810 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T03:32:55.913 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package bison. 2024-09-12T03:32:56.014 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-12T03:32:56.019 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T03:32:56.065 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T03:32:56.354 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-12T03:32:56.359 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T03:32:56.441 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-12T03:32:56.468 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-12T03:32:56.499 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T03:32:56.513 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T03:32:56.962 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package dump. 2024-09-12T03:32:56.990 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-12T03:32:57.028 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking dump (0.4b47-3) ... 2024-09-12T03:32:57.074 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-12T03:32:57.222 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-12T03:32:57.315 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package indent. 2024-09-12T03:32:57.332 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:32:57.374 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T03:32:57.610 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T03:32:57.626 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T03:32:57.634 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T03:32:57.660 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T03:32:57.998 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-12T03:32:58.025 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-12T03:32:58.032 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package bison. 2024-09-12T03:32:58.064 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T03:32:58.137 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174058 files and directories currently installed.) 2024-09-12T03:32:58.143 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-12T03:32:58.184 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T03:32:58.333 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T03:32:58.350 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T03:32:58.391 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T03:32:58.669 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-12T03:32:58.678 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T03:32:58.696 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-12T03:32:58.706 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T03:32:58.737 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T03:32:58.743 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T03:32:58.972 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T03:32:59.000 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T03:32:59.039 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T03:32:59.113 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package dump. 2024-09-12T03:32:59.141 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-12T03:32:59.205 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking dump (0.4b47-3) ... 2024-09-12T03:32:59.292 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjson-perl. 2024-09-12T03:32:59.308 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-12T03:32:59.350 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-12T03:32:59.517 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package indent. 2024-09-12T03:32:59.545 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:32:59.592 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T03:32:59.662 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-12T03:32:59.690 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-12T03:32:59.728 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T03:32:59.870 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-12T03:32:59.885 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-12T03:32:59.928 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T03:33:00.207 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-12T03:33:00.237 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-12T03:33:00.265 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T03:33:00.526 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-12T03:33:00.554 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-12T03:33:00.593 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T03:33:00.921 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-12T03:33:00.949 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-12T03:33:00.988 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T03:33:01.232 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-12T03:33:01.248 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-12T03:33:01.282 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T03:33:01.465 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-12T03:33:01.484 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjson-perl. 2024-09-12T03:33:01.492 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T03:33:01.500 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-12T03:33:01.523 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:01.543 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-12T03:33:01.775 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-12T03:33:01.792 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T03:33:01.834 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:01.865 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-12T03:33:01.890 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-12T03:33:01.929 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T03:33:02.153 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-12T03:33:02.181 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T03:33:02.220 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:02.539 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-12T03:33:02.556 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-12T03:33:02.589 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T03:33:02.876 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-12T03:33:02.904 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T03:33:02.976 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T03:33:03.330 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-12T03:33:03.357 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:03.396 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:03.633 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-12T03:33:03.661 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T03:33:03.699 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:03.707 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-12T03:33:03.735 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:03.765 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:03.936 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-12T03:33:03.963 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-12T03:33:03.994 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:04.060 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-12T03:33:04.080 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:04.118 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:04.321 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-12T03:33:04.349 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T03:33:04.363 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T03:33:04.388 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:04.390 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T03:33:04.429 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T03:33:04.741 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-12T03:33:04.768 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-12T03:33:04.808 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T03:33:04.991 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-12T03:33:05.019 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-12T03:33:05.049 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T03:33:05.110 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-12T03:33:05.138 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T03:33:05.169 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T03:33:05.411 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package modemmanager. 2024-09-12T03:33:05.439 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T03:33:05.478 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:05.530 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-12T03:33:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:05.597 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:05.933 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-12T03:33:05.961 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:06.000 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:06.161 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package network-manager. 2024-09-12T03:33:06.187 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T03:33:06.235 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-12T03:33:06.286 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-12T03:33:06.302 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:06.336 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:06.547 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-12T03:33:06.574 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-12T03:33:06.613 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T03:33:06.792 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ppp. 2024-09-12T03:33:06.816 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-12T03:33:07.082 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T03:33:07.135 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-12T03:33:07.151 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-12T03:33:07.194 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T03:33:07.355 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package pptp-linux. 2024-09-12T03:33:07.369 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-12T03:33:07.414 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-12T03:33:07.538 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package modemmanager. 2024-09-12T03:33:07.566 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-12T03:33:07.605 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:07.667 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-12T03:33:07.695 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-12T03:33:07.733 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-12T03:33:08.112 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-12T03:33:08.140 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-12T03:33:08.505 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client-common (238) ... 2024-09-12T03:33:08.507 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager. 2024-09-12T03:33:08.535 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-12T03:33:08.582 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-12T03:33:08.968 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-12T03:33:08.996 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:09.034 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:09.198 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ppp. 2024-09-12T03:33:09.226 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-12T03:33:09.502 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T03:33:09.589 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-common. 2024-09-12T03:33:09.617 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-12T03:33:09.665 INFO:teuthology.orchestra.run.smithi150.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-12T03:33:09.695 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-common (238) ... 2024-09-12T03:33:09.812 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pptp-linux. 2024-09-12T03:33:09.840 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-12T03:33:09.878 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-12T03:33:10.131 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-12T03:33:10.147 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-12T03:33:10.155 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-14. 2024-09-12T03:33:10.183 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:10.189 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-12T03:33:10.225 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:10.492 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-12T03:33:10.521 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-12T03:33:10.559 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-common (238) ... 2024-09-12T03:33:10.913 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-12T03:33:10.941 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:10.971 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:11.510 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-common. 2024-09-12T03:33:11.537 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-12T03:33:11.541 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql. 2024-09-12T03:33:11.558 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-12T03:33:11.594 INFO:teuthology.orchestra.run.smithi073.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-12T03:33:11.599 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql (14+238) ... 2024-09-12T03:33:11.624 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-common (238) ... 2024-09-12T03:33:11.801 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client. 2024-09-12T03:33:11.818 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-12T03:33:11.852 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client (14+238) ... 2024-09-12T03:33:12.059 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-14. 2024-09-12T03:33:12.087 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-12T03:33:12.097 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-12T03:33:12.114 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-12T03:33:12.145 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:12.172 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-12T03:33:12.492 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package tcl8.6. 2024-09-12T03:33:12.520 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-12T03:33:12.558 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T03:33:12.777 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package tcl. 2024-09-12T03:33:12.793 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-12T03:33:12.832 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-12T03:33:13.189 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package wpasupplicant. 2024-09-12T03:33:13.217 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-12T03:33:13.255 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T03:33:13.396 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql. 2024-09-12T03:33:13.425 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-12T03:33:13.454 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql (14+238) ... 2024-09-12T03:33:13.643 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-12T03:33:13.671 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-12T03:33:13.673 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client. 2024-09-12T03:33:13.690 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-12T03:33:13.717 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-12T03:33:13.731 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client (14+238) ... 2024-09-12T03:33:13.975 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-12T03:33:13.992 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-12T03:33:14.033 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-12T03:33:14.037 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-12T03:33:14.065 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-12T03:33:14.104 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T03:33:14.361 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package tcl8.6. 2024-09-12T03:33:14.390 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-12T03:33:14.408 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client-common (238) ... 2024-09-12T03:33:14.428 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T03:33:14.618 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T03:33:14.680 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package tcl. 2024-09-12T03:33:14.697 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-12T03:33:14.735 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-12T03:33:14.744 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T03:33:14.870 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:14.996 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T03:33:15.075 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package wpasupplicant. 2024-09-12T03:33:15.104 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-12T03:33:15.122 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T03:33:15.141 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T03:33:15.223 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:15.530 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-12T03:33:15.558 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-12T03:33:15.588 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-12T03:33:15.709 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-12T03:33:15.795 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T03:33:15.966 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-12T03:33:15.995 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-12T03:33:16.041 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T03:33:16.209 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T03:33:16.209 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T03:33:16.329 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-common (238) ... 2024-09-12T03:33:16.514 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-12T03:33:16.624 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-12T03:33:16.715 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T03:33:16.750 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:16.892 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-12T03:33:16.941 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T03:33:17.019 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-12T03:33:17.067 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T03:33:17.153 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:17.176 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-12T03:33:17.285 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T03:33:17.394 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T03:33:17.520 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T03:33:17.646 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T03:33:17.655 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-12T03:33:17.759 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-12T03:33:18.156 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T03:33:18.156 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-12T03:33:18.285 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T03:33:18.386 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up dump (0.4b47-3) ... 2024-09-12T03:33:18.472 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-12T03:33:18.537 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:18.663 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T03:33:18.671 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-12T03:33:18.797 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-12T03:33:18.898 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-12T03:33:19.015 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-12T03:33:19.073 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-12T03:33:19.141 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-12T03:33:19.267 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-12T03:33:19.358 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-12T03:33:19.393 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-12T03:33:19.484 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T03:33:19.528 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-12T03:33:19.574 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T03:33:19.635 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T03:33:19.736 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T03:33:19.921 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T03:33:20.047 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:20.117 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-12T03:33:20.181 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-12T03:33:20.242 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up dump (0.4b47-3) ... 2024-09-12T03:33:20.349 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client (14+238) ... 2024-09-12T03:33:20.413 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-12T03:33:20.475 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-12T03:33:20.528 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:20.654 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-12T03:33:20.763 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-12T03:33:20.864 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-12T03:33:20.928 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:20.928 INFO:teuthology.orchestra.run.smithi150.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-12T03:33:20.928 INFO:teuthology.orchestra.run.smithi150.stdout:which means they are currently configured by ifupdown: 2024-09-12T03:33:20.928 INFO:teuthology.orchestra.run.smithi150.stdout:- enp3s0f1 2024-09-12T03:33:20.929 INFO:teuthology.orchestra.run.smithi150.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-12T03:33:20.929 INFO:teuthology.orchestra.run.smithi150.stdout:remove their configuration from /etc/network/interfaces. 2024-09-12T03:33:20.929 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:20.965 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-12T03:33:21.043 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-12T03:33:21.056 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-12T03:33:21.125 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-12T03:33:21.251 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-12T03:33:21.377 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-12T03:33:21.427 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-12T03:33:21.554 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:21.671 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-12T03:33:21.720 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-12T03:33:21.814 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client (14+238) ... 2024-09-12T03:33:21.924 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-12T03:33:22.219 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:22.362 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T03:33:22.407 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:22.408 INFO:teuthology.orchestra.run.smithi073.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-12T03:33:22.408 INFO:teuthology.orchestra.run.smithi073.stdout:which means they are currently configured by ifupdown: 2024-09-12T03:33:22.408 INFO:teuthology.orchestra.run.smithi073.stdout:- enp3s0f1 2024-09-12T03:33:22.408 INFO:teuthology.orchestra.run.smithi073.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-12T03:33:22.408 INFO:teuthology.orchestra.run.smithi073.stdout:remove their configuration from /etc/network/interfaces. 2024-09-12T03:33:22.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:22.472 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-12T03:33:22.536 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-12T03:33:22.573 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-common (238) ... 2024-09-12T03:33:22.854 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-12T03:33:23.160 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-12T03:33:23.396 INFO:teuthology.orchestra.run.smithi150.stdout:Adding user postgres to group ssl-cert 2024-09-12T03:33:23.606 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:23.607 INFO:teuthology.orchestra.run.smithi150.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-12T03:33:23.786 INFO:teuthology.orchestra.run.smithi150.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-12T03:33:23.786 INFO:teuthology.orchestra.run.smithi150.stdout:Removing obsolete dictionary files: 2024-09-12T03:33:24.202 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-12T03:33:24.328 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-12T03:33:24.339 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-12T03:33:24.454 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-12T03:33:24.564 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-common (238) ... 2024-09-12T03:33:24.700 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:25.046 INFO:teuthology.orchestra.run.smithi150.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-12T03:33:25.058 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-12T03:33:25.100 INFO:teuthology.orchestra.run.smithi150.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:This user must also own the server process. 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:The database cluster will be initialized with locale "en_US". 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:The default text search configuration will be set to "english". 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:Data page checksums are disabled. 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-12T03:33:25.101 INFO:teuthology.orchestra.run.smithi150.stdout:creating subdirectories ... ok 2024-09-12T03:33:25.102 INFO:teuthology.orchestra.run.smithi150.stdout:selecting dynamic shared memory implementation ... posix 2024-09-12T03:33:25.113 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default max_connections ... 100 2024-09-12T03:33:25.130 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default shared_buffers ... 128MB 2024-09-12T03:33:25.140 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default time zone ... Etc/UTC 2024-09-12T03:33:25.141 INFO:teuthology.orchestra.run.smithi150.stdout:creating configuration files ... ok 2024-09-12T03:33:25.253 INFO:teuthology.orchestra.run.smithi150.stdout:running bootstrap script ... ok 2024-09-12T03:33:25.417 INFO:teuthology.orchestra.run.smithi073.stdout:Adding user postgres to group ssl-cert 2024-09-12T03:33:25.649 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:25.649 INFO:teuthology.orchestra.run.smithi073.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-12T03:33:25.835 INFO:teuthology.orchestra.run.smithi073.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-12T03:33:25.836 INFO:teuthology.orchestra.run.smithi073.stdout:Removing obsolete dictionary files: 2024-09-12T03:33:25.893 INFO:teuthology.orchestra.run.smithi150.stdout:performing post-bootstrap initialization ... ok 2024-09-12T03:33:26.447 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-12T03:33:26.536 INFO:teuthology.orchestra.run.smithi150.stdout:syncing data to disk ... ok 2024-09-12T03:33:26.802 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-12T03:33:26.958 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-12T03:33:27.116 INFO:teuthology.orchestra.run.smithi073.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-12T03:33:27.128 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-12T03:33:27.170 INFO:teuthology.orchestra.run.smithi073.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:This user must also own the server process. 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:The database cluster will be initialized with locale "en_US". 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:The default text search configuration will be set to "english". 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:Data page checksums are disabled. 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:creating subdirectories ... ok 2024-09-12T03:33:27.171 INFO:teuthology.orchestra.run.smithi073.stdout:selecting dynamic shared memory implementation ... posix 2024-09-12T03:33:27.183 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default max_connections ... 100 2024-09-12T03:33:27.203 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default shared_buffers ... 128MB 2024-09-12T03:33:27.214 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default time zone ... Etc/UTC 2024-09-12T03:33:27.214 INFO:teuthology.orchestra.run.smithi073.stdout:creating configuration files ... ok 2024-09-12T03:33:27.331 INFO:teuthology.orchestra.run.smithi073.stdout:running bootstrap script ... ok 2024-09-12T03:33:27.965 INFO:teuthology.orchestra.run.smithi073.stdout:performing post-bootstrap initialization ... ok 2024-09-12T03:33:28.694 INFO:teuthology.orchestra.run.smithi073.stdout:syncing data to disk ... ok 2024-09-12T03:33:29.107 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-12T03:33:29.814 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:29.915 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-12T03:33:30.025 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql (14+238) ... 2024-09-12T03:33:30.151 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:30.277 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:30.534 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T03:33:30.534 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T03:33:31.105 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T03:33:31.205 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T03:33:31.552 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T03:33:31.710 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T03:33:31.873 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:31.982 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-12T03:33:32.150 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql (14+238) ... 2024-09-12T03:33:32.276 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-12T03:33:32.402 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-12T03:33:32.664 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T03:33:32.664 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-12T03:33:33.196 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T03:33:33.289 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T03:33:33.355 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-12T03:33:33.454 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T03:33:33.599 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T03:33:33.743 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T03:33:33.981 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T03:33:33.986 DEBUG:teuthology.parallel:result is None 2024-09-12T03:33:35.122 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-12T03:33:35.222 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T03:33:35.735 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T03:33:35.739 DEBUG:teuthology.parallel:result is None 2024-09-12T03:33:35.740 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T03:33:35.907 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-09-12T03:33:35.926 INFO:teuthology.orchestra.run.smithi073.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:33:35.927 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:33:35.927 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-12T03:33:35.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T03:33:36.076 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-query -W -f '${Version}' ceph 2024-09-12T03:33:36.096 INFO:teuthology.orchestra.run.smithi150.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:33:36.096 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-12T03:33:36.097 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-12T03:33:36.098 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T03:33:36.098 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:36.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T03:33:36.113 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:36.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T03:33:36.151 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T03:33:36.151 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:36.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T03:33:36.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T03:33:36.226 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:36.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T03:33:36.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T03:33:36.295 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T03:33:36.295 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:36.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T03:33:36.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T03:33:36.361 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:36.362 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T03:33:36.375 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T03:33:36.432 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T03:33:36.432 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:36.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T03:33:36.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T03:33:36.501 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:36.501 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T03:33:36.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T03:33:36.567 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T03:33:36.662 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T03:33:36.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-12T03:33:36.665 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2024-09-12T03:33:36.677 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T03:33:36.677 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T03:33:36.719 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T03:33:36.731 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T03:33:36.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T03:33:36.775 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T03:33:36.794 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T03:33:36.794 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T03:33:36.794 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T03:33:36.794 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:36.794 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T03:33:36.834 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T03:33:36.910 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:36.911 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T03:33:36.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T03:33:36.999 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T03:33:36.999 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T03:33:36.999 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quota}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901690', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAIlkSOXC/hztZIUYaBivh1iuDRdnZ7ayPYoc6nIoJ5ErKACsCraDM6IKWcvPg/0DSBgg8WSlmhlNlYoWVy1s/s=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPXU3bpALQENa/aG72l4fBJayGA0nbWEbLQYDEfiy5gCAE5dkAbrJISrZJGEO9ACCzPCkNK4zSh6R1BWVO+wu4g='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T03:33:37.000 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T03:33:37.002 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T03:33:37.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T03:33:37.051 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T03:33:37.096 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:37.096 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T03:33:37.110 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T03:33:37.110 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-12T03:33:37.158 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T03:33:37.159 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:37.159 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-09-12T03:33:37.159 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:37.159 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 03:27:24.239100482 +0000 2024-09-12T03:33:37.159 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 03:27:23.975102840 +0000 2024-09-12T03:33:37.159 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 03:27:23.975102840 +0000 2024-09-12T03:33:37.159 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-12T03:33:37.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T03:33:37.214 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T03:33:37.215 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T03:33:37.215 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000450847 s, 1.1 MB/s 2024-09-12T03:33:37.215 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T03:33:37.263 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-12T03:33:37.310 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T03:33:37.310 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:37.310 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-12T03:33:37.310 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:37.310 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 03:27:24.763095801 +0000 2024-09-12T03:33:37.310 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 03:27:24.467098445 +0000 2024-09-12T03:33:37.311 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 03:27:24.467098445 +0000 2024-09-12T03:33:37.311 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-12T03:33:37.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T03:33:37.365 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T03:33:37.365 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T03:33:37.366 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000454747 s, 1.1 MB/s 2024-09-12T03:33:37.367 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T03:33:37.415 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-12T03:33:37.462 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T03:33:37.462 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:37.462 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-12T03:33:37.462 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:37.462 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 03:27:25.231091621 +0000 2024-09-12T03:33:37.463 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 03:27:24.991093764 +0000 2024-09-12T03:33:37.463 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 03:27:24.991093764 +0000 2024-09-12T03:33:37.463 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-12T03:33:37.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T03:33:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T03:33:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T03:33:37.516 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000420421 s, 1.2 MB/s 2024-09-12T03:33:37.518 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T03:33:37.567 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-12 03:27:25.735087119 +0000 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-12 03:27:25.491089299 +0000 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-12 03:27:25.491089299 +0000 2024-09-12T03:33:37.614 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-12T03:33:37.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T03:33:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-12T03:33:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-12T03:33:37.668 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000357709 s, 1.4 MB/s 2024-09-12T03:33:37.669 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T03:33:37.719 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:37.719 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:37.719 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T03:33:37.725 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T03:33:37.725 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-09-12T03:33:37.772 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T03:33:37.772 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:37.772 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-12T03:33:37.773 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:37.773 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 03:27:24.247008102 +0000 2024-09-12T03:33:37.773 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 03:27:23.983010459 +0000 2024-09-12T03:33:37.773 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 03:27:23.983010459 +0000 2024-09-12T03:33:37.773 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T03:33:37.773 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T03:33:37.827 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T03:33:37.827 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T03:33:37.827 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.00038707 s, 1.3 MB/s 2024-09-12T03:33:37.828 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T03:33:37.877 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-09-12T03:33:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T03:33:37.924 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:37.924 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-12T03:33:37.924 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:37.924 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 03:27:24.475006065 +0000 2024-09-12T03:33:37.924 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 03:27:24.471006101 +0000 2024-09-12T03:33:37.925 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 03:27:24.471006101 +0000 2024-09-12T03:33:37.925 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T03:33:37.925 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T03:33:37.978 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T03:33:37.978 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T03:33:37.978 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000366307 s, 1.4 MB/s 2024-09-12T03:33:37.980 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T03:33:38.029 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-09-12T03:33:38.076 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T03:33:38.076 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:38.076 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-12T03:33:38.076 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:38.076 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 03:27:24.991001455 +0000 2024-09-12T03:33:38.076 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 03:27:24.987001491 +0000 2024-09-12T03:33:38.077 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 03:27:24.987001491 +0000 2024-09-12T03:33:38.077 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T03:33:38.077 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T03:33:38.131 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T03:33:38.131 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T03:33:38.131 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000417827 s, 1.2 MB/s 2024-09-12T03:33:38.132 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T03:33:38.182 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-09-12T03:33:38.228 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T03:33:38.228 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T03:33:38.228 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-09-12T03:33:38.228 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T03:33:38.228 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-09-12 03:27:25.766994525 +0000 2024-09-12T03:33:38.228 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-09-12 03:27:25.506996847 +0000 2024-09-12T03:33:38.229 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-09-12 03:27:25.506996847 +0000 2024-09-12T03:33:38.229 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-09-12T03:33:38.229 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T03:33:38.283 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-09-12T03:33:38.283 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-09-12T03:33:38.283 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.00039318 s, 1.3 MB/s 2024-09-12T03:33:38.284 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T03:33:38.333 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:38.333 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T03:33:38.333 INFO:tasks.ceph:Generating config... 2024-09-12T03:33:38.335 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T03:33:38.335 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T03:33:38.335 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T03:33:38.335 INFO:tasks.ceph:[client] pid file = 2024-09-12T03:33:38.335 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T03:33:38.335 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T03:33:38.335 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T03:33:38.335 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T03:33:38.335 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T03:33:38.335 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T03:33:38.336 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T03:33:38.337 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T03:33:38.337 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T03:33:38.337 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T03:33:38.338 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T03:33:38.338 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T03:33:38.338 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T03:33:38.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T03:33:38.372 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T03:33:38.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T03:33:38.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T03:33:38.524 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.150'), ('mon.c', '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]')] 2024-09-12T03:33:38.525 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T03:33:38.526 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:38.526 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T03:33:38.570 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.150 --addv c '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:38.656 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 7f20e802-78a7-4f58-bc5b-05a554b3f603 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 7f20e802-78a7-4f58-bc5b-05a554b3f603 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-09-12T03:33:38.658202+0000 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-12T03:33:38.658202+0000 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2024-09-12T03:33:38.657 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon.c 2024-09-12T03:33:38.658 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T03:33:38.659 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T03:33:38.706 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7f20e802-78a7-4f58-bc5b-05a554b3f603... 2024-09-12T03:33:38.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T03:33:38.751 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T03:33:38.780 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-12T03:33:38.780 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-12T03:33:38.780 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T03:33:38.780 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-12T03:33:38.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.780 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-12T03:33:38.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T03:33:38.781 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-12T03:33:38.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 7f20e802-78a7-4f58-bc5b-05a554b3f603 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.783 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-12T03:33:38.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.785 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-12T03:33:38.786 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-09-12T03:33:38.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.788 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: mon down mkfs grace = 300 2024-09-12T03:33:38.789 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on pool no app = False 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-09-12T03:33:38.790 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-09-12T03:33:38.791 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-09-12T03:33:38.792 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-09-12T03:33:38.792 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-09-12T03:33:38.792 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-09-12T03:33:38.792 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-09-12T03:33:38.792 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-09-12T03:33:38.792 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.793 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2024-09-12T03:33:38.794 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.795 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.73,172.21.15.150,[v2:172.21.15.150:3301,v1:172.21.15.150:6790]" 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 7f20e802-78a7-4f58-bc5b-05a554b3f603 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.796 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug trim objects = true 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2024-09-12T03:33:38.797 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2024-09-12T03:33:38.798 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 20 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 20 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 10 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2024-09-12T03:33:38.799 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2024-09-12T03:33:38.800 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T03:33:38.801 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: mon down mkfs grace = 300 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on pool no app = False 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2024-09-12T03:33:38.802 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = "" 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-09-12T03:33:38.803 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds balancer = 20 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2024-09-12T03:33:38.804 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2024-09-12T03:33:38.806 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T03:33:38.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T03:33:38.899 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T03:33:38.899 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:38.899 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T03:33:38.904 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:38.904 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T03:33:38.950 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:33:38.950 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:38.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T03:33:38.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T03:33:39.017 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:33:39.018 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:39.066 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:33:39.067 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:39.067 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T03:33:39.067 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T03:33:39.090 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:33:39.090 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:39.136 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T03:33:39.136 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T03:33:39.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T03:33:39.179 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T03:33:39.182 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T03:33:39.225 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T03:33:39.242 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T03:33:39.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T03:33:39.285 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T03:33:39.287 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T03:33:39.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T03:33:39.429 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T03:33:39.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T03:33:39.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T03:33:39.537 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T03:33:39.538 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T03:33:39.591 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T03:33:39.675 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T03:33:39.678 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T03:33:39.732 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T03:33:39.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T03:33:39.769 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T03:33:39.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-12T03:33:39.852 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-12T03:33:39.861 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T03:33:39.897 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T03:33:39.908 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-12T03:33:39.984 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-12T03:33:39.994 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T03:33:39.994 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T03:33:39.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T03:33:40.008 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:40.008 INFO:tasks.ceph:role: osd.0 2024-09-12T03:33:40.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:33:40.009 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T03:33:40.069 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:40.069 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:40.069 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:40.069 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:40.070 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:40.070 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:40.070 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:40.070 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:40.070 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:40.070 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:40.528 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T03:33:40.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T03:33:40.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T03:33:40.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T03:33:40.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:40.646 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:40.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T03:33:40.699 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:40.699 INFO:tasks.ceph:role: osd.1 2024-09-12T03:33:40.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:33:40.700 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T03:33:40.763 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:40.763 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:40.763 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:40.763 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:40.764 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:40.764 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:40.764 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:40.764 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:40.764 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:40.764 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:41.233 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T03:33:41.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T03:33:41.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T03:33:41.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T03:33:41.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:41.403 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:41.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T03:33:41.458 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:41.458 INFO:tasks.ceph:role: osd.2 2024-09-12T03:33:41.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:33:41.458 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:41.522 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:41.523 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:42.010 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T03:33:42.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T03:33:42.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T03:33:42.154 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T03:33:42.165 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:42.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:42.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T03:33:42.222 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:42.222 INFO:tasks.ceph:role: osd.3 2024-09-12T03:33:42.222 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:33:42.222 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:42.286 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:42.709 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-12T03:33:42.711 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-12T03:33:42.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T03:33:42.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T03:33:42.855 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:42.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:42.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:42.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:42.963+0000 7fc3b1a477c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T03:33:42.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:42.967+0000 7fc3b1a477c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T03:33:42.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:42.967+0000 7fc3b1a477c0 -1 bdev(0x55b43fac5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T03:33:42.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:42.967+0000 7fc3b1a477c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T03:33:46.118 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T03:33:46.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:46.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:46.207+0000 7f0f908df7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T03:33:46.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:46.207+0000 7f0f908df7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T03:33:46.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:46.207+0000 7f0f908df7c0 -1 bdev(0x561ba3e37800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T03:33:46.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:46.207+0000 7f0f908df7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T03:33:49.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T03:33:49.389 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:49.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:49.467+0000 7f49a57ff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T03:33:49.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:49.467+0000 7f49a57ff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T03:33:49.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:49.467+0000 7f49a57ff7c0 -1 bdev(0x5579e189f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T03:33:49.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:49.467+0000 7f49a57ff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T03:33:52.632 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T03:33:52.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:52.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:52.763+0000 7fbeec0d17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T03:33:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:52.763+0000 7fbeec0d17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T03:33:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:52.763+0000 7fbeec0d17c0 -1 bdev(0x55c9afbeb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T03:33:52.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:33:52.763+0000 7fbeec0d17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T03:33:55.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T03:33:55.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T03:33:55.981 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:55.981 INFO:tasks.ceph:role: osd.4 2024-09-12T03:33:55.981 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:33:55.981 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T03:33:56.043 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:56.044 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:56.045 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:56.525 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T03:33:56.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T03:33:56.527 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T03:33:56.692 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T03:33:56.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:56.705 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:56.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T03:33:56.763 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:56.763 INFO:tasks.ceph:role: osd.5 2024-09-12T03:33:56.763 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:33:56.763 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T03:33:56.827 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:56.827 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:56.828 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:57.273 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T03:33:57.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T03:33:57.275 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T03:33:57.371 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T03:33:57.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:57.381 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:57.381 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T03:33:57.433 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:57.433 INFO:tasks.ceph:role: osd.6 2024-09-12T03:33:57.433 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:33:57.433 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T03:33:57.494 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:57.951 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T03:33:57.953 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T03:33:57.953 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T03:33:58.045 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T03:33:58.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:58.055 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:58.056 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T03:33:58.109 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T03:33:58.109 INFO:tasks.ceph:role: osd.7 2024-09-12T03:33:58.110 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:33:58.110 DEBUG:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T03:33:58.171 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T03:33:58.674 INFO:teuthology.orchestra.run.smithi150.stdout:Discarding blocks...Done. 2024-09-12T03:33:58.676 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2024-09-12T03:33:58.676 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T03:33:58.828 DEBUG:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T03:33:58.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:33:58.841 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T03:33:58.841 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:33:58.977 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:33:58.980+0000 7f2032c227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T03:33:58.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:33:58.984+0000 7f2032c227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T03:33:58.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:33:58.984+0000 7f2032c227c0 -1 bdev(0x563674c23800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T03:33:58.982 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:33:58.984+0000 7f2032c227c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T03:34:02.144 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T03:34:02.157 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:34:02.237 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:02.240+0000 7f717aa267c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T03:34:02.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:02.240+0000 7f717aa267c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T03:34:02.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:02.240+0000 7f717aa267c0 -1 bdev(0x5564053d3800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T03:34:02.238 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:02.240+0000 7f717aa267c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T03:34:05.364 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T03:34:05.421 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:34:05.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:05.504+0000 7f4bd1fff7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T03:34:05.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:05.504+0000 7f4bd1fff7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T03:34:05.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:05.504+0000 7f4bd1fff7c0 -1 bdev(0x561ece917800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T03:34:05.501 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:05.504+0000 7f4bd1fff7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T03:34:07.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:34:07.004 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:34:08.610 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T03:34:08.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:34:08.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:08.708+0000 7f7da74ad7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T03:34:08.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:08.708+0000 7f7da74ad7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T03:34:08.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:08.708+0000 7f7da74ad7c0 -1 bdev(0x564135643800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T03:34:08.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:08.708+0000 7f7da74ad7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T03:34:11.834 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T03:34:11.892 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T03:34:11.893 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:11.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T03:34:11.907 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:11.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T03:34:11.961 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:11.961 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T03:34:12.021 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:12.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T03:34:12.076 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:12.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T03:34:12.130 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:12.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T03:34:12.185 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:12.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T03:34:12.241 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.241 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T03:34:12.255 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.255 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T03:34:12.313 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.313 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T03:34:12.368 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.368 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T03:34:12.423 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.423 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T03:34:12.479 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.479 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T03:34:12.535 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.535 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T03:34:12.591 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:12.591 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T03:34:12.598 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:12.598 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-12T03:34:12.646 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.646 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T03:34:12.653 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:12.653 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-12T03:34:12.700 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T03:34:12.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T03:34:12.703 DEBUG:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T03:34:12.745 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA== 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ== 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA== 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg== 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw== 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-12T03:34:12.746 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig== 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ== 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw== 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw== 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ== 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A== 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg== 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-09-12T03:34:12.747 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ== 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g== 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout:[client.2] 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw== 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA== 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout:[client.3] 2024-09-12T03:34:12.748 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ== 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA== 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ== 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA== 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg== 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2024-09-12T03:34:12.754 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw== 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig== 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ== 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw== 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw== 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.d] 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ== 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A== 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2024-09-12T03:34:12.755 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg== 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ== 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g== 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout:[client.2] 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw== 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout:[client.1] 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA== 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout:[client.3] 2024-09-12T03:34:12.756 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ== 2024-09-12T03:34:12.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T03:34:12.795 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T03:34:12.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:12.887 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:12.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:12.979 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:13.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.067 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.307 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T03:34:13.390 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T03:34:13.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:13.470 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:13.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:13.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T03:34:13.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.638 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.769 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.811 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.895 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T03:34:13.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:13.978 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:14.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:14.062 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:14.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:14.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:14.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:14.230 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T03:34:14.276 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T03:34:14.276 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T03:34:14.287 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T03:34:14.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T03:34:14.385 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T03:34:14.399 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T03:34:14.495 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T03:34:14.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T03:34:14.556 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T03:34:14.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T03:34:14.658 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:34:14.660 DEBUG:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T03:34:14.703 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T03:34:14.703 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T03:34:14.703 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T03:34:14.706 INFO:tasks.ceph.mon.a:Started 2024-09-12T03:34:14.706 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T03:34:14.706 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T03:34:14.748 INFO:tasks.ceph.mon.b:Started 2024-09-12T03:34:14.748 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T03:34:14.749 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T03:34:14.750 INFO:tasks.ceph.mon.c:Started 2024-09-12T03:34:14.750 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T03:34:14.751 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T03:34:14.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T03:34:14.753 INFO:tasks.ceph.mgr.y:Started 2024-09-12T03:34:14.753 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T03:34:14.753 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T03:34:14.755 INFO:tasks.ceph.mgr.x:Started 2024-09-12T03:34:14.755 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T03:34:14.755 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T03:34:14.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1607a7a640 1 Processor -- start 2024-09-12T03:34:14.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1607a7a640 1 -- start start 2024-09-12T03:34:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1607a7a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1607a7a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1607a7a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1600073740 con 0x7f16001627d0 2024-09-12T03:34:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1607a7a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f16000b4630 con 0x7f160006bcc0 2024-09-12T03:34:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1607a7a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f16000b6050 con 0x7f16000b40c0 2024-09-12T03:34:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1606017640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1606017640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:36384/0 (socket says 172.21.15.73:36384) 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1606017640 1 -- 172.21.15.73:0/1922530680 learned_addr learned my addr 172.21.15.73:0/1922530680 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1605015640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1605816640 1 --1- 172.21.15.73:0/1922530680 >> v1:172.21.15.150:6789/0 conn(0x7f16001627d0 0x7f1600163f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:38802/0 (socket says 172.21.15.73:38802) 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1606017640 1 -- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 msgr2=0x7f160006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1606017640 1 -- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 msgr2=0x7f160006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1606017640 1 --2- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1606017640 1 --2- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1605015640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 msgr2=0x7f160009aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1605015640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 msgr2=0x7f160009aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1605015640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T03:34:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:14.871+0000 7f1605015640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T03:34:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1605015640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1606017640 1 --2- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1605015640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 msgr2=0x7f160009aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T03:34:15.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1605015640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 msgr2=0x7f160009aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T03:34:15.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1605015640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T03:34:15.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1606017640 1 -- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 msgr2=0x7f160006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T03:34:15.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1606017640 1 -- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 msgr2=0x7f160006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T03:34:15.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1605015640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T03:34:15.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1606017640 1 --2- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T03:34:15.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.075+0000 7f1606017640 1 --2- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T03:34:15.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.147+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490737105 0 0) 0x7f1600073740 con 0x7f16001627d0 2024-09-12T03:34:15.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.147+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15ec003530 con 0x7f16001627d0 2024-09-12T03:34:15.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1736541339 0 0) 0x7f15ec003530 con 0x7f16001627d0 2024-09-12T03:34:15.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 msgr2=0x7f160009aa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T03:34:15.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f160009aa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 msgr2=0x7f160006c150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 --2- 172.21.15.73:0/1922530680 >> v2:172.21.15.150:3300/0 conn(0x7f160006bcc0 0x7f160006c150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16000b6330 con 0x7f16001627d0 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f15fc001680 con 0x7f16001627d0 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 >> v1:172.21.15.150:6789/0 conn(0x7f16001627d0 legacy=0x7f1600163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f15ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f15ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15ec004d50 0x7f15ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16000b4630 con 0x7f15ec0039c0 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f16000b6050 con 0x7f15ec004d50 2024-09-12T03:34:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f15ec00bb60 con 0x7f16000b40c0 2024-09-12T03:34:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1605816640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f15ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1605015640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f15ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1606017640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15ec004d50 0x7f15ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1605816640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 msgr2=0x7f15ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1605816640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f16000b40c0 0x7f15ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1605816640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15ec004d50 msgr2=0x7f15ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1605816640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15ec004d50 0x7f15ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.151+0000 7f1605816640 1 -- 172.21.15.73:0/1922530680 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ec003530 con 0x7f15ec0039c0 2024-09-12T03:34:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.155+0000 7f1605816640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f15ec003de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15fc007f90 tx=0x7f15fc01cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b284594ed3f80224 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc007bb0 con 0x7f15ec0039c0 2024-09-12T03:34:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15fc0a9020 con 0x7f15ec0039c0 2024-09-12T03:34:15.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1604814640 1 -- 172.21.15.73:0/1922530680 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0072f0 con 0x7f15ec0039c0 2024-09-12T03:34:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1607a7a640 1 -- 172.21.15.73:0/1922530680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 msgr2=0x7f15ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1607a7a640 1 --2- 172.21.15.73:0/1922530680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f15ec003de0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f15fc007f90 tx=0x7f15fc01cb20 comp rx=0 tx=0).stop 2024-09-12T03:34:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1606017640 1 -- 172.21.15.73:0/1922530680 reap_dead start 2024-09-12T03:34:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1607a7a640 1 -- 172.21.15.73:0/1922530680 shutdown_connections 2024-09-12T03:34:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1607a7a640 1 -- 172.21.15.73:0/1922530680 >> 172.21.15.73:0/1922530680 conn(0x7f16000b6800 msgr2=0x7f16000b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1607a7a640 1 -- 172.21.15.73:0/1922530680 shutdown_connections 2024-09-12T03:34:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.159+0000 7f1607a7a640 1 -- 172.21.15.73:0/1922530680 wait complete. 2024-09-12T03:34:15.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 Processor -- start 2024-09-12T03:34:15.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 -- start start 2024-09-12T03:34:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f160009b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1600157ce0 0x7f160014a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f160016c650 0x7f160016cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f160009ae10 con 0x7f15ec0039c0 2024-09-12T03:34:15.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1600167270 con 0x7f160016c650 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1607a7a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f160016d800 con 0x7f1600157ce0 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1605816640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f160009b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1605816640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f160009b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46926/0 (socket says 172.21.15.73:46926) 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1605816640 1 -- 172.21.15.73:0/2819134527 learned_addr learned my addr 172.21.15.73:0/2819134527 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1606017640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f160016c650 0x7f160016cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.163+0000 7f1605015640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1600157ce0 0x7f160014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1606017640 1 -- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1600157ce0 msgr2=0x7f160014a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1606017640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1600157ce0 0x7f160014a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1606017640 1 -- 172.21.15.73:0/2819134527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 msgr2=0x7f160009b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1606017640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f160009b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1606017640 1 -- 172.21.15.73:0/2819134527 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160016d630 con 0x7f160016c650 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1605015640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1600157ce0 0x7f160014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:15.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1605816640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f160009b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:15.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1606017640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f160016c650 0x7f160016cad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1600072440 tx=0x7f15f8007f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f15f67fc640 1 -- 172.21.15.73:0/2819134527 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f801d070 con 0x7f160016c650 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f15f67fc640 1 -- 172.21.15.73:0/2819134527 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8011b50 con 0x7f160016c650 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f15f67fc640 1 -- 172.21.15.73:0/2819134527 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8016450 con 0x7f160016c650 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1600158250 con 0x7f160016c650 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1600158810 con 0x7f160016c650 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f15f67fc640 1 -- 172.21.15.73:0/2819134527 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f15f8016980 con 0x7f160016c650 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f15f67fc640 1 -- 172.21.15.73:0/2819134527 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f15f80156f0 con 0x7f160016c650 2024-09-12T03:34:15.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.167+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160016d010 con 0x7f160016c650 2024-09-12T03:34:15.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.191+0000 7f15f67fc640 1 -- 172.21.15.73:0/2819134527 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f15f8016db0 con 0x7f160016c650 2024-09-12T03:34:15.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.255+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f160006c130 con 0x7f160016c650 2024-09-12T03:34:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f15f67fc640 1 -- 172.21.15.73:0/2819134527 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f15f8021ca0 con 0x7f160016c650 2024-09-12T03:34:15.266 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-12T03:34:15.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f160016c650 msgr2=0x7f160016cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f160016c650 0x7f160016cad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1600072440 tx=0x7f15f8007f60 comp rx=0 tx=0).stop 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 shutdown_connections 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f160016c650 0x7f160016cad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1600157ce0 0x7f160014a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 --2- 172.21.15.73:0/2819134527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15ec0039c0 0x7f160009b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 >> 172.21.15.73:0/2819134527 conn(0x7f16000b6800 msgr2=0x7f160006efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 shutdown_connections 2024-09-12T03:34:15.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:15.267+0000 7f1607a7a640 1 -- 172.21.15.73:0/2819134527 wait complete. 2024-09-12T03:34:15.286 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T03:34:15.286 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T03:34:15.286 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:15.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T03:34:15.298 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:15.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T03:34:15.351 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:15.351+0000 7fbc9b98a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T03:34:15.352 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:15.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T03:34:15.405 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:15.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T03:34:15.428 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:15.432+0000 7f4e8bbb6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T03:34:15.461 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:15.461 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T03:34:15.475 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:15.475 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T03:34:15.530 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:15.530 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T03:34:15.582 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:34:15.582 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T03:34:15.635 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new e1c2cdf0-ccb0-4631-999b-d09d433decec 0 2024-09-12T03:34:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa79550640 1 Processor -- start 2024-09-12T03:34:15.808 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa79550640 1 -- start start 2024-09-12T03:34:15.809 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa79550640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa7415e260 0x7faa740afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa79550640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa74067e30 0x7faa74161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa79550640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa741627e0 con 0x7faa741623e0 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa79550640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7faa740afbb0 con 0x7faa74067e30 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa79550640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7faa740af310 con 0x7faa7415e260 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa72ffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa7415e260 0x7faa740afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa72ffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faa7415e260 0x7faa740afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54930/0 (socket says 172.21.15.150:54930) 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa72ffd640 1 -- 172.21.15.150:0/2710785203 learned_addr learned my addr 172.21.15.150:0/2710785203 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa727fc640 1 --2- 172.21.15.150:0/2710785203 >> v2:172.21.15.73:3300/0 conn(0x7faa74067e30 0x7faa74161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa72ffd640 1 -- 172.21.15.150:0/2710785203 >> v2:172.21.15.73:3300/0 conn(0x7faa74067e30 msgr2=0x7faa74161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa72ffd640 1 --2- 172.21.15.150:0/2710785203 >> v2:172.21.15.73:3300/0 conn(0x7faa74067e30 0x7faa74161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa72ffd640 1 -- 172.21.15.150:0/2710785203 >> v1:172.21.15.150:6789/0 conn(0x7faa741623e0 legacy=0x7faa7415e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.810 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.812+0000 7faa72ffd640 1 -- 172.21.15.150:0/2710785203 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740af5f0 con 0x7faa7415e260 2024-09-12T03:34:15.812 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:15.811+0000 7fbc9b98a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T03:34:15.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa72ffd640 1 --2- 172.21.15.150:0/2710785203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa7415e260 0x7faa740afff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faa74072270 tx=0x7faa6c01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc2f7fe1d42eff43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:15.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa71ffb640 1 -- 172.21.15.150:0/2710785203 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0a5510 con 0x7faa7415e260 2024-09-12T03:34:15.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa71ffb640 1 -- 172.21.15.150:0/2710785203 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c0a56b0 con 0x7faa7415e260 2024-09-12T03:34:15.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa71ffb640 1 -- 172.21.15.150:0/2710785203 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0a5a80 con 0x7faa7415e260 2024-09-12T03:34:15.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 -- 172.21.15.150:0/2710785203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa7415e260 msgr2=0x7faa740afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 --2- 172.21.15.150:0/2710785203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa7415e260 0x7faa740afff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faa74072270 tx=0x7faa6c01c9f0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 -- 172.21.15.150:0/2710785203 shutdown_connections 2024-09-12T03:34:15.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 --2- 172.21.15.150:0/2710785203 >> v2:172.21.15.73:3300/0 conn(0x7faa74067e30 0x7faa74161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.814 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 --2- 172.21.15.150:0/2710785203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa7415e260 0x7faa740afff0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 -- 172.21.15.150:0/2710785203 >> 172.21.15.150:0/2710785203 conn(0x7faa74073580 msgr2=0x7faa7406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 -- 172.21.15.150:0/2710785203 shutdown_connections 2024-09-12T03:34:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.816+0000 7faa79550640 1 -- 172.21.15.150:0/2710785203 wait complete. 2024-09-12T03:34:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 Processor -- start 2024-09-12T03:34:15.815 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 -- start start 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa74067e30 0x7faa74156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa7415e260 0x7faa741586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa741623e0 0x7faa7415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faa7416b3a0 con 0x7faa7415e260 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faa7416b220 con 0x7faa741623e0 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faa7416b520 con 0x7faa74067e30 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa737fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa741623e0 0x7faa7415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa72ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa74067e30 0x7faa74156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa737fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa741623e0 0x7faa7415a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54936/0 (socket says 172.21.15.150:54936) 2024-09-12T03:34:15.818 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa737fe640 1 -- 172.21.15.150:0/2950447150 learned_addr learned my addr 172.21.15.150:0/2950447150 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa727fc640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa7415e260 0x7faa741586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa72ffd640 1 -- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa741623e0 msgr2=0x7faa7415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa72ffd640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa741623e0 0x7faa7415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa72ffd640 1 -- 172.21.15.150:0/2950447150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa7415e260 msgr2=0x7faa741586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa72ffd640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa7415e260 0x7faa741586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa72ffd640 1 -- 172.21.15.150:0/2950447150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7415fb40 con 0x7faa74067e30 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa737fe640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa741623e0 0x7faa7415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa72ffd640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa74067e30 0x7faa74156f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa740af490 tx=0x7faa6c019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa5b7fe640 1 -- 172.21.15.150:0/2950447150 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c009510 con 0x7faa74067e30 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa5b7fe640 1 -- 172.21.15.150:0/2950447150 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c0be070 con 0x7faa74067e30 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa7415fe20 con 0x7faa74067e30 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa5b7fe640 1 -- 172.21.15.150:0/2950447150 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0b88b0 con 0x7faa74067e30 2024-09-12T03:34:15.819 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa741603e0 con 0x7faa74067e30 2024-09-12T03:34:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa5b7fe640 1 -- 172.21.15.150:0/2950447150 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa6c0b8a50 con 0x7faa74067e30 2024-09-12T03:34:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa5b7fe640 1 -- 172.21.15.150:0/2950447150 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7faa6c0c3a90 con 0x7faa74067e30 2024-09-12T03:34:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.820+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa74161ea0 con 0x7faa74067e30 2024-09-12T03:34:15.820 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.824+0000 7faa5b7fe640 1 -- 172.21.15.150:0/2950447150 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faa6c0165e0 con 0x7faa74067e30 2024-09-12T03:34:15.891 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.896+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1c2cdf0-ccb0-4631-999b-d09d433decec", "id": 0} v 0) -- 0x7faa740b2120 con 0x7faa74067e30 2024-09-12T03:34:15.899 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa5b7fe640 1 -- 172.21.15.150:0/2950447150 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1c2cdf0-ccb0-4631-999b-d09d433decec", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7faa6c0a5610 con 0x7faa74067e30 2024-09-12T03:34:15.899 INFO:teuthology.orchestra.run.smithi150.stdout:0 2024-09-12T03:34:15.900 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa74067e30 msgr2=0x7faa74156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa74067e30 0x7faa74156f10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa740af490 tx=0x7faa6c019790 comp rx=0 tx=0).stop 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 shutdown_connections 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa7415e260 0x7faa741586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa741623e0 0x7faa7415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 --2- 172.21.15.150:0/2950447150 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa74067e30 0x7faa74156f10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 >> 172.21.15.150:0/2950447150 conn(0x7faa74073580 msgr2=0x7faa740b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 shutdown_connections 2024-09-12T03:34:15.901 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:15.904+0000 7faa79550640 1 -- 172.21.15.150:0/2950447150 wait complete. 2024-09-12T03:34:15.908 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:15.912+0000 7f4e8bbb6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T03:34:15.917 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 0cc94582-3332-4869-b0d4-216908b0991e 1 2024-09-12T03:34:16.019 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.019+0000 7fbc9b98a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T03:34:16.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353ee06640 1 Processor -- start 2024-09-12T03:34:16.038 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353ee06640 1 -- start start 2024-09-12T03:34:16.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353ee06640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3538144d60 0x7f3538070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353ee06640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f35380b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353ee06640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3538071030 con 0x7f35380b4ba0 2024-09-12T03:34:16.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353ee06640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3538070660 con 0x7f3538144d60 2024-09-12T03:34:16.039 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353ee06640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f353806fa50 con 0x7f35380b4090 2024-09-12T03:34:16.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f3537fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f35380b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353d3a3640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f35380b4ba0 0x7f35380ae610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41116/0 (socket says 172.21.15.150:41116) 2024-09-12T03:34:16.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.040+0000 7f353d3a3640 1 -- 172.21.15.150:0/437044645 learned_addr learned my addr 172.21.15.150:0/437044645 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-09-12T03:34:16.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353cba2640 1 --2- 172.21.15.150:0/437044645 >> v2:172.21.15.73:3300/0 conn(0x7f3538144d60 0x7f3538070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f3537fff640 1 -- 172.21.15.150:0/437044645 >> v2:172.21.15.73:3300/0 conn(0x7f3538144d60 msgr2=0x7f3538070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:16.040 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f3537fff640 1 --2- 172.21.15.150:0/437044645 >> v2:172.21.15.73:3300/0 conn(0x7f3538144d60 0x7f3538070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f3537fff640 1 -- 172.21.15.150:0/437044645 >> v1:172.21.15.150:6789/0 conn(0x7f35380b4ba0 legacy=0x7f35380ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f35377fe640 1 -- 172.21.15.150:0/437044645 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054123792 0 0) 0x7f3538071030 con 0x7f35380b4ba0 2024-09-12T03:34:16.041 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f3537fff640 1 -- 172.21.15.150:0/437044645 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353806fd30 con 0x7f35380b4090 2024-09-12T03:34:16.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f3537fff640 1 --2- 172.21.15.150:0/437044645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f35380b44d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f35280097c0 tx=0x7f352801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e196dce1e8a6f737 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f35377fe640 1 -- 172.21.15.150:0/437044645 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35280b2070 con 0x7f35380b4090 2024-09-12T03:34:16.042 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f35377fe640 1 -- 172.21.15.150:0/437044645 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35280ad640 con 0x7f35380b4090 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f35377fe640 1 -- 172.21.15.150:0/437044645 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35280ada10 con 0x7f35380b4090 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 -- 172.21.15.150:0/437044645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 msgr2=0x7f35380b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 --2- 172.21.15.150:0/437044645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f35380b44d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f35280097c0 tx=0x7f352801c4a0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 -- 172.21.15.150:0/437044645 shutdown_connections 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 --2- 172.21.15.150:0/437044645 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f35380b44d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 --2- 172.21.15.150:0/437044645 >> v2:172.21.15.73:3300/0 conn(0x7f3538144d60 0x7f3538070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 -- 172.21.15.150:0/437044645 >> 172.21.15.150:0/437044645 conn(0x7f353809aa00 msgr2=0x7f35380b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 -- 172.21.15.150:0/437044645 shutdown_connections 2024-09-12T03:34:16.043 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.044+0000 7f353ee06640 1 -- 172.21.15.150:0/437044645 wait complete. 2024-09-12T03:34:16.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 Processor -- start 2024-09-12T03:34:16.045 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 -- start start 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f353815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35380b4ba0 0x7f353809e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538144d60 0x7f353809c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f35380b6fd0 con 0x7f35380b4ba0 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f35380b6e50 con 0x7f3538144d60 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f35380af130 con 0x7f35380b4090 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f353815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f353815aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:59478/0 (socket says 172.21.15.150:59478) 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 -- 172.21.15.150:0/617677018 learned_addr learned my addr 172.21.15.150:0/617677018 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353d3a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538144d60 0x7f353809c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.046 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f3537fff640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35380b4ba0 0x7f353809e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 -- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538144d60 msgr2=0x7f353809c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538144d60 0x7f353809c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 -- 172.21.15.150:0/617677018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35380b4ba0 msgr2=0x7f353809e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35380b4ba0 0x7f353809e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 -- 172.21.15.150:0/617677018 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35380d1270 con 0x7f35380b4090 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353d3a3640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538144d60 0x7f353809c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353cba2640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f353815aac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f352c00d800 tx=0x7f352c00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f35357fa640 1 -- 172.21.15.150:0/617677018 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c00b6c0 con 0x7f35380b4090 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f35357fa640 1 -- 172.21.15.150:0/617677018 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352c019070 con 0x7f35380b4090 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35380d1550 con 0x7f35380b4090 2024-09-12T03:34:16.047 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f35357fa640 1 -- 172.21.15.150:0/617677018 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c00ba60 con 0x7f35380b4090 2024-09-12T03:34:16.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f353809bbc0 con 0x7f35380b4090 2024-09-12T03:34:16.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f35357fa640 1 -- 172.21.15.150:0/617677018 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f352c00bc00 con 0x7f35380b4090 2024-09-12T03:34:16.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f35357fa640 1 -- 172.21.15.150:0/617677018 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f352c014950 con 0x7f35380b4090 2024-09-12T03:34:16.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.048+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35380b44d0 con 0x7f35380b4090 2024-09-12T03:34:16.048 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.052+0000 7f35357fa640 1 -- 172.21.15.150:0/617677018 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f352c014b50 con 0x7f35380b4090 2024-09-12T03:34:16.117 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.120+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0cc94582-3332-4869-b0d4-216908b0991e", "id": 1} v 0) -- 0x7f353815de00 con 0x7f35380b4090 2024-09-12T03:34:16.118 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:16.120+0000 7f4e8bbb6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T03:34:16.127 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f35357fa640 1 -- 172.21.15.150:0/617677018 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cc94582-3332-4869-b0d4-216908b0991e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f352c014e00 con 0x7f35380b4090 2024-09-12T03:34:16.127 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 msgr2=0x7f353815aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f353815aac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f352c00d800 tx=0x7f352c00dcc0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 shutdown_connections 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35380b4ba0 0x7f353809e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3538144d60 0x7f353809c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 --2- 172.21.15.150:0/617677018 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35380b4090 0x7f353815aac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 >> 172.21.15.150:0/617677018 conn(0x7f353809aa00 msgr2=0x7f3538074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 shutdown_connections 2024-09-12T03:34:16.129 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.132+0000 7f353ee06640 1 -- 172.21.15.150:0/617677018 wait complete. 2024-09-12T03:34:16.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 6627cbc3-87f9-4320-84d2-4c6d4f2adf34 2 2024-09-12T03:34:16.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9aab0d640 1 Processor -- start 2024-09-12T03:34:16.261 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9aab0d640 1 -- start start 2024-09-12T03:34:16.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9aab0d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9a409ba00 0x7fc9a40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9aab0d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a40afd80 con 0x7fc9a409ac60 2024-09-12T03:34:16.264 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9aab0d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a40b0060 con 0x7fc9a409b040 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9aab0d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a40b0340 con 0x7fc9a409ba00 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9a3fff640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc9a409b040 0x7fc9a415d010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41128/0 (socket says 172.21.15.150:41128) 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9a3fff640 1 -- 172.21.15.150:0/3448436388 learned_addr learned my addr 172.21.15.150:0/3448436388 (peer_addr_for_me v1:172.21.15.150:0/0) 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9a90aa640 1 --2- 172.21.15.150:0/3448436388 >> v2:172.21.15.73:3300/0 conn(0x7fc9a409ba00 0x7fc9a40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648454923 0 0) 0x7fc9a40b0060 con 0x7fc9a409b040 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.264+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc98c003530 con 0x7fc9a409b040 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4239411834 0 0) 0x7fc98c003530 con 0x7fc9a409b040 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 >> v2:172.21.15.73:3300/0 conn(0x7fc9a409ba00 msgr2=0x7fc9a40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 --2- 172.21.15.150:0/3448436388 >> v2:172.21.15.73:3300/0 conn(0x7fc9a409ba00 0x7fc9a40af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 >> v1:172.21.15.73:6789/0 conn(0x7fc9a409ac60 legacy=0x7fc9a40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.265 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a40b0620 con 0x7fc9a409b040 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fc998001680 con 0x7fc9a409b040 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 >> v1:172.21.15.150:6789/0 conn(0x7fc9a409b040 legacy=0x7fc9a415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0039c0 0x7fc98c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c004810 0x7fc98c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc98c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40b0340 con 0x7fc98c0039c0 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c00c170 con 0x7fc98c0051d0 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc98c00c370 con 0x7fc98c004810 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc98c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a3fff640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c004810 0x7fc98c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a88a9640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0039c0 0x7fc98c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.266 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 -- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c004810 msgr2=0x7fc98c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc98c004810 0x7fc98c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 -- 172.21.15.150:0/3448436388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0039c0 msgr2=0x7fc98c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0039c0 0x7fc98c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 -- 172.21.15.150:0/3448436388 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c003530 con 0x7fc98c0051d0 2024-09-12T03:34:16.267 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a88a9640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc98c0039c0 0x7fc98c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:16.270 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 -- 172.21.15.150:0/3448436388 reap_dead start 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a90aa640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc98c00b9d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009fc0 tx=0x7fc99c01ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99eb0e98466cab02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c009c10 con 0x7fc98c0051d0 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c003ba0 con 0x7fc98c0051d0 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9a37fe640 1 -- 172.21.15.150:0/3448436388 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0a58b0 con 0x7fc98c0051d0 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9aab0d640 1 -- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 msgr2=0x7fc98c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9aab0d640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc98c00b9d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009fc0 tx=0x7fc99c01ccc0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9aab0d640 1 -- 172.21.15.150:0/3448436388 shutdown_connections 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9aab0d640 1 --2- 172.21.15.150:0/3448436388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc98c00b9d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9aab0d640 1 -- 172.21.15.150:0/3448436388 >> 172.21.15.150:0/3448436388 conn(0x7fc9a40b78d0 msgr2=0x7fc9a40b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9aab0d640 1 -- 172.21.15.150:0/3448436388 shutdown_connections 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.268+0000 7fc9aab0d640 1 -- 172.21.15.150:0/3448436388 wait complete. 2024-09-12T03:34:16.271 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 Processor -- start 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 -- start start 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc9a4157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9a414eed0 0x7fc9a415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9a415e1b0 0x7fc9a4150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40af730 con 0x7fc9a414eed0 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40b25d0 con 0x7fc98c0051d0 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a40af8b0 con 0x7fc9a415e1b0 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc9a4157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc9a4157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54954/0 (socket says 172.21.15.150:54954) 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 -- 172.21.15.150:0/1529347823 learned_addr learned my addr 172.21.15.150:0/1529347823 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.272 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a90aa640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9a415e1b0 0x7fc9a4150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a3fff640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9a414eed0 0x7fc9a415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 -- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9a415e1b0 msgr2=0x7fc9a4150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9a415e1b0 0x7fc9a4150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 -- 172.21.15.150:0/1529347823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9a414eed0 msgr2=0x7fc9a415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9a414eed0 0x7fc9a415dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 -- 172.21.15.150:0/1529347823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a41582b0 con 0x7fc98c0051d0 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a3fff640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9a414eed0 0x7fc9a415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a88a9640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc9a4157d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc99400e410 tx=0x7fc99400e8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a17fa640 1 -- 172.21.15.150:0/1529347823 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994019070 con 0x7fc98c0051d0 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a17fa640 1 -- 172.21.15.150:0/1529347823 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9940052e0 con 0x7fc98c0051d0 2024-09-12T03:34:16.273 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a4156cd0 con 0x7fc98c0051d0 2024-09-12T03:34:16.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a17fa640 1 -- 172.21.15.150:0/1529347823 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994003820 con 0x7fc98c0051d0 2024-09-12T03:34:16.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a4157290 con 0x7fc98c0051d0 2024-09-12T03:34:16.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a17fa640 1 -- 172.21.15.150:0/1529347823 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc99401c070 con 0x7fc98c0051d0 2024-09-12T03:34:16.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9a17fa640 1 -- 172.21.15.150:0/1529347823 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc994014d50 con 0x7fc98c0051d0 2024-09-12T03:34:16.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.272+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a40b0e20 con 0x7fc98c0051d0 2024-09-12T03:34:16.274 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.276+0000 7fc9a17fa640 1 -- 172.21.15.150:0/1529347823 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc994014480 con 0x7fc98c0051d0 2024-09-12T03:34:16.343 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.344+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6627cbc3-87f9-4320-84d2-4c6d4f2adf34", "id": 2} v 0) -- 0x7fc9a406efe0 con 0x7fc98c0051d0 2024-09-12T03:34:16.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9a17fa640 1 -- 172.21.15.150:0/1529347823 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6627cbc3-87f9-4320-84d2-4c6d4f2adf34", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc994014a00 con 0x7fc98c0051d0 2024-09-12T03:34:16.350 INFO:teuthology.orchestra.run.smithi150.stdout:2 2024-09-12T03:34:16.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 msgr2=0x7fc9a4157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc9a4157d70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc99400e410 tx=0x7fc99400e8d0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 shutdown_connections 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9a414eed0 0x7fc9a415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc9a415e1b0 0x7fc9a4150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 --2- 172.21.15.150:0/1529347823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc98c0051d0 0x7fc9a4157d70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 >> 172.21.15.150:0/1529347823 conn(0x7fc9a40b78d0 msgr2=0x7fc9a40b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 shutdown_connections 2024-09-12T03:34:16.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.352+0000 7fc9aab0d640 1 -- 172.21.15.150:0/1529347823 wait complete. 2024-09-12T03:34:16.366 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new e679e61d-caf2-4250-b9bb-7df985b49c9f 3 2024-09-12T03:34:16.482 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.484+0000 7fcf09c7f640 1 Processor -- start 2024-09-12T03:34:16.483 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.484+0000 7fcf09c7f640 1 -- start start 2024-09-12T03:34:16.485 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf09c7f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcf0409ac60 0x7fcf0409ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf09c7f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf040af730 0x7fcf0415d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf09c7f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040afd80 con 0x7fcf0409b040 2024-09-12T03:34:16.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf09c7f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcf040afb60 con 0x7fcf0409ac60 2024-09-12T03:34:16.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf09c7f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fcf040b0060 con 0x7fcf040af730 2024-09-12T03:34:16.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf040af730 0x7fcf0415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.486 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf040af730 0x7fcf0415d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54960/0 (socket says 172.21.15.150:54960) 2024-09-12T03:34:16.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 -- 172.21.15.150:0/1797474084 learned_addr learned my addr 172.21.15.150:0/1797474084 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf037fe640 1 --2- 172.21.15.150:0/1797474084 >> v2:172.21.15.73:3300/0 conn(0x7fcf0409ac60 0x7fcf0409ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 -- 172.21.15.150:0/1797474084 >> v2:172.21.15.73:3300/0 conn(0x7fcf0409ac60 msgr2=0x7fcf0409ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:16.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 --2- 172.21.15.150:0/1797474084 >> v2:172.21.15.73:3300/0 conn(0x7fcf0409ac60 0x7fcf0409ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 -- 172.21.15.150:0/1797474084 >> v1:172.21.15.73:6789/0 conn(0x7fcf0409b040 legacy=0x7fcf040b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:16.487 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 -- 172.21.15.150:0/1797474084 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf040b0340 con 0x7fcf040af730 2024-09-12T03:34:16.488 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf037fe640 1 --2- 172.21.15.150:0/1797474084 >> v2:172.21.15.73:3300/0 conn(0x7fcf0409ac60 0x7fcf0409ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:16.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.488+0000 7fcf03fff640 1 --2- 172.21.15.150:0/1797474084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf0415d010 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf0409b500 tx=0x7fcefc01c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22dea05700678537 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf027fc640 1 -- 172.21.15.150:0/1797474084 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0a5710 con 0x7fcf040af730 2024-09-12T03:34:16.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf027fc640 1 -- 172.21.15.150:0/1797474084 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcefc0a58b0 con 0x7fcf040af730 2024-09-12T03:34:16.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf027fc640 1 -- 172.21.15.150:0/1797474084 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc0a5c80 con 0x7fcf040af730 2024-09-12T03:34:16.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- 172.21.15.150:0/1797474084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 msgr2=0x7fcf0415d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 --2- 172.21.15.150:0/1797474084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf0415d010 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcf0409b500 tx=0x7fcefc01c960 comp rx=0 tx=0).stop 2024-09-12T03:34:16.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- 172.21.15.150:0/1797474084 shutdown_connections 2024-09-12T03:34:16.494 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 --2- 172.21.15.150:0/1797474084 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf0415d010 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 --2- 172.21.15.150:0/1797474084 >> v2:172.21.15.73:3300/0 conn(0x7fcf0409ac60 0x7fcf0409ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- 172.21.15.150:0/1797474084 >> 172.21.15.150:0/1797474084 conn(0x7fcf040b78d0 msgr2=0x7fcf040b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- 172.21.15.150:0/1797474084 shutdown_connections 2024-09-12T03:34:16.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- 172.21.15.150:0/1797474084 wait complete. 2024-09-12T03:34:16.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 Processor -- start 2024-09-12T03:34:16.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- start start 2024-09-12T03:34:16.495 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf0409ac60 0x7fcf04158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf0409b040 0x7fcf0413dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf04154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040b23c0 con 0x7fcf0409b040 2024-09-12T03:34:16.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0415d550 con 0x7fcf040af730 2024-09-12T03:34:16.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040b2540 con 0x7fcf0409ac60 2024-09-12T03:34:16.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf03fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf04154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf0409ac60 0x7fcf04158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf03fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf04154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54972/0 (socket says 172.21.15.150:54972) 2024-09-12T03:34:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf0409ac60 0x7fcf04158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:59518/0 (socket says 172.21.15.150:59518) 2024-09-12T03:34:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf03fff640 1 -- 172.21.15.150:0/2290041511 learned_addr learned my addr 172.21.15.150:0/2290041511 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf02ffd640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf0409b040 0x7fcf0413dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.497 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 -- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 msgr2=0x7fcf04154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf04154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 -- 172.21.15.150:0/2290041511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf0409b040 msgr2=0x7fcf0413dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf0409b040 0x7fcf0413dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 -- 172.21.15.150:0/2290041511 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf04154030 con 0x7fcf0409ac60 2024-09-12T03:34:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf02ffd640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf0409b040 0x7fcf0413dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf03fff640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf04154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:16.498 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf037fe640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf0409ac60 0x7fcf04158b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcef800e630 tx=0x7fcef800eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fceebfff640 1 -- 172.21.15.150:0/2290041511 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8017070 con 0x7fcf0409ac60 2024-09-12T03:34:16.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fceebfff640 1 -- 172.21.15.150:0/2290041511 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef800c620 con 0x7fcf0409ac60 2024-09-12T03:34:16.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.492+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf04151ef0 con 0x7fcf0409ac60 2024-09-12T03:34:16.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.496+0000 7fceebfff640 1 -- 172.21.15.150:0/2290041511 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef800f040 con 0x7fcf0409ac60 2024-09-12T03:34:16.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.496+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf041524b0 con 0x7fcf0409ac60 2024-09-12T03:34:16.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.496+0000 7fceebfff640 1 -- 172.21.15.150:0/2290041511 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcef801a070 con 0x7fcf0409ac60 2024-09-12T03:34:16.499 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.496+0000 7fceebfff640 1 -- 172.21.15.150:0/2290041511 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fcef801cc20 con 0x7fcf0409ac60 2024-09-12T03:34:16.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.496+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf040b31f0 con 0x7fcf0409ac60 2024-09-12T03:34:16.500 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.496+0000 7fceebfff640 1 -- 172.21.15.150:0/2290041511 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcef800cbf0 con 0x7fcf0409ac60 2024-09-12T03:34:16.563 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.564+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e679e61d-caf2-4250-b9bb-7df985b49c9f", "id": 3} v 0) -- 0x7fcf040b2f10 con 0x7fcf0409ac60 2024-09-12T03:34:16.570 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.572+0000 7fceebfff640 1 -- 172.21.15.150:0/2290041511 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e679e61d-caf2-4250-b9bb-7df985b49c9f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fcef801c450 con 0x7fcf0409ac60 2024-09-12T03:34:16.571 INFO:teuthology.orchestra.run.smithi150.stdout:3 2024-09-12T03:34:16.572 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf0409ac60 msgr2=0x7fcf04158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf0409ac60 0x7fcf04158b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcef800e630 tx=0x7fcef800eaf0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 shutdown_connections 2024-09-12T03:34:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf0409b040 0x7fcf0413dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf040af730 0x7fcf04154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 --2- 172.21.15.150:0/2290041511 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf0409ac60 0x7fcf04158b50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 >> 172.21.15.150:0/2290041511 conn(0x7fcf040b78d0 msgr2=0x7fcf04074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.573 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 shutdown_connections 2024-09-12T03:34:16.574 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.576+0000 7fcf09c7f640 1 -- 172.21.15.150:0/2290041511 wait complete. 2024-09-12T03:34:16.574 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.575+0000 7fbc9b98a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T03:34:16.588 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 8e02f987-c7f5-4f86-b278-4588336953aa 4 2024-09-12T03:34:16.628 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.627+0000 7fbc9b98a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T03:34:16.680 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.679+0000 7fbc9b98a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T03:34:16.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa81aaa5640 1 Processor -- start 2024-09-12T03:34:16.697 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa81aaa5640 1 -- start start 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa81aaa5640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa81409ac60 0x7fa81409ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa81aaa5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa8140af730 0x7fa81415d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa81aaa5640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140afd80 con 0x7fa81409b040 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa81aaa5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa8140afb60 con 0x7fa8140af730 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa81aaa5640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa8140b0060 con 0x7fa81409ac60 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa818841640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa81409ac60 0x7fa81409ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa818841640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa81409ac60 0x7fa81409ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54978/0 (socket says 172.21.15.150:54978) 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa818841640 1 -- 172.21.15.150:0/2638763216 learned_addr learned my addr 172.21.15.150:0/2638763216 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa813fff640 1 --1- 172.21.15.150:0/2638763216 >> v1:172.21.15.150:6789/0 conn(0x7fa81409b040 0x7fa8140b0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41134/0 (socket says 172.21.15.150:41134) 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa819042640 1 --2- 172.21.15.150:0/2638763216 >> v2:172.21.15.73:3300/0 conn(0x7fa8140af730 0x7fa81415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa818841640 1 -- 172.21.15.150:0/2638763216 >> v2:172.21.15.73:3300/0 conn(0x7fa8140af730 msgr2=0x7fa81415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:16.699 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa818841640 1 --2- 172.21.15.150:0/2638763216 >> v2:172.21.15.73:3300/0 conn(0x7fa8140af730 0x7fa81415d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa818841640 1 -- 172.21.15.150:0/2638763216 >> v1:172.21.15.150:6789/0 conn(0x7fa81409b040 legacy=0x7fa8140b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.700+0000 7fa818841640 1 -- 172.21.15.150:0/2638763216 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8140b0340 con 0x7fa81409ac60 2024-09-12T03:34:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa818841640 1 --2- 172.21.15.150:0/2638763216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409ac60 0x7fa81409ba00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8140b7d70 tx=0x7fa80401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528e0f0a8ec413d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.700 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa8137fe640 1 -- 172.21.15.150:0/2638763216 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8040b2070 con 0x7fa81409ac60 2024-09-12T03:34:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa8137fe640 1 -- 172.21.15.150:0/2638763216 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8040ad680 con 0x7fa81409ac60 2024-09-12T03:34:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa8137fe640 1 -- 172.21.15.150:0/2638763216 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8040ada50 con 0x7fa81409ac60 2024-09-12T03:34:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 -- 172.21.15.150:0/2638763216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409ac60 msgr2=0x7fa81409ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.701 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 --2- 172.21.15.150:0/2638763216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409ac60 0x7fa81409ba00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa8140b7d70 tx=0x7fa80401c490 comp rx=0 tx=0).stop 2024-09-12T03:34:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 -- 172.21.15.150:0/2638763216 shutdown_connections 2024-09-12T03:34:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 --2- 172.21.15.150:0/2638763216 >> v2:172.21.15.73:3300/0 conn(0x7fa8140af730 0x7fa81415d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 --2- 172.21.15.150:0/2638763216 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409ac60 0x7fa81409ba00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 -- 172.21.15.150:0/2638763216 >> 172.21.15.150:0/2638763216 conn(0x7fa8140b78d0 msgr2=0x7fa8140b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 -- 172.21.15.150:0/2638763216 shutdown_connections 2024-09-12T03:34:16.702 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.704+0000 7fa81aaa5640 1 -- 172.21.15.150:0/2638763216 wait complete. 2024-09-12T03:34:16.702 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:16.704+0000 7f4e8bbb6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T03:34:16.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 Processor -- start 2024-09-12T03:34:16.703 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 -- start start 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81409ac60 0x7fa814147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409b040 0x7fa814147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8140af730 0x7fa814148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8140b23c0 con 0x7fa8140af730 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa81415d550 con 0x7fa81409b040 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa8140b2540 con 0x7fa81409ac60 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa813fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409b040 0x7fa814147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.705 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81409ac60 0x7fa814147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa813fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409b040 0x7fa814147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54990/0 (socket says 172.21.15.150:54990) 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81409ac60 0x7fa814147a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:59524/0 (socket says 172.21.15.150:59524) 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa813fff640 1 -- 172.21.15.150:0/1048938657 learned_addr learned my addr 172.21.15.150:0/1048938657 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa819042640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8140af730 0x7fa814148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 -- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409b040 msgr2=0x7fa814147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409b040 0x7fa814147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 -- 172.21.15.150:0/1048938657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8140af730 msgr2=0x7fa814148490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8140af730 0x7fa814148490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 -- 172.21.15.150:0/1048938657 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81414c250 con 0x7fa81409ac60 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa813fff640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409b040 0x7fa814147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa818841640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81409ac60 0x7fa814147a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa8040ac000 tx=0x7fa80401acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa8117fa640 1 -- 172.21.15.150:0/1048938657 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8040b2040 con 0x7fa81409ac60 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa8117fa640 1 -- 172.21.15.150:0/1048938657 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8040bd070 con 0x7fa81409ac60 2024-09-12T03:34:16.706 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa8117fa640 1 -- 172.21.15.150:0/1048938657 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8040b8450 con 0x7fa81409ac60 2024-09-12T03:34:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa81414c530 con 0x7fa81409ac60 2024-09-12T03:34:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa81414caf0 con 0x7fa81409ac60 2024-09-12T03:34:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa8117fa640 1 -- 172.21.15.150:0/1048938657 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa8040b85f0 con 0x7fa81409ac60 2024-09-12T03:34:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa8117fa640 1 -- 172.21.15.150:0/1048938657 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa8040c2a60 con 0x7fa81409ac60 2024-09-12T03:34:16.707 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.708+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81414d1b0 con 0x7fa81409ac60 2024-09-12T03:34:16.708 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.712+0000 7fa8117fa640 1 -- 172.21.15.150:0/1048938657 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa81414d1b0 con 0x7fa81409ac60 2024-09-12T03:34:16.757 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.755+0000 7fbc9b98a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T03:34:16.758 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:16.760+0000 7f4e8bbb6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T03:34:16.777 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.780+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e02f987-c7f5-4f86-b278-4588336953aa", "id": 4} v 0) -- 0x7fa8140b3f30 con 0x7fa81409ac60 2024-09-12T03:34:16.783 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa8117fa640 1 -- 172.21.15.150:0/1048938657 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e02f987-c7f5-4f86-b278-4588336953aa", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fa804016110 con 0x7fa81409ac60 2024-09-12T03:34:16.784 INFO:teuthology.orchestra.run.smithi150.stdout:4 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81409ac60 msgr2=0x7fa814147a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81409ac60 0x7fa814147a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa8040ac000 tx=0x7fa80401acd0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 shutdown_connections 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8140af730 0x7fa814148490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa81409b040 0x7fa814147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 --2- 172.21.15.150:0/1048938657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa81409ac60 0x7fa814147a10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 >> 172.21.15.150:0/1048938657 conn(0x7fa8140b78d0 msgr2=0x7fa81415eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 shutdown_connections 2024-09-12T03:34:16.785 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.788+0000 7fa81aaa5640 1 -- 172.21.15.150:0/1048938657 wait complete. 2024-09-12T03:34:16.800 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 0d11e705-899d-426f-91f2-b2a8d1900c20 5 2024-09-12T03:34:16.809 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.811+0000 7fbc9b98a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T03:34:16.814 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:16.816+0000 7f4e8bbb6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T03:34:16.885 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.887+0000 7fbc9b98a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T03:34:16.896 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:16.900+0000 7f4e8bbb6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T03:34:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.912+0000 7f356f595640 1 Processor -- start 2024-09-12T03:34:16.910 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.912+0000 7f356f595640 1 -- start start 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356f595640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3568160900 0x7f356815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356f595640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35680d0d70 con 0x7f3568160520 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356f595640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f356815d390 con 0x7f3568071e60 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356f595640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f35680d1640 con 0x7f3568160900 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356cb30640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3568160900 0x7f356815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356cb30640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3568160900 0x7f356815c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:54996/0 (socket says 172.21.15.150:54996) 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356cb30640 1 -- 172.21.15.150:0/2112443937 learned_addr learned my addr 172.21.15.150:0/2112443937 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356cb30640 1 -- 172.21.15.150:0/2112443937 >> v1:172.21.15.150:6789/0 conn(0x7f3568071e60 legacy=0x7f356815cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.912 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356cb30640 1 -- 172.21.15.150:0/2112443937 >> v1:172.21.15.73:6789/0 conn(0x7f3568160520 legacy=0x7f3568071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.913 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356cb30640 1 -- 172.21.15.150:0/2112443937 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35680d0ff0 con 0x7f3568160900 2024-09-12T03:34:16.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f356cb30640 1 --2- 172.21.15.150:0/2112443937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f356815c5f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f355801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88b4a97cf6f64ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.914 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f355ffff640 1 -- 172.21.15.150:0/2112443937 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580b1070 con 0x7f3568160900 2024-09-12T03:34:16.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f355ffff640 1 -- 172.21.15.150:0/2112443937 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35580a8050 con 0x7f3568160900 2024-09-12T03:34:16.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.916+0000 7f355ffff640 1 -- 172.21.15.150:0/2112443937 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580ac860 con 0x7f3568160900 2024-09-12T03:34:16.915 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- 172.21.15.150:0/2112443937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 msgr2=0x7f356815c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 --2- 172.21.15.150:0/2112443937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f356815c5f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3558009870 tx=0x7f355801c4d0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- 172.21.15.150:0/2112443937 shutdown_connections 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 --2- 172.21.15.150:0/2112443937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f356815c5f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- 172.21.15.150:0/2112443937 >> 172.21.15.150:0/2112443937 conn(0x7f356806c0c0 msgr2=0x7f356806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- 172.21.15.150:0/2112443937 shutdown_connections 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- 172.21.15.150:0/2112443937 wait complete. 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 Processor -- start 2024-09-12T03:34:16.916 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- start start 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3568071e60 0x7f3568165b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3568160520 0x7f356813ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f3568156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3568142320 con 0x7f3568071e60 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f35681421a0 con 0x7f3568160900 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f35681424a0 con 0x7f3568160520 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f3568156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.919 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356cb30640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3568160520 0x7f356813ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f3568156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55002/0 (socket says 172.21.15.150:55002) 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 -- 172.21.15.150:0/2843635430 learned_addr learned my addr 172.21.15.150:0/2843635430 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356d331640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3568071e60 0x7f3568165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 -- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3568160520 msgr2=0x7f356813ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3568160520 0x7f356813ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 -- 172.21.15.150:0/2843635430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3568071e60 msgr2=0x7f3568165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3568071e60 0x7f3568165b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 -- 172.21.15.150:0/2843635430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3568166760 con 0x7f3568160900 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356cb30640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3568160520 0x7f356813ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356db32640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f3568156cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f356000c730 tx=0x7f356000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f355dffb640 1 -- 172.21.15.150:0/2843635430 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560003b80 con 0x7f3568160900 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f355dffb640 1 -- 172.21.15.150:0/2843635430 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3560003d20 con 0x7f3568160900 2024-09-12T03:34:16.920 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3568166a40 con 0x7f3568160900 2024-09-12T03:34:16.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f355dffb640 1 -- 172.21.15.150:0/2843635430 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3560005310 con 0x7f3568160900 2024-09-12T03:34:16.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3568165650 con 0x7f3568160900 2024-09-12T03:34:16.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f355dffb640 1 -- 172.21.15.150:0/2843635430 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35600056c0 con 0x7f3568160900 2024-09-12T03:34:16.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.920+0000 7f355dffb640 1 -- 172.21.15.150:0/2843635430 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f3560012c70 con 0x7f3568160900 2024-09-12T03:34:16.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.924+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3568071750 con 0x7f3568160900 2024-09-12T03:34:16.921 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.924+0000 7f355dffb640 1 -- 172.21.15.150:0/2843635430 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f35600126f0 con 0x7f3568160900 2024-09-12T03:34:16.938 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:16.939+0000 7fbc9b98a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T03:34:16.951 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:16.956+0000 7f4e8bbb6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T03:34:16.990 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:16.992+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0d11e705-899d-426f-91f2-b2a8d1900c20", "id": 5} v 0) -- 0x7f356815cff0 con 0x7f3568160900 2024-09-12T03:34:16.996 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f355dffb640 1 -- 172.21.15.150:0/2843635430 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d11e705-899d-426f-91f2-b2a8d1900c20", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f35600128d0 con 0x7f3568160900 2024-09-12T03:34:16.997 INFO:teuthology.orchestra.run.smithi150.stdout:5 2024-09-12T03:34:16.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 msgr2=0x7f3568156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:16.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f3568156cb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f356000c730 tx=0x7f356000cbf0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 shutdown_connections 2024-09-12T03:34:16.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3568160900 0x7f3568156cb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.998 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3568160520 0x7f356813ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 --2- 172.21.15.150:0/2843635430 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3568071e60 0x7f3568165b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:16.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 >> 172.21.15.150:0/2843635430 conn(0x7f356806c0c0 msgr2=0x7f3568141060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:16.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 shutdown_connections 2024-09-12T03:34:16.999 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.000+0000 7f356f595640 1 -- 172.21.15.150:0/2843635430 wait complete. 2024-09-12T03:34:17.014 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 1e797bfd-8a8c-4732-ae90-a807e7da2bd7 6 2024-09-12T03:34:17.032 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:17.036+0000 7f4e8bbb6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T03:34:17.087 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:17.092+0000 7f4e8bbb6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T03:34:17.089 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:17.087+0000 7fbc9b98a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T03:34:17.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 Processor -- start 2024-09-12T03:34:17.147 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 -- start start 2024-09-12T03:34:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8174147c90 0x7f81740b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f817406f9b0 0x7f81740b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817406bcc0 0x7f817406c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f817406c670 con 0x7f817406f9b0 2024-09-12T03:34:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8174148070 con 0x7f8174147c90 2024-09-12T03:34:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817c5f5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f81740b45d0 con 0x7f817406bcc0 2024-09-12T03:34:17.149 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8174147c90 0x7f81740b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8174147c90 0x7f81740b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55016/0 (socket says 172.21.15.150:55016) 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 -- 172.21.15.150:0/3948276085 learned_addr learned my addr 172.21.15.150:0/3948276085 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817ab92640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817406bcc0 0x7f817406c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f8179b90640 1 --2- 172.21.15.150:0/3948276085 >> v2:172.21.15.73:3300/0 conn(0x7f817406f9b0 0x7f81740b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 -- 172.21.15.150:0/3948276085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817406bcc0 msgr2=0x7f817406c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 --2- 172.21.15.150:0/3948276085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817406bcc0 0x7f817406c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 -- 172.21.15.150:0/3948276085 >> v2:172.21.15.73:3300/0 conn(0x7f817406f9b0 msgr2=0x7f81740b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 --2- 172.21.15.150:0/3948276085 >> v2:172.21.15.73:3300/0 conn(0x7f817406f9b0 0x7f81740b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.150 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 -- 172.21.15.150:0/3948276085 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8174070830 con 0x7f8174147c90 2024-09-12T03:34:17.151 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:17.151+0000 7fbc9b98a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T03:34:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817a391640 1 --2- 172.21.15.150:0/3948276085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8174147c90 0x7f81740b5fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81740711f0 tx=0x7f817001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=890d1512cf92e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817938f640 1 -- 172.21.15.150:0/3948276085 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81700b0070 con 0x7f8174147c90 2024-09-12T03:34:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817938f640 1 -- 172.21.15.150:0/3948276085 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81700ab600 con 0x7f8174147c90 2024-09-12T03:34:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.152+0000 7f817938f640 1 -- 172.21.15.150:0/3948276085 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81700ab9d0 con 0x7f8174147c90 2024-09-12T03:34:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- 172.21.15.150:0/3948276085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8174147c90 msgr2=0x7f81740b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.152 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3948276085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8174147c90 0x7f81740b5fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81740711f0 tx=0x7f817001c490 comp rx=0 tx=0).stop 2024-09-12T03:34:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- 172.21.15.150:0/3948276085 shutdown_connections 2024-09-12T03:34:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3948276085 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f817406bcc0 0x7f817406c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3948276085 >> v2:172.21.15.73:3300/0 conn(0x7f817406f9b0 0x7f81740b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3948276085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8174147c90 0x7f81740b5fd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- 172.21.15.150:0/3948276085 >> 172.21.15.150:0/3948276085 conn(0x7f817409aa00 msgr2=0x7f81740b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- 172.21.15.150:0/3948276085 shutdown_connections 2024-09-12T03:34:17.153 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- 172.21.15.150:0/3948276085 wait complete. 2024-09-12T03:34:17.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 Processor -- start 2024-09-12T03:34:17.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- start start 2024-09-12T03:34:17.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817406bcc0 0x7f817415c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.155 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f817406f9b0 0x7f817413c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8174147c90 0x7f81740b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f81740aea00 con 0x7f817406f9b0 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f81740ae880 con 0x7f817406bcc0 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f81740aeb80 con 0x7f8174147c90 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817a391640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817406bcc0 0x7f817415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817ab92640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8174147c90 0x7f81740b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817a391640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817406bcc0 0x7f817415c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55026/0 (socket says 172.21.15.150:55026) 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817a391640 1 -- 172.21.15.150:0/3765099447 learned_addr learned my addr 172.21.15.150:0/3765099447 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f8179b90640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f817406f9b0 0x7f817413c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817ab92640 1 -- 172.21.15.150:0/3765099447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817406bcc0 msgr2=0x7f817415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817ab92640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817406bcc0 0x7f817415c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.156 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817ab92640 1 -- 172.21.15.150:0/3765099447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f817406f9b0 msgr2=0x7f817413c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817ab92640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f817406f9b0 0x7f817413c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817ab92640 1 -- 172.21.15.150:0/3765099447 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81740b3c60 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817ab92640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8174147c90 0x7f81740b1b20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f816c00ef00 tx=0x7f816c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f816affd640 1 -- 172.21.15.150:0/3765099447 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c018020 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f816affd640 1 -- 172.21.15.150:0/3765099447 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f816c014400 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81740b2570 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f816affd640 1 -- 172.21.15.150:0/3765099447 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c009e60 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8174160550 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f816affd640 1 -- 172.21.15.150:0/3765099447 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f816c01b020 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.156+0000 7f816affd640 1 -- 172.21.15.150:0/3765099447 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f816c01da30 con 0x7f8174147c90 2024-09-12T03:34:17.157 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.160+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817406c130 con 0x7f8174147c90 2024-09-12T03:34:17.158 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.160+0000 7f816affd640 1 -- 172.21.15.150:0/3765099447 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f816c022030 con 0x7f8174147c90 2024-09-12T03:34:17.222 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.224+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1e797bfd-8a8c-4732-ae90-a807e7da2bd7", "id": 6} v 0) -- 0x7f8174146c00 con 0x7f8174147c90 2024-09-12T03:34:17.233 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f816affd640 1 -- 172.21.15.150:0/3765099447 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e797bfd-8a8c-4732-ae90-a807e7da2bd7", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f816c01d590 con 0x7f8174147c90 2024-09-12T03:34:17.233 INFO:teuthology.orchestra.run.smithi150.stdout:6 2024-09-12T03:34:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8174147c90 msgr2=0x7f81740b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8174147c90 0x7f81740b1b20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f816c00ef00 tx=0x7f816c00b480 comp rx=0 tx=0).stop 2024-09-12T03:34:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 shutdown_connections 2024-09-12T03:34:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f817406f9b0 0x7f817413c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8174147c90 0x7f81740b1b20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f817c5f5640 1 --2- 172.21.15.150:0/3765099447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f817406bcc0 0x7f817415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.235 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.236+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 >> 172.21.15.150:0/3765099447 conn(0x7f817409aa00 msgr2=0x7f81740afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:17.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.240+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 shutdown_connections 2024-09-12T03:34:17.236 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.240+0000 7f817c5f5640 1 -- 172.21.15.150:0/3765099447 wait complete. 2024-09-12T03:34:17.255 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --cluster ceph osd new 28d562a5-358c-4df8-8a9a-af42ab17731a 7 2024-09-12T03:34:17.258 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:17.256+0000 7f4e8bbb6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T03:34:17.318 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:17.320+0000 7f4e8bbb6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T03:34:17.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.376+0000 7f86e2fba640 1 Processor -- start 2024-09-12T03:34:17.374 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.376+0000 7f86e2fba640 1 -- start start 2024-09-12T03:34:17.375 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86e2fba640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86dc06bcc0 0x7f86dc06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86e2fba640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86dc0d1050 0x7f86dc0d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86e2fba640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86dc0d1d80 con 0x7f86dc145d90 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86e2fba640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f86dc06c670 con 0x7f86dc0d1050 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86e2fba640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f86dc0afa20 con 0x7f86dc06bcc0 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86dc06bcc0 0x7f86dc06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86dc06bcc0 0x7f86dc06c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55034/0 (socket says 172.21.15.150:55034) 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86e0d56640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f86dc145d90 0x7f86dc0b0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.150:41146/0 (socket says 172.21.15.150:41146) 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 -- 172.21.15.150:0/3493179718 learned_addr learned my addr 172.21.15.150:0/3493179718 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 -- 172.21.15.150:0/3493179718 >> v2:172.21.15.73:3300/0 conn(0x7f86dc0d1050 msgr2=0x7f86dc0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 --2- 172.21.15.150:0/3493179718 >> v2:172.21.15.73:3300/0 conn(0x7f86dc0d1050 0x7f86dc0d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.376 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 -- 172.21.15.150:0/3493179718 >> v1:172.21.15.150:6789/0 conn(0x7f86dc145d90 legacy=0x7f86dc0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 -- 172.21.15.150:0/3493179718 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc0afd00 con 0x7f86dc06bcc0 2024-09-12T03:34:17.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86dbfff640 1 --2- 172.21.15.150:0/3493179718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc06bcc0 0x7f86dc06c130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0af1a0 tx=0x7f86c401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4a75ad3dbe8cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:17.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86db7fe640 1 -- 172.21.15.150:0/3493179718 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c40b1070 con 0x7f86dc06bcc0 2024-09-12T03:34:17.378 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86db7fe640 1 -- 172.21.15.150:0/3493179718 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c40ac630 con 0x7f86dc06bcc0 2024-09-12T03:34:17.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.380+0000 7f86db7fe640 1 -- 172.21.15.150:0/3493179718 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c40a8050 con 0x7f86dc06bcc0 2024-09-12T03:34:17.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- 172.21.15.150:0/3493179718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc06bcc0 msgr2=0x7f86dc06c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 --2- 172.21.15.150:0/3493179718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc06bcc0 0x7f86dc06c130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0af1a0 tx=0x7f86c401c520 comp rx=0 tx=0).stop 2024-09-12T03:34:17.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- 172.21.15.150:0/3493179718 shutdown_connections 2024-09-12T03:34:17.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 --2- 172.21.15.150:0/3493179718 >> v2:172.21.15.73:3300/0 conn(0x7f86dc0d1050 0x7f86dc0d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 --2- 172.21.15.150:0/3493179718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc06bcc0 0x7f86dc06c130 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- 172.21.15.150:0/3493179718 >> 172.21.15.150:0/3493179718 conn(0x7f86dc09aa00 msgr2=0x7f86dc0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:17.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- 172.21.15.150:0/3493179718 shutdown_connections 2024-09-12T03:34:17.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- 172.21.15.150:0/3493179718 wait complete. 2024-09-12T03:34:17.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 Processor -- start 2024-09-12T03:34:17.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- start start 2024-09-12T03:34:17.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc06bcc0 0x7f86dc141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86dc0d1050 0x7f86dc159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc145d90 0x7f86dc142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc0b4a20 con 0x7f86dc06bcc0 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f86dc0b48a0 con 0x7f86dc145d90 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f86dc0b4ba0 con 0x7f86dc0d1050 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86dc0d1050 0x7f86dc159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc145d90 0x7f86dc142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86dbfff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86dc0d1050 0x7f86dc159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.150:59550/0 (socket says 172.21.15.150:59550) 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc145d90 0x7f86dc142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:55038/0 (socket says 172.21.15.150:55038) 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86dbfff640 1 -- 172.21.15.150:0/25794240 learned_addr learned my addr 172.21.15.150:0/25794240 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e0d56640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc06bcc0 0x7f86dc141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 -- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86dc0d1050 msgr2=0x7f86dc159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86dc0d1050 0x7f86dc159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 -- 172.21.15.150:0/25794240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc06bcc0 msgr2=0x7f86dc141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc06bcc0 0x7f86dc141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 -- 172.21.15.150:0/25794240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86dc142550 con 0x7f86dc145d90 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86dbfff640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86dc0d1050 0x7f86dc159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e1557640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc145d90 0x7f86dc142c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00be50 tx=0x7f86cc00bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86d97fa640 1 -- 172.21.15.150:0/25794240 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc019070 con 0x7f86dc145d90 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86d97fa640 1 -- 172.21.15.150:0/25794240 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc014440 con 0x7f86dc145d90 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86d97fa640 1 -- 172.21.15.150:0/25794240 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc014830 con 0x7f86dc145d90 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86dc142830 con 0x7f86dc145d90 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86dc141380 con 0x7f86dc145d90 2024-09-12T03:34:17.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86d97fa640 1 -- 172.21.15.150:0/25794240 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f86cc01c070 con 0x7f86dc145d90 2024-09-12T03:34:17.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.384+0000 7f86d97fa640 1 -- 172.21.15.150:0/25794240 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f86cc01da10 con 0x7f86dc145d90 2024-09-12T03:34:17.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.388+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86dc06c130 con 0x7f86dc145d90 2024-09-12T03:34:17.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.388+0000 7f86d97fa640 1 -- 172.21.15.150:0/25794240 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f86cc023020 con 0x7f86dc145d90 2024-09-12T03:34:17.460 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.464+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28d562a5-358c-4df8-8a9a-af42ab17731a", "id": 7} v 0) -- 0x7f86dc0b6aa0 con 0x7f86dc145d90 2024-09-12T03:34:17.471 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.472+0000 7f86d97fa640 1 -- 172.21.15.150:0/25794240 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28d562a5-358c-4df8-8a9a-af42ab17731a", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f86cc01dde0 con 0x7f86dc145d90 2024-09-12T03:34:17.471 INFO:teuthology.orchestra.run.smithi150.stdout:7 2024-09-12T03:34:17.472 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc145d90 msgr2=0x7f86dc142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc145d90 0x7f86dc142c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00be50 tx=0x7f86cc00bf40 comp rx=0 tx=0).stop 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 shutdown_connections 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86dc145d90 0x7f86dc142c90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86dc0d1050 0x7f86dc159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 --2- 172.21.15.150:0/25794240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86dc06bcc0 0x7f86dc141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 >> 172.21.15.150:0/25794240 conn(0x7f86dc09aa00 msgr2=0x7f86dc0cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 shutdown_connections 2024-09-12T03:34:17.473 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:34:17.476+0000 7f86e2fba640 1 -- 172.21.15.150:0/25794240 wait complete. 2024-09-12T03:34:17.487 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T03:34:17.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T03:34:17.490 INFO:tasks.ceph.osd.0:Started 2024-09-12T03:34:17.490 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T03:34:17.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T03:34:17.493 INFO:tasks.ceph.osd.1:Started 2024-09-12T03:34:17.493 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T03:34:17.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T03:34:17.496 INFO:tasks.ceph.osd.2:Started 2024-09-12T03:34:17.496 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T03:34:17.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T03:34:17.499 INFO:tasks.ceph.osd.3:Started 2024-09-12T03:34:17.499 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T03:34:17.499 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T03:34:17.502 INFO:tasks.ceph.osd.4:Started 2024-09-12T03:34:17.503 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T03:34:17.503 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T03:34:17.504 INFO:tasks.ceph.osd.5:Started 2024-09-12T03:34:17.505 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T03:34:17.505 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T03:34:17.506 INFO:tasks.ceph.osd.6:Started 2024-09-12T03:34:17.506 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T03:34:17.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T03:34:17.509 INFO:tasks.ceph.osd.7:Started 2024-09-12T03:34:17.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe67c2640 1 Processor -- start 2024-09-12T03:34:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe67c2640 1 -- start start 2024-09-12T03:34:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe67c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe009aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe67c2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbfe006c3d0 0x7fbfe015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe67c2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe00b5c90 con 0x7fbfe00b40c0 2024-09-12T03:34:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe67c2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe00b4860 con 0x7fbfe006c3d0 2024-09-12T03:34:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe67c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe00b4580 con 0x7fbfe015e450 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe4d5f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbfe006c3d0 0x7fbfe015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfdffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe009aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe4d5f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbfe006c3d0 0x7fbfe015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:57884/0 (socket says 172.21.15.73:57884) 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe4d5f640 1 -- 172.21.15.73:0/488584824 learned_addr learned my addr 172.21.15.73:0/488584824 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe4d5f640 1 -- 172.21.15.73:0/488584824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 msgr2=0x7fbfe009aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe4d5f640 1 --2- 172.21.15.73:0/488584824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe009aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe4d5f640 1 -- 172.21.15.73:0/488584824 >> v1:172.21.15.150:6789/0 conn(0x7fbfe00b40c0 legacy=0x7fbfe006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.663+0000 7fbfe4d5f640 1 -- 172.21.15.73:0/488584824 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe00b5f10 con 0x7fbfe006c3d0 2024-09-12T03:34:17.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe4d5f640 1 --2- 172.21.15.73:0/488584824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe015fc60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd801c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57732c3936ed956c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:17.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfdf7fe640 1 -- 172.21.15.73:0/488584824 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80a5770 con 0x7fbfe006c3d0 2024-09-12T03:34:17.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfdf7fe640 1 -- 172.21.15.73:0/488584824 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd80a5910 con 0x7fbfe006c3d0 2024-09-12T03:34:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfdf7fe640 1 -- 172.21.15.73:0/488584824 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80a5ce0 con 0x7fbfe006c3d0 2024-09-12T03:34:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 -- 172.21.15.73:0/488584824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 msgr2=0x7fbfe015fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 --2- 172.21.15.73:0/488584824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe015fc60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009e50 tx=0x7fbfd801c9a0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 -- 172.21.15.73:0/488584824 shutdown_connections 2024-09-12T03:34:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 --2- 172.21.15.73:0/488584824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe015fc60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 --2- 172.21.15.73:0/488584824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe009aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 -- 172.21.15.73:0/488584824 >> 172.21.15.73:0/488584824 conn(0x7fbfe00b6800 msgr2=0x7fbfe00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 -- 172.21.15.73:0/488584824 shutdown_connections 2024-09-12T03:34:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 -- 172.21.15.73:0/488584824 wait complete. 2024-09-12T03:34:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 Processor -- start 2024-09-12T03:34:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.667+0000 7fbfe67c2640 1 -- start start 2024-09-12T03:34:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfe00b40c0 0x7fbfe0151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe0151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0162d00 con 0x7fbfe00b40c0 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0162b80 con 0x7fbfe006c3d0 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe0162e80 con 0x7fbfe015e450 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfe00b40c0 0x7fbfe0151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfe00b40c0 0x7fbfe0151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46946/0 (socket says 172.21.15.73:46946) 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 -- 172.21.15.73:0/3821767333 learned_addr learned my addr 172.21.15.73:0/3821767333 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfdffff640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe4d5f640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe0151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 -- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 msgr2=0x7fbfe0151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe0151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 -- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 msgr2=0x7fbfe014c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe014c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 -- 172.21.15.73:0/3821767333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe0152e20 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfdffff640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe014c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfd7fff640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfe00b40c0 0x7fbfe0151000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c430 tx=0x7fbfc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfdd7fa640 1 -- 172.21.15.73:0/3821767333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8017070 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfdd7fa640 1 -- 172.21.15.73:0/3821767333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc80052d0 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe0153100 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfdd7fa640 1 -- 172.21.15.73:0/3821767333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8003840 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe01536c0 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfdd7fa640 1 -- 172.21.15.73:0/3821767333 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbfc801a070 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfdd7fa640 1 -- 172.21.15.73:0/3821767333 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbfc8011b30 con 0x7fbfe00b40c0 2024-09-12T03:34:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.671+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe015fc60 con 0x7fbfe00b40c0 2024-09-12T03:34:17.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.703+0000 7fbfdd7fa640 1 -- 172.21.15.73:0/3821767333 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbfc8021020 con 0x7fbfe00b40c0 2024-09-12T03:34:17.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.759+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfe006e7c0 con 0x7fbfe00b40c0 2024-09-12T03:34:17.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.759+0000 7fbfdd7fa640 1 -- 172.21.15.73:0/3821767333 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbfe00b5c90 con 0x7fbfe00b40c0 2024-09-12T03:34:17.761 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:17.761 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:17.464191+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfe00b40c0 msgr2=0x7fbfe0151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfe00b40c0 0x7fbfe0151000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c430 tx=0x7fbfc800c8f0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 shutdown_connections 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfe00b40c0 0x7fbfe0151000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfe015e450 0x7fbfe0151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 --2- 172.21.15.73:0/3821767333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfe006c3d0 0x7fbfe014c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 >> 172.21.15.73:0/3821767333 conn(0x7fbfe00b6800 msgr2=0x7fbfe0070590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:17.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 shutdown_connections 2024-09-12T03:34:17.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:17.763+0000 7fbfe67c2640 1 -- 172.21.15.73:0/3821767333 wait complete. 2024-09-12T03:34:17.777 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T03:34:17.777 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T03:34:17.837 INFO:tasks.ceph.mgr.y.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T03:34:17.837 INFO:tasks.ceph.mgr.y.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T03:34:17.838 INFO:tasks.ceph.mgr.y.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-09-12T03:34:17.898 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:17.899+0000 7fbc9b98a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T03:34:17.963 INFO:tasks.ceph.mgr.x.smithi150.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T03:34:17.963 INFO:tasks.ceph.mgr.x.smithi150.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T03:34:17.963 INFO:tasks.ceph.mgr.x.smithi150.stderr: from numpy import show_config as show_numpy_config 2024-09-12T03:34:18.002 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:18.004+0000 7f4e8bbb6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T03:34:18.079 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:18.079+0000 7fbc9b98a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T03:34:18.141 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:18.144+0000 7f4e8bbb6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T03:34:18.247 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:18.247+0000 7fbc9b98a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T03:34:18.305 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:18.307+0000 7f4e8bbb6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T03:34:18.316 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:18.315+0000 7fbc9b98a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T03:34:18.369 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:18.371+0000 7f4e8bbb6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T03:34:18.452 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:18.451+0000 7fbc9b98a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T03:34:18.504 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:18.507+0000 7f4e8bbb6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T03:34:18.584 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:18.627 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T03:34:18.627+0000 7f56ed3157c0 -1 Falling back to public interface 2024-09-12T03:34:18.641 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T03:34:18.643+0000 7f89c17487c0 -1 Falling back to public interface 2024-09-12T03:34:18.666 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T03:34:18.667+0000 7f10983dc7c0 -1 Falling back to public interface 2024-09-12T03:34:18.669 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T03:34:18.671+0000 7f28682c07c0 -1 Falling back to public interface 2024-09-12T03:34:18.695 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fe6d7640 1 Processor -- start 2024-09-12T03:34:18.696 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fe6d7640 1 -- start start 2024-09-12T03:34:18.697 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fe6d7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8f815c1b0 0x7fd8f80afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:18.697 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fe6d7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8f80cdde0 0x7fd8f815c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:18.697 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fe6d7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f8067cd0 con 0x7fd8f80cd9c0 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fe6d7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f80ce270 con 0x7fd8f815c1b0 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fe6d7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f80cd530 con 0x7fd8f80cdde0 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8f7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8f815c1b0 0x7fd8f80afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8f7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8f815c1b0 0x7fd8f80afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46960/0 (socket says 172.21.15.73:46960) 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8f7fff640 1 -- 172.21.15.73:0/2625893716 learned_addr learned my addr 172.21.15.73:0/2625893716 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8fcc74640 1 --2- 172.21.15.73:0/2625893716 >> v2:172.21.15.150:3300/0 conn(0x7fd8f80cdde0 0x7fd8f815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8f7fff640 1 -- 172.21.15.73:0/2625893716 >> v2:172.21.15.150:3300/0 conn(0x7fd8f80cdde0 msgr2=0x7fd8f815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8f7fff640 1 --2- 172.21.15.73:0/2625893716 >> v2:172.21.15.150:3300/0 conn(0x7fd8f80cdde0 0x7fd8f815c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.698 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8f7fff640 1 -- 172.21.15.73:0/2625893716 >> v1:172.21.15.150:6789/0 conn(0x7fd8f80cd9c0 legacy=0x7fd8f806e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:18.699 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.695+0000 7fd8f7fff640 1 -- 172.21.15.73:0/2625893716 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f8067fb0 con 0x7fd8f815c1b0 2024-09-12T03:34:18.700 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8f7fff640 1 --2- 172.21.15.73:0/2625893716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f815c1b0 0x7fd8f80afe10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8074460 tx=0x7fd8f001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df3d2424d15f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:18.700 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8f6ffd640 1 -- 172.21.15.73:0/2625893716 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00b0070 con 0x7fd8f815c1b0 2024-09-12T03:34:18.700 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8f6ffd640 1 -- 172.21.15.73:0/2625893716 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f00ab600 con 0x7fd8f815c1b0 2024-09-12T03:34:18.700 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8f6ffd640 1 -- 172.21.15.73:0/2625893716 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00ab9d0 con 0x7fd8f815c1b0 2024-09-12T03:34:18.700 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2625893716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f815c1b0 msgr2=0x7fd8f80afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:18.701 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 --2- 172.21.15.73:0/2625893716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f815c1b0 0x7fd8f80afe10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8074460 tx=0x7fd8f001c4e0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.701 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2625893716 shutdown_connections 2024-09-12T03:34:18.701 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 --2- 172.21.15.73:0/2625893716 >> v2:172.21.15.150:3300/0 conn(0x7fd8f80cdde0 0x7fd8f815c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.701 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 --2- 172.21.15.73:0/2625893716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f815c1b0 0x7fd8f80afe10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.701 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2625893716 >> 172.21.15.73:0/2625893716 conn(0x7fd8f80734e0 msgr2=0x7fd8f806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:18.701 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2625893716 shutdown_connections 2024-09-12T03:34:18.701 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2625893716 wait complete. 2024-09-12T03:34:18.705 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 Processor -- start 2024-09-12T03:34:18.705 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.699+0000 7fd8fe6d7640 1 -- start start 2024-09-12T03:34:18.705 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f80cd9c0 0x7fd8f8147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:18.705 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80cdde0 0x7fd8f81f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:18.705 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f815c1b0 0x7fd8f814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8169b80 con 0x7fd8f80cdde0 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8169a00 con 0x7fd8f815c1b0 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f8169d00 con 0x7fd8f80cd9c0 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80cdde0 0x7fd8f81f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80cdde0 0x7fd8f81f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46974/0 (socket says 172.21.15.73:46974) 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 -- 172.21.15.73:0/2230925900 learned_addr learned my addr 172.21.15.73:0/2230925900 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f7fff640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f80cd9c0 0x7fd8f8147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:18.706 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fcc74640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f815c1b0 0x7fd8f814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 -- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f80cd9c0 msgr2=0x7fd8f8147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f80cd9c0 0x7fd8f8147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 -- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f815c1b0 msgr2=0x7fd8f814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f815c1b0 0x7fd8f814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 -- 172.21.15.73:0/2230925900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f8148190 con 0x7fd8f80cdde0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fcc74640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f815c1b0 0x7fd8f814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f77fe640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80cdde0 0x7fd8f81f5d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c480 tx=0x7fd8ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f4ff9640 1 -- 172.21.15.73:0/2230925900 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec012830 con 0x7fd8f80cdde0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f4ff9640 1 -- 172.21.15.73:0/2230925900 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8ec017070 con 0x7fd8f80cdde0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f8148c40 con 0x7fd8f80cdde0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f4ff9640 1 -- 172.21.15.73:0/2230925900 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec012c30 con 0x7fd8f80cdde0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f8149200 con 0x7fd8f80cdde0 2024-09-12T03:34:18.707 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f4ff9640 1 -- 172.21.15.73:0/2230925900 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd8ec01c460 con 0x7fd8f80cdde0 2024-09-12T03:34:18.708 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8f4ff9640 1 -- 172.21.15.73:0/2230925900 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd8ec01be00 con 0x7fd8f80cdde0 2024-09-12T03:34:18.708 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.703+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f815c590 con 0x7fd8f80cdde0 2024-09-12T03:34:18.708 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.707+0000 7fd8f4ff9640 1 -- 172.21.15.73:0/2230925900 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd8ec012dd0 con 0x7fd8f80cdde0 2024-09-12T03:34:18.763 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.763+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8f806d450 con 0x7fd8f80cdde0 2024-09-12T03:34:18.764 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.763+0000 7fd8f4ff9640 1 -- 172.21.15.73:0/2230925900 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd8ec01b7e0 con 0x7fd8f80cdde0 2024-09-12T03:34:18.764 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T03:34:18.764 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:17.464191+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:18.765 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80cdde0 msgr2=0x7fd8f81f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:18.765 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80cdde0 0x7fd8f81f5d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c480 tx=0x7fd8ec00c940 comp rx=0 tx=0).stop 2024-09-12T03:34:18.765 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 shutdown_connections 2024-09-12T03:34:18.765 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80cdde0 0x7fd8f81f5d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.766 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f815c1b0 0x7fd8f814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.766 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 --2- 172.21.15.73:0/2230925900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f80cd9c0 0x7fd8f8147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:18.766 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 >> 172.21.15.73:0/2230925900 conn(0x7fd8f80734e0 msgr2=0x7fd8f80b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:18.766 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 shutdown_connections 2024-09-12T03:34:18.766 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:18.767+0000 7fd8fe6d7640 1 -- 172.21.15.73:0/2230925900 wait complete. 2024-09-12T03:34:18.779 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T03:34:18.901 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T03:34:18.903+0000 7f7b3248f7c0 -1 Falling back to public interface 2024-09-12T03:34:18.906 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T03:34:18.907+0000 7ffa503d67c0 -1 Falling back to public interface 2024-09-12T03:34:18.916 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T03:34:18.919+0000 7fced6d257c0 -1 Falling back to public interface 2024-09-12T03:34:19.068 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:19.067+0000 7fbc9b98a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T03:34:19.133 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:19.135+0000 7f4e8bbb6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T03:34:19.143 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:19.143+0000 7fbc9b98a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T03:34:19.170 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T03:34:19.171+0000 7ff9317917c0 -1 Falling back to public interface 2024-09-12T03:34:19.210 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:19.211+0000 7f4e8bbb6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T03:34:19.325 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:19.327+0000 7fbc9b98a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T03:34:19.393 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:19.395+0000 7f4e8bbb6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T03:34:19.398 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:19.399+0000 7fbc9b98a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T03:34:19.466 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:19.467+0000 7f4e8bbb6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T03:34:19.692 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:19.691+0000 7fbc9b98a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T03:34:19.750 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:19.751+0000 7fbc9b98a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T03:34:19.760 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:19.763+0000 7f4e8bbb6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T03:34:19.825 INFO:tasks.ceph.mgr.x.smithi150.stderr:2024-09-12T03:34:19.827+0000 7f4e8bbb6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T03:34:20.791 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:20.791+0000 7fbc424c0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T03:34:20.792 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-12T03:34:20.791+0000 7fbc424c0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T03:34:22.755 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T03:34:22.754+0000 7f89c17487c0 -1 osd.0 0 log_to_monitors true 2024-09-12T03:34:22.773 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T03:34:22.774+0000 7f28682c07c0 -1 osd.6 0 log_to_monitors true 2024-09-12T03:34:22.789 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T03:34:22.790+0000 7f10983dc7c0 -1 osd.3 0 log_to_monitors true 2024-09-12T03:34:22.852 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T03:34:22.850+0000 7f56ed3157c0 -1 osd.2 0 log_to_monitors true 2024-09-12T03:34:22.895 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T03:34:22.894+0000 7fced6d257c0 -1 osd.5 0 log_to_monitors true 2024-09-12T03:34:22.959 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T03:34:22.958+0000 7f7b3248f7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T03:34:23.272 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T03:34:23.270+0000 7ff9317917c0 -1 osd.1 0 log_to_monitors true 2024-09-12T03:34:23.390 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T03:34:23.390+0000 7ffa503d67c0 -1 osd.4 0 log_to_monitors true 2024-09-12T03:34:24.696 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T03:34:24.694+0000 7f89bd6f1640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T03:34:24.702 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T03:34:24.702+0000 7f2864269640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T03:34:24.718 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-12T03:34:24.718+0000 7f89b5526640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:24.729 INFO:tasks.ceph.osd.6.smithi150.stderr:2024-09-12T03:34:24.730+0000 7f285c09e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:25.587 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:25.712 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.710+0000 7f61898d4640 1 Processor -- start 2024-09-12T03:34:25.713 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.710+0000 7f61898d4640 1 -- start start 2024-09-12T03:34:25.715 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61898d4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f618415c480 0x7f61840cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.715 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61898d4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 0x7f618409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.715 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61898d4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618409b330 con 0x7f61840ccd20 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61898d4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f61840b1c40 con 0x7f618415c480 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61898d4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f61840d0a00 con 0x7f618409a9d0 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f61840ccd20 0x7f61840cd1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55942/0 (socket says 172.21.15.73:55942) 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 -- 172.21.15.73:0/3637037816 learned_addr learned my addr 172.21.15.73:0/3637037816 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6182ffd640 1 --2- 172.21.15.73:0/3637037816 >> v2:172.21.15.150:3300/0 conn(0x7f618415c480 0x7f61840cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968694883 0 0) 0x7f618409b330 con 0x7f61840ccd20 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61827fc640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 0x7f618409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f616c003530 con 0x7f61840ccd20 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 470893845 0 0) 0x7f616c003530 con 0x7f61840ccd20 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 msgr2=0x7f618409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 0x7f618409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.716 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 >> v2:172.21.15.150:3300/0 conn(0x7f618415c480 msgr2=0x7f61840cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 --2- 172.21.15.73:0/3637037816 >> v2:172.21.15.150:3300/0 conn(0x7f618415c480 0x7f61840cfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61840d0ce0 con 0x7f61840ccd20 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f617c001a00 con 0x7f61840ccd20 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 >> v1:172.21.15.73:6789/0 conn(0x7f61840ccd20 legacy=0x7f61840cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f616c0039c0 0x7f616c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 0x7f616c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f616c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b1c40 con 0x7f616c004d50 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61840d0a00 con 0x7f616c0039c0 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f616c00b9d0 con 0x7f618409a9d0 2024-09-12T03:34:25.717 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f616c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.718 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f6182ffd640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f616c0039c0 0x7f616c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.718 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61827fc640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 0x7f616c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.718 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 -- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 msgr2=0x7f616c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:25.718 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f618409a9d0 0x7f616c004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.718 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 -- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f616c0039c0 msgr2=0x7f616c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:25.718 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f616c0039c0 0x7f616c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.718 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.714+0000 7f61837fe640 1 -- 172.21.15.73:0/3637037816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c003530 con 0x7f616c004d50 2024-09-12T03:34:25.719 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61837fe640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f616c0051d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f617c00a890 tx=0x7f617c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b419775f17787b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c00a4e0 con 0x7f616c004d50 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c0072f0 con 0x7f616c004d50 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f6181ffb640 1 -- 172.21.15.73:0/3637037816 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c0076e0 con 0x7f616c004d50 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 -- 172.21.15.73:0/3637037816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 msgr2=0x7f616c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 --2- 172.21.15.73:0/3637037816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f616c0051d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f617c00a890 tx=0x7f617c01d3a0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61837fe640 1 -- 172.21.15.73:0/3637037816 reap_dead start 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 -- 172.21.15.73:0/3637037816 shutdown_connections 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 -- 172.21.15.73:0/3637037816 >> 172.21.15.73:0/3637037816 conn(0x7f61840d2280 msgr2=0x7f61840d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 -- 172.21.15.73:0/3637037816 shutdown_connections 2024-09-12T03:34:25.720 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 -- 172.21.15.73:0/3637037816 wait complete. 2024-09-12T03:34:25.721 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 Processor -- start 2024-09-12T03:34:25.721 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.718+0000 7f61898d4640 1 -- start start 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f618415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61841587e0 0x7f61840b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6184158c60 0x7f61840b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f618415c860 con 0x7f616c004d50 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b1e90 con 0x7f61841587e0 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f61840d3020 con 0x7f6184158c60 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f618415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f618415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35170/0 (socket says 172.21.15.73:35170) 2024-09-12T03:34:25.723 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 -- 172.21.15.73:0/1856582882 learned_addr learned my addr 172.21.15.73:0/1856582882 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61827fc640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61841587e0 0x7f61840b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61837fe640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6184158c60 0x7f61840b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 -- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6184158c60 msgr2=0x7f61840b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6184158c60 0x7f61840b7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 -- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61841587e0 msgr2=0x7f61840b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61841587e0 0x7f61840b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 -- 172.21.15.73:0/1856582882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61840b67b0 con 0x7f616c004d50 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f6182ffd640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f618415c9e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6174011690 tx=0x7f6174011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:25.724 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f616bfff640 1 -- 172.21.15.73:0/1856582882 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617400f9c0 con 0x7f616c004d50 2024-09-12T03:34:25.725 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f616bfff640 1 -- 172.21.15.73:0/1856582882 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617400fb60 con 0x7f616c004d50 2024-09-12T03:34:25.725 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618415cf20 con 0x7f616c004d50 2024-09-12T03:34:25.725 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f616bfff640 1 -- 172.21.15.73:0/1856582882 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174015460 con 0x7f616c004d50 2024-09-12T03:34:25.725 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61840b6d00 con 0x7f616c004d50 2024-09-12T03:34:25.726 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618409adf0 con 0x7f616c004d50 2024-09-12T03:34:25.726 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f616bfff640 1 -- 172.21.15.73:0/1856582882 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f6174015600 con 0x7f616c004d50 2024-09-12T03:34:25.726 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f616bfff640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6170067830 0x7f6170069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:25.726 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f616bfff640 1 -- 172.21.15.73:0/1856582882 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2791+0+0 (secure 0 0 0) 0x7f6174085a60 con 0x7f616c004d50 2024-09-12T03:34:25.726 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.722+0000 7f61827fc640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6170067830 0x7f6170069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:25.726 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.726+0000 7f61827fc640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6170067830 0x7f6170069cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f618415be40 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:25.729 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.730+0000 7f616bfff640 1 -- 172.21.15.73:0/1856582882 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6174019030 con 0x7f616c004d50 2024-09-12T03:34:25.920 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.918+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6184075030 con 0x7f616c004d50 2024-09-12T03:34:25.956 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.954+0000 7f616bfff640 1 -- 172.21.15.73:0/1856582882 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8064 (secure 0 0 0) 0x7f61740571e0 con 0x7f616c004d50 2024-09-12T03:34:25.956 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T03:34:25.956 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":14,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:25.860326+0000","last_up_change":"2024-09-12T03:34:24.792783+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:25.959 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6170067830 msgr2=0x7f6170069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:25.959 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6170067830 0x7f6170069cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f618415be40 tx=0x7f6178008040 comp rx=0 tx=0).stop 2024-09-12T03:34:25.959 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 msgr2=0x7f618415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:25.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f618415c9e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6174011690 tx=0x7f6174011b50 comp rx=0 tx=0).stop 2024-09-12T03:34:25.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 shutdown_connections 2024-09-12T03:34:25.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6170067830 0x7f6170069cf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6184158c60 0x7f61840b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.960 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61841587e0 0x7f61840b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 --2- 172.21.15.73:0/1856582882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f616c004d50 0x7f618415c9e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:25.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 >> 172.21.15.73:0/1856582882 conn(0x7f61840d2280 msgr2=0x7f61840b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:25.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 shutdown_connections 2024-09-12T03:34:25.961 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:25.958+0000 7f61898d4640 1 -- 172.21.15.73:0/1856582882 wait complete. 2024-09-12T03:34:25.979 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-12T03:34:26.558 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T03:34:26.558+0000 7fced2cce640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T03:34:26.561 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T03:34:26.562+0000 7f7b2e438640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T03:34:26.577 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T03:34:26.574+0000 7ffa4c37f640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T03:34:26.583 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T03:34:26.582+0000 7ff92d73a640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T03:34:26.589 INFO:tasks.ceph.osd.5.smithi150.stderr:2024-09-12T03:34:26.590+0000 7fcecab03640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:26.606 INFO:tasks.ceph.osd.4.smithi150.stderr:2024-09-12T03:34:26.606+0000 7ffa441b4640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:26.606 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-12T03:34:26.606+0000 7ff92556f640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:26.609 INFO:tasks.ceph.osd.7.smithi150.stderr:2024-09-12T03:34:26.610+0000 7f7b2626d640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:26.617 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T03:34:26.614+0000 7f56e92be640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T03:34:26.625 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T03:34:26.626+0000 7f1094b97640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T03:34:26.650 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-12T03:34:26.650+0000 7f56e10f3640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:26.657 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-12T03:34:26.658+0000 7f108c1ba640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T03:34:32.786 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:32.910 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.906+0000 7f345f22d640 1 Processor -- start 2024-09-12T03:34:32.910 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345f22d640 1 -- start start 2024-09-12T03:34:32.911 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345f22d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3458161b80 0x7f34580b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:32.911 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345f22d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:32.911 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345f22d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345809adb0 con 0x7f34580b1d70 2024-09-12T03:34:32.911 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345f22d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f345806d920 con 0x7f3458161b80 2024-09-12T03:34:32.912 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345f22d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f345809be50 con 0x7f345806cf70 2024-09-12T03:34:32.912 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f3457fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:32.912 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345cfc9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3458161b80 0x7f34580b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:32.912 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345d7ca640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f34580b1d70 0x7f34580b21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:49146/0 (socket says 172.21.15.73:49146) 2024-09-12T03:34:32.912 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345d7ca640 1 -- 172.21.15.73:0/2006942988 learned_addr learned my addr 172.21.15.73:0/2006942988 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:32.913 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f34577fe640 1 -- 172.21.15.73:0/2006942988 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100122914 0 0) 0x7f345809adb0 con 0x7f34580b1d70 2024-09-12T03:34:32.913 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f34577fe640 1 -- 172.21.15.73:0/2006942988 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3444003530 con 0x7f34580b1d70 2024-09-12T03:34:32.913 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345cfc9640 1 -- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 msgr2=0x7f345806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:32.913 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345cfc9640 1 --2- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345806d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:32.913 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345cfc9640 1 -- 172.21.15.73:0/2006942988 >> v1:172.21.15.150:6789/0 conn(0x7f34580b1d70 legacy=0x7f34580b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:32.913 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f345cfc9640 1 -- 172.21.15.73:0/2006942988 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345809b090 con 0x7f3458161b80 2024-09-12T03:34:32.913 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.910+0000 7f3457fff640 1 --2- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:32.914 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345cfc9640 1 --2- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 0x7f34580b3890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3450009d90 tx=0x7f345001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb40e58ed63d559a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:32.914 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f34577fe640 1 -- 172.21.15.73:0/2006942988 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34500b2070 con 0x7f3458161b80 2024-09-12T03:34:32.914 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f34577fe640 1 -- 172.21.15.73:0/2006942988 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34500a5830 con 0x7f3458161b80 2024-09-12T03:34:32.914 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f34577fe640 1 -- 172.21.15.73:0/2006942988 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34500a5be0 con 0x7f3458161b80 2024-09-12T03:34:32.915 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 msgr2=0x7f34580b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:32.915 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 --2- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 0x7f34580b3890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3450009d90 tx=0x7f345001c970 comp rx=0 tx=0).stop 2024-09-12T03:34:32.915 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- 172.21.15.73:0/2006942988 shutdown_connections 2024-09-12T03:34:32.916 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 --2- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345806d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:32.916 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 --2- 172.21.15.73:0/2006942988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 0x7f34580b3890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:32.916 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- 172.21.15.73:0/2006942988 >> 172.21.15.73:0/2006942988 conn(0x7f34580d2370 msgr2=0x7f34580d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:32.916 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- 172.21.15.73:0/2006942988 shutdown_connections 2024-09-12T03:34:32.916 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- 172.21.15.73:0/2006942988 wait complete. 2024-09-12T03:34:32.919 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 Processor -- start 2024-09-12T03:34:32.919 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- start start 2024-09-12T03:34:32.919 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:32.919 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34580b1d70 0x7f345814eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:32.919 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 0x7f3458070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:32.919 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f345806ddb0 con 0x7f34580b1d70 2024-09-12T03:34:32.919 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f345806dc30 con 0x7f3458161b80 2024-09-12T03:34:32.920 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345f22d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f345809a9d0 con 0x7f345806cf70 2024-09-12T03:34:32.920 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34580b1d70 0x7f345814eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:32.920 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34580b1d70 0x7f345814eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35208/0 (socket says 172.21.15.73:35208) 2024-09-12T03:34:32.920 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 -- 172.21.15.73:0/1114006035 learned_addr learned my addr 172.21.15.73:0/1114006035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:32.920 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345cfc9640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:32.920 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f345d7ca640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 0x7f3458070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:32.921 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 -- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 msgr2=0x7f345815ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:32.921 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345815ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:32.921 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 -- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 msgr2=0x7f3458070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:32.921 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 0x7f3458070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:32.921 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.914+0000 7f3457fff640 1 -- 172.21.15.73:0/1114006035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345814f430 con 0x7f34580b1d70 2024-09-12T03:34:32.921 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f3457fff640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34580b1d70 0x7f345814eef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f344000e9b0 tx=0x7f344000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:32.922 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f34557fa640 1 -- 172.21.15.73:0/1114006035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440017070 con 0x7f34580b1d70 2024-09-12T03:34:32.922 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f34557fa640 1 -- 172.21.15.73:0/1114006035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f344000ca00 con 0x7f34580b1d70 2024-09-12T03:34:32.922 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f345f22d640 1 -- 172.21.15.73:0/1114006035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345815ded0 con 0x7f34580b1d70 2024-09-12T03:34:32.922 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f34557fa640 1 -- 172.21.15.73:0/1114006035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344000cdd0 con 0x7f34580b1d70 2024-09-12T03:34:32.922 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f345f22d640 1 -- 172.21.15.73:0/1114006035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345815e490 con 0x7f34580b1d70 2024-09-12T03:34:32.922 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34300052a0 con 0x7f34580b1d70 2024-09-12T03:34:32.924 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f34557fa640 1 -- 172.21.15.73:0/1114006035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f344001a070 con 0x7f34580b1d70 2024-09-12T03:34:32.924 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f34557fa640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34380678c0 0x7f3438069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:32.924 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f34557fa640 1 -- 172.21.15.73:0/1114006035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3440085750 con 0x7f34580b1d70 2024-09-12T03:34:32.924 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f345cfc9640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34380678c0 0x7f3438069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:32.924 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.918+0000 7f345cfc9640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34380678c0 0x7f3438069d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34500af000 tx=0x7f34500a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:32.925 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:32.922+0000 7f34557fa640 1 -- 172.21.15.73:0/1114006035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3440056670 con 0x7f34580b1d70 2024-09-12T03:34:33.089 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.086+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3430005860 con 0x7f34580b1d70 2024-09-12T03:34:33.090 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f34557fa640 1 -- 172.21.15.73:0/1114006035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f3440055f70 con 0x7f34580b1d70 2024-09-12T03:34:33.090 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-12T03:34:33.090 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":17,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:28.938378+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:33.092 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34380678c0 msgr2=0x7f3438069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.092 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34380678c0 0x7f3438069d80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34500af000 tx=0x7f34500a7070 comp rx=0 tx=0).stop 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34580b1d70 msgr2=0x7f345814eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34580b1d70 0x7f345814eef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f344000e9b0 tx=0x7f344000ee70 comp rx=0 tx=0).stop 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 shutdown_connections 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34380678c0 0x7f3438069d80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34580b1d70 0x7f345814eef0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3458161b80 0x7f3458070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 --2- 172.21.15.73:0/1114006035 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345806cf70 0x7f345815ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.093 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 >> 172.21.15.73:0/1114006035 conn(0x7f34580d2370 msgr2=0x7f3458158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:33.094 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 shutdown_connections 2024-09-12T03:34:33.094 INFO:teuthology.misc.health.smithi073.stderr:2024-09-12T03:34:33.090+0000 7f344effd640 1 -- 172.21.15.73:0/1114006035 wait complete. 2024-09-12T03:34:33.108 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T03:34:33.108 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T03:34:33.109 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T03:34:33.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T03:34:33.111 INFO:tasks.ceph.mds.a:Started 2024-09-12T03:34:33.111 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T03:34:33.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T03:34:33.113 INFO:tasks.ceph.mds.c:Started 2024-09-12T03:34:33.113 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T03:34:33.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T03:34:33.116 INFO:tasks.ceph.mds.b:Started 2024-09-12T03:34:33.116 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T03:34:33.117 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T03:34:33.119 INFO:tasks.ceph.mds.d:Started 2024-09-12T03:34:33.119 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T03:34:33.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:33.182 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:34:33.182 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:34:33.209 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-12T03:34:33.213 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:34:33.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f38034cb640 1 Processor -- start 2024-09-12T03:34:33.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f38034cb640 1 -- start start 2024-09-12T03:34:33.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f38034cb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc067e30 0x7f37fc161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:33.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f38034cb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37fc1623e0 0x7f37fc0b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f38034cb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37fc0afbb0 con 0x7f37fc15e260 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f38034cb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f37fc162830 con 0x7f37fc1623e0 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f38034cb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc0b0700 con 0x7f37fc067e30 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3801267640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f37fc15e260 0x7f37fc0afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55954/0 (socket says 172.21.15.73:55954) 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3801267640 1 -- 172.21.15.73:0/1705836072 learned_addr learned my addr 172.21.15.73:0/1705836072 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3801a68640 1 --2- 172.21.15.73:0/1705836072 >> v2:172.21.15.73:3300/0 conn(0x7f37fc1623e0 0x7f37fc0b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3800a66640 1 --2- 172.21.15.73:0/1705836072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc067e30 0x7f37fc161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f37f3fff640 1 -- 172.21.15.73:0/1705836072 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306042042 0 0) 0x7f37fc0afbb0 con 0x7f37fc15e260 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f37f3fff640 1 -- 172.21.15.73:0/1705836072 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37e8003530 con 0x7f37fc15e260 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3801a68640 1 -- 172.21.15.73:0/1705836072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc067e30 msgr2=0x7f37fc161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:33.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3801a68640 1 --2- 172.21.15.73:0/1705836072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc067e30 0x7f37fc161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3801a68640 1 -- 172.21.15.73:0/1705836072 >> v1:172.21.15.73:6789/0 conn(0x7f37fc15e260 legacy=0x7f37fc0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f37f3fff640 1 -- 172.21.15.73:0/1705836072 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1514520567 0 0) 0x7f37e8003530 con 0x7f37fc15e260 2024-09-12T03:34:33.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3801a68640 1 -- 172.21.15.73:0/1705836072 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc0af310 con 0x7f37fc1623e0 2024-09-12T03:34:33.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.238+0000 7f3800a66640 1 --2- 172.21.15.73:0/1705836072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc067e30 0x7f37fc161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f3801a68640 1 --2- 172.21.15.73:0/1705836072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc1623e0 0x7f37fc0b41c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f37f80097c0 tx=0x7f37f801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcf53177575db2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f37f3fff640 1 -- 172.21.15.73:0/1705836072 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80b0070 con 0x7f37fc1623e0 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f37f3fff640 1 -- 172.21.15.73:0/1705836072 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80ab400 con 0x7f37fc1623e0 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f37f3fff640 1 -- 172.21.15.73:0/1705836072 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4001a00 con 0x7f37fc1623e0 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 -- 172.21.15.73:0/1705836072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc1623e0 msgr2=0x7f37fc0b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 --2- 172.21.15.73:0/1705836072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc1623e0 0x7f37fc0b41c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f37f80097c0 tx=0x7f37f801c3c0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 -- 172.21.15.73:0/1705836072 shutdown_connections 2024-09-12T03:34:33.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 --2- 172.21.15.73:0/1705836072 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc067e30 0x7f37fc161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 --2- 172.21.15.73:0/1705836072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc1623e0 0x7f37fc0b41c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 -- 172.21.15.73:0/1705836072 >> 172.21.15.73:0/1705836072 conn(0x7f37fc073580 msgr2=0x7f37fc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:33.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 -- 172.21.15.73:0/1705836072 shutdown_connections 2024-09-12T03:34:33.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 -- 172.21.15.73:0/1705836072 wait complete. 2024-09-12T03:34:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 Processor -- start 2024-09-12T03:34:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 -- start start 2024-09-12T03:34:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc067e30 0x7f37fc154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37fc15e260 0x7f37fc06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc1623e0 0x7f37fc159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.242+0000 7f38034cb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc0b5090 con 0x7f37fc067e30 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f38034cb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc0b4f10 con 0x7f37fc15e260 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f38034cb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc0b5210 con 0x7f37fc1623e0 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc067e30 0x7f37fc154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc067e30 0x7f37fc154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35250/0 (socket says 172.21.15.73:35250) 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 -- 172.21.15.73:0/990827631 learned_addr learned my addr 172.21.15.73:0/990827631 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 -- 172.21.15.73:0/990827631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc1623e0 msgr2=0x7f37fc159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc1623e0 0x7f37fc159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 -- 172.21.15.73:0/990827631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37fc15e260 msgr2=0x7f37fc06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37fc15e260 0x7f37fc06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 -- 172.21.15.73:0/990827631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc0cdfa0 con 0x7f37fc067e30 2024-09-12T03:34:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3801267640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc067e30 0x7f37fc154250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37f4001920 tx=0x7f37f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f37f1ffb640 1 -- 172.21.15.73:0/990827631 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4012400 con 0x7f37fc067e30 2024-09-12T03:34:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f37f1ffb640 1 -- 172.21.15.73:0/990827631 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f40125c0 con 0x7f37fc067e30 2024-09-12T03:34:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc168980 con 0x7f37fc067e30 2024-09-12T03:34:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f37f1ffb640 1 -- 172.21.15.73:0/990827631 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40129b0 con 0x7f37fc067e30 2024-09-12T03:34:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc0ce520 con 0x7f37fc067e30 2024-09-12T03:34:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37fc1685c0 con 0x7f37fc067e30 2024-09-12T03:34:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f37f1ffb640 1 -- 172.21.15.73:0/990827631 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37f4012b50 con 0x7f37fc067e30 2024-09-12T03:34:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f37f1ffb640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37e00678c0 0x7f37e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f37f1ffb640 1 -- 172.21.15.73:0/990827631 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f37f4086290 con 0x7f37fc067e30 2024-09-12T03:34:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3800a66640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37e00678c0 0x7f37e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.246+0000 7f3800a66640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37e00678c0 0x7f37e0069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37ec006e90 tx=0x7f37ec006de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:33.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.250+0000 7f37f1ffb640 1 -- 172.21.15.73:0/990827631 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f37f4057120 con 0x7f37fc067e30 2024-09-12T03:34:33.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.450+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37fc161ea0 con 0x7f37fc067e30 2024-09-12T03:34:33.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.450+0000 7f37f1ffb640 1 -- 172.21.15.73:0/990827631 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f37f4056a20 con 0x7f37fc067e30 2024-09-12T03:34:33.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:33.453 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"btime":"2024-09-12T03:34:33:187188+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T03:34:33.457 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-09-12T03:34:33.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37e00678c0 msgr2=0x7f37e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37e00678c0 0x7f37e0069d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37ec006e90 tx=0x7f37ec006de0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc067e30 msgr2=0x7f37fc154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:33.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc067e30 0x7f37fc154250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37f4001920 tx=0x7f37f400a430 comp rx=0 tx=0).stop 2024-09-12T03:34:33.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 shutdown_connections 2024-09-12T03:34:33.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37e00678c0 0x7f37e0069d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37fc1623e0 0x7f37fc159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37fc15e260 0x7f37fc06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 --2- 172.21.15.73:0/990827631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37fc067e30 0x7f37fc154250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:33.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 >> 172.21.15.73:0/990827631 conn(0x7f37fc073580 msgr2=0x7f37fc15f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:33.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 shutdown_connections 2024-09-12T03:34:33.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:33.454+0000 7f38034cb640 1 -- 172.21.15.73:0/990827631 wait complete. 2024-09-12T03:34:35.472 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.601+0000 7f7a2b206640 1 Processor -- start 2024-09-12T03:34:35.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.601+0000 7f7a2b206640 1 -- start start 2024-09-12T03:34:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a2b206640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7a24161a60 0x7f7a240d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a2b206640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a240d2e90 0x7f7a240cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a2b206640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a240d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a2b206640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7a240d32b0 con 0x7f7a240d2e90 2024-09-12T03:34:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a2b206640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f7a240d0300 con 0x7f7a24161a60 2024-09-12T03:34:35.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a2b206640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7a240b0f60 con 0x7f7a240cf450 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a240d2e90 0x7f7a240cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a240d2e90 0x7f7a240cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34160/0 (socket says 172.21.15.73:34160) 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 -- 172.21.15.73:0/4107737863 learned_addr learned my addr 172.21.15.73:0/4107737863 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a297a3640 1 --2- 172.21.15.73:0/4107737863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a240d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a28fa2640 1 --2- 172.21.15.73:0/4107737863 >> v2:172.21.15.150:3300/0 conn(0x7f7a24161a60 0x7f7a240d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 -- 172.21.15.73:0/4107737863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 msgr2=0x7f7a240d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 --2- 172.21.15.73:0/4107737863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a240d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 -- 172.21.15.73:0/4107737863 >> v2:172.21.15.150:3300/0 conn(0x7f7a24161a60 msgr2=0x7f7a240d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 --2- 172.21.15.73:0/4107737863 >> v2:172.21.15.150:3300/0 conn(0x7f7a24161a60 0x7f7a240d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 -- 172.21.15.73:0/4107737863 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a240cfd40 con 0x7f7a240d2e90 2024-09-12T03:34:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a23fff640 1 --2- 172.21.15.73:0/4107737863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240cef10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a2408e010 tx=0x7f7a0c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6497a2102bc4b80d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a237fe640 1 -- 172.21.15.73:0/4107737863 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0ab620 con 0x7f7a240d2e90 2024-09-12T03:34:35.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a237fe640 1 -- 172.21.15.73:0/4107737863 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0c0b0070 con 0x7f7a240d2e90 2024-09-12T03:34:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.605+0000 7f7a237fe640 1 -- 172.21.15.73:0/4107737863 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0ab9e0 con 0x7f7a240d2e90 2024-09-12T03:34:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- 172.21.15.73:0/4107737863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 msgr2=0x7f7a240cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 --2- 172.21.15.73:0/4107737863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240cef10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7a2408e010 tx=0x7f7a0c01c460 comp rx=0 tx=0).stop 2024-09-12T03:34:35.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- 172.21.15.73:0/4107737863 shutdown_connections 2024-09-12T03:34:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 --2- 172.21.15.73:0/4107737863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a240d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 --2- 172.21.15.73:0/4107737863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240cef10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 --2- 172.21.15.73:0/4107737863 >> v2:172.21.15.150:3300/0 conn(0x7f7a24161a60 0x7f7a240d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- 172.21.15.73:0/4107737863 >> 172.21.15.73:0/4107737863 conn(0x7f7a2408bf90 msgr2=0x7f7a2409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- 172.21.15.73:0/4107737863 shutdown_connections 2024-09-12T03:34:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- 172.21.15.73:0/4107737863 wait complete. 2024-09-12T03:34:35.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 Processor -- start 2024-09-12T03:34:35.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- start start 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a2415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240b9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a24161a60 0x7f7a241fac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2406d830 con 0x7f7a240d2e90 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2406d6b0 con 0x7f7a24161a60 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7a2406d9b0 con 0x7f7a240cf450 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240b9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34168/0 (socket says 172.21.15.73:34168) 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 -- 172.21.15.73:0/2428315305 learned_addr learned my addr 172.21.15.73:0/2428315305 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 -- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 msgr2=0x7f7a2415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a28fa2640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a2415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a297a3640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a24161a60 0x7f7a241fac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a2415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 -- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a24161a60 msgr2=0x7f7a241fac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a24161a60 0x7f7a241fac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 -- 172.21.15.73:0/2428315305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a240ccf90 con 0x7f7a240d2e90 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a28fa2640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a2415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a23fff640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240b9110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c01ab10 tx=0x7f7a0c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a217fa640 1 -- 172.21.15.73:0/2428315305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0abdb0 con 0x7f7a240d2e90 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a217fa640 1 -- 172.21.15.73:0/2428315305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a0c0be3f0 con 0x7f7a240d2e90 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a240cd270 con 0x7f7a240d2e90 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a217fa640 1 -- 172.21.15.73:0/2428315305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0be7a0 con 0x7f7a240d2e90 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.609+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a240cdb10 con 0x7f7a240d2e90 2024-09-12T03:34:35.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.613+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a240cef10 con 0x7f7a240d2e90 2024-09-12T03:34:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.613+0000 7f7a217fa640 1 -- 172.21.15.73:0/2428315305 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a0c0b43f0 con 0x7f7a240d2e90 2024-09-12T03:34:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.613+0000 7f7a217fa640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a040678c0 0x7f7a04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.613+0000 7f7a217fa640 1 -- 172.21.15.73:0/2428315305 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7a0c11fe20 con 0x7f7a240d2e90 2024-09-12T03:34:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.613+0000 7f7a28fa2640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a040678c0 0x7f7a04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.613+0000 7f7a28fa2640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a040678c0 0x7f7a04069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009f50 tx=0x7f7a1400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:35.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.617+0000 7f7a217fa640 1 -- 172.21.15.73:0/2428315305 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a0c0c4060 con 0x7f7a240d2e90 2024-09-12T03:34:35.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.813+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a240cd600 con 0x7f7a240d2e90 2024-09-12T03:34:35.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.813+0000 7f7a217fa640 1 -- 172.21.15.73:0/2428315305 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f7a0c016110 con 0x7f7a240d2e90 2024-09-12T03:34:35.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:35.817 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"btime":"2024-09-12T03:34:34:191183+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T03:34:35.818 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a040678c0 msgr2=0x7f7a04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a040678c0 0x7f7a04069d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009f50 tx=0x7f7a1400b040 comp rx=0 tx=0).stop 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 msgr2=0x7f7a240b9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240b9110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c01ab10 tx=0x7f7a0c01aca0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 shutdown_connections 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a040678c0 0x7f7a04069d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a240d2e90 0x7f7a240b9110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a24161a60 0x7f7a241fac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 --2- 172.21.15.73:0/2428315305 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a240cf450 0x7f7a2415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 >> 172.21.15.73:0/2428315305 conn(0x7f7a2408bf90 msgr2=0x7f7a24160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:35.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 shutdown_connections 2024-09-12T03:34:35.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.817+0000 7f7a2b206640 1 -- 172.21.15.73:0/2428315305 wait complete. 2024-09-12T03:34:35.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T03:34:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad42ec640 1 Processor -- start 2024-09-12T03:34:35.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad42ec640 1 -- start start 2024-09-12T03:34:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad42ec640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7faacc070020 0x7faacc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad42ec640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faacc0aede0 con 0x7faacc1520a0 2024-09-12T03:34:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad42ec640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faacc15fa10 con 0x7faacc15f1d0 2024-09-12T03:34:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad42ec640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7faacc152480 con 0x7faacc070020 2024-09-12T03:34:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2088640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7faacc1520a0 0x7faacc06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47194/0 (socket says 172.21.15.73:47194) 2024-09-12T03:34:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2088640 1 -- 172.21.15.73:0/3323815919 learned_addr learned my addr 172.21.15.73:0/3323815919 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:35.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016229505 0 0) 0x7faacc0aede0 con 0x7faacc1520a0 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1887640 1 --2- 172.21.15.73:0/3323815919 >> v2:172.21.15.150:3300/0 conn(0x7faacc070020 0x7faacc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faab8003530 con 0x7faacc1520a0 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 622712986 0 0) 0x7faab8003530 con 0x7faacc1520a0 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 >> v2:172.21.15.150:3300/0 conn(0x7faacc070020 msgr2=0x7faacc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 --2- 172.21.15.73:0/3323815919 >> v2:172.21.15.150:3300/0 conn(0x7faacc070020 0x7faacc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 >> v1:172.21.15.150:6789/0 conn(0x7faacc15f1d0 legacy=0x7faacc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc074250 con 0x7faacc1520a0 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7faac8001680 con 0x7faacc1520a0 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1887640 1 --2- 172.21.15.73:0/3323815919 >> v2:172.21.15.150:3300/0 conn(0x7faacc070020 0x7faacc15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 >> v1:172.21.15.73:6789/0 conn(0x7faacc1520a0 legacy=0x7faacc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80039c0 0x7faab8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab8004810 0x7faab8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faab800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faab800c0f0 con 0x7faab80051d0 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faab800c2a0 con 0x7faab80039c0 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faab800c4a0 con 0x7faab8004810 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2889640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faab800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2088640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80039c0 0x7faab8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2889640 1 -- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab8004810 msgr2=0x7faab8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2889640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faab8004810 0x7faab8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2889640 1 -- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80039c0 msgr2=0x7faab8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2889640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80039c0 0x7faab8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2889640 1 -- 172.21.15.73:0/3323815919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab8003530 con 0x7faab80051d0 2024-09-12T03:34:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.945+0000 7faad2088640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faab80039c0 0x7faab8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2889640 1 -- 172.21.15.73:0/3323815919 reap_dead start 2024-09-12T03:34:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2889640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faab800b9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faac4001e70 tx=0x7faac401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d196072edb0e880f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4001a90 con 0x7faab80051d0 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac4003ba0 con 0x7faab80051d0 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad1086640 1 -- 172.21.15.73:0/3323815919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4005020 con 0x7faab80051d0 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- 172.21.15.73:0/3323815919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 msgr2=0x7faab800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faab800b9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faac4001e70 tx=0x7faac401c780 comp rx=0 tx=0).stop 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- 172.21.15.73:0/3323815919 shutdown_connections 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 --2- 172.21.15.73:0/3323815919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faab800b9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- 172.21.15.73:0/3323815919 >> 172.21.15.73:0/3323815919 conn(0x7faacc0b1f90 msgr2=0x7faacc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- 172.21.15.73:0/3323815919 shutdown_connections 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- 172.21.15.73:0/3323815919 wait complete. 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 Processor -- start 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- start start 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faacc09b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faacc09d450 0x7faacc14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faacc071f10 0x7faacc072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faacc073a50 con 0x7faab80051d0 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faacc073770 con 0x7faacc09d450 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad42ec640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faacc073d30 con 0x7faacc071f10 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faacc09b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faacc09b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34186/0 (socket says 172.21.15.73:34186) 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 -- 172.21.15.73:0/222776119 learned_addr learned my addr 172.21.15.73:0/222776119 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad1887640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faacc09d450 0x7faacc14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 -- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faacc071f10 msgr2=0x7faacc072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faacc071f10 0x7faacc072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 -- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faacc09d450 msgr2=0x7faacc14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faacc09d450 0x7faacc14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 -- 172.21.15.73:0/222776119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc09dc10 con 0x7faab80051d0 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad1887640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faacc09d450 0x7faacc14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faad2088640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faacc09b030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faac8001000 tx=0x7faac800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.949+0000 7faac2ffd640 1 -- 172.21.15.73:0/222776119 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8019070 con 0x7faab80051d0 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faac2ffd640 1 -- 172.21.15.73:0/222776119 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac80074e0 con 0x7faab80051d0 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc09def0 con 0x7faab80051d0 2024-09-12T03:34:35.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faac2ffd640 1 -- 172.21.15.73:0/222776119 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac80049f0 con 0x7faab80051d0 2024-09-12T03:34:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc0cdd00 con 0x7faab80051d0 2024-09-12T03:34:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc068e50 con 0x7faab80051d0 2024-09-12T03:34:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faac2ffd640 1 -- 172.21.15.73:0/222776119 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faac801c070 con 0x7faab80051d0 2024-09-12T03:34:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faac2ffd640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faab00678c0 0x7faab0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faad1887640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faab00678c0 0x7faab0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faac2ffd640 1 -- 172.21.15.73:0/222776119 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7faac8085380 con 0x7faab80051d0 2024-09-12T03:34:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.953+0000 7faad1887640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faab00678c0 0x7faab0069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b48c0 tx=0x7faabc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:35.957+0000 7faac2ffd640 1 -- 172.21.15.73:0/222776119 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faac80562a0 con 0x7faab80051d0 2024-09-12T03:34:36.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7faacc0aede0 con 0x7faab80051d0 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faac2ffd640 1 -- 172.21.15.73:0/222776119 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7faac8055ba0 con 0x7faab80051d0 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:34:36.119 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T03:34:36.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faab00678c0 msgr2=0x7faab0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faab00678c0 0x7faab0069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b48c0 tx=0x7faabc008040 comp rx=0 tx=0).stop 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 msgr2=0x7faacc09b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faacc09b030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faac8001000 tx=0x7faac800dd40 comp rx=0 tx=0).stop 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 shutdown_connections 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faab00678c0 0x7faab0069d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faacc071f10 0x7faacc072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faacc09d450 0x7faacc14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 --2- 172.21.15.73:0/222776119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faab80051d0 0x7faacc09b030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 >> 172.21.15.73:0/222776119 conn(0x7faacc0b1f90 msgr2=0x7faacc06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 shutdown_connections 2024-09-12T03:34:36.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.117+0000 7faad42ec640 1 -- 172.21.15.73:0/222776119 wait complete. 2024-09-12T03:34:36.136 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T03:34:36.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T03:34:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe01df71640 1 Processor -- start 2024-09-12T03:34:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe01df71640 1 -- start start 2024-09-12T03:34:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe01df71640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe018073e60 0x7fe01806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe01df71640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe01806fef0 0x7fe01815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe01df71640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe01815bda0 con 0x7fe0180b3d50 2024-09-12T03:34:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe01df71640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe01806ee50 con 0x7fe018073e60 2024-09-12T03:34:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe01df71640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe01806f130 con 0x7fe01806fef0 2024-09-12T03:34:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe0177fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe018073e60 0x7fe01806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe016ffd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe01806fef0 0x7fe01815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe0177fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe018073e60 0x7fe01806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:38386/0 (socket says 172.21.15.73:38386) 2024-09-12T03:34:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe017fff640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe0180b3d50 0x7fe0180b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:41074/0 (socket says 172.21.15.73:41074) 2024-09-12T03:34:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe0177fe640 1 -- 172.21.15.73:0/2929567889 learned_addr learned my addr 172.21.15.73:0/2929567889 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe016ffd640 1 -- 172.21.15.73:0/2929567889 >> v2:172.21.15.150:3300/0 conn(0x7fe018073e60 msgr2=0x7fe01806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe016ffd640 1 --2- 172.21.15.73:0/2929567889 >> v2:172.21.15.150:3300/0 conn(0x7fe018073e60 0x7fe01806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe016ffd640 1 -- 172.21.15.73:0/2929567889 >> v1:172.21.15.150:6789/0 conn(0x7fe0180b3d50 legacy=0x7fe0180b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.245+0000 7fe016ffd640 1 -- 172.21.15.73:0/2929567889 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01806f410 con 0x7fe01806fef0 2024-09-12T03:34:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe016ffd640 1 --2- 172.21.15.73:0/2929567889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe01806fef0 0x7fe01815b860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0097c0 tx=0x7fe00c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4963bc32c0238ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe0167fc640 1 -- 172.21.15.73:0/2929567889 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b0070 con 0x7fe01806fef0 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe0167fc640 1 -- 172.21.15.73:0/2929567889 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0ab600 con 0x7fe01806fef0 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe0167fc640 1 -- 172.21.15.73:0/2929567889 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0ab9d0 con 0x7fe01806fef0 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 -- 172.21.15.73:0/2929567889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe01806fef0 msgr2=0x7fe01815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 --2- 172.21.15.73:0/2929567889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe01806fef0 0x7fe01815b860 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0097c0 tx=0x7fe00c01c410 comp rx=0 tx=0).stop 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 -- 172.21.15.73:0/2929567889 shutdown_connections 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 --2- 172.21.15.73:0/2929567889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe01806fef0 0x7fe01815b860 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 --2- 172.21.15.73:0/2929567889 >> v2:172.21.15.150:3300/0 conn(0x7fe018073e60 0x7fe01806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 -- 172.21.15.73:0/2929567889 >> 172.21.15.73:0/2929567889 conn(0x7fe0180b1f90 msgr2=0x7fe0180b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 -- 172.21.15.73:0/2929567889 shutdown_connections 2024-09-12T03:34:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.249+0000 7fe01df71640 1 -- 172.21.15.73:0/2929567889 wait complete. 2024-09-12T03:34:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 Processor -- start 2024-09-12T03:34:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 -- start start 2024-09-12T03:34:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe01806fef0 0x7fe018150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe018073e60 0x7fe01809a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0180b3d50 0x7fe01814c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0180729e0 con 0x7fe01806fef0 2024-09-12T03:34:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe018072860 con 0x7fe0180b3d50 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe018072b60 con 0x7fe018073e60 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe01806fef0 0x7fe018150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe01806fef0 0x7fe018150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34188/0 (socket says 172.21.15.73:34188) 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 -- 172.21.15.73:0/748204335 learned_addr learned my addr 172.21.15.73:0/748204335 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe017fff640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0180b3d50 0x7fe01814c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe016ffd640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe018073e60 0x7fe01809a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 -- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe018073e60 msgr2=0x7fe01809a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe018073e60 0x7fe01809a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 -- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0180b3d50 msgr2=0x7fe01814c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0180b3d50 0x7fe01814c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 -- 172.21.15.73:0/748204335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01809a8c0 con 0x7fe01806fef0 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe016ffd640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe018073e60 0x7fe01809a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe0177fe640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe01806fef0 0x7fe018150660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe008010f50 tx=0x7fe00800e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fdffffff640 1 -- 172.21.15.73:0/748204335 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00801b680 con 0x7fe01806fef0 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fdffffff640 1 -- 172.21.15.73:0/748204335 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00801b820 con 0x7fe01806fef0 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01814cba0 con 0x7fe01806fef0 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fdffffff640 1 -- 172.21.15.73:0/748204335 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00801bbd0 con 0x7fe01806fef0 2024-09-12T03:34:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0181519e0 con 0x7fe01806fef0 2024-09-12T03:34:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01815b860 con 0x7fe01806fef0 2024-09-12T03:34:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.253+0000 7fdffffff640 1 -- 172.21.15.73:0/748204335 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe008012430 con 0x7fe01806fef0 2024-09-12T03:34:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.257+0000 7fdffffff640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0040678c0 0x7fe004069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.257+0000 7fdffffff640 1 -- 172.21.15.73:0/748204335 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe008088b20 con 0x7fe01806fef0 2024-09-12T03:34:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.257+0000 7fe016ffd640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0040678c0 0x7fe004069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.257+0000 7fe016ffd640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0040678c0 0x7fe004069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ad000 tx=0x7fe00c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:36.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.261+0000 7fdffffff640 1 -- 172.21.15.73:0/748204335 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe008020060 con 0x7fe01806fef0 2024-09-12T03:34:36.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.409+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe0180723f0 con 0x7fe01806fef0 2024-09-12T03:34:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.969+0000 7fdffffff640 1 -- 172.21.15.73:0/748204335 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fe008059a40 con 0x7fe01806fef0 2024-09-12T03:34:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T03:34:36.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.973+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0040678c0 msgr2=0x7fe004069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.973+0000 7fe01df71640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0040678c0 0x7fe004069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ad000 tx=0x7fe00c008040 comp rx=0 tx=0).stop 2024-09-12T03:34:36.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.973+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe01806fef0 msgr2=0x7fe018150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:36.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.973+0000 7fe01df71640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe01806fef0 0x7fe018150660 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe008010f50 tx=0x7fe00800e760 comp rx=0 tx=0).stop 2024-09-12T03:34:36.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 shutdown_connections 2024-09-12T03:34:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0040678c0 0x7fe004069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0180b3d50 0x7fe01814c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe018073e60 0x7fe01809a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 --2- 172.21.15.73:0/748204335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe01806fef0 0x7fe018150660 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 >> 172.21.15.73:0/748204335 conn(0x7fe0180b1f90 msgr2=0x7fe01815d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 shutdown_connections 2024-09-12T03:34:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:36.977+0000 7fe01df71640 1 -- 172.21.15.73:0/748204335 wait complete. 2024-09-12T03:34:37.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T03:34:37.075 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:34:37.078 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:34:37.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.125+0000 7fd6850ea640 1 Processor -- start 2024-09-12T03:34:37.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.125+0000 7fd6850ea640 1 -- start start 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd6850ea640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6800d15d0 0x7fd6800cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd6850ea640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd680162070 0x7fd6801624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd6850ea640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6800d0350 con 0x7fd68015e4f0 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd6850ea640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd680162a00 con 0x7fd6800d15d0 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd6850ea640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6800cf070 con 0x7fd680162070 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd677fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6800d15d0 0x7fd6800cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67ed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd68015e4f0 0x7fd6800d4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47204/0 (socket says 172.21.15.73:47204) 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67ed9d640 1 -- 172.21.15.73:0/1854921075 learned_addr learned my addr 172.21.15.73:0/1854921075 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:37.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67f59e640 1 --2- 172.21.15.73:0/1854921075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd680162070 0x7fd6801624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:37.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd677fff640 1 -- 172.21.15.73:0/1854921075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd680162070 msgr2=0x7fd6801624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:37.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd677fff640 1 --2- 172.21.15.73:0/1854921075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd680162070 0x7fd6801624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd677fff640 1 -- 172.21.15.73:0/1854921075 >> v1:172.21.15.73:6789/0 conn(0x7fd68015e4f0 legacy=0x7fd6800d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:37.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd677fff640 1 -- 172.21.15.73:0/1854921075 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6800d1c20 con 0x7fd6800d15d0 2024-09-12T03:34:37.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67e59c640 1 -- 172.21.15.73:0/1854921075 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901417959 0 0) 0x7fd6800d0350 con 0x7fd68015e4f0 2024-09-12T03:34:37.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67f59e640 1 --2- 172.21.15.73:0/1854921075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd680162070 0x7fd6801624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd677fff640 1 --2- 172.21.15.73:0/1854921075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6800d15d0 0x7fd6800cfe10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097c0 tx=0x7fd66801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d55b1ed74d3af8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67e59c640 1 -- 172.21.15.73:0/1854921075 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6680b5070 con 0x7fd6800d15d0 2024-09-12T03:34:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67e59c640 1 -- 172.21.15.73:0/1854921075 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6680a8990 con 0x7fd6800d15d0 2024-09-12T03:34:37.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.129+0000 7fd67e59c640 1 -- 172.21.15.73:0/1854921075 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6680a8d60 con 0x7fd6800d15d0 2024-09-12T03:34:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/1854921075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6800d15d0 msgr2=0x7fd6800cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 --2- 172.21.15.73:0/1854921075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6800d15d0 0x7fd6800cfe10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6680097c0 tx=0x7fd66801ec90 comp rx=0 tx=0).stop 2024-09-12T03:34:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/1854921075 shutdown_connections 2024-09-12T03:34:37.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 --2- 172.21.15.73:0/1854921075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd680162070 0x7fd6801624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 --2- 172.21.15.73:0/1854921075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6800d15d0 0x7fd6800cfe10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/1854921075 >> 172.21.15.73:0/1854921075 conn(0x7fd68008bf90 msgr2=0x7fd6800d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:37.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/1854921075 shutdown_connections 2024-09-12T03:34:37.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/1854921075 wait complete. 2024-09-12T03:34:37.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 Processor -- start 2024-09-12T03:34:37.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- start start 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6800d15d0 0x7fd680151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68015e4f0 0x7fd6801514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680162070 0x7fd6800c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800cf8f0 con 0x7fd680162070 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800cf610 con 0x7fd68015e4f0 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd68015e8d0 con 0x7fd6800d15d0 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680162070 0x7fd6800c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680162070 0x7fd6800c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34204/0 (socket says 172.21.15.73:34204) 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 -- 172.21.15.73:0/499279509 learned_addr learned my addr 172.21.15.73:0/499279509 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 -- 172.21.15.73:0/499279509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6800d15d0 msgr2=0x7fd680151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6800d15d0 0x7fd680151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 -- 172.21.15.73:0/499279509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68015e4f0 msgr2=0x7fd6801514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68015e4f0 0x7fd6801514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 -- 172.21.15.73:0/499279509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6800c93a0 con 0x7fd680162070 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd67f59e640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680162070 0x7fd6800c8950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd67800ce40 tx=0x7fd67800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6777fe640 1 -- 172.21.15.73:0/499279509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67801a070 con 0x7fd680162070 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6777fe640 1 -- 172.21.15.73:0/499279509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67800d840 con 0x7fd680162070 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68015eca0 con 0x7fd680162070 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6777fe640 1 -- 172.21.15.73:0/499279509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67800dc30 con 0x7fd680162070 2024-09-12T03:34:37.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68015f260 con 0x7fd680162070 2024-09-12T03:34:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.133+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6800d4b20 con 0x7fd680162070 2024-09-12T03:34:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.137+0000 7fd6777fe640 1 -- 172.21.15.73:0/499279509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd67801d070 con 0x7fd680162070 2024-09-12T03:34:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.137+0000 7fd6777fe640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6600678c0 0x7fd660069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.137+0000 7fd6777fe640 1 -- 172.21.15.73:0/499279509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fd678086270 con 0x7fd680162070 2024-09-12T03:34:37.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.137+0000 7fd67ed9d640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6600678c0 0x7fd660069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:37.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.137+0000 7fd67ed9d640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6600678c0 0x7fd660069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd6700011f0 tx=0x7fd670007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:37.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.141+0000 7fd6777fe640 1 -- 172.21.15.73:0/499279509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd678056fa0 con 0x7fd680162070 2024-09-12T03:34:37.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.293+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fd68006df70 con 0x7fd680162070 2024-09-12T03:34:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.977+0000 7fd6777fe640 1 -- 172.21.15.73:0/499279509 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7fd6780568a0 con 0x7fd680162070 2024-09-12T03:34:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T03:34:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6600678c0 msgr2=0x7fd660069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6600678c0 0x7fd660069d80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd6700011f0 tx=0x7fd670007930 comp rx=0 tx=0).stop 2024-09-12T03:34:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680162070 msgr2=0x7fd6800c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680162070 0x7fd6800c8950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd67800ce40 tx=0x7fd67800a710 comp rx=0 tx=0).stop 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 shutdown_connections 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6600678c0 0x7fd660069d80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd680162070 0x7fd6800c8950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd68015e4f0 0x7fd6801514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 --2- 172.21.15.73:0/499279509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6800d15d0 0x7fd680151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 >> 172.21.15.73:0/499279509 conn(0x7fd68008bf90 msgr2=0x7fd6800d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 shutdown_connections 2024-09-12T03:34:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:37.981+0000 7fd6850ea640 1 -- 172.21.15.73:0/499279509 wait complete. 2024-09-12T03:34:38.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T03:34:38.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f07759d0640 1 Processor -- start 2024-09-12T03:34:38.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f07759d0640 1 -- start start 2024-09-12T03:34:38.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f07759d0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0770161a60 0x7f07700d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:38.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f07759d0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f07700d2e90 0x7f07700cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:38.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f07759d0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07700d32b0 con 0x7f07700cf450 2024-09-12T03:34:38.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f07759d0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f07700d0300 con 0x7f07700d2e90 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f07759d0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f077006e6c0 con 0x7f0770161a60 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f07700d2e90 0x7f07700cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f07700d2e90 0x7f07700cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34212/0 (socket says 172.21.15.73:34212) 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f07700cf450 0x7f07700d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47218/0 (socket says 172.21.15.73:47218) 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076e7fc640 1 -- 172.21.15.73:0/1855844290 learned_addr learned my addr 172.21.15.73:0/1855844290 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076effd640 1 --2- 172.21.15.73:0/1855844290 >> v2:172.21.15.150:3300/0 conn(0x7f0770161a60 0x7f07700d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076e7fc640 1 -- 172.21.15.73:0/1855844290 >> v2:172.21.15.150:3300/0 conn(0x7f0770161a60 msgr2=0x7f07700d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076e7fc640 1 --2- 172.21.15.73:0/1855844290 >> v2:172.21.15.150:3300/0 conn(0x7f0770161a60 0x7f07700d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076e7fc640 1 -- 172.21.15.73:0/1855844290 >> v1:172.21.15.73:6789/0 conn(0x7f07700cf450 legacy=0x7f07700d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:38.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.177+0000 7f076e7fc640 1 -- 172.21.15.73:0/1855844290 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07700b0f60 con 0x7f07700d2e90 2024-09-12T03:34:38.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f076e7fc640 1 --2- 172.21.15.73:0/1855844290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07700d2e90 0x7f07700cef10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f077008e010 tx=0x7f076401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c595ea10d77005 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:38.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f076dffb640 1 -- 172.21.15.73:0/1855844290 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07700d1930 con 0x7f07700d2e90 2024-09-12T03:34:38.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f076dffb640 1 -- 172.21.15.73:0/1855844290 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07640b0070 con 0x7f07700d2e90 2024-09-12T03:34:38.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f076dffb640 1 -- 172.21.15.73:0/1855844290 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07640ab880 con 0x7f07700d2e90 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- 172.21.15.73:0/1855844290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07700d2e90 msgr2=0x7f07700cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 --2- 172.21.15.73:0/1855844290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07700d2e90 0x7f07700cef10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f077008e010 tx=0x7f076401c460 comp rx=0 tx=0).stop 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- 172.21.15.73:0/1855844290 shutdown_connections 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 --2- 172.21.15.73:0/1855844290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07700d2e90 0x7f07700cef10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 --2- 172.21.15.73:0/1855844290 >> v2:172.21.15.150:3300/0 conn(0x7f0770161a60 0x7f07700d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- 172.21.15.73:0/1855844290 >> 172.21.15.73:0/1855844290 conn(0x7f077008bf90 msgr2=0x7f077009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- 172.21.15.73:0/1855844290 shutdown_connections 2024-09-12T03:34:38.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- 172.21.15.73:0/1855844290 wait complete. 2024-09-12T03:34:38.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 Processor -- start 2024-09-12T03:34:38.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- start start 2024-09-12T03:34:38.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07700cf450 0x7f07700c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:38.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700d2e90 0x7f07701f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:38.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0770161a60 0x7f07700c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:38.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f077016af20 con 0x7f0770161a60 2024-09-12T03:34:38.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f077006d190 con 0x7f07700cf450 2024-09-12T03:34:38.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f07759d0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f077016b0a0 con 0x7f07700d2e90 2024-09-12T03:34:38.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f076f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0770161a60 0x7f07700c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f076f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0770161a60 0x7f07700c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34218/0 (socket says 172.21.15.73:34218) 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.181+0000 7f076f7fe640 1 -- 172.21.15.73:0/2433548784 learned_addr learned my addr 172.21.15.73:0/2433548784 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076effd640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07700cf450 0x7f07700c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076e7fc640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700d2e90 0x7f07701f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076f7fe640 1 -- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700d2e90 msgr2=0x7f07701f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076f7fe640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700d2e90 0x7f07701f7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076f7fe640 1 -- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07700cf450 msgr2=0x7f07700c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076f7fe640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07700cf450 0x7f07700c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076f7fe640 1 -- 172.21.15.73:0/2433548784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07700c8fa0 con 0x7f0770161a60 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076f7fe640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0770161a60 0x7f07700c8870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f076800c710 tx=0x7f076800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f0757fff640 1 -- 172.21.15.73:0/2433548784 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768017070 con 0x7f0770161a60 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f0757fff640 1 -- 172.21.15.73:0/2433548784 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076800ce20 con 0x7f0770161a60 2024-09-12T03:34:38.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f0757fff640 1 -- 172.21.15.73:0/2433548784 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076800a860 con 0x7f0770161a60 2024-09-12T03:34:38.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07700cc7e0 con 0x7f0770161a60 2024-09-12T03:34:38.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07700c9280 con 0x7f0770161a60 2024-09-12T03:34:38.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07700cef10 con 0x7f0770161a60 2024-09-12T03:34:38.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f0757fff640 1 -- 172.21.15.73:0/2433548784 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f076801a070 con 0x7f0770161a60 2024-09-12T03:34:38.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f0757fff640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f075c0678c0 0x7f075c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:38.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f0757fff640 1 -- 172.21.15.73:0/2433548784 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f07680851d0 con 0x7f0770161a60 2024-09-12T03:34:38.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076effd640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f075c0678c0 0x7f075c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:38.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.185+0000 7f076effd640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f075c0678c0 0x7f075c069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07700b5930 tx=0x7f0760008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:38.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.189+0000 7f0757fff640 1 -- 172.21.15.73:0/2433548784 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0768055e00 con 0x7f0770161a60 2024-09-12T03:34:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:38.385+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0770160cd0 con 0x7f0770161a60 2024-09-12T03:34:39.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.033+0000 7f0757fff640 1 -- 172.21.15.73:0/2433548784 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f0768055700 con 0x7f0770161a60 2024-09-12T03:34:39.035 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T03:34:39.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f075c0678c0 msgr2=0x7f075c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:39.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f075c0678c0 0x7f075c069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f07700b5930 tx=0x7f0760008040 comp rx=0 tx=0).stop 2024-09-12T03:34:39.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0770161a60 msgr2=0x7f07700c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:39.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0770161a60 0x7f07700c8870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f076800c710 tx=0x7f076800cbd0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 shutdown_connections 2024-09-12T03:34:39.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f075c0678c0 0x7f075c069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0770161a60 0x7f07700c8870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f07700d2e90 0x7f07701f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 --2- 172.21.15.73:0/2433548784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07700cf450 0x7f07700c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 >> 172.21.15.73:0/2433548784 conn(0x7f077008bf90 msgr2=0x7f077006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:39.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 shutdown_connections 2024-09-12T03:34:39.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.037+0000 7f07759d0640 1 -- 172.21.15.73:0/2433548784 wait complete. 2024-09-12T03:34:39.073 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T03:34:39.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T03:34:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f1431639640 1 Processor -- start 2024-09-12T03:34:39.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f1431639640 1 -- start start 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f1431639640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15bec0 0x7f142c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f1431639640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f142c0af470 0x7f142c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f1431639640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f142c0b3290 con 0x7f142c15c2a0 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f1431639640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f142c0b3570 con 0x7f142c0af470 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f1431639640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f142c0b3850 con 0x7f142c15bec0 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f142b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f142c0af470 0x7f142c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f142a7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f142c15c2a0 0x7f142c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47234/0 (socket says 172.21.15.73:47234) 2024-09-12T03:34:39.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f142b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f142c0af470 0x7f142c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34228/0 (socket says 172.21.15.73:34228) 2024-09-12T03:34:39.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f142a7fc640 1 -- 172.21.15.73:0/3651053414 learned_addr learned my addr 172.21.15.73:0/3651053414 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:39.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.197+0000 7f142affd640 1 --2- 172.21.15.73:0/3651053414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15bec0 0x7f142c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:39.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f142b7fe640 1 -- 172.21.15.73:0/3651053414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15bec0 msgr2=0x7f142c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:39.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f142b7fe640 1 --2- 172.21.15.73:0/3651053414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15bec0 0x7f142c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f142b7fe640 1 -- 172.21.15.73:0/3651053414 >> v1:172.21.15.73:6789/0 conn(0x7f142c15c2a0 legacy=0x7f142c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:39.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f142b7fe640 1 -- 172.21.15.73:0/3651053414 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c0b3b30 con 0x7f142c0af470 2024-09-12T03:34:39.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f142affd640 1 --2- 172.21.15.73:0/3651053414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15bec0 0x7f142c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:39.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f142b7fe640 1 --2- 172.21.15.73:0/3651053414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c06e000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f141c0097c0 tx=0x7f141c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7ff2946221ef83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:39.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1429ffb640 1 -- 172.21.15.73:0/3651053414 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0b2070 con 0x7f142c0af470 2024-09-12T03:34:39.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1429ffb640 1 -- 172.21.15.73:0/3651053414 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c0ad680 con 0x7f142c0af470 2024-09-12T03:34:39.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1429ffb640 1 -- 172.21.15.73:0/3651053414 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c0ada50 con 0x7f142c0af470 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 -- 172.21.15.73:0/3651053414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 msgr2=0x7f142c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 --2- 172.21.15.73:0/3651053414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c06e000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f141c0097c0 tx=0x7f141c01c470 comp rx=0 tx=0).stop 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 -- 172.21.15.73:0/3651053414 shutdown_connections 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 --2- 172.21.15.73:0/3651053414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c06e000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 --2- 172.21.15.73:0/3651053414 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15bec0 0x7f142c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 -- 172.21.15.73:0/3651053414 >> 172.21.15.73:0/3651053414 conn(0x7f142c0b1f90 msgr2=0x7f142c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 -- 172.21.15.73:0/3651053414 shutdown_connections 2024-09-12T03:34:39.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.201+0000 7f1431639640 1 -- 172.21.15.73:0/3651053414 wait complete. 2024-09-12T03:34:39.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 Processor -- start 2024-09-12T03:34:39.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 -- start start 2024-09-12T03:34:39.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f142c15bec0 0x7f142c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15c2a0 0x7f142c14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f142c06ed50 con 0x7f142c0af470 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f142c0ad740 con 0x7f142c15bec0 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f142c06eed0 con 0x7f142c15c2a0 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c15afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34234/0 (socket says 172.21.15.73:34234) 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 -- 172.21.15.73:0/4058701172 learned_addr learned my addr 172.21.15.73:0/4058701172 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142a7fc640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f142c15bec0 0x7f142c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142b7fe640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15c2a0 0x7f142c14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:39.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 -- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15c2a0 msgr2=0x7f142c14b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15c2a0 0x7f142c14b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 -- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f142c15bec0 msgr2=0x7f142c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f142c15bec0 0x7f142c151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 -- 172.21.15.73:0/4058701172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c0b1d00 con 0x7f142c0af470 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142affd640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c15afc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f142400cf90 tx=0x7f142400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f14137fe640 1 -- 172.21.15.73:0/4058701172 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142401a070 con 0x7f142c0af470 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f14137fe640 1 -- 172.21.15.73:0/4058701172 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f142400d840 con 0x7f142c0af470 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142c155550 con 0x7f142c0af470 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f14137fe640 1 -- 172.21.15.73:0/4058701172 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142400dc10 con 0x7f142c0af470 2024-09-12T03:34:39.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142c155ad0 con 0x7f142c0af470 2024-09-12T03:34:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142c06e000 con 0x7f142c0af470 2024-09-12T03:34:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f14137fe640 1 -- 172.21.15.73:0/4058701172 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f142401d070 con 0x7f142c0af470 2024-09-12T03:34:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f14137fe640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14180678c0 0x7f1418069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f14137fe640 1 -- 172.21.15.73:0/4058701172 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f14240864f0 con 0x7f142c0af470 2024-09-12T03:34:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.205+0000 7f142a7fc640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14180678c0 0x7f1418069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:39.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.209+0000 7f142a7fc640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14180678c0 0x7f1418069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f142c0d0d00 tx=0x7f1420009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:39.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.213+0000 7f14137fe640 1 -- 172.21.15.73:0/4058701172 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1424056960 con 0x7f142c0af470 2024-09-12T03:34:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:39.369+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f142c06fcd0 con 0x7f142c0af470 2024-09-12T03:34:40.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.061+0000 7f14137fe640 1 -- 172.21.15.73:0/4058701172 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f142405ac60 con 0x7f142c0af470 2024-09-12T03:34:40.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14180678c0 msgr2=0x7f1418069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:40.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14180678c0 0x7f1418069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f142c0d0d00 tx=0x7f1420009040 comp rx=0 tx=0).stop 2024-09-12T03:34:40.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 msgr2=0x7f142c15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:40.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c15afc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f142400cf90 tx=0x7f142400a7d0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 shutdown_connections 2024-09-12T03:34:40.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14180678c0 0x7f1418069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f142c15c2a0 0x7f142c14b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f142c15bec0 0x7f142c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 --2- 172.21.15.73:0/4058701172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f142c0af470 0x7f142c15afc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 >> 172.21.15.73:0/4058701172 conn(0x7f142c0b1f90 msgr2=0x7f142c0b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:40.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 shutdown_connections 2024-09-12T03:34:40.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.065+0000 7f1431639640 1 -- 172.21.15.73:0/4058701172 wait complete. 2024-09-12T03:34:40.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T03:34:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.217+0000 7fd0eecaa640 1 Processor -- start 2024-09-12T03:34:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.217+0000 7fd0eecaa640 1 -- start start 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0e80af120 0x7fd0e80af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80ace80 0x7fd0e80ad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e8071e00 con 0x7fd0e80cf210 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e80720e0 con 0x7fd0e80af120 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e80723c0 con 0x7fd0e80ace80 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eca46640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd0e80cf210 0x7fd0e8072ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47246/0 (socket says 172.21.15.73:47246) 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0e80af120 0x7fd0e80af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eca46640 1 -- 172.21.15.73:0/3071860354 learned_addr learned my addr 172.21.15.73:0/3071860354 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0ed247640 1 --2- 172.21.15.73:0/3071860354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80ace80 0x7fd0e80ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e7fff640 1 -- 172.21.15.73:0/3071860354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80ace80 msgr2=0x7fd0e80ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e7fff640 1 --2- 172.21.15.73:0/3071860354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80ace80 0x7fd0e80ad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e7fff640 1 -- 172.21.15.73:0/3071860354 >> v1:172.21.15.73:6789/0 conn(0x7fd0e80cf210 legacy=0x7fd0e8072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e77fe640 1 -- 172.21.15.73:0/3071860354 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980035891 0 0) 0x7fd0e8071e00 con 0x7fd0e80cf210 2024-09-12T03:34:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e7fff640 1 -- 172.21.15.73:0/3071860354 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80726a0 con 0x7fd0e80af120 2024-09-12T03:34:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0ed247640 1 --2- 172.21.15.73:0/3071860354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80ace80 0x7fd0e80ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e7fff640 1 --2- 172.21.15.73:0/3071860354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80af120 0x7fd0e80af560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0097c0 tx=0x7fd0dc01ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13a46328cc7ebac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e77fe640 1 -- 172.21.15.73:0/3071860354 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0b0070 con 0x7fd0e80af120 2024-09-12T03:34:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e77fe640 1 -- 172.21.15.73:0/3071860354 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc0ab600 con 0x7fd0e80af120 2024-09-12T03:34:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0e77fe640 1 -- 172.21.15.73:0/3071860354 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0ab9d0 con 0x7fd0e80af120 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- 172.21.15.73:0/3071860354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80af120 msgr2=0x7fd0e80af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/3071860354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80af120 0x7fd0e80af560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0097c0 tx=0x7fd0dc01ce70 comp rx=0 tx=0).stop 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- 172.21.15.73:0/3071860354 shutdown_connections 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/3071860354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80ace80 0x7fd0e80ad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/3071860354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80af120 0x7fd0e80af560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- 172.21.15.73:0/3071860354 >> 172.21.15.73:0/3071860354 conn(0x7fd0e806c380 msgr2=0x7fd0e80b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- 172.21.15.73:0/3071860354 shutdown_connections 2024-09-12T03:34:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.221+0000 7fd0eecaa640 1 -- 172.21.15.73:0/3071860354 wait complete. 2024-09-12T03:34:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 Processor -- start 2024-09-12T03:34:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 -- start start 2024-09-12T03:34:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e80ace80 0x7fd0e81652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80af120 0x7fd0e80b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80cf210 0x7fd0e815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8168f40 con 0x7fd0e80cf210 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8168dc0 con 0x7fd0e80ace80 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e81690c0 con 0x7fd0e80af120 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80cf210 0x7fd0e815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80cf210 0x7fd0e815a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34256/0 (socket says 172.21.15.73:34256) 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 -- 172.21.15.73:0/929073739 learned_addr learned my addr 172.21.15.73:0/929073739 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0e7fff640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80af120 0x7fd0e80b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eca46640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e80ace80 0x7fd0e81652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 -- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80af120 msgr2=0x7fd0e80b1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80af120 0x7fd0e80b1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 -- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e80ace80 msgr2=0x7fd0e81652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e80ace80 0x7fd0e81652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 -- 172.21.15.73:0/929073739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e80cd7e0 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0e7fff640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80af120 0x7fd0e80b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0ed247640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80cf210 0x7fd0e815a170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000cd50 tx=0x7fd0e000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0e57fa640 1 -- 172.21.15.73:0/929073739 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000f680 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0e57fa640 1 -- 172.21.15.73:0/929073739 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e000f840 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e80b0340 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0e57fa640 1 -- 172.21.15.73:0/929073739 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000fc30 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e80b0900 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e80ad310 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.225+0000 7fd0e57fa640 1 -- 172.21.15.73:0/929073739 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0e00213f0 con 0x7fd0e80cf210 2024-09-12T03:34:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.229+0000 7fd0e57fa640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0d40678c0 0x7fd0d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.229+0000 7fd0e57fa640 1 -- 172.21.15.73:0/929073739 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fd0e0086cc0 con 0x7fd0e80cf210 2024-09-12T03:34:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.229+0000 7fd0eca46640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0d40678c0 0x7fd0d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.229+0000 7fd0eca46640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0d40678c0 0x7fd0d4069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000f70 tx=0x7fd0d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:40.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.233+0000 7fd0e57fa640 1 -- 172.21.15.73:0/929073739 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0e008d080 con 0x7fd0e80cf210 2024-09-12T03:34:40.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:40.381+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd0e80ad630 con 0x7fd0e80cf210 2024-09-12T03:34:42.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.073+0000 7fd0e57fa640 1 -- 172.21.15.73:0/929073739 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fd0e0014030 con 0x7fd0e80cf210 2024-09-12T03:34:42.077 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data_ec' created 2024-09-12T03:34:42.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.081+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0d40678c0 msgr2=0x7fd0d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:42.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.081+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0d40678c0 0x7fd0d4069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000f70 tx=0x7fd0d8009040 comp rx=0 tx=0).stop 2024-09-12T03:34:42.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.081+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80cf210 msgr2=0x7fd0e815a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:42.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.081+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80cf210 0x7fd0e815a170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000cd50 tx=0x7fd0e000a650 comp rx=0 tx=0).stop 2024-09-12T03:34:42.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 shutdown_connections 2024-09-12T03:34:42.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0d40678c0 0x7fd0d4069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e80cf210 0x7fd0e815a170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0e80af120 0x7fd0e80b1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 --2- 172.21.15.73:0/929073739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0e80ace80 0x7fd0e81652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 >> 172.21.15.73:0/929073739 conn(0x7fd0e806c380 msgr2=0x7fd0e815ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 shutdown_connections 2024-09-12T03:34:42.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.085+0000 7fd0eecaa640 1 -- 172.21.15.73:0/929073739 wait complete. 2024-09-12T03:34:42.114 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T03:34:42.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f989a8d9640 1 Processor -- start 2024-09-12T03:34:42.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f989a8d9640 1 -- start start 2024-09-12T03:34:42.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f989a8d9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 0x7f98940ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f989a8d9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98940b3290 con 0x7f98940af470 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f989a8d9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98940b3570 con 0x7f989415c2a0 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f989a8d9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98940b3850 con 0x7f989415bec0 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9898e76640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98940af470 0x7f989406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47252/0 (socket says 172.21.15.73:47252) 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9898e76640 1 -- 172.21.15.73:0/2956722872 learned_addr learned my addr 172.21.15.73:0/2956722872 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905035411 0 0) 0x7f98940b3290 con 0x7f98940af470 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9893fff640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 0x7f98940ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9880003530 con 0x7f98940af470 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1812520425 0 0) 0x7f9880003530 con 0x7f98940af470 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 msgr2=0x7f98940ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 0x7f98940ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 >> v1:172.21.15.150:6789/0 conn(0x7f989415c2a0 legacy=0x7f98940aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98940b3b30 con 0x7f98940af470 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f988c001680 con 0x7f98940af470 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 >> v1:172.21.15.73:6789/0 conn(0x7f98940af470 legacy=0x7f989406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 0x7f98800039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9880003f70 0x7f9880004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9880004d50 0x7f98800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98940b3850 con 0x7f9880004d50 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f988000bab0 con 0x7f9880003f70 2024-09-12T03:34:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.233+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f988000bcb0 con 0x7f989415bec0 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9880004d50 0x7f98800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9893fff640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 0x7f98800039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f98937fe640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9880003f70 0x7f9880004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 -- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 msgr2=0x7f98800039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f989415bec0 0x7f98800039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 -- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9880003f70 msgr2=0x7f9880004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9880003f70 0x7f9880004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 -- 172.21.15.73:0/2956722872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9880003530 con 0x7f9880004d50 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9880004d50 0x7f98800051d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c1c0 tx=0x7f988c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b3755692eee827 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c007d00 con 0x7f9880004d50 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988c0a9020 con 0x7f9880004d50 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9892ffd640 1 -- 172.21.15.73:0/2956722872 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c0a5b80 con 0x7f9880004d50 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f989a8d9640 1 -- 172.21.15.73:0/2956722872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9880004d50 msgr2=0x7f98800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f989a8d9640 1 --2- 172.21.15.73:0/2956722872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9880004d50 0x7f98800051d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f988c00c1c0 tx=0x7f988c01cc60 comp rx=0 tx=0).stop 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f9898e76640 1 -- 172.21.15.73:0/2956722872 reap_dead start 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f989a8d9640 1 -- 172.21.15.73:0/2956722872 shutdown_connections 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f989a8d9640 1 -- 172.21.15.73:0/2956722872 >> 172.21.15.73:0/2956722872 conn(0x7f98940b1f90 msgr2=0x7f98940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f989a8d9640 1 -- 172.21.15.73:0/2956722872 shutdown_connections 2024-09-12T03:34:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.237+0000 7f989a8d9640 1 -- 172.21.15.73:0/2956722872 wait complete. 2024-09-12T03:34:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 Processor -- start 2024-09-12T03:34:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 -- start start 2024-09-12T03:34:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9880004d50 0x7f989414b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98941597f0 0x7f9894159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98941e3690 0x7f98941e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98940afc90 con 0x7f98941e3690 2024-09-12T03:34:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98940b40f0 con 0x7f98941597f0 2024-09-12T03:34:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98940ad200 con 0x7f9880004d50 2024-09-12T03:34:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98941e3690 0x7f98941e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98941e3690 0x7f98941e3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34266/0 (socket says 172.21.15.73:34266) 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 -- 172.21.15.73:0/3828814669 learned_addr learned my addr 172.21.15.73:0/3828814669 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f98937fe640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98941597f0 0x7f9894159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9893fff640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9880004d50 0x7f989414b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 -- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9880004d50 msgr2=0x7f989414b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9880004d50 0x7f989414b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 -- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98941597f0 msgr2=0x7f9894159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98941597f0 0x7f9894159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 -- 172.21.15.73:0/3828814669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98941e46e0 con 0x7f98941e3690 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9898e76640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98941e3690 0x7f98941e3b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f988c007040 tx=0x7f9880005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9890ff9640 1 -- 172.21.15.73:0/3828814669 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c001c40 con 0x7f98941e3690 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9890ff9640 1 -- 172.21.15.73:0/3828814669 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f988c0b3070 con 0x7f98941e3690 2024-09-12T03:34:42.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98941e49c0 con 0x7f98941e3690 2024-09-12T03:34:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f9890ff9640 1 -- 172.21.15.73:0/3828814669 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f988c004bf0 con 0x7f98941e3690 2024-09-12T03:34:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98941e4f80 con 0x7f98941e3690 2024-09-12T03:34:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.241+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98940ad630 con 0x7f98941e3690 2024-09-12T03:34:42.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.245+0000 7f9890ff9640 1 -- 172.21.15.73:0/3828814669 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f988c007070 con 0x7f98941e3690 2024-09-12T03:34:42.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.245+0000 7f9890ff9640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98740678f0 0x7f9874069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:42.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.245+0000 7f9890ff9640 1 -- 172.21.15.73:0/3828814669 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f988c11fbd0 con 0x7f98941e3690 2024-09-12T03:34:42.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.245+0000 7f9893fff640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98740678f0 0x7f9874069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:42.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.245+0000 7f9893fff640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98740678f0 0x7f9874069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f987c009ae0 tx=0x7f987c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:42.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.249+0000 7f9890ff9640 1 -- 172.21.15.73:0/3828814669 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f988c016970 con 0x7f98941e3690 2024-09-12T03:34:42.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:42.409+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f989406fcd0 con 0x7f98941e3690 2024-09-12T03:34:43.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.081+0000 7f9890ff9640 1 -- 172.21.15.73:0/3828814669 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f988c0a5e20 con 0x7f98941e3690 2024-09-12T03:34:43.085 INFO:teuthology.orchestra.run.smithi073.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T03:34:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.085+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98740678f0 msgr2=0x7f9874069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.085+0000 7f989a8d9640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98740678f0 0x7f9874069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f987c009ae0 tx=0x7f987c008040 comp rx=0 tx=0).stop 2024-09-12T03:34:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.085+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98941e3690 msgr2=0x7f98941e3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:43.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.085+0000 7f989a8d9640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98941e3690 0x7f98941e3b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f988c007040 tx=0x7f9880005840 comp rx=0 tx=0).stop 2024-09-12T03:34:43.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 shutdown_connections 2024-09-12T03:34:43.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98740678f0 0x7f9874069db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98941e3690 0x7f98941e3b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98941597f0 0x7f9894159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 --2- 172.21.15.73:0/3828814669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9880004d50 0x7f989414b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 >> 172.21.15.73:0/3828814669 conn(0x7f98940b1f90 msgr2=0x7f98941578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:43.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 shutdown_connections 2024-09-12T03:34:43.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.089+0000 7f989a8d9640 1 -- 172.21.15.73:0/3828814669 wait complete. 2024-09-12T03:34:43.128 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T03:34:43.194 INFO:tasks.ceph.mds.c.smithi073.stderr:2024-09-12T03:34:43.193+0000 7f3c759f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:34:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.249+0000 7fe4c5933640 1 Processor -- start 2024-09-12T03:34:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.249+0000 7fe4c5933640 1 -- start start 2024-09-12T03:34:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.249+0000 7fe4c5933640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe4c015bec0 0x7fe4c00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.249+0000 7fe4c5933640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:43.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.249+0000 7fe4c5933640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c00b3290 con 0x7fe4c015c2a0 2024-09-12T03:34:43.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.249+0000 7fe4c5933640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c00b3570 con 0x7fe4c015bec0 2024-09-12T03:34:43.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.249+0000 7fe4c5933640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c00b3850 con 0x7fe4c00af470 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4beffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe4c015bec0 0x7fe4c00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4be7fc640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe4c015c2a0 0x7fe4c00aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:41084/0 (socket says 172.21.15.73:41084) 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4bf7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4beffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe4c015bec0 0x7fe4c00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:38430/0 (socket says 172.21.15.73:38430) 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4be7fc640 1 -- 172.21.15.73:0/3662994915 learned_addr learned my addr 172.21.15.73:0/3662994915 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4beffd640 1 -- 172.21.15.73:0/3662994915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 msgr2=0x7fe4c006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4beffd640 1 --2- 172.21.15.73:0/3662994915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4beffd640 1 -- 172.21.15.73:0/3662994915 >> v1:172.21.15.150:6789/0 conn(0x7fe4c015c2a0 legacy=0x7fe4c00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:43.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4beffd640 1 -- 172.21.15.73:0/3662994915 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c00b3b30 con 0x7fe4c015bec0 2024-09-12T03:34:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4beffd640 1 --2- 172.21.15.73:0/3662994915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015bec0 0x7fe4c00ad200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00097c0 tx=0x7fe4b001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25eae55ea9465302 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4bdffb640 1 -- 172.21.15.73:0/3662994915 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b1070 con 0x7fe4c015bec0 2024-09-12T03:34:43.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4bdffb640 1 -- 172.21.15.73:0/3662994915 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b00a8050 con 0x7fe4c015bec0 2024-09-12T03:34:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.253+0000 7fe4bdffb640 1 -- 172.21.15.73:0/3662994915 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00ac860 con 0x7fe4c015bec0 2024-09-12T03:34:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- 172.21.15.73:0/3662994915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015bec0 msgr2=0x7fe4c00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:43.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3662994915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015bec0 0x7fe4c00ad200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00097c0 tx=0x7fe4b001c3e0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- 172.21.15.73:0/3662994915 shutdown_connections 2024-09-12T03:34:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3662994915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3662994915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015bec0 0x7fe4c00ad200 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- 172.21.15.73:0/3662994915 >> 172.21.15.73:0/3662994915 conn(0x7fe4c00b1f90 msgr2=0x7fe4c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- 172.21.15.73:0/3662994915 shutdown_connections 2024-09-12T03:34:43.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- 172.21.15.73:0/3662994915 wait complete. 2024-09-12T03:34:43.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 Processor -- start 2024-09-12T03:34:43.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- start start 2024-09-12T03:34:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4c015bec0 0x7fe4c014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015c2a0 0x7fe4c0149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c006ed50 con 0x7fe4c015bec0 2024-09-12T03:34:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00ad740 con 0x7fe4c015c2a0 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c006eed0 con 0x7fe4c00af470 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4c015bec0 0x7fe4c014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4c015bec0 0x7fe4c014dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34274/0 (socket says 172.21.15.73:34274) 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 -- 172.21.15.73:0/3830274951 learned_addr learned my addr 172.21.15.73:0/3830274951 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4beffd640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4bf7fe640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015c2a0 0x7fe4c0149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 -- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 msgr2=0x7fe4c014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c014d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 -- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015c2a0 msgr2=0x7fe4c0149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015c2a0 0x7fe4c0149f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 -- 172.21.15.73:0/3830274951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c014eae0 con 0x7fe4c015bec0 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4be7fc640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4c015bec0 0x7fe4c014dc30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001ec0 tx=0x7fe4b400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:43.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4a7fff640 1 -- 172.21.15.73:0/3830274951 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4017070 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4a7fff640 1 -- 172.21.15.73:0/3830274951 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b4005cf0 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c015e7f0 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4a7fff640 1 -- 172.21.15.73:0/3830274951 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40072d0 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.257+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c01493a0 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.261+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c006e000 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.261+0000 7fe4a7fff640 1 -- 172.21.15.73:0/3830274951 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4b401a070 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.261+0000 7fe4a7fff640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe4ac0678c0 0x7fe4ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.261+0000 7fe4beffd640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe4ac0678c0 0x7fe4ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.261+0000 7fe4a7fff640 1 -- 172.21.15.73:0/3830274951 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fe4b4085200 con 0x7fe4c015bec0 2024-09-12T03:34:43.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.261+0000 7fe4beffd640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe4ac0678c0 0x7fe4ac069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00ae000 tx=0x7fe4b00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:43.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.265+0000 7fe4a7fff640 1 -- 172.21.15.73:0/3830274951 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4b40553d0 con 0x7fe4c015bec0 2024-09-12T03:34:43.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:43.465+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fe4c006fcd0 con 0x7fe4c015bec0 2024-09-12T03:34:44.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.093+0000 7fe4a7fff640 1 -- 172.21.15.73:0/3830274951 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7fe4b40596d0 con 0x7fe4c015bec0 2024-09-12T03:34:44.098 INFO:teuthology.orchestra.run.smithi073.stderr:added data pool 4 to fsmap 2024-09-12T03:34:44.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe4ac0678c0 msgr2=0x7fe4ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe4ac0678c0 0x7fe4ac069d80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00ae000 tx=0x7fe4b00a7000 comp rx=0 tx=0).stop 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4c015bec0 msgr2=0x7fe4c014dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4c015bec0 0x7fe4c014dc30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001ec0 tx=0x7fe4b400c890 comp rx=0 tx=0).stop 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 shutdown_connections 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe4ac0678c0 0x7fe4ac069d80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4c015bec0 0x7fe4c014dc30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c015c2a0 0x7fe4c0149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 --2- 172.21.15.73:0/3830274951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe4c00af470 0x7fe4c014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 >> 172.21.15.73:0/3830274951 conn(0x7fe4c00b1f90 msgr2=0x7fe4c0150a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 shutdown_connections 2024-09-12T03:34:44.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.097+0000 7fe4c5933640 1 -- 172.21.15.73:0/3830274951 wait complete. 2024-09-12T03:34:44.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:44.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.237+0000 7fc2aea6a640 1 Processor -- start 2024-09-12T03:34:44.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2aea6a640 1 -- start start 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2aea6a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc2a806f010 0x7fc2a8166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2aea6a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a80b3290 con 0x7fc2a815c2a0 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2aea6a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a80b3570 con 0x7fc2a815bec0 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2aea6a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a80b3850 con 0x7fc2a806f010 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc2a815c2a0 0x7fc2a80aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47258/0 (socket says 172.21.15.73:47258) 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a7fff640 1 -- 172.21.15.73:0/2456224913 learned_addr learned my addr 172.21.15.73:0/2456224913 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ad007640 1 --2- 172.21.15.73:0/2456224913 >> v2:172.21.15.150:3300/0 conn(0x7fc2a806f010 0x7fc2a8166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025267499 0 0) 0x7fc2a80b3290 con 0x7fc2a815c2a0 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc290003530 con 0x7fc2a815c2a0 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633205726 0 0) 0x7fc290003530 con 0x7fc2a815c2a0 2024-09-12T03:34:44.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 >> v2:172.21.15.150:3300/0 conn(0x7fc2a806f010 msgr2=0x7fc2a8166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 --2- 172.21.15.73:0/2456224913 >> v2:172.21.15.150:3300/0 conn(0x7fc2a806f010 0x7fc2a8166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 >> v1:172.21.15.150:6789/0 conn(0x7fc2a815bec0 legacy=0x7fc2a80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a80b3b30 con 0x7fc2a815c2a0 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fc298001680 con 0x7fc2a815c2a0 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 >> v1:172.21.15.73:6789/0 conn(0x7fc2a815c2a0 legacy=0x7fc2a80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2900039c0 0x7fc290003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc290004810 0x7fc290004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc29000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a80b3850 con 0x7fc2900051d0 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc29000c070 con 0x7fc2900039c0 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc29000c270 con 0x7fc290004810 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ad007640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc29000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ac806640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2900039c0 0x7fc290003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2a7fff640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc290004810 0x7fc290004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ad007640 1 -- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc290004810 msgr2=0x7fc290004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ad007640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc290004810 0x7fc290004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ad007640 1 -- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2900039c0 msgr2=0x7fc290003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ad007640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2900039c0 0x7fc290003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.241+0000 7fc2ad007640 1 -- 172.21.15.73:0/2456224913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc290003530 con 0x7fc2900051d0 2024-09-12T03:34:44.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2ad007640 1 -- 172.21.15.73:0/2456224913 reap_dead start 2024-09-12T03:34:44.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2ad007640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc29000b9d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009f90 tx=0x7fc2a001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205baf45c531df14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0009c10 con 0x7fc2900051d0 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a00a5c90 con 0x7fc2900051d0 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2a77fe640 1 -- 172.21.15.73:0/2456224913 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0003be0 con 0x7fc2900051d0 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- 172.21.15.73:0/2456224913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 msgr2=0x7fc29000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc29000b9d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009f90 tx=0x7fc2a001cc80 comp rx=0 tx=0).stop 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- 172.21.15.73:0/2456224913 shutdown_connections 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/2456224913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc29000b9d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- 172.21.15.73:0/2456224913 >> 172.21.15.73:0/2456224913 conn(0x7fc2a80b1f90 msgr2=0x7fc2a80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- 172.21.15.73:0/2456224913 shutdown_connections 2024-09-12T03:34:44.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- 172.21.15.73:0/2456224913 wait complete. 2024-09-12T03:34:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 Processor -- start 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- start start 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc2a81f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a80b1010 0x7fc2a80b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a815df10 0x7fc2a815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a80afc90 con 0x7fc2900051d0 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a80b40f0 con 0x7fc2a815df10 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2aea6a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a80ad200 con 0x7fc2a80b1010 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2ac806640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc2a81f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2ac806640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc2a81f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34286/0 (socket says 172.21.15.73:34286) 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.245+0000 7fc2ac806640 1 -- 172.21.15.73:0/3229850831 learned_addr learned my addr 172.21.15.73:0/3229850831 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:44.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ad007640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a815df10 0x7fc2a815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a7fff640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a80b1010 0x7fc2a80b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ac806640 1 -- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a80b1010 msgr2=0x7fc2a80b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ac806640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a80b1010 0x7fc2a80b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ac806640 1 -- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a815df10 msgr2=0x7fc2a815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ac806640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a815df10 0x7fc2a815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ac806640 1 -- 172.21.15.73:0/3229850831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a81f5620 con 0x7fc2900051d0 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ad007640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a815df10 0x7fc2a815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2ac806640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc2a81f50e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00e500 tx=0x7fc29c00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a57fa640 1 -- 172.21.15.73:0/3229850831 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c0052e0 con 0x7fc2900051d0 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a57fa640 1 -- 172.21.15.73:0/3229850831 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc29c018070 con 0x7fc2900051d0 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a57fa640 1 -- 172.21.15.73:0/3229850831 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c003820 con 0x7fc2900051d0 2024-09-12T03:34:44.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a815e900 con 0x7fc2900051d0 2024-09-12T03:34:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a815ee70 con 0x7fc2900051d0 2024-09-12T03:34:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a80ad590 con 0x7fc2900051d0 2024-09-12T03:34:44.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a57fa640 1 -- 172.21.15.73:0/3229850831 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc29c0039c0 con 0x7fc2900051d0 2024-09-12T03:34:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a57fa640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2940678c0 0x7fc294069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a57fa640 1 -- 172.21.15.73:0/3229850831 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc29c085be0 con 0x7fc2900051d0 2024-09-12T03:34:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a7fff640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2940678c0 0x7fc294069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.249+0000 7fc2a7fff640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2940678c0 0x7fc294069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc298001ec0 tx=0x7fc298000ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.253+0000 7fc2a57fa640 1 -- 172.21.15.73:0/3229850831 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc2a81f5620 con 0x7fc2900051d0 2024-09-12T03:34:44.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.445+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2a80b2930 con 0x7fc2900051d0 2024-09-12T03:34:44.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.445+0000 7fc2a57fa640 1 -- 172.21.15.73:0/3229850831 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7fc29c0563f0 con 0x7fc2900051d0 2024-09-12T03:34:44.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:44.449 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"btime":"2024-09-12T03:34:44:086747+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:43.469045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:34:44.449 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-09-12T03:34:44.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2940678c0 msgr2=0x7fc294069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2940678c0 0x7fc294069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc298001ec0 tx=0x7fc298000ee0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 msgr2=0x7fc2a81f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc2a81f50e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00e500 tx=0x7fc29c00e9c0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 shutdown_connections 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2940678c0 0x7fc294069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a815df10 0x7fc2a815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a80b1010 0x7fc2a80b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 --2- 172.21.15.73:0/3229850831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2900051d0 0x7fc2a81f50e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 >> 172.21.15.73:0/3229850831 conn(0x7fc2a80b1f90 msgr2=0x7fc2a80aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 shutdown_connections 2024-09-12T03:34:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.449+0000 7fc2aea6a640 1 -- 172.21.15.73:0/3229850831 wait complete. 2024-09-12T03:34:44.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e4670640 1 Processor -- start 2024-09-12T03:34:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e4670640 1 -- start start 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e4670640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc15bec0 0x7fb6dc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e4670640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb6dc15c2a0 0x7fb6dc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e4670640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc0b3290 con 0x7fb6dc0af2a0 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e4670640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb6dc0b3570 con 0x7fb6dc15c2a0 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e4670640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc0b3850 con 0x7fb6dc15bec0 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e2c0d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb6dc0af2a0 0x7fb6dc15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47270/0 (socket says 172.21.15.73:47270) 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e2c0d640 1 -- 172.21.15.73:0/406641950 learned_addr learned my addr 172.21.15.73:0/406641950 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e240c640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc15bec0 0x7fb6dc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e1c0b640 1 --2- 172.21.15.73:0/406641950 >> v2:172.21.15.150:3300/0 conn(0x7fb6dc15c2a0 0x7fb6dc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901613379 0 0) 0x7fb6dc0b3290 con 0x7fb6dc0af2a0 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6c8003530 con 0x7fb6dc0af2a0 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 858840626 0 0) 0x7fb6c8003530 con 0x7fb6dc0af2a0 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc15bec0 msgr2=0x7fb6dc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc15bec0 0x7fb6dc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 >> v2:172.21.15.150:3300/0 conn(0x7fb6dc15c2a0 msgr2=0x7fb6dc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 --2- 172.21.15.73:0/406641950 >> v2:172.21.15.150:3300/0 conn(0x7fb6dc15c2a0 0x7fb6dc0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc0b3b30 con 0x7fb6dc0af2a0 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fb6d4001680 con 0x7fb6dc0af2a0 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 >> v1:172.21.15.73:6789/0 conn(0x7fb6dc0af2a0 legacy=0x7fb6dc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c80039c0 0x7fb6c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c8004810 0x7fb6c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc15bec0 0x7fb6c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc0b3570 con 0x7fb6c80039c0 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc0b3850 con 0x7fb6c8004810 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c800b9d0 con 0x7fb6dc15bec0 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e240c640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c80039c0 0x7fb6c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e1c0b640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c8004810 0x7fb6c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e240c640 1 -- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc15bec0 msgr2=0x7fb6c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e240c640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc15bec0 0x7fb6c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e240c640 1 -- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c8004810 msgr2=0x7fb6c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e240c640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c8004810 0x7fb6c8004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.581+0000 7fb6e240c640 1 -- 172.21.15.73:0/406641950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c8003530 con 0x7fb6c80039c0 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e240c640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c80039c0 0x7fb6c8003de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009ae0 tx=0x7fb6d001ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d804028bfe79ce89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00b2070 con 0x7fb6c80039c0 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d00a5570 con 0x7fb6c80039c0 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e140a640 1 -- 172.21.15.73:0/406641950 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00096b0 con 0x7fb6c80039c0 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- 172.21.15.73:0/406641950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c80039c0 msgr2=0x7fb6c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 --2- 172.21.15.73:0/406641950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c80039c0 0x7fb6c8003de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009ae0 tx=0x7fb6d001ca80 comp rx=0 tx=0).stop 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e2c0d640 1 -- 172.21.15.73:0/406641950 reap_dead start 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- 172.21.15.73:0/406641950 shutdown_connections 2024-09-12T03:34:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- 172.21.15.73:0/406641950 >> 172.21.15.73:0/406641950 conn(0x7fb6dc0b1f90 msgr2=0x7fb6dc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:44.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- 172.21.15.73:0/406641950 shutdown_connections 2024-09-12T03:34:44.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- 172.21.15.73:0/406641950 wait complete. 2024-09-12T03:34:44.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 Processor -- start 2024-09-12T03:34:44.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- start start 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c80039c0 0x7fb6dc14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6dc073520 0x7fb6dc0739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc0cfef0 0x7fb6dc0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc0ad610 con 0x7fb6dc073520 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb6dc0af6d0 con 0x7fb6c80039c0 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e4670640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb6dc0ad790 con 0x7fb6dc0cfef0 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6dc073520 0x7fb6dc0739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6dc073520 0x7fb6dc0739a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34306/0 (socket says 172.21.15.73:34306) 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 -- 172.21.15.73:0/1843949986 learned_addr learned my addr 172.21.15.73:0/1843949986 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e240c640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c80039c0 0x7fb6dc14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e2c0d640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc0cfef0 0x7fb6dc0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 -- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc0cfef0 msgr2=0x7fb6dc0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc0cfef0 0x7fb6dc0d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 -- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c80039c0 msgr2=0x7fb6dc14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c80039c0 0x7fb6dc14fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.585+0000 7fb6e1c0b640 1 -- 172.21.15.73:0/1843949986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc14ffd0 con 0x7fb6dc073520 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6e1c0b640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6dc073520 0x7fb6dc0739a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800f3d0 tx=0x7fb6d800f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6ceffd640 1 -- 172.21.15.73:0/1843949986 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8016620 con 0x7fb6dc073520 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6ceffd640 1 -- 172.21.15.73:0/1843949986 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d801b070 con 0x7fb6dc073520 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6dc1e8f90 con 0x7fb6dc073520 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6ceffd640 1 -- 172.21.15.73:0/1843949986 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8016a20 con 0x7fb6dc073520 2024-09-12T03:34:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6dc1e9550 con 0x7fb6dc073520 2024-09-12T03:34:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6dc06fcd0 con 0x7fb6dc073520 2024-09-12T03:34:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6ceffd640 1 -- 172.21.15.73:0/1843949986 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb6d8016bc0 con 0x7fb6dc073520 2024-09-12T03:34:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6ceffd640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb6c00678c0 0x7fb6c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6ceffd640 1 -- 172.21.15.73:0/1843949986 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb6d8086f60 con 0x7fb6dc073520 2024-09-12T03:34:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6e240c640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb6c00678c0 0x7fb6c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.589+0000 7fb6e240c640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb6c00678c0 0x7fb6c0069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00af000 tx=0x7fb6d00046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.593+0000 7fb6ceffd640 1 -- 172.21.15.73:0/1843949986 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb6d8057760 con 0x7fb6dc073520 2024-09-12T03:34:44.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.741+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6dc0b0ed0 con 0x7fb6dc073520 2024-09-12T03:34:44.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6ceffd640 1 -- 172.21.15.73:0/1843949986 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7fb6d8057060 con 0x7fb6dc073520 2024-09-12T03:34:44.748 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:44.748 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:44.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb6c00678c0 msgr2=0x7fb6c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb6c00678c0 0x7fb6c0069d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00af000 tx=0x7fb6d00046d0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6dc073520 msgr2=0x7fb6dc0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6dc073520 0x7fb6dc0739a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800f3d0 tx=0x7fb6d800f890 comp rx=0 tx=0).stop 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 shutdown_connections 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb6c00678c0 0x7fb6c0069d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6dc073520 0x7fb6dc0739a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb6dc0cfef0 0x7fb6dc0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 --2- 172.21.15.73:0/1843949986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6c80039c0 0x7fb6dc14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 >> 172.21.15.73:0/1843949986 conn(0x7fb6dc0b1f90 msgr2=0x7fb6dc0b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 shutdown_connections 2024-09-12T03:34:44.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.745+0000 7fb6e4670640 1 -- 172.21.15.73:0/1843949986 wait complete. 2024-09-12T03:34:44.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 Processor -- start 2024-09-12T03:34:44.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 -- start start 2024-09-12T03:34:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33a4153010 0x7f33a415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a4072dd0 0x7f33a4073220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33a40b3280 0x7f33a40b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f33a40b3c30 con 0x7f33a4153010 2024-09-12T03:34:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f33a41533f0 con 0x7f33a40b3280 2024-09-12T03:34:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33ac77b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f33a4073850 con 0x7f33a4072dd0 2024-09-12T03:34:44.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33a4153010 0x7f33a415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33a4153010 0x7f33a415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34322/0 (socket says 172.21.15.73:34322) 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 -- 172.21.15.73:0/3873655572 learned_addr learned my addr 172.21.15.73:0/3873655572 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33a9d16640 1 --2- 172.21.15.73:0/3873655572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a4072dd0 0x7f33a4073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aad18640 1 --2- 172.21.15.73:0/3873655572 >> v2:172.21.15.150:3300/0 conn(0x7f33a40b3280 0x7f33a40b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 -- 172.21.15.73:0/3873655572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a4072dd0 msgr2=0x7f33a4073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 --2- 172.21.15.73:0/3873655572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a4072dd0 0x7f33a4073220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 -- 172.21.15.73:0/3873655572 >> v2:172.21.15.150:3300/0 conn(0x7f33a40b3280 msgr2=0x7f33a40b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 --2- 172.21.15.73:0/3873655572 >> v2:172.21.15.150:3300/0 conn(0x7f33a40b3280 0x7f33a40b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.881+0000 7f33aa517640 1 -- 172.21.15.73:0/3873655572 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a4073b30 con 0x7f33a4153010 2024-09-12T03:34:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33aa517640 1 --2- 172.21.15.73:0/3873655572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a415d090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33a415fa70 tx=0x7f33a001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c69b19ccca3d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33a9515640 1 -- 172.21.15.73:0/3873655572 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a00b1070 con 0x7f33a4153010 2024-09-12T03:34:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33a9515640 1 -- 172.21.15.73:0/3873655572 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a00ac630 con 0x7f33a4153010 2024-09-12T03:34:44.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33a9515640 1 -- 172.21.15.73:0/3873655572 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a00a8050 con 0x7f33a4153010 2024-09-12T03:34:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- 172.21.15.73:0/3873655572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 msgr2=0x7f33a415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 --2- 172.21.15.73:0/3873655572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a415d090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f33a415fa70 tx=0x7f33a001c520 comp rx=0 tx=0).stop 2024-09-12T03:34:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- 172.21.15.73:0/3873655572 shutdown_connections 2024-09-12T03:34:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 --2- 172.21.15.73:0/3873655572 >> v2:172.21.15.150:3300/0 conn(0x7f33a40b3280 0x7f33a40b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 --2- 172.21.15.73:0/3873655572 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a4072dd0 0x7f33a4073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 --2- 172.21.15.73:0/3873655572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a415d090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- 172.21.15.73:0/3873655572 >> 172.21.15.73:0/3873655572 conn(0x7f33a40b6870 msgr2=0x7f33a40b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- 172.21.15.73:0/3873655572 shutdown_connections 2024-09-12T03:34:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- 172.21.15.73:0/3873655572 wait complete. 2024-09-12T03:34:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 Processor -- start 2024-09-12T03:34:44.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- start start 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a4072dd0 0x7f33a4156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a40b3280 0x7f33a4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a41591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33a4160340 con 0x7f33a4153010 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f33a406fe00 con 0x7f33a4072dd0 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33ac77b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f33a41604c0 con 0x7f33a40b3280 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33aad18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a41591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33aad18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a41591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34332/0 (socket says 172.21.15.73:34332) 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33aad18640 1 -- 172.21.15.73:0/1044497103 learned_addr learned my addr 172.21.15.73:0/1044497103 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33a9d16640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a40b3280 0x7f33a4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.885+0000 7f33aa517640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a4072dd0 0x7f33a4156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aad18640 1 -- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a40b3280 msgr2=0x7f33a4158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aad18640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a40b3280 0x7f33a4158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aad18640 1 -- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a4072dd0 msgr2=0x7f33a4156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aad18640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a4072dd0 0x7f33a4156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aad18640 1 -- 172.21.15.73:0/1044497103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a415bc80 con 0x7f33a4153010 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33a9d16640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a40b3280 0x7f33a4158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aa517640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a4072dd0 0x7f33a4156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aad18640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a41591f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f339c007e40 tx=0x7f339c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f339affd640 1 -- 172.21.15.73:0/1044497103 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c014620 con 0x7f33a4153010 2024-09-12T03:34:44.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f339affd640 1 -- 172.21.15.73:0/1044497103 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c019070 con 0x7f33a4153010 2024-09-12T03:34:44.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a41616f0 con 0x7f33a4153010 2024-09-12T03:34:44.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f339affd640 1 -- 172.21.15.73:0/1044497103 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c014a20 con 0x7f33a4153010 2024-09-12T03:34:44.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a4161cb0 con 0x7f33a4153010 2024-09-12T03:34:44.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a4073220 con 0x7f33a4153010 2024-09-12T03:34:44.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f339affd640 1 -- 172.21.15.73:0/1044497103 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f339c014bc0 con 0x7f33a4153010 2024-09-12T03:34:44.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f339affd640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33880678c0 0x7f3388069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:44.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f339affd640 1 -- 172.21.15.73:0/1044497103 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f339c0867f0 con 0x7f33a4153010 2024-09-12T03:34:44.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aa517640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33880678c0 0x7f3388069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:44.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.889+0000 7f33aa517640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33880678c0 0x7f3388069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33a00ae000 tx=0x7f33a00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:44.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:44.893+0000 7f339affd640 1 -- 172.21.15.73:0/1044497103 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f339c057080 con 0x7f33a4153010 2024-09-12T03:34:45.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.057+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33a406dde0 con 0x7f33a4153010 2024-09-12T03:34:45.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f339affd640 1 -- 172.21.15.73:0/1044497103 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f339c056980 con 0x7f33a4153010 2024-09-12T03:34:45.063 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:45.063 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33880678c0 msgr2=0x7f3388069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33880678c0 0x7f3388069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f33a00ae000 tx=0x7f33a00a7000 comp rx=0 tx=0).stop 2024-09-12T03:34:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 msgr2=0x7f33a41591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a41591f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f339c007e40 tx=0x7f339c00e4b0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 shutdown_connections 2024-09-12T03:34:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33880678c0 0x7f3388069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33a4153010 0x7f33a41591f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33a40b3280 0x7f33a4158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 --2- 172.21.15.73:0/1044497103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33a4072dd0 0x7f33a4156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 >> 172.21.15.73:0/1044497103 conn(0x7f33a40b6870 msgr2=0x7f33a406c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:45.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 shutdown_connections 2024-09-12T03:34:45.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.061+0000 7f33ac77b640 1 -- 172.21.15.73:0/1044497103 wait complete. 2024-09-12T03:34:45.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:45.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.201+0000 7f40bcafa640 1 Processor -- start 2024-09-12T03:34:45.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.201+0000 7f40bcafa640 1 -- start start 2024-09-12T03:34:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40bcafa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 0x7f40b80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40bcafa640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b80b3290 con 0x7f40b80af470 2024-09-12T03:34:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40bcafa640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b80b3570 con 0x7f40b815c2a0 2024-09-12T03:34:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40bcafa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f40b80b3850 con 0x7f40b815bec0 2024-09-12T03:34:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b6d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f40b80af470 0x7f40b806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42130/0 (socket says 172.21.15.73:42130) 2024-09-12T03:34:45.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b6d9d640 1 -- 172.21.15.73:0/3145987873 learned_addr learned my addr 172.21.15.73:0/3145987873 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587063085 0 0) 0x7f40b80b3290 con 0x7f40b80af470 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 0x7f40b80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a4003530 con 0x7f40b80af470 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814748197 0 0) 0x7f40a4003530 con 0x7f40b80af470 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 msgr2=0x7f40b80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 0x7f40b80ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 >> v1:172.21.15.150:6789/0 conn(0x7f40b815c2a0 legacy=0x7f40b80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b80b3b30 con 0x7f40b80af470 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f40b0001a00 con 0x7f40b80af470 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 >> v1:172.21.15.73:6789/0 conn(0x7f40b80af470 legacy=0x7f40b806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40a40039f0 0x7f40a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 0x7f40a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a4004d50 0x7f40a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f40b80b3850 con 0x7f40a40039f0 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f40a400bab0 con 0x7f40a4004d50 2024-09-12T03:34:45.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f40a400bcb0 con 0x7f40b815bec0 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40a40039f0 0x7f40a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40add9b640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 0x7f40a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 -- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 msgr2=0x7f40a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b815bec0 0x7f40a4004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b6d9d640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a4004d50 0x7f40a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 -- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a4004d50 msgr2=0x7f40a40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a4004d50 0x7f40a40051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 -- 172.21.15.73:0/3145987873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a4003530 con 0x7f40a40039f0 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b659c640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40a40039f0 0x7f40a4003e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009ab0 tx=0x7f40a801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78ffa36bcab4261 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.205+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a80b2070 con 0x7f40a40039f0 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a80a55f0 con 0x7f40a40039f0 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40b5d9b640 1 -- 172.21.15.73:0/3145987873 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a80096b0 con 0x7f40a40039f0 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- 172.21.15.73:0/3145987873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40a40039f0 msgr2=0x7f40a4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 --2- 172.21.15.73:0/3145987873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40a40039f0 0x7f40a4003e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009ab0 tx=0x7f40a801ca20 comp rx=0 tx=0).stop 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40b6d9d640 1 -- 172.21.15.73:0/3145987873 reap_dead start 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- 172.21.15.73:0/3145987873 shutdown_connections 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- 172.21.15.73:0/3145987873 >> 172.21.15.73:0/3145987873 conn(0x7f40b80b1f90 msgr2=0x7f40b80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:45.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- 172.21.15.73:0/3145987873 shutdown_connections 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- 172.21.15.73:0/3145987873 wait complete. 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 Processor -- start 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- start start 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a40039f0 0x7f40b81572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40b814f8b0 0x7f40b814dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b8155f40 0x7f40b81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f40b80ad790 con 0x7f40b814f8b0 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f40b80ad610 con 0x7f40a40039f0 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f40b806ef20 con 0x7f40b8155f40 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40b814f8b0 0x7f40b814dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40b814f8b0 0x7f40b814dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42022/0 (socket says 172.21.15.73:42022) 2024-09-12T03:34:45.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 -- 172.21.15.73:0/2336835303 learned_addr learned my addr 172.21.15.73:0/2336835303 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40b659c640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a40039f0 0x7f40b81572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40b6d9d640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b8155f40 0x7f40b81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 -- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b8155f40 msgr2=0x7f40b81563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b8155f40 0x7f40b81563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 -- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a40039f0 msgr2=0x7f40b81572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a40039f0 0x7f40b81572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 -- 172.21.15.73:0/2336835303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b814e810 con 0x7f40b814f8b0 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40add9b640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40b814f8b0 0x7f40b814dfe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40a000d4d0 tx=0x7f40a000d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40af7fe640 1 -- 172.21.15.73:0/2336835303 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0005480 con 0x7f40b814f8b0 2024-09-12T03:34:45.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40af7fe640 1 -- 172.21.15.73:0/2336835303 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a0017070 con 0x7f40b814f8b0 2024-09-12T03:34:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b814eaf0 con 0x7f40b814f8b0 2024-09-12T03:34:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40af7fe640 1 -- 172.21.15.73:0/2336835303 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0003840 con 0x7f40b814f8b0 2024-09-12T03:34:45.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.209+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b814f0b0 con 0x7f40b814f8b0 2024-09-12T03:34:45.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.213+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b806e000 con 0x7f40b814f8b0 2024-09-12T03:34:45.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.213+0000 7f40af7fe640 1 -- 172.21.15.73:0/2336835303 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40a00039e0 con 0x7f40b814f8b0 2024-09-12T03:34:45.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.213+0000 7f40af7fe640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40980678f0 0x7f4098069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.213+0000 7f40af7fe640 1 -- 172.21.15.73:0/2336835303 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f40a00859f0 con 0x7f40b814f8b0 2024-09-12T03:34:45.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.213+0000 7f40b659c640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40980678f0 0x7f4098069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.213+0000 7f40b659c640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40980678f0 0x7f4098069db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40a80af000 tx=0x7f40a80046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:45.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.217+0000 7f40af7fe640 1 -- 172.21.15.73:0/2336835303 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f40a0056160 con 0x7f40b814f8b0 2024-09-12T03:34:45.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40b806fcd0 con 0x7f40b814f8b0 2024-09-12T03:34:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40af7fe640 1 -- 172.21.15.73:0/2336835303 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5225 (secure 0 0 0) 0x7f40a0055a60 con 0x7f40b814f8b0 2024-09-12T03:34:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:45.400 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"btime":"2024-09-12T03:34:44:086747+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:43.469045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:34:45.400 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-09-12T03:34:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40980678f0 msgr2=0x7f4098069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40980678f0 0x7f4098069db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40a80af000 tx=0x7f40a80046d0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40b814f8b0 msgr2=0x7f40b814dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40b814f8b0 0x7f40b814dfe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40a000d4d0 tx=0x7f40a000d990 comp rx=0 tx=0).stop 2024-09-12T03:34:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 shutdown_connections 2024-09-12T03:34:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40980678f0 0x7f4098069db0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40b814f8b0 0x7f40b814dfe0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f40b8155f40 0x7f40b81563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 --2- 172.21.15.73:0/2336835303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40a40039f0 0x7f40b81572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 >> 172.21.15.73:0/2336835303 conn(0x7f40b80b1f90 msgr2=0x7f40b8074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 shutdown_connections 2024-09-12T03:34:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.397+0000 7f40bcafa640 1 -- 172.21.15.73:0/2336835303 wait complete. 2024-09-12T03:34:45.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:45.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.533+0000 7f092e0c2640 1 Processor -- start 2024-09-12T03:34:45.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.533+0000 7f092e0c2640 1 -- start start 2024-09-12T03:34:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0928073e60 0x7f092806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f092806fef0 0x7f092815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f092815bda0 con 0x7f09280b3d50 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f092806ee50 con 0x7f092806fef0 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f092806f130 con 0x7f0928073e60 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0926ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f092806fef0 0x7f092815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0927fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f09280b3d50 0x7f09280b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42144/0 (socket says 172.21.15.73:42144) 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0927fff640 1 -- 172.21.15.73:0/3706862605 learned_addr learned my addr 172.21.15.73:0/3706862605 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f09277fe640 1 --2- 172.21.15.73:0/3706862605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0928073e60 0x7f092806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0926ffd640 1 -- 172.21.15.73:0/3706862605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0928073e60 msgr2=0x7f092806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0926ffd640 1 --2- 172.21.15.73:0/3706862605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0928073e60 0x7f092806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0926ffd640 1 -- 172.21.15.73:0/3706862605 >> v1:172.21.15.73:6789/0 conn(0x7f09280b3d50 legacy=0x7f09280b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0926ffd640 1 -- 172.21.15.73:0/3706862605 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092806f410 con 0x7f092806fef0 2024-09-12T03:34:45.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f0926ffd640 1 --2- 172.21.15.73:0/3706862605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092806fef0 0x7f092815b860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f63c1ebbf12447b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:45.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f09267fc640 1 -- 172.21.15.73:0/3706862605 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c0b0070 con 0x7f092806fef0 2024-09-12T03:34:45.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f09267fc640 1 -- 172.21.15.73:0/3706862605 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c0ab600 con 0x7f092806fef0 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f09267fc640 1 -- 172.21.15.73:0/3706862605 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c0ab9d0 con 0x7f092806fef0 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- 172.21.15.73:0/3706862605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092806fef0 msgr2=0x7f092815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 --2- 172.21.15.73:0/3706862605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092806fef0 0x7f092815b860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f091c0097c0 tx=0x7f091c01c410 comp rx=0 tx=0).stop 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- 172.21.15.73:0/3706862605 shutdown_connections 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 --2- 172.21.15.73:0/3706862605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f092806fef0 0x7f092815b860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 --2- 172.21.15.73:0/3706862605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0928073e60 0x7f092806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- 172.21.15.73:0/3706862605 >> 172.21.15.73:0/3706862605 conn(0x7f09280b1f90 msgr2=0x7f09280b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- 172.21.15.73:0/3706862605 shutdown_connections 2024-09-12T03:34:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.537+0000 7f092e0c2640 1 -- 172.21.15.73:0/3706862605 wait complete. 2024-09-12T03:34:45.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 Processor -- start 2024-09-12T03:34:45.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 -- start start 2024-09-12T03:34:45.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f092806fef0 0x7f0928153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0928073e60 0x7f0928159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09280b3d50 0x7f0928159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f09280729e0 con 0x7f0928073e60 2024-09-12T03:34:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0928072860 con 0x7f092806fef0 2024-09-12T03:34:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0928072b60 con 0x7f09280b3d50 2024-09-12T03:34:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0928073e60 0x7f0928159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0928073e60 0x7f0928159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42048/0 (socket says 172.21.15.73:42048) 2024-09-12T03:34:45.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 -- 172.21.15.73:0/1919979307 learned_addr learned my addr 172.21.15.73:0/1919979307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:45.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0927fff640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09280b3d50 0x7f0928159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f09277fe640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f092806fef0 0x7f0928153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 -- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09280b3d50 msgr2=0x7f0928159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09280b3d50 0x7f0928159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 -- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f092806fef0 msgr2=0x7f0928153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f092806fef0 0x7f0928153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 -- 172.21.15.73:0/1919979307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0928152dd0 con 0x7f0928073e60 2024-09-12T03:34:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0927fff640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09280b3d50 0x7f0928159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f09277fe640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f092806fef0 0x7f0928153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f0926ffd640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0928073e60 0x7f0928159840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f091c0ae040 tx=0x7f091c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f090ffff640 1 -- 172.21.15.73:0/1919979307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c0b8030 con 0x7f0928073e60 2024-09-12T03:34:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f090ffff640 1 -- 172.21.15.73:0/1919979307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f091c0b4410 con 0x7f0928073e60 2024-09-12T03:34:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092809e0e0 con 0x7f0928073e60 2024-09-12T03:34:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f090ffff640 1 -- 172.21.15.73:0/1919979307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c0b0040 con 0x7f0928073e60 2024-09-12T03:34:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0928153370 con 0x7f0928073e60 2024-09-12T03:34:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092815b860 con 0x7f0928073e60 2024-09-12T03:34:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f090ffff640 1 -- 172.21.15.73:0/1919979307 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f091c0bb070 con 0x7f0928073e60 2024-09-12T03:34:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f090ffff640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09140678c0 0x7f0914069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.541+0000 7f090ffff640 1 -- 172.21.15.73:0/1919979307 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f091c11f7f0 con 0x7f0928073e60 2024-09-12T03:34:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.545+0000 7f09277fe640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09140678c0 0x7f0914069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.545+0000 7f09277fe640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09140678c0 0x7f0914069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0918006fd0 tx=0x7f0918008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.549+0000 7f090ffff640 1 -- 172.21.15.73:0/1919979307 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f091c0c2070 con 0x7f0928073e60 2024-09-12T03:34:45.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.709+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09280723f0 con 0x7f0928073e60 2024-09-12T03:34:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f090ffff640 1 -- 172.21.15.73:0/1919979307 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f091c016090 con 0x7f0928073e60 2024-09-12T03:34:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:45.715 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09140678c0 msgr2=0x7f0914069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09140678c0 0x7f0914069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0918006fd0 tx=0x7f0918008040 comp rx=0 tx=0).stop 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0928073e60 msgr2=0x7f0928159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0928073e60 0x7f0928159840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f091c0ae040 tx=0x7f091c0191b0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 shutdown_connections 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09140678c0 0x7f0914069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0928073e60 0x7f0928159840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f09280b3d50 0x7f0928159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 --2- 172.21.15.73:0/1919979307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f092806fef0 0x7f0928153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 >> 172.21.15.73:0/1919979307 conn(0x7f09280b1f90 msgr2=0x7f092815ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 shutdown_connections 2024-09-12T03:34:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:45.713+0000 7f092e0c2640 1 -- 172.21.15.73:0/1919979307 wait complete. 2024-09-12T03:34:46.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:34:38.389239+0000', 'modified': '2024-09-12T03:34:43.469045+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4248}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4248': {'gid': 4248, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/2532110988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2532110988}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2532110988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4248, 'qdb_cluster': [4248]} 2024-09-12T03:34:46.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:34:46.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T03:34:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfcb1e7640 1 Processor -- start 2024-09-12T03:34:46.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfcb1e7640 1 -- start start 2024-09-12T03:34:46.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfcb1e7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc415c2a0 0x7fcfc40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfcb1e7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc40af2a0 0x7fcfc406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfcb1e7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc40b3290 con 0x7fcfc415bec0 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfcb1e7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc40b3570 con 0x7fcfc415c2a0 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfcb1e7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc40b3850 con 0x7fcfc40af2a0 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfbbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc415c2a0 0x7fcfc40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfbbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfc415c2a0 0x7fcfc40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42056/0 (socket says 172.21.15.73:42056) 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2445295653 learned_addr learned my addr 172.21.15.73:0/2445295653 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfc9784640 1 --2- 172.21.15.73:0/2445295653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc40af2a0 0x7fcfc406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2445295653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc40af2a0 msgr2=0x7fcfc406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/2445295653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc40af2a0 0x7fcfc406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2445295653 >> v1:172.21.15.150:6789/0 conn(0x7fcfc415bec0 legacy=0x7fcfc40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.265+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2445295653 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc40b3b30 con 0x7fcfc415c2a0 2024-09-12T03:34:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/2445295653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc415c2a0 0x7fcfc40aed60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009870 tx=0x7fcfb401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2fd24edc728fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfbb7fe640 1 -- 172.21.15.73:0/2445295653 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40aa610 con 0x7fcfc415c2a0 2024-09-12T03:34:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfbb7fe640 1 -- 172.21.15.73:0/2445295653 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb40af070 con 0x7fcfc415c2a0 2024-09-12T03:34:46.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfbb7fe640 1 -- 172.21.15.73:0/2445295653 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40aa9d0 con 0x7fcfc415c2a0 2024-09-12T03:34:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/2445295653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc415c2a0 msgr2=0x7fcfc40aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/2445295653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc415c2a0 0x7fcfc40aed60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009870 tx=0x7fcfb401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/2445295653 shutdown_connections 2024-09-12T03:34:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/2445295653 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc40af2a0 0x7fcfc406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/2445295653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc415c2a0 0x7fcfc40aed60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/2445295653 >> 172.21.15.73:0/2445295653 conn(0x7fcfc40b1f90 msgr2=0x7fcfc40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/2445295653 shutdown_connections 2024-09-12T03:34:46.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/2445295653 wait complete. 2024-09-12T03:34:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.269+0000 7fcfcb1e7640 1 Processor -- start 2024-09-12T03:34:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 -- start start 2024-09-12T03:34:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc40af2a0 0x7fcfc4157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc415bec0 0x7fcfc414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc415c2a0 0x7fcfc4148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc406ed50 con 0x7fcfc40af2a0 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc40af6b0 con 0x7fcfc415c2a0 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc406eed0 con 0x7fcfc415bec0 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc40af2a0 0x7fcfc4157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc40af2a0 0x7fcfc4157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42068/0 (socket says 172.21.15.73:42068) 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 -- 172.21.15.73:0/410439859 learned_addr learned my addr 172.21.15.73:0/410439859 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 -- 172.21.15.73:0/410439859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc415bec0 msgr2=0x7fcfc414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc415bec0 0x7fcfc414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 -- 172.21.15.73:0/410439859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc415c2a0 msgr2=0x7fcfc4148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc415c2a0 0x7fcfc4148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 -- 172.21.15.73:0/410439859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc414ab80 con 0x7fcfc40af2a0 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc40af2a0 0x7fcfc4157b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c450 tx=0x7fcfc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfb97fa640 1 -- 172.21.15.73:0/410439859 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0012830 con 0x7fcfc40af2a0 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfb97fa640 1 -- 172.21.15.73:0/410439859 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc0017070 con 0x7fcfc40af2a0 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc41490d0 con 0x7fcfc40af2a0 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfb97fa640 1 -- 172.21.15.73:0/410439859 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0012c10 con 0x7fcfc40af2a0 2024-09-12T03:34:46.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc414de30 con 0x7fcfc40af2a0 2024-09-12T03:34:46.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfb97fa640 1 -- 172.21.15.73:0/410439859 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfc001c460 con 0x7fcfc40af2a0 2024-09-12T03:34:46.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfb97fa640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcfb00678c0 0x7fcfb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfb97fa640 1 -- 172.21.15.73:0/410439859 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcfc0085d60 con 0x7fcfc40af2a0 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.273+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcfb00678c0 0x7fcfb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcfb00678c0 0x7fcfb0069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40ae000 tx=0x7fcfb4004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 Processor -- start 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- start start 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d06c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0677d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d0678290 0x55e0d0678670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e0d055fb60 con 0x55e0d06c2440 2024-09-12T03:34:46.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e0d04c6c70 con 0x55e0d06c1b20 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e0d046ced0 con 0x55e0d0678290 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0677d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0677d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42070/0 (socket says 172.21.15.73:42070) 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 -- 172.21.15.73:0/3501982123 learned_addr learned my addr 172.21.15.73:0/3501982123 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d06c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfc9784640 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d0678290 0x55e0d0678670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 -- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d0678290 msgr2=0x55e0d0678670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d0678290 0x55e0d0678670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 -- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 msgr2=0x55e0d06c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d06c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 -- 172.21.15.73:0/3501982123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d047ee50 con 0x55e0d06c2440 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0677d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009630 tx=0x7fcfb40a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b1fcdd71da2d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfaa7fc640 1 -- 172.21.15.73:0/3501982123 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40c3070 con 0x55e0d06c2440 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfaa7fc640 1 -- 172.21.15.73:0/3501982123 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb40b3870 con 0x55e0d06c2440 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfaa7fc640 1 -- 172.21.15.73:0/3501982123 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40b3c60 con 0x55e0d06c2440 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3501982123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 msgr2=0x55e0d0677d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0677d50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009630 tx=0x7fcfb40a9000 comp rx=0 tx=0).stop 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3501982123 shutdown_connections 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0677d50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d0678290 0x55e0d0678670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3501982123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d06c1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3501982123 >> 172.21.15.73:0/3501982123 conn(0x55e0d067e600 msgr2=0x55e0d0676630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3501982123 shutdown_connections 2024-09-12T03:34:46.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3501982123 wait complete. 2024-09-12T03:34:46.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 -- start start 2024-09-12T03:34:46.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.277+0000 7fcfce2a3000 1 Processor -- start 2024-09-12T03:34:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d067ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0682cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d067d390 0x55e0d0683230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0528b00 con 0x55e0d06c2440 2024-09-12T03:34:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e0d04a1360 con 0x55e0d06c1b20 2024-09-12T03:34:46.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e0d049e2d0 con 0x55e0d067d390 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 10 client.0 _ll_register_callbacks cb 0x55e0d0663820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0682cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0682cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42074/0 (socket says 172.21.15.73:42074) 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 -- 172.21.15.73:0/699690769 learned_addr learned my addr 172.21.15.73:0/699690769 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 -- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d067d390 msgr2=0x55e0d0683230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfc9784640 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d067d390 0x55e0d0683230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d067ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d067d390 0x55e0d0683230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 -- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 msgr2=0x55e0d067ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d067ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 -- 172.21.15.73:0/699690769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d046d120 con 0x55e0d06c2440 2024-09-12T03:34:46.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0682cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009630 tx=0x7fcfb40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8954f892307573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 1 -- 172.21.15.73:0/699690769 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40d1060 con 0x55e0d06c2440 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 1 -- 172.21.15.73:0/699690769 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcfb4004230 con 0x55e0d06c2440 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfb40b3870 con 0x55e0d06c2440 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 1 -- 172.21.15.73:0/699690769 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fcfb40d7050 con 0x55e0d06c2440 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 10 client.4377 fetch_fsmap learned FSMap version 6 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55e0d0466450 con 0x55e0d06c2440 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 1 -- 172.21.15.73:0/699690769 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb40b3870 con 0x55e0d06c2440 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 1 -- 172.21.15.73:0/699690769 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7fcfb40d2250 con 0x55e0d06c2440 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 10 client.4377 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 10 client.4377 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 20 client.4377 populate_metadata read hostname 'smithi073' 2024-09-12T03:34:46.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06d0280 0x55e0d06d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 4 client.4377 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 --> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0d0460c00 con 0x55e0d06d0280 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06d0280 0x55e0d06d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 10 client.4377 ms_handle_connect on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06d0280 0x55e0d06d2670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d10a773a480ccd53 server_cookie=ad8ff8dfd7fb4ff9 in_seq=0 out_seq=0 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 1 -- 172.21.15.73:0/699690769 <== mds.0 v2:172.21.15.73:6835/2532110988 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0d0460c00 con 0x55e0d06d0280 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 10 client.4377 handle_command_reply: tid=0 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 client.4377 shutdown 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 msgr2=0x55e0d0682cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0682cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009630 tx=0x7fcfb40046d0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 shutdown_connections 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06d0280 0x55e0d06d2670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c2440 0x55e0d0682cf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d067d390 0x55e0d0683230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfa37fe640 0 client.4377 ms_handle_reset on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/699690769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c1b20 0x55e0d067ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 >> 172.21.15.73:0/699690769 conn(0x55e0d0678290 msgr2=0x55e0d0676d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 shutdown_connections 2024-09-12T03:34:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 1 -- 172.21.15.73:0/699690769 wait complete. 2024-09-12T03:34:46.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.281+0000 7fcfce2a3000 20 client.4377 trim_cache size 0 max 16384 2024-09-12T03:34:46.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 Processor -- start 2024-09-12T03:34:46.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- start start 2024-09-12T03:34:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d067d390 0x55e0d06c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c1b20 0x55e0d06c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c2440 0x55e0d06d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc42018a0 con 0x55e0d067d390 2024-09-12T03:34:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc4200de0 con 0x55e0d06c2440 2024-09-12T03:34:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc4201280 con 0x55e0d06c1b20 2024-09-12T03:34:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d067d390 0x55e0d06c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d067d390 0x55e0d06c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42080/0 (socket says 172.21.15.73:42080) 2024-09-12T03:34:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 -- 172.21.15.73:0/3083625293 learned_addr learned my addr 172.21.15.73:0/3083625293 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 -- 172.21.15.73:0/3083625293 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c1b20 msgr2=0x55e0d06c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/3083625293 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c1b20 0x55e0d06c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 -- 172.21.15.73:0/3083625293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c2440 msgr2=0x55e0d06d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/3083625293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c2440 0x55e0d06d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 -- 172.21.15.73:0/3083625293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d044dfd0 con 0x55e0d067d390 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/3083625293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d067d390 0x55e0d06c0cf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfc005e510 tx=0x7fcfc0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fbb87b002aedca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfa9ffb640 1 -- 172.21.15.73:0/3083625293 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0053f00 con 0x55e0d067d390 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfa9ffb640 1 -- 172.21.15.73:0/3083625293 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc0054160 con 0x55e0d067d390 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfa9ffb640 1 -- 172.21.15.73:0/3083625293 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00742f0 con 0x55e0d067d390 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3083625293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d067d390 msgr2=0x55e0d06c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3083625293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d067d390 0x55e0d06c0cf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfc005e510 tx=0x7fcfc0014040 comp rx=0 tx=0).stop 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3083625293 shutdown_connections 2024-09-12T03:34:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3083625293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d06c2440 0x55e0d06d2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3083625293 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c1b20 0x55e0d06c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/3083625293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d067d390 0x55e0d06c0cf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3083625293 >> 172.21.15.73:0/3083625293 conn(0x55e0d0678290 msgr2=0x55e0d067c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3083625293 shutdown_connections 2024-09-12T03:34:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- 172.21.15.73:0/3083625293 wait complete. 2024-09-12T03:34:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- start start 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 Processor -- start 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d067d390 0x55e0d06d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c1b20 0x55e0d06f9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c2440 0x55e0d06f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e0d04c5f80 con 0x55e0d06c1b20 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55e0d047eca0 con 0x55e0d067d390 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55e0d04cb2a0 con 0x55e0d06c2440 2024-09-12T03:34:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfce2a3000 10 client.0 _ll_register_callbacks cb 0x7fcfb40096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c1b20 0x55e0d06f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c1b20 0x55e0d06f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42090/0 (socket says 172.21.15.73:42090) 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2198158791 learned_addr learned my addr 172.21.15.73:0/2198158791 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2198158791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c2440 msgr2=0x55e0d06f96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c2440 0x55e0d06f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d067d390 0x55e0d06d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2198158791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d067d390 msgr2=0x55e0d06d5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d067d390 0x55e0d06d5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.301+0000 7fcfbbfff640 1 -- 172.21.15.73:0/2198158791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d0549750 con 0x55e0d06c1b20 2024-09-12T03:34:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfbbfff640 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c1b20 0x55e0d06f9170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4004710 tx=0x7fcfb4019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e31f1cc296403e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 1 -- 172.21.15.73:0/2198158791 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40b7070 con 0x55e0d06c1b20 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 1 -- 172.21.15.73:0/2198158791 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcfb40d2250 con 0x55e0d06c1b20 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc0054160 con 0x55e0d06c1b20 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 1 -- 172.21.15.73:0/2198158791 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fcfb40c3070 con 0x55e0d06c1b20 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 10 client.4383 fetch_fsmap learned FSMap version 6 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55e0d0454a30 con 0x55e0d06c1b20 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 1 -- 172.21.15.73:0/2198158791 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc0054160 con 0x55e0d06c1b20 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 1 -- 172.21.15.73:0/2198158791 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7fcfb40c8460 con 0x55e0d06c1b20 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 10 client.4383 fetch_fsmap finished waiting for FSMap version 6 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 10 client.4383 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:34:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 20 client.4383 populate_metadata read hostname 'smithi073' 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06f9bf0 0x55e0d073d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 4 client.4383 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 --> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] -- command(tid 0: {"prefix": "status"}) -- 0x55e0d04d43a0 con 0x55e0d06f9bf0 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06f9bf0 0x55e0d073d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 10 client.4383 ms_handle_connect on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfc8f83640 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06f9bf0 0x55e0d073d200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e88d489586b1a5 server_cookie=c864321f329fb800 in_seq=0 out_seq=0 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 1 -- 172.21.15.73:0/2198158791 <== mds.0 v2:172.21.15.73:6835/2532110988 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55e0d04d43a0 con 0x55e0d06f9bf0 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 10 client.4383 handle_command_reply: tid=0 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 client.4383 shutdown 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c1b20 msgr2=0x55e0d06f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c1b20 0x55e0d06f9170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4004710 tx=0x7fcfb4019290 comp rx=0 tx=0).stop 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 shutdown_connections 2024-09-12T03:34:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55e0d06f9bf0 0x55e0d073d200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e0d06c1b20 0x55e0d06f9170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfa37fe640 0 client.4383 ms_handle_reset on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55e0d06c2440 0x55e0d06f96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 --2- 172.21.15.73:0/2198158791 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0d067d390 0x55e0d06d5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 >> 172.21.15.73:0/2198158791 conn(0x55e0d0678290 msgr2=0x55e0d06bfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 shutdown_connections 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 1 -- 172.21.15.73:0/2198158791 wait complete. 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfce2a3000 20 client.4383 trim_cache size 0 max 16384 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:34:46.316 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:34:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:34:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4248, 2024-09-12T03:34:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:34:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:34:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:34:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 7.2709374840000001, 2024-09-12T03:34:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 6, 2024-09-12T03:34:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 25, 2024-09-12T03:34:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 25, 2024-09-12T03:34:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 13.123893879000001 2024-09-12T03:34:46.318 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:34:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcfb00678c0 msgr2=0x7fcfb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcfb00678c0 0x7fcfb0069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40ae000 tx=0x7fcfb4004740 comp rx=0 tx=0).stop 2024-09-12T03:34:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc40af2a0 msgr2=0x7fcfc4157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc40af2a0 0x7fcfc4157b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c450 tx=0x7fcfc000c910 comp rx=0 tx=0).stop 2024-09-12T03:34:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 shutdown_connections 2024-09-12T03:34:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcfb00678c0 0x7fcfb0069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc415c2a0 0x7fcfc4148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcfc415bec0 0x7fcfc414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 --2- 172.21.15.73:0/410439859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc40af2a0 0x7fcfc4157b70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 >> 172.21.15.73:0/410439859 conn(0x7fcfc40b1f90 msgr2=0x7fcfc414f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 shutdown_connections 2024-09-12T03:34:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.305+0000 7fcfcb1e7640 1 -- 172.21.15.73:0/410439859 wait complete. 2024-09-12T03:34:46.325 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T03:34:46.326 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:46.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:34:46.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.437+0000 7ff7b77c8640 1 Processor -- start 2024-09-12T03:34:46.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.437+0000 7ff7b77c8640 1 -- start start 2024-09-12T03:34:46.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015c2a0 0x7ff7b00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7b00af2a0 0x7ff7b006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b00b3290 con 0x7ff7b015bec0 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b00b3570 con 0x7ff7b00af2a0 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b00b3850 con 0x7ff7b015c2a0 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5d65640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7b00af2a0 0x7ff7b006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5564640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff7b015bec0 0x7ff7b00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42152/0 (socket says 172.21.15.73:42152) 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5564640 1 -- 172.21.15.73:0/2572938333 learned_addr learned my addr 172.21.15.73:0/2572938333 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b4d63640 1 --2- 172.21.15.73:0/2572938333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015c2a0 0x7ff7b00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5d65640 1 -- 172.21.15.73:0/2572938333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015c2a0 msgr2=0x7ff7b00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5d65640 1 --2- 172.21.15.73:0/2572938333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015c2a0 0x7ff7b00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5d65640 1 -- 172.21.15.73:0/2572938333 >> v1:172.21.15.73:6789/0 conn(0x7ff7b015bec0 legacy=0x7ff7b00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5d65640 1 -- 172.21.15.73:0/2572938333 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b00b3b30 con 0x7ff7b00af2a0 2024-09-12T03:34:46.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7a7fff640 1 -- 172.21.15.73:0/2572938333 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078334433 0 0) 0x7ff7b00b3290 con 0x7ff7b015bec0 2024-09-12T03:34:46.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b4d63640 1 --2- 172.21.15.73:0/2572938333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015c2a0 0x7ff7b00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:46.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b5d65640 1 --2- 172.21.15.73:0/2572938333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b00af2a0 0x7ff7b006e000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009d90 tx=0x7ff7a801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f08e9c58861aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7a7fff640 1 -- 172.21.15.73:0/2572938333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80b2070 con 0x7ff7b00af2a0 2024-09-12T03:34:46.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7a7fff640 1 -- 172.21.15.73:0/2572938333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a80a5a00 con 0x7ff7b00af2a0 2024-09-12T03:34:46.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7a7fff640 1 -- 172.21.15.73:0/2572938333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80a5dd0 con 0x7ff7b00af2a0 2024-09-12T03:34:46.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- 172.21.15.73:0/2572938333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b00af2a0 msgr2=0x7ff7b006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/2572938333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b00af2a0 0x7ff7b006e000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009d90 tx=0x7ff7a801c940 comp rx=0 tx=0).stop 2024-09-12T03:34:46.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- 172.21.15.73:0/2572938333 shutdown_connections 2024-09-12T03:34:46.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/2572938333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015c2a0 0x7ff7b00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/2572938333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b00af2a0 0x7ff7b006e000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- 172.21.15.73:0/2572938333 >> 172.21.15.73:0/2572938333 conn(0x7ff7b00b1f90 msgr2=0x7ff7b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- 172.21.15.73:0/2572938333 shutdown_connections 2024-09-12T03:34:46.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.441+0000 7ff7b77c8640 1 -- 172.21.15.73:0/2572938333 wait complete. 2024-09-12T03:34:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 Processor -- start 2024-09-12T03:34:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 -- start start 2024-09-12T03:34:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b00af2a0 0x7ff7b00727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015bec0 0x7ff7b0166090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b015c2a0 0x7ff7b01665d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b006ed50 con 0x7ff7b015c2a0 2024-09-12T03:34:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b00afc90 con 0x7ff7b00af2a0 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b006eed0 con 0x7ff7b015bec0 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b015c2a0 0x7ff7b01665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b015c2a0 0x7ff7b01665d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42106/0 (socket says 172.21.15.73:42106) 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 -- 172.21.15.73:0/1156126763 learned_addr learned my addr 172.21.15.73:0/1156126763 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b4d63640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015bec0 0x7ff7b0166090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 -- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015bec0 msgr2=0x7ff7b0166090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5564640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b00af2a0 0x7ff7b00727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015bec0 0x7ff7b0166090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 -- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b00af2a0 msgr2=0x7ff7b00727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b00af2a0 0x7ff7b00727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 -- 172.21.15.73:0/1156126763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b0073430 con 0x7ff7b015c2a0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b5d65640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b015c2a0 0x7ff7b01665d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b0040 tx=0x7ff7a80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7a5ffb640 1 -- 172.21.15.73:0/1156126763 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80b2050 con 0x7ff7b015c2a0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7a5ffb640 1 -- 172.21.15.73:0/1156126763 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a80b3040 con 0x7ff7b015c2a0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b014d0e0 con 0x7ff7b015c2a0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7a5ffb640 1 -- 172.21.15.73:0/1156126763 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8003dc0 con 0x7ff7b015c2a0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b0073150 con 0x7ff7b015c2a0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.445+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b006f230 con 0x7ff7b015c2a0 2024-09-12T03:34:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.449+0000 7ff7a5ffb640 1 -- 172.21.15.73:0/1156126763 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff7a80ad850 con 0x7ff7b015c2a0 2024-09-12T03:34:46.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.449+0000 7ff7a5ffb640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff7940678c0 0x7ff794069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:46.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.449+0000 7ff7b5564640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff7940678c0 0x7ff794069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:46.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.449+0000 7ff7a5ffb640 1 -- 172.21.15.73:0/1156126763 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff7a8120b00 con 0x7ff7b015c2a0 2024-09-12T03:34:46.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.449+0000 7ff7b5564640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff7940678c0 0x7ff794069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000f70 tx=0x7ff7ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.453+0000 7ff7a5ffb640 1 -- 172.21.15.73:0/1156126763 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff7a8016560 con 0x7ff7b015c2a0 2024-09-12T03:34:46.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.645+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff7b006fcd0 con 0x7ff7b015c2a0 2024-09-12T03:34:46.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.645+0000 7ff7a5ffb640 1 -- 172.21.15.73:0/1156126763 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7ff7a80f1390 con 0x7ff7b015c2a0 2024-09-12T03:34:46.648 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T03:34:46.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff7940678c0 msgr2=0x7ff794069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff7940678c0 0x7ff794069d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000f70 tx=0x7ff7ac009040 comp rx=0 tx=0).stop 2024-09-12T03:34:46.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b015c2a0 msgr2=0x7ff7b01665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:46.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b015c2a0 0x7ff7b01665d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80b0040 tx=0x7ff7a80196e0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 shutdown_connections 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff7940678c0 0x7ff794069d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b015c2a0 0x7ff7b01665d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff7b015bec0 0x7ff7b0166090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 --2- 172.21.15.73:0/1156126763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7b00af2a0 0x7ff7b00727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 >> 172.21.15.73:0/1156126763 conn(0x7ff7b00b1f90 msgr2=0x7ff7b0075280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 shutdown_connections 2024-09-12T03:34:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46.649+0000 7ff7b77c8640 1 -- 172.21.15.73:0/1156126763 wait complete. 2024-09-12T03:34:46.666 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T03:34:46.666 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:34:46.666 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:34:46.666 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T03:34:46.667 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:46.667 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T03:34:46.667 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:34:46.667 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:34:46.667 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T03:34:46.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:46.667 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:34:46.672 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:34:46.673 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42482sec preferred_lft 42482sec 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:34:46.674 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:34:46.675 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:34:46.675 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T03:34:46.675 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:34:46.675 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:34:46.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-09-12T03:34:46.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-09-12T03:34:46.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-09-12T03:34:46.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T03:34:46.676 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:34:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:34:46.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:34:46.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:46.794 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:34:46.842 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:34:46.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:46.843 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:34:46.915 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:34:46.916 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:34:46.917 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:34:46.917 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:34:46.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:34:46.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:34:46.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:34:46.917 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:34:47.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:34:47.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:34:47.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:47.033 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:34:47.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:47.083 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-09-12T03:34:47.131 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:34:47.131 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:34:47.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:47.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T03:34:47.131 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:34:47.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:34:47.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:34:47.253 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T03:34:47.254 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:34:47.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:34:47.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:34:47.351 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:34:47.351 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:34:47.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:34:47.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T03:34:47.351 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:34:47.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:34:47.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:34:47.455 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T03:34:47.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:34:47.455 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:47.502 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T03:34:47.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:34:47.503 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:47.550 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:34:47.604 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:34:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:34:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:34:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:34:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:34:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:34:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:34:47.651 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:34:47.652 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:34:47.652 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:34:47.652 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:34:47.652 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:34:47.652 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:34:47.652 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:34:47.653 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:34:47.654 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:34:47.654 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:34:47.654 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:34:47.654 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:47.654 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:47.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:47.655 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:34:47.702 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:34:47.703 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T03:34:47.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:34:47.762 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:34:47.811 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:34:47.811 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:34:47.811 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:34:47.811 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:34:47.811 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:34:47.812 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:47.813 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:47.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:47.814 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:34:47.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:2024-09-12T03:34:47.821+0000 7f59e5cb3580 -1 init, newargv = 0x55f1c3d54f40 newargc=15 2024-09-12T03:34:47.824 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[34826]: starting ceph client 2024-09-12T03:34:47.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[34826]: starting fuse 2024-09-12T03:34:48.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:34:48.945 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:34:48.992 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:34:48.993 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:48.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:48.995 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:34:49.043 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:34:49.043 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:34:49.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:34:49.043 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T03:34:49.044 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:34:49.045 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:34:49.046 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:34:49.046 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:34:49.046 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:34:49.046 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:34:49.046 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.admin")) 2024-09-12T03:34:49.046 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:34:49.168 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.admin.34826.asok 2024-09-12T03:34:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:34:49.180 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.34826.asok 2024-09-12T03:34:49.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:49.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.34826.asok status 2024-09-12T03:34:49.339 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:34:49.339 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:34:49.339 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:34:49.339 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "admin", 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "34826", 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4401, 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:34:49.340 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4401 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 420507317 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 420507317 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4401 192.168.0.1:0/420507317", 2024-09-12T03:34:49.341 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/420507317", 2024-09-12T03:34:49.342 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:34:49.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 6, 2024-09-12T03:34:49.342 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 25, 2024-09-12T03:34:49.342 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:34:49.342 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:34:49.342 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:34:49.342 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:34:49.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:49.353 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:34:49.353 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:49.359 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:34:49.359 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:49.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:49.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:49.414 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T03:34:49.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T03:34:49.532 INFO:teuthology.orchestra.run.smithi073.stdout:# file: . 2024-09-12T03:34:49.532 INFO:teuthology.orchestra.run.smithi073.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T03:34:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:49.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:34:49.539 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:49.539 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:34:49.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:34:49.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06ee80640 1 Processor -- start 2024-09-12T03:34:49.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06ee80640 1 -- start start 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06ee80640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0680cf620 0x7fa068168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06ee80640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0680d0300 con 0x7fa0680d3060 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06ee80640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06806e6c0 con 0x7fa068161a60 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06ee80640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa0680cfa90 con 0x7fa0680cf620 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa067fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa0680d3060 0x7fa0680cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42166/0 (socket says 172.21.15.73:42166) 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa067fff640 1 -- 172.21.15.73:0/4103724036 learned_addr learned my addr 172.21.15.73:0/4103724036 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06d41d640 1 --2- 172.21.15.73:0/4103724036 >> v2:172.21.15.73:3300/0 conn(0x7fa0680cf620 0x7fa068168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:49.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06d41d640 1 -- 172.21.15.73:0/4103724036 >> v1:172.21.15.150:6789/0 conn(0x7fa068161a60 legacy=0x7fa0680d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06d41d640 1 -- 172.21.15.73:0/4103724036 >> v1:172.21.15.73:6789/0 conn(0x7fa0680d3060 legacy=0x7fa0680cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa0677fe640 1 -- 172.21.15.73:0/4103724036 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433425851 0 0) 0x7fa05c001120 con 0x7fa0680d3060 2024-09-12T03:34:49.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.709+0000 7fa06d41d640 1 -- 172.21.15.73:0/4103724036 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680b0f60 con 0x7fa0680cf620 2024-09-12T03:34:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06d41d640 1 --2- 172.21.15.73:0/4103724036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680cf620 0x7fa068168f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa060009d90 tx=0x7fa06001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ad401517dffd60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa0677fe640 1 -- 172.21.15.73:0/4103724036 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600b2070 con 0x7fa0680cf620 2024-09-12T03:34:49.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa0677fe640 1 -- 172.21.15.73:0/4103724036 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0600a5930 con 0x7fa0680cf620 2024-09-12T03:34:49.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa0677fe640 1 -- 172.21.15.73:0/4103724036 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600a5d00 con 0x7fa0680cf620 2024-09-12T03:34:49.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06ee80640 1 -- 172.21.15.73:0/4103724036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680cf620 msgr2=0x7fa068168f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:49.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06ee80640 1 --2- 172.21.15.73:0/4103724036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680cf620 0x7fa068168f10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa060009d90 tx=0x7fa06001c870 comp rx=0 tx=0).stop 2024-09-12T03:34:49.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06ee80640 1 -- 172.21.15.73:0/4103724036 shutdown_connections 2024-09-12T03:34:49.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06ee80640 1 --2- 172.21.15.73:0/4103724036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680cf620 0x7fa068168f10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:49.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06ee80640 1 -- 172.21.15.73:0/4103724036 >> 172.21.15.73:0/4103724036 conn(0x7fa06808bf90 msgr2=0x7fa06809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:49.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06ee80640 1 -- 172.21.15.73:0/4103724036 shutdown_connections 2024-09-12T03:34:49.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.713+0000 7fa06ee80640 1 -- 172.21.15.73:0/4103724036 wait complete. 2024-09-12T03:34:49.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 Processor -- start 2024-09-12T03:34:49.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 -- start start 2024-09-12T03:34:49.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0680cf620 0x7fa0680c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:49.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680d3060 0x7fa06815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:49.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa068161a60 0x7fa068158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa06816bc70 con 0x7fa0680d3060 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa06806d190 con 0x7fa068161a60 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa06816bdf0 con 0x7fa0680cf620 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680d3060 0x7fa06815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680d3060 0x7fa06815bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42134/0 (socket says 172.21.15.73:42134) 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 -- 172.21.15.73:0/2955881441 learned_addr learned my addr 172.21.15.73:0/2955881441 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06d41d640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa068161a60 0x7fa068158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06cc1c640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0680cf620 0x7fa0680c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 -- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0680cf620 msgr2=0x7fa0680c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0680cf620 0x7fa0680c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:49.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 -- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa068161a60 msgr2=0x7fa068158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:49.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa068161a60 0x7fa068158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:49.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 -- 172.21.15.73:0/2955881441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0680c8310 con 0x7fa0680d3060 2024-09-12T03:34:49.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa067fff640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680d3060 0x7fa06815bf60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c7b0 tx=0x7fa05c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:49.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa0657fa640 1 -- 172.21.15.73:0/2955881441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c018070 con 0x7fa0680d3060 2024-09-12T03:34:49.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa0657fa640 1 -- 172.21.15.73:0/2955881441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c0072f0 con 0x7fa0680d3060 2024-09-12T03:34:49.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0680c85f0 con 0x7fa0680d3060 2024-09-12T03:34:49.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa0657fa640 1 -- 172.21.15.73:0/2955881441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c0047f0 con 0x7fa0680d3060 2024-09-12T03:34:49.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0680c8bb0 con 0x7fa0680d3060 2024-09-12T03:34:49.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0680cef10 con 0x7fa0680d3060 2024-09-12T03:34:49.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa0657fa640 1 -- 172.21.15.73:0/2955881441 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa05c01b070 con 0x7fa0680d3060 2024-09-12T03:34:49.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.717+0000 7fa0657fa640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0540678c0 0x7fa054069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:49.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.721+0000 7fa06cc1c640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0540678c0 0x7fa054069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:49.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.721+0000 7fa0657fa640 1 -- 172.21.15.73:0/2955881441 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa05c085430 con 0x7fa0680d3060 2024-09-12T03:34:49.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.721+0000 7fa06cc1c640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0540678c0 0x7fa054069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa06815f230 tx=0x7fa058008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:49.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.725+0000 7fa0657fa640 1 -- 172.21.15.73:0/2955881441 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0680d0300 con 0x7fa0680d3060 2024-09-12T03:34:49.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.897+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0681599e0 con 0x7fa0680d3060 2024-09-12T03:34:49.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.897+0000 7fa0657fa640 1 -- 172.21.15.73:0/2955881441 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa05c055c30 con 0x7fa0680d3060 2024-09-12T03:34:49.901 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0540678c0 msgr2=0x7fa054069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0540678c0 0x7fa054069d80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa06815f230 tx=0x7fa058008040 comp rx=0 tx=0).stop 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680d3060 msgr2=0x7fa06815bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680d3060 0x7fa06815bf60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00c7b0 tx=0x7fa05c00cc70 comp rx=0 tx=0).stop 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 shutdown_connections 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0540678c0 0x7fa054069d80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0680d3060 0x7fa06815bf60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa068161a60 0x7fa068158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:49.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 --2- 172.21.15.73:0/2955881441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0680cf620 0x7fa0680c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 >> 172.21.15.73:0/2955881441 conn(0x7fa06808bf90 msgr2=0x7fa0680d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 shutdown_connections 2024-09-12T03:34:49.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:49.901+0000 7fa06ee80640 1 -- 172.21.15.73:0/2955881441 wait complete. 2024-09-12T03:34:49.920 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:34:49.920 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:34:49.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:34:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58d15b640 1 Processor -- start 2024-09-12T03:34:50.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58d15b640 1 -- start start 2024-09-12T03:34:50.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58d15b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 0x7fd58809aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58d15b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd5880b40c0 0x7fd58815fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58d15b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5880b5c90 con 0x7fd58806bcc0 2024-09-12T03:34:50.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58d15b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd5880b4860 con 0x7fd5880b40c0 2024-09-12T03:34:50.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58d15b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd5880b4580 con 0x7fd58815e450 2024-09-12T03:34:50.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58759e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd58806bcc0 0x7fd588162370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42178/0 (socket says 172.21.15.73:42178) 2024-09-12T03:34:50.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58759e640 1 -- 172.21.15.73:0/49361960 learned_addr learned my addr 172.21.15.73:0/49361960 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:50.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd586d9d640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 0x7fd58809aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899128181 0 0) 0x7fd5800014a0 con 0x7fd58806bcc0 2024-09-12T03:34:50.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58659c640 1 --2- 172.21.15.73:0/49361960 >> v2:172.21.15.150:3300/0 conn(0x7fd5880b40c0 0x7fd58815fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd574003530 con 0x7fd58806bcc0 2024-09-12T03:34:50.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3208562457 0 0) 0x7fd574003530 con 0x7fd58806bcc0 2024-09-12T03:34:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 msgr2=0x7fd58809aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 0x7fd58809aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 >> v2:172.21.15.150:3300/0 conn(0x7fd5880b40c0 msgr2=0x7fd58815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 --2- 172.21.15.73:0/49361960 >> v2:172.21.15.150:3300/0 conn(0x7fd5880b40c0 0x7fd58815fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5880b5f10 con 0x7fd58806bcc0 2024-09-12T03:34:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fd580001bd0 con 0x7fd58806bcc0 2024-09-12T03:34:50.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 >> v1:172.21.15.73:6789/0 conn(0x7fd58806bcc0 legacy=0x7fd588162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd574003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 0x7fd574004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd574004d50 0x7fd5740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd5880b4860 con 0x7fd5740039c0 2024-09-12T03:34:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd5880b4580 con 0x7fd574004d50 2024-09-12T03:34:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd57400b9d0 con 0x7fd58815e450 2024-09-12T03:34:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd586d9d640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd574003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58759e640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd574004d50 0x7fd5740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58659c640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 0x7fd574004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd586d9d640 1 -- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 msgr2=0x7fd574004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd586d9d640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58815e450 0x7fd574004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd586d9d640 1 -- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd574004d50 msgr2=0x7fd5740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd586d9d640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd574004d50 0x7fd5740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd586d9d640 1 -- 172.21.15.73:0/49361960 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd574003530 con 0x7fd5740039c0 2024-09-12T03:34:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.085+0000 7fd58759e640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd574004d50 0x7fd5740051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:50.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd586d9d640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd574003de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd570009ae0 tx=0x7fd57001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4474859d6cbe02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700b2070 con 0x7fd5740039c0 2024-09-12T03:34:50.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5700a5550 con 0x7fd5740039c0 2024-09-12T03:34:50.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd585d9b640 1 -- 172.21.15.73:0/49361960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700096b0 con 0x7fd5740039c0 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 -- 172.21.15.73:0/49361960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 msgr2=0x7fd574003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 --2- 172.21.15.73:0/49361960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd574003de0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd570009ae0 tx=0x7fd57001ca70 comp rx=0 tx=0).stop 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58759e640 1 -- 172.21.15.73:0/49361960 reap_dead start 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 -- 172.21.15.73:0/49361960 shutdown_connections 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 -- 172.21.15.73:0/49361960 >> 172.21.15.73:0/49361960 conn(0x7fd5880b6800 msgr2=0x7fd5880b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 -- 172.21.15.73:0/49361960 shutdown_connections 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 -- 172.21.15.73:0/49361960 wait complete. 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 Processor -- start 2024-09-12T03:34:50.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.089+0000 7fd58d15b640 1 -- start start 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd5881518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58813f870 0x7fd58815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd588154060 0x7fd5881544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd58806c4e0 con 0x7fd5740039c0 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd58809ae10 con 0x7fd588154060 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd588154a20 con 0x7fd58813f870 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd5881518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd5881518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42150/0 (socket says 172.21.15.73:42150) 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 -- 172.21.15.73:0/472632287 learned_addr learned my addr 172.21.15.73:0/472632287 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58659c640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58813f870 0x7fd58815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58759e640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd588154060 0x7fd5881544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 -- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58813f870 msgr2=0x7fd58815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58813f870 0x7fd58815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 -- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd588154060 msgr2=0x7fd5881544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd588154060 0x7fd5881544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 -- 172.21.15.73:0/472632287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58815da30 con 0x7fd5740039c0 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd586d9d640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd5881518f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd5700b0040 tx=0x7fd574005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd57f7fe640 1 -- 172.21.15.73:0/472632287 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700bc030 con 0x7fd5740039c0 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd57f7fe640 1 -- 172.21.15.73:0/472632287 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57000f000 con 0x7fd5740039c0 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd588140050 con 0x7fd5740039c0 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd57f7fe640 1 -- 172.21.15.73:0/472632287 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700b2040 con 0x7fd5740039c0 2024-09-12T03:34:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd588140610 con 0x7fd5740039c0 2024-09-12T03:34:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58813d7e0 con 0x7fd5740039c0 2024-09-12T03:34:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd57f7fe640 1 -- 172.21.15.73:0/472632287 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5700bf070 con 0x7fd5740039c0 2024-09-12T03:34:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd57f7fe640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5680678c0 0x7fd568069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd57f7fe640 1 -- 172.21.15.73:0/472632287 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd570120590 con 0x7fd5740039c0 2024-09-12T03:34:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.093+0000 7fd58659c640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5680678c0 0x7fd568069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.097+0000 7fd58659c640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5680678c0 0x7fd568069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd588151380 tx=0x7fd578008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.097+0000 7fd57f7fe640 1 -- 172.21.15.73:0/472632287 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd5700c7020 con 0x7fd5740039c0 2024-09-12T03:34:50.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd58815fc60 con 0x7fd5740039c0 2024-09-12T03:34:50.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd57f7fe640 1 -- 172.21.15.73:0/472632287 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fd570016780 con 0x7fd5740039c0 2024-09-12T03:34:50.272 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:34:50.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5680678c0 msgr2=0x7fd568069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5680678c0 0x7fd568069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd588151380 tx=0x7fd578008040 comp rx=0 tx=0).stop 2024-09-12T03:34:50.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 msgr2=0x7fd5881518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd5881518f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd5700b0040 tx=0x7fd574005840 comp rx=0 tx=0).stop 2024-09-12T03:34:50.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 shutdown_connections 2024-09-12T03:34:50.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5680678c0 0x7fd568069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd588154060 0x7fd5881544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd58813f870 0x7fd58815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 --2- 172.21.15.73:0/472632287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5740039c0 0x7fd5881518f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 >> 172.21.15.73:0/472632287 conn(0x7fd5880b6800 msgr2=0x7fd58806ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:50.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 shutdown_connections 2024-09-12T03:34:50.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.269+0000 7fd58d15b640 1 -- 172.21.15.73:0/472632287 wait complete. 2024-09-12T03:34:50.290 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:34:50.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:50.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T03:34:50.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[34826]: fuse finished with error 0 and tester_r 0 2024-09-12T03:34:50.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:34:50.412 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:34:50.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:50.412 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T03:34:50.421 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.585+0000 7ff8d67ab640 1 Processor -- start 2024-09-12T03:34:50.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.585+0000 7ff8d67ab640 1 -- start start 2024-09-12T03:34:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8d67ab640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8d01587a0 0x7ff8d00b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8d67ab640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d00b37d0 0x7ff8d006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8d67ab640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8d006ec60 con 0x7ff8d006e4b0 2024-09-12T03:34:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8d67ab640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d006f870 con 0x7ff8d01587a0 2024-09-12T03:34:50.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8d67ab640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d00b3c10 con 0x7ff8d00b37d0 2024-09-12T03:34:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cf7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d00b37d0 0x7ff8d006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cffff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff8d01587a0 0x7ff8d00b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cf7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d00b37d0 0x7ff8d006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:56682/0 (socket says 172.21.15.73:56682) 2024-09-12T03:34:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cf7fe640 1 -- 172.21.15.73:0/3653316915 learned_addr learned my addr 172.21.15.73:0/3653316915 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cf7fe640 1 -- 172.21.15.73:0/3653316915 >> v2:172.21.15.150:3300/0 conn(0x7ff8d01587a0 msgr2=0x7ff8d00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:50.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cf7fe640 1 --2- 172.21.15.73:0/3653316915 >> v2:172.21.15.150:3300/0 conn(0x7ff8d01587a0 0x7ff8d00b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cf7fe640 1 -- 172.21.15.73:0/3653316915 >> v1:172.21.15.150:6789/0 conn(0x7ff8d006e4b0 legacy=0x7ff8d0161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.589+0000 7ff8cf7fe640 1 -- 172.21.15.73:0/3653316915 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d006ef40 con 0x7ff8d00b37d0 2024-09-12T03:34:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cf7fe640 1 --2- 172.21.15.73:0/3653316915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d00b37d0 0x7ff8d006df70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009870 tx=0x7ff8c401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a66c9d87b00e149 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8ceffd640 1 -- 172.21.15.73:0/3653316915 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40ab650 con 0x7ff8d00b37d0 2024-09-12T03:34:50.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8ceffd640 1 -- 172.21.15.73:0/3653316915 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c40b0070 con 0x7ff8d00b37d0 2024-09-12T03:34:50.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8ceffd640 1 -- 172.21.15.73:0/3653316915 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40aba10 con 0x7ff8d00b37d0 2024-09-12T03:34:50.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- 172.21.15.73:0/3653316915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d00b37d0 msgr2=0x7ff8d006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/3653316915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d00b37d0 0x7ff8d006df70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009870 tx=0x7ff8c401c530 comp rx=0 tx=0).stop 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- 172.21.15.73:0/3653316915 shutdown_connections 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/3653316915 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d00b37d0 0x7ff8d006df70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/3653316915 >> v2:172.21.15.150:3300/0 conn(0x7ff8d01587a0 0x7ff8d00b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- 172.21.15.73:0/3653316915 >> 172.21.15.73:0/3653316915 conn(0x7ff8d00b1f90 msgr2=0x7ff8d00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- 172.21.15.73:0/3653316915 shutdown_connections 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- 172.21.15.73:0/3653316915 wait complete. 2024-09-12T03:34:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 Processor -- start 2024-09-12T03:34:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- start start 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d006e4b0 0x7ff8d00aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d00b37d0 0x7ff8d0154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d01587a0 0x7ff8d014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d0158b80 con 0x7ff8d006e4b0 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d0073170 con 0x7ff8d00b37d0 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d67ab640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d014fc80 con 0x7ff8d01587a0 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d006e4b0 0x7ff8d00aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d006e4b0 0x7ff8d00aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42152/0 (socket says 172.21.15.73:42152) 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 -- 172.21.15.73:0/2898893681 learned_addr learned my addr 172.21.15.73:0/2898893681 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:50.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d4d48640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d01587a0 0x7ff8d014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cf7fe640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d00b37d0 0x7ff8d0154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 -- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d01587a0 msgr2=0x7ff8d014e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d01587a0 0x7ff8d014e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 -- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d00b37d0 msgr2=0x7ff8d0154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d00b37d0 0x7ff8d0154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8cffff640 1 -- 172.21.15.73:0/2898893681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d0154fd0 con 0x7ff8d006e4b0 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.593+0000 7ff8d4d48640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d01587a0 0x7ff8d014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8cffff640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d006e4b0 0x7ff8d00aec80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000e870 tx=0x7ff8c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8ccff9640 1 -- 172.21.15.73:0/2898893681 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0017070 con 0x7ff8d006e4b0 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8ccff9640 1 -- 172.21.15.73:0/2898893681 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c000c940 con 0x7ff8d006e4b0 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d01552b0 con 0x7ff8d006e4b0 2024-09-12T03:34:50.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8ccff9640 1 -- 172.21.15.73:0/2898893681 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000ccf0 con 0x7ff8d006e4b0 2024-09-12T03:34:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d0155590 con 0x7ff8d006e4b0 2024-09-12T03:34:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d0070080 con 0x7ff8d006e4b0 2024-09-12T03:34:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8ccff9640 1 -- 172.21.15.73:0/2898893681 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8c001a070 con 0x7ff8d006e4b0 2024-09-12T03:34:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8ccff9640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff8bc0678c0 0x7ff8bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8ccff9640 1 -- 172.21.15.73:0/2898893681 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff8c00862c0 con 0x7ff8d006e4b0 2024-09-12T03:34:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8cf7fe640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff8bc0678c0 0x7ff8bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.597+0000 7ff8cf7fe640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff8bc0678c0 0x7ff8bc069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40af000 tx=0x7ff8c40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.601+0000 7ff8ccff9640 1 -- 172.21.15.73:0/2898893681 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff8c0056a40 con 0x7ff8d006e4b0 2024-09-12T03:34:50.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.761+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8d01524b0 con 0x7ff8d006e4b0 2024-09-12T03:34:50.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8ccff9640 1 -- 172.21.15.73:0/2898893681 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7ff8c0056340 con 0x7ff8d006e4b0 2024-09-12T03:34:50.767 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:50.768 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:50.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff8bc0678c0 msgr2=0x7ff8bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff8bc0678c0 0x7ff8bc069d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40af000 tx=0x7ff8c40a7000 comp rx=0 tx=0).stop 2024-09-12T03:34:50.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d006e4b0 msgr2=0x7ff8d00aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d006e4b0 0x7ff8d00aec80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000e870 tx=0x7ff8c000ec70 comp rx=0 tx=0).stop 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 shutdown_connections 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff8bc0678c0 0x7ff8bc069d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff8d01587a0 0x7ff8d014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8d00b37d0 0x7ff8d0154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 --2- 172.21.15.73:0/2898893681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8d006e4b0 0x7ff8d00aec80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 >> 172.21.15.73:0/2898893681 conn(0x7ff8d00b1f90 msgr2=0x7ff8d015e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 shutdown_connections 2024-09-12T03:34:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.765+0000 7ff8d67ab640 1 -- 172.21.15.73:0/2898893681 wait complete. 2024-09-12T03:34:50.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:50.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23bc61640 1 Processor -- start 2024-09-12T03:34:50.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23bc61640 1 -- start start 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23bc61640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd23406f010 0x7fd234166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23bc61640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2340b3290 con 0x7fd23415c2a0 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23bc61640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2340b3570 con 0x7fd23415bec0 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23bc61640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd2340b3850 con 0x7fd23406f010 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23a1fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd23406f010 0x7fd234166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23a1fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd23406f010 0x7fd234166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42156/0 (socket says 172.21.15.73:42156) 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23a1fe640 1 -- 172.21.15.73:0/3722672827 learned_addr learned my addr 172.21.15.73:0/3722672827 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:50.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd2391fc640 1 --1- 172.21.15.73:0/3722672827 >> v1:172.21.15.73:6789/0 conn(0x7fd23415c2a0 0x7fd2340aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42188/0 (socket says 172.21.15.73:42188) 2024-09-12T03:34:50.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23a1fe640 1 -- 172.21.15.73:0/3722672827 >> v1:172.21.15.150:6789/0 conn(0x7fd23415bec0 legacy=0x7fd2340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23a1fe640 1 -- 172.21.15.73:0/3722672827 >> v1:172.21.15.73:6789/0 conn(0x7fd23415c2a0 legacy=0x7fd2340aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.901+0000 7fd23a1fe640 1 -- 172.21.15.73:0/3722672827 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2340b3b30 con 0x7fd23406f010 2024-09-12T03:34:50.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 --2- 172.21.15.73:0/3722672827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23406f010 0x7fd234166ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009e50 tx=0x7fd22c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76de2d020d907f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd2389fb640 1 -- 172.21.15.73:0/3722672827 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0a57e0 con 0x7fd23406f010 2024-09-12T03:34:50.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd2389fb640 1 -- 172.21.15.73:0/3722672827 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c0a5980 con 0x7fd23406f010 2024-09-12T03:34:50.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd2389fb640 1 -- 172.21.15.73:0/3722672827 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0a5d50 con 0x7fd23406f010 2024-09-12T03:34:50.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- 172.21.15.73:0/3722672827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23406f010 msgr2=0x7fd234166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 --2- 172.21.15.73:0/3722672827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23406f010 0x7fd234166ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009e50 tx=0x7fd22c01ca00 comp rx=0 tx=0).stop 2024-09-12T03:34:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- 172.21.15.73:0/3722672827 shutdown_connections 2024-09-12T03:34:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 --2- 172.21.15.73:0/3722672827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23406f010 0x7fd234166ff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- 172.21.15.73:0/3722672827 >> 172.21.15.73:0/3722672827 conn(0x7fd2340b1f90 msgr2=0x7fd2340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- 172.21.15.73:0/3722672827 shutdown_connections 2024-09-12T03:34:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- 172.21.15.73:0/3722672827 wait complete. 2024-09-12T03:34:50.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 Processor -- start 2024-09-12T03:34:50.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- start start 2024-09-12T03:34:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23406f010 0x7fd234153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23415bec0 0x7fd234158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23415c2a0 0x7fd234158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd234169ed0 con 0x7fd23415c2a0 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd234169d50 con 0x7fd23415bec0 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd23416a050 con 0x7fd23406f010 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23415c2a0 0x7fd234158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23415c2a0 0x7fd234158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42170/0 (socket says 172.21.15.73:42170) 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 -- 172.21.15.73:0/234073132 learned_addr learned my addr 172.21.15.73:0/234073132 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd2399fd640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23406f010 0x7fd234153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 -- 172.21.15.73:0/234073132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23406f010 msgr2=0x7fd234153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23406f010 0x7fd234153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 -- 172.21.15.73:0/234073132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23415bec0 msgr2=0x7fd234158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23415bec0 0x7fd234158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 -- 172.21.15.73:0/234073132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd234154030 con 0x7fd23415c2a0 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23a1fe640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23415c2a0 0x7fd234158860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0af040 tx=0x7fd22c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd22a7fc640 1 -- 172.21.15.73:0/234073132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0b8880 con 0x7fd23415c2a0 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd22a7fc640 1 -- 172.21.15.73:0/234073132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c0be070 con 0x7fd23415c2a0 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd234154310 con 0x7fd23415c2a0 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd22a7fc640 1 -- 172.21.15.73:0/234073132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22c0b8c80 con 0x7fd23415c2a0 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.905+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2341548d0 con 0x7fd23415c2a0 2024-09-12T03:34:50.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.909+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2340ad200 con 0x7fd23415c2a0 2024-09-12T03:34:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.909+0000 7fd22a7fc640 1 -- 172.21.15.73:0/234073132 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd22c0c3460 con 0x7fd23415c2a0 2024-09-12T03:34:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.909+0000 7fd22a7fc640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2180678c0 0x7fd218069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.909+0000 7fd22a7fc640 1 -- 172.21.15.73:0/234073132 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd22c121390 con 0x7fd23415c2a0 2024-09-12T03:34:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.909+0000 7fd2399fd640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2180678c0 0x7fd218069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:50.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.909+0000 7fd2399fd640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2180678c0 0x7fd218069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd224007fd0 tx=0x7fd224009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:50.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:50.913+0000 7fd22a7fc640 1 -- 172.21.15.73:0/234073132 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd22c016620 con 0x7fd23415c2a0 2024-09-12T03:34:51.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.061+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2340d0dc0 con 0x7fd23415c2a0 2024-09-12T03:34:51.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd22a7fc640 1 -- 172.21.15.73:0/234073132 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7fd22c0f1af0 con 0x7fd23415c2a0 2024-09-12T03:34:51.067 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:51.068 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2180678c0 msgr2=0x7fd218069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2180678c0 0x7fd218069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd224007fd0 tx=0x7fd224009040 comp rx=0 tx=0).stop 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23415c2a0 msgr2=0x7fd234158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23415c2a0 0x7fd234158860 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0af040 tx=0x7fd22c0197a0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 shutdown_connections 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2180678c0 0x7fd218069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23415c2a0 0x7fd234158860 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd23415bec0 0x7fd234158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 --2- 172.21.15.73:0/234073132 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23406f010 0x7fd234153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 >> 172.21.15.73:0/234073132 conn(0x7fd2340b1f90 msgr2=0x7fd234159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:51.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 shutdown_connections 2024-09-12T03:34:51.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.065+0000 7fd23bc61640 1 -- 172.21.15.73:0/234073132 wait complete. 2024-09-12T03:34:51.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T03:34:51.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6977460640 1 Processor -- start 2024-09-12T03:34:51.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6977460640 1 -- start start 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6977460640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6970073e60 0x7f697006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6977460640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 0x7f69700b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6977460640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69700b4670 con 0x7f697006fef0 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6977460640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f697006ee50 con 0x7f6970073e60 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6977460640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f697006f130 con 0x7f69700b3d50 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69749fb640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f697006fef0 0x7f697015b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42204/0 (socket says 172.21.15.73:42204) 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69749fb640 1 -- 172.21.15.73:0/428292932 learned_addr learned my addr 172.21.15.73:0/428292932 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448152274 0 0) 0x7f69700b4670 con 0x7f697006fef0 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f695c003530 con 0x7f697006fef0 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69751fc640 1 --2- 172.21.15.73:0/428292932 >> v2:172.21.15.150:3300/0 conn(0x7f6970073e60 0x7f697006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69759fd640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 0x7f69700b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3231300377 0 0) 0x7f695c003530 con 0x7f697006fef0 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 msgr2=0x7f69700b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 0x7f69700b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 >> v2:172.21.15.150:3300/0 conn(0x7f6970073e60 msgr2=0x7f697006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 --2- 172.21.15.73:0/428292932 >> v2:172.21.15.150:3300/0 conn(0x7f6970073e60 0x7f697006e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697006f410 con 0x7f697006fef0 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f6960001680 con 0x7f697006fef0 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 >> v1:172.21.15.73:6789/0 conn(0x7f697006fef0 legacy=0x7f697015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:51.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f695c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695c004810 0x7f695c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 0x7f695c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f697006ee50 con 0x7f695c0039c0 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f697006f130 con 0x7f695c004810 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f695c00bb60 con 0x7f69700b3d50 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69751fc640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f695c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69759fd640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 0x7f695c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69749fb640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695c004810 0x7f695c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69751fc640 1 -- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 msgr2=0x7f695c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69751fc640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69700b3d50 0x7f695c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69751fc640 1 -- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695c004810 msgr2=0x7f695c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69751fc640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695c004810 0x7f695c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69751fc640 1 -- 172.21.15.73:0/428292932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695c003530 con 0x7f695c0039c0 2024-09-12T03:34:51.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.205+0000 7f69749fb640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f695c004810 0x7f695c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f69751fc640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f695c003de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f696c00ca70 tx=0x7f696c01db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50e875ca57b3354 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0ac070 con 0x7f695c0039c0 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c0a68d0 con 0x7f695c0039c0 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6967fff640 1 -- 172.21.15.73:0/428292932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c00b040 con 0x7f695c0039c0 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 -- 172.21.15.73:0/428292932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 msgr2=0x7f695c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 --2- 172.21.15.73:0/428292932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f695c003de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f696c00ca70 tx=0x7f696c01db70 comp rx=0 tx=0).stop 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f69759fd640 1 -- 172.21.15.73:0/428292932 reap_dead start 2024-09-12T03:34:51.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 -- 172.21.15.73:0/428292932 shutdown_connections 2024-09-12T03:34:51.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 -- 172.21.15.73:0/428292932 >> 172.21.15.73:0/428292932 conn(0x7f69700b1f90 msgr2=0x7f69700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:51.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 -- 172.21.15.73:0/428292932 shutdown_connections 2024-09-12T03:34:51.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 -- 172.21.15.73:0/428292932 wait complete. 2024-09-12T03:34:51.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 Processor -- start 2024-09-12T03:34:51.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.209+0000 7f6977460640 1 -- start start 2024-09-12T03:34:51.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f69700cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6970162fd0 0x7f69701f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6970160f40 0x7f69701613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69700729a0 con 0x7f695c0039c0 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6970072820 con 0x7f6970162fd0 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6970072b20 con 0x7f6970160f40 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f69700cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f69700cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42194/0 (socket says 172.21.15.73:42194) 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 -- 172.21.15.73:0/2934546742 learned_addr learned my addr 172.21.15.73:0/2934546742 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69749fb640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6970162fd0 0x7f69701f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 -- 172.21.15.73:0/2934546742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6970160f40 msgr2=0x7f69701613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6970160f40 0x7f69701613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 -- 172.21.15.73:0/2934546742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6970162fd0 msgr2=0x7f69701f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6970162fd0 0x7f69701f5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 -- 172.21.15.73:0/2934546742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6970160c10 con 0x7f695c0039c0 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69751fc640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f69700cf730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f696c01d5e0 tx=0x7f696c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6965ffb640 1 -- 172.21.15.73:0/2934546742 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0ac040 con 0x7f695c0039c0 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6965ffb640 1 -- 172.21.15.73:0/2934546742 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c004020 con 0x7f695c0039c0 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6970163460 con 0x7f695c0039c0 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6965ffb640 1 -- 172.21.15.73:0/2934546742 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0043f0 con 0x7f695c0039c0 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6970160930 con 0x7f695c0039c0 2024-09-12T03:34:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69700b4650 con 0x7f695c0039c0 2024-09-12T03:34:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6965ffb640 1 -- 172.21.15.73:0/2934546742 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f696c0c1060 con 0x7f695c0039c0 2024-09-12T03:34:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6965ffb640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678c0 0x7f6954069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f6965ffb640 1 -- 172.21.15.73:0/2934546742 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f696c11fb60 con 0x7f695c0039c0 2024-09-12T03:34:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.213+0000 7f69749fb640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678c0 0x7f6954069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.217+0000 7f69749fb640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678c0 0x7f6954069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f697015b610 tx=0x7f6960009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:51.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.221+0000 7f6965ffb640 1 -- 172.21.15.73:0/2934546742 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f696c017880 con 0x7f695c0039c0 2024-09-12T03:34:51.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:51.413+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6970152f60 con 0x7f695c0039c0 2024-09-12T03:34:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.125+0000 7f6965ffb640 1 -- 172.21.15.73:0/2934546742 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f696c0f0360 con 0x7f695c0039c0 2024-09-12T03:34:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.125+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678c0 msgr2=0x7f6954069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.125+0000 7f6977460640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678c0 0x7f6954069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f697015b610 tx=0x7f6960009040 comp rx=0 tx=0).stop 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.125+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 msgr2=0x7f69700cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.125+0000 7f6977460640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f69700cf730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f696c01d5e0 tx=0x7f696c01c3b0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 shutdown_connections 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678c0 0x7f6954069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6970160f40 0x7f69701613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6970162fd0 0x7f69701f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 --2- 172.21.15.73:0/2934546742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695c0039c0 0x7f69700cf730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 >> 172.21.15.73:0/2934546742 conn(0x7f69700b1f90 msgr2=0x7f6970152210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 shutdown_connections 2024-09-12T03:34:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.129+0000 7f6977460640 1 -- 172.21.15.73:0/2934546742 wait complete. 2024-09-12T03:34:52.153 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-12T03:34:52.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T03:34:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad8fdb640 1 Processor -- start 2024-09-12T03:34:52.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad8fdb640 1 -- start start 2024-09-12T03:34:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad8fdb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9ad415c2a0 0x7f9ad40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad8fdb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad40b3290 con 0x7f9ad40af2a0 2024-09-12T03:34:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad8fdb640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad40b3570 con 0x7f9ad415bec0 2024-09-12T03:34:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad8fdb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad40b3850 con 0x7f9ad415c2a0 2024-09-12T03:34:52.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad2d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9ad40af2a0 0x7f9ad406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42212/0 (socket says 172.21.15.73:42212) 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad2d9d640 1 -- 172.21.15.73:0/3752600576 learned_addr learned my addr 172.21.15.73:0/3752600576 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ac9d9b640 1 --2- 172.21.15.73:0/3752600576 >> v2:172.21.15.150:3300/0 conn(0x7f9ad415c2a0 0x7f9ad40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233411860 0 0) 0x7f9ad40b3290 con 0x7f9ad40af2a0 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ac0003530 con 0x7f9ad40af2a0 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3444214473 0 0) 0x7f9ac0003530 con 0x7f9ad40af2a0 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 >> v2:172.21.15.150:3300/0 conn(0x7f9ad415c2a0 msgr2=0x7f9ad40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 --2- 172.21.15.73:0/3752600576 >> v2:172.21.15.150:3300/0 conn(0x7f9ad415c2a0 0x7f9ad40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 >> v1:172.21.15.150:6789/0 conn(0x7f9ad415bec0 legacy=0x7f9ad40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad40b3b30 con 0x7f9ad40af2a0 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f9acc001a00 con 0x7f9ad40af2a0 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 >> v1:172.21.15.73:6789/0 conn(0x7f9ad40af2a0 legacy=0x7f9ad406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac0003a10 0x7f9ac0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0004810 0x7f9ac0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ac00051d0 0x7f9ac000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40b3850 con 0x7f9ac0003a10 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac000c0d0 con 0x7f9ac00051d0 2024-09-12T03:34:52.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac000c2d0 con 0x7f9ac0004810 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad259c640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac0003a10 0x7f9ac0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ac9d9b640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0004810 0x7f9ac0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad2d9d640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ac00051d0 0x7f9ac000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad259c640 1 -- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0004810 msgr2=0x7f9ac0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad259c640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0004810 0x7f9ac0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad259c640 1 -- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ac00051d0 msgr2=0x7f9ac000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad259c640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ac00051d0 0x7f9ac000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad259c640 1 -- 172.21.15.73:0/3752600576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac0003530 con 0x7f9ac0003a10 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad2d9d640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ac00051d0 0x7f9ac000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ad2d9d640 1 -- 172.21.15.73:0/3752600576 reap_dead start 2024-09-12T03:34:52.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.277+0000 7f9ac9d9b640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0004810 0x7f9ac0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad259c640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac0003a10 0x7f9ac0003e30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001780 tx=0x7f9ac401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3b75cd347a00a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40013a0 con 0x7f9ac0003a10 2024-09-12T03:34:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac40052f0 con 0x7f9ac0003a10 2024-09-12T03:34:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad1d9b640 1 -- 172.21.15.73:0/3752600576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4003840 con 0x7f9ac0003a10 2024-09-12T03:34:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/3752600576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac0003a10 msgr2=0x7f9ac0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac0003a10 0x7f9ac0003e30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001780 tx=0x7f9ac401c3d0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/3752600576 shutdown_connections 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/3752600576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ac0003a10 0x7f9ac0003e30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/3752600576 >> 172.21.15.73:0/3752600576 conn(0x7f9ad40b1f90 msgr2=0x7f9ad40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/3752600576 shutdown_connections 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/3752600576 wait complete. 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 Processor -- start 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.281+0000 7f9ad8fdb640 1 -- start start 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0003a10 0x7f9ad4148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad4153c40 0x7f9ad409b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ad4148640 0x7f9ad409b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40af680 con 0x7f9ad4148640 2024-09-12T03:34:52.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40ad610 con 0x7f9ad4153c40 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad409a280 con 0x7f9ac0003a10 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ad4148640 0x7f9ad409b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ad4148640 0x7f9ad409b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42204/0 (socket says 172.21.15.73:42204) 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 -- 172.21.15.73:0/66424476 learned_addr learned my addr 172.21.15.73:0/66424476 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad259c640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0003a10 0x7f9ad4148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ac9d9b640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad4153c40 0x7f9ad409b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 -- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0003a10 msgr2=0x7f9ad4148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0003a10 0x7f9ad4148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 -- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad4153c40 msgr2=0x7f9ad409b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad4153c40 0x7f9ad409b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:52.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 -- 172.21.15.73:0/66424476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad40b1110 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad259c640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0003a10 0x7f9ad4148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad2d9d640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ad4148640 0x7f9ad409b7d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40b5950 tx=0x7f9acc00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9acb7fe640 1 -- 172.21.15.73:0/66424476 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc019070 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9acb7fe640 1 -- 172.21.15.73:0/66424476 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc004d90 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9acb7fe640 1 -- 172.21.15.73:0/66424476 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00bd60 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad409a4d0 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad409aa90 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad4160470 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9acb7fe640 1 -- 172.21.15.73:0/66424476 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9acc01c070 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9acb7fe640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ab40678c0 0x7f9ab4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9acb7fe640 1 -- 172.21.15.73:0/66424476 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9acc0859e0 con 0x7f9ad4148640 2024-09-12T03:34:52.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad259c640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ab40678c0 0x7f9ab4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.285+0000 7f9ad259c640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ab40678c0 0x7f9ab4069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001750 tx=0x7f9ac40011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:52.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.289+0000 7f9acb7fe640 1 -- 172.21.15.73:0/66424476 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9acc056270 con 0x7f9ad4148640 2024-09-12T03:34:52.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:52.477+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9ad406fcd0 con 0x7f9ad4148640 2024-09-12T03:34:53.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.137+0000 7f9acb7fe640 1 -- 172.21.15.73:0/66424476 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f9acc055b70 con 0x7f9ad4148640 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ab40678c0 msgr2=0x7f9ab4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ab40678c0 0x7f9ab4069d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001750 tx=0x7f9ac40011a0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ad4148640 msgr2=0x7f9ad409b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ad4148640 0x7f9ad409b7d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40b5950 tx=0x7f9acc00b4a0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 shutdown_connections 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ab40678c0 0x7f9ab4069d80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ad4148640 0x7f9ad409b7d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ad4153c40 0x7f9ad409b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 --2- 172.21.15.73:0/66424476 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ac0003a10 0x7f9ad4148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 >> 172.21.15.73:0/66424476 conn(0x7f9ad40b1f90 msgr2=0x7f9ad41546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 shutdown_connections 2024-09-12T03:34:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.141+0000 7f9ad8fdb640 1 -- 172.21.15.73:0/66424476 wait complete. 2024-09-12T03:34:53.167 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T03:34:53.168 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:53.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.285+0000 7fd32df8e640 1 Processor -- start 2024-09-12T03:34:53.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.285+0000 7fd32df8e640 1 -- start start 2024-09-12T03:34:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd32df8e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd3281630c0 0x7fd32806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd32df8e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd3280b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd32df8e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd328163bb0 con 0x7fd32806df70 2024-09-12T03:34:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd32df8e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd32806e470 con 0x7fd3281630c0 2024-09-12T03:34:53.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd32df8e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd32806e750 con 0x7fd3280b3290 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd327fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd3280b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd3277fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd3281630c0 0x7fd32806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd3277fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd3281630c0 0x7fd32806f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:44974/0 (socket says 172.21.15.73:44974) 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd3277fe640 1 -- 172.21.15.73:0/681468316 learned_addr learned my addr 172.21.15.73:0/681468316 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd327fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd3280b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:56752/0 (socket says 172.21.15.73:56752) 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd326ffd640 1 --1- 172.21.15.73:0/681468316 >> v1:172.21.15.150:6789/0 conn(0x7fd32806df70 0x7fd3281634a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:43854/0 (socket says 172.21.15.73:43854) 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd327fff640 1 -- 172.21.15.73:0/681468316 >> v2:172.21.15.150:3300/0 conn(0x7fd3281630c0 msgr2=0x7fd32806f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd327fff640 1 --2- 172.21.15.73:0/681468316 >> v2:172.21.15.150:3300/0 conn(0x7fd3281630c0 0x7fd32806f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd327fff640 1 -- 172.21.15.73:0/681468316 >> v1:172.21.15.150:6789/0 conn(0x7fd32806df70 legacy=0x7fd3281634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.289+0000 7fd327fff640 1 -- 172.21.15.73:0/681468316 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32806ea30 con 0x7fd3280b3290 2024-09-12T03:34:53.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd327fff640 1 --2- 172.21.15.73:0/681468316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd3280b3720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd320009d90 tx=0x7fd32001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8612a05a4974056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3267fc640 1 -- 172.21.15.73:0/681468316 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3200b2070 con 0x7fd3280b3290 2024-09-12T03:34:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3267fc640 1 -- 172.21.15.73:0/681468316 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3200a5830 con 0x7fd3280b3290 2024-09-12T03:34:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3267fc640 1 -- 172.21.15.73:0/681468316 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3200a5c00 con 0x7fd3280b3290 2024-09-12T03:34:53.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- 172.21.15.73:0/681468316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 msgr2=0x7fd3280b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 --2- 172.21.15.73:0/681468316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd3280b3720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd320009d90 tx=0x7fd32001c970 comp rx=0 tx=0).stop 2024-09-12T03:34:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- 172.21.15.73:0/681468316 shutdown_connections 2024-09-12T03:34:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 --2- 172.21.15.73:0/681468316 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd3280b3720 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 --2- 172.21.15.73:0/681468316 >> v2:172.21.15.150:3300/0 conn(0x7fd3281630c0 0x7fd32806f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- 172.21.15.73:0/681468316 >> 172.21.15.73:0/681468316 conn(0x7fd3280b1f90 msgr2=0x7fd3280b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- 172.21.15.73:0/681468316 shutdown_connections 2024-09-12T03:34:53.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- 172.21.15.73:0/681468316 wait complete. 2024-09-12T03:34:53.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 Processor -- start 2024-09-12T03:34:53.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- start start 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd32806df70 0x7fd3281519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd32815c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3281630c0 0x7fd32815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd32816f5f0 con 0x7fd32806df70 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd32806fc60 con 0x7fd3281630c0 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd32816f770 con 0x7fd3280b3290 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd32806df70 0x7fd3281519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd32806df70 0x7fd3281519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42210/0 (socket says 172.21.15.73:42210) 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 -- 172.21.15.73:0/72388849 learned_addr learned my addr 172.21.15.73:0/72388849 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd327fff640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3281630c0 0x7fd32815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd326ffd640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd32815c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 -- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 msgr2=0x7fd32815c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd32815c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 -- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3281630c0 msgr2=0x7fd32815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3281630c0 0x7fd32815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 -- 172.21.15.73:0/72388849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3281555a0 con 0x7fd32806df70 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd327fff640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3281630c0 0x7fd32815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd3277fe640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd32806df70 0x7fd3281519f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00e820 tx=0x7fd31c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd30ffff640 1 -- 172.21.15.73:0/72388849 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c017070 con 0x7fd32806df70 2024-09-12T03:34:53.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd30ffff640 1 -- 172.21.15.73:0/72388849 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd31c00c940 con 0x7fd32806df70 2024-09-12T03:34:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd328155880 con 0x7fd32806df70 2024-09-12T03:34:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd30ffff640 1 -- 172.21.15.73:0/72388849 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00cd30 con 0x7fd32806df70 2024-09-12T03:34:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.293+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd328155e40 con 0x7fd32806df70 2024-09-12T03:34:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.297+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3280b3720 con 0x7fd32806df70 2024-09-12T03:34:53.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.297+0000 7fd30ffff640 1 -- 172.21.15.73:0/72388849 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd31c01a070 con 0x7fd32806df70 2024-09-12T03:34:53.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.297+0000 7fd30ffff640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd3140678c0 0x7fd314069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.297+0000 7fd30ffff640 1 -- 172.21.15.73:0/72388849 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd31c086150 con 0x7fd32806df70 2024-09-12T03:34:53.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.297+0000 7fd326ffd640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd3140678c0 0x7fd314069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.297+0000 7fd326ffd640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd3140678c0 0x7fd314069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd32815cf60 tx=0x7fd318009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.301+0000 7fd30ffff640 1 -- 172.21.15.73:0/72388849 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd31c0569e0 con 0x7fd32806df70 2024-09-12T03:34:53.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.497+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd328070080 con 0x7fd32806df70 2024-09-12T03:34:53.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.497+0000 7fd30ffff640 1 -- 172.21.15.73:0/72388849 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7fd31c0562e0 con 0x7fd32806df70 2024-09-12T03:34:53.501 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:53.501 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:34:53.501 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd3140678c0 msgr2=0x7fd314069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd3140678c0 0x7fd314069d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd32815cf60 tx=0x7fd318009040 comp rx=0 tx=0).stop 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd32806df70 msgr2=0x7fd3281519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd32806df70 0x7fd3281519f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00e820 tx=0x7fd31c00ece0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 shutdown_connections 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd3140678c0 0x7fd314069d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3281630c0 0x7fd32815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd3280b3290 0x7fd32815c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 --2- 172.21.15.73:0/72388849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd32806df70 0x7fd3281519f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 >> 172.21.15.73:0/72388849 conn(0x7fd3280b1f90 msgr2=0x7fd3281634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 shutdown_connections 2024-09-12T03:34:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.501+0000 7fd32df8e640 1 -- 172.21.15.73:0/72388849 wait complete. 2024-09-12T03:34:53.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2793025640 1 Processor -- start 2024-09-12T03:34:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2793025640 1 -- start start 2024-09-12T03:34:53.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2793025640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c15bec0 0x7f278c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2793025640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f278c0af470 0x7f278c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2793025640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278c0b3290 con 0x7f278c15c2a0 2024-09-12T03:34:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2793025640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f278c0b3570 con 0x7f278c0af470 2024-09-12T03:34:53.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2793025640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f278c0b3850 con 0x7f278c15bec0 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2790dc1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c15bec0 0x7f278c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2783fff640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f278c15c2a0 0x7f278c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:43870/0 (socket says 172.21.15.73:43870) 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2783fff640 1 -- 172.21.15.73:0/207437354 learned_addr learned my addr 172.21.15.73:0/207437354 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f27915c2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f278c0af470 0x7f278c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2790dc1640 1 -- 172.21.15.73:0/207437354 >> v2:172.21.15.150:3300/0 conn(0x7f278c0af470 msgr2=0x7f278c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2790dc1640 1 --2- 172.21.15.73:0/207437354 >> v2:172.21.15.150:3300/0 conn(0x7f278c0af470 0x7f278c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2790dc1640 1 -- 172.21.15.73:0/207437354 >> v1:172.21.15.150:6789/0 conn(0x7f278c15c2a0 legacy=0x7f278c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.637+0000 7f2790dc1640 1 -- 172.21.15.73:0/207437354 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c0b3b30 con 0x7f278c15bec0 2024-09-12T03:34:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2790dc1640 1 --2- 172.21.15.73:0/207437354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c15bec0 0x7f278c0ad200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f27880097c0 tx=0x7f278801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2620c525ca5bd7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f27837fe640 1 -- 172.21.15.73:0/207437354 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27880a7070 con 0x7f278c15bec0 2024-09-12T03:34:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f27837fe640 1 -- 172.21.15.73:0/207437354 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27880b0070 con 0x7f278c15bec0 2024-09-12T03:34:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f27837fe640 1 -- 172.21.15.73:0/207437354 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27880ab890 con 0x7f278c15bec0 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 -- 172.21.15.73:0/207437354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c15bec0 msgr2=0x7f278c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 --2- 172.21.15.73:0/207437354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c15bec0 0x7f278c0ad200 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f27880097c0 tx=0x7f278801c470 comp rx=0 tx=0).stop 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 -- 172.21.15.73:0/207437354 shutdown_connections 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 --2- 172.21.15.73:0/207437354 >> v2:172.21.15.150:3300/0 conn(0x7f278c0af470 0x7f278c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 --2- 172.21.15.73:0/207437354 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c15bec0 0x7f278c0ad200 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 -- 172.21.15.73:0/207437354 >> 172.21.15.73:0/207437354 conn(0x7f278c0b1f90 msgr2=0x7f278c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 -- 172.21.15.73:0/207437354 shutdown_connections 2024-09-12T03:34:53.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 -- 172.21.15.73:0/207437354 wait complete. 2024-09-12T03:34:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 Processor -- start 2024-09-12T03:34:53.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.641+0000 7f2793025640 1 -- start start 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c0af470 0x7f278c165e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278c15bec0 0x7f278c1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f278c15c2a0 0x7f278c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f278c06ed50 con 0x7f278c15bec0 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f278c0ad740 con 0x7f278c15c2a0 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f278c06eed0 con 0x7f278c0af470 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278c15bec0 0x7f278c1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278c15bec0 0x7f278c1499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42214/0 (socket says 172.21.15.73:42214) 2024-09-12T03:34:53.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 -- 172.21.15.73:0/2562473105 learned_addr learned my addr 172.21.15.73:0/2562473105 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2790dc1640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c0af470 0x7f278c165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f27915c2640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f278c15c2a0 0x7f278c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 -- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c0af470 msgr2=0x7f278c165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c0af470 0x7f278c165e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 -- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f278c15c2a0 msgr2=0x7f278c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f278c15c2a0 0x7f278c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 -- 172.21.15.73:0/2562473105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278c1581b0 con 0x7f278c15bec0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2783fff640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278c15bec0 0x7f278c1499e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c310 tx=0x7f277c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f27817fa640 1 -- 172.21.15.73:0/2562473105 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c017070 con 0x7f278c15bec0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f27817fa640 1 -- 172.21.15.73:0/2562473105 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c005cf0 con 0x7f278c15bec0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278c166450 con 0x7f278c15bec0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f27817fa640 1 -- 172.21.15.73:0/2562473105 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c007310 con 0x7f278c15bec0 2024-09-12T03:34:53.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278c14faa0 con 0x7f278c15bec0 2024-09-12T03:34:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278c06f280 con 0x7f278c15bec0 2024-09-12T03:34:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f27817fa640 1 -- 172.21.15.73:0/2562473105 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f277c01a070 con 0x7f278c15bec0 2024-09-12T03:34:53.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f27817fa640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f27780678f0 0x7f2778069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2790dc1640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f27780678f0 0x7f2778069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f27817fa640 1 -- 172.21.15.73:0/2562473105 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f277c085260 con 0x7f278c15bec0 2024-09-12T03:34:53.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.645+0000 7f2790dc1640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f27780678f0 0x7f2778069db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27880af000 tx=0x7f27880a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.649+0000 7f27817fa640 1 -- 172.21.15.73:0/2562473105 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f278c1581b0 con 0x7f278c15bec0 2024-09-12T03:34:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.813+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f278c06fcd0 con 0x7f278c15bec0 2024-09-12T03:34:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.817+0000 7f27817fa640 1 -- 172.21.15.73:0/2562473105 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f277c055af0 con 0x7f278c15bec0 2024-09-12T03:34:53.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:53.819 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f27780678f0 msgr2=0x7f2778069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f27780678f0 0x7f2778069db0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f27880af000 tx=0x7f27880a7000 comp rx=0 tx=0).stop 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278c15bec0 msgr2=0x7f278c1499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278c15bec0 0x7f278c1499e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f277c00c310 tx=0x7f277c00c7d0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 shutdown_connections 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f27780678f0 0x7f2778069db0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278c15bec0 0x7f278c1499e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f278c15c2a0 0x7f278c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 --2- 172.21.15.73:0/2562473105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f278c0af470 0x7f278c165e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 >> 172.21.15.73:0/2562473105 conn(0x7f278c0b1f90 msgr2=0x7f278c14b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:53.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 shutdown_connections 2024-09-12T03:34:53.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.821+0000 7f2793025640 1 -- 172.21.15.73:0/2562473105 wait complete. 2024-09-12T03:34:53.839 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:34:53.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:34:53.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f7fce640 1 Processor -- start 2024-09-12T03:34:53.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f7fce640 1 -- start start 2024-09-12T03:34:53.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f7fce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69f015f830 0x7f69f006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f7fce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f7fce640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f015fc10 con 0x7f69f015d290 2024-09-12T03:34:53.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f7fce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f69f015da40 con 0x7f69f015f830 2024-09-12T03:34:53.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f7fce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f69f015d800 con 0x7f69f015eee0 2024-09-12T03:34:53.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5d6a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69f015f830 0x7f69f006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5569640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f69f015d290 0x7f69f015fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42226/0 (socket says 172.21.15.73:42226) 2024-09-12T03:34:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5569640 1 -- 172.21.15.73:0/3369999960 learned_addr learned my addr 172.21.15.73:0/3369999960 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5d6a640 1 -- 172.21.15.73:0/3369999960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 msgr2=0x7f69f006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f656b640 1 --2- 172.21.15.73:0/3369999960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f4d68640 1 -- 172.21.15.73:0/3369999960 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229108266 0 0) 0x7f69f015fc10 con 0x7f69f015d290 2024-09-12T03:34:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5d6a640 1 --2- 172.21.15.73:0/3369999960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f006c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5d6a640 1 -- 172.21.15.73:0/3369999960 >> v1:172.21.15.73:6789/0 conn(0x7f69f015d290 legacy=0x7f69f015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5d6a640 1 -- 172.21.15.73:0/3369999960 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f00b3570 con 0x7f69f015f830 2024-09-12T03:34:53.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f5d6a640 1 --2- 172.21.15.73:0/3369999960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f006bcc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097c0 tx=0x7f69ec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc0115fa26aeefc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f4d68640 1 -- 172.21.15.73:0/3369999960 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0a7070 con 0x7f69f015f830 2024-09-12T03:34:53.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.944+0000 7f69f4d68640 1 -- 172.21.15.73:0/3369999960 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec0b0070 con 0x7f69f015f830 2024-09-12T03:34:53.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f4d68640 1 -- 172.21.15.73:0/3369999960 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0ab890 con 0x7f69f015f830 2024-09-12T03:34:53.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- 172.21.15.73:0/3369999960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 msgr2=0x7f69f006bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 --2- 172.21.15.73:0/3369999960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f006bcc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0097c0 tx=0x7f69ec01c470 comp rx=0 tx=0).stop 2024-09-12T03:34:53.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- 172.21.15.73:0/3369999960 shutdown_connections 2024-09-12T03:34:53.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 --2- 172.21.15.73:0/3369999960 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f006c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 --2- 172.21.15.73:0/3369999960 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f006bcc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- 172.21.15.73:0/3369999960 >> 172.21.15.73:0/3369999960 conn(0x7f69f00b6800 msgr2=0x7f69f00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:53.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- 172.21.15.73:0/3369999960 shutdown_connections 2024-09-12T03:34:53.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- 172.21.15.73:0/3369999960 wait complete. 2024-09-12T03:34:53.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 Processor -- start 2024-09-12T03:34:53.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- start start 2024-09-12T03:34:53.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f015d290 0x7f69f0146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f015b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0169390 con 0x7f69f015f830 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0169210 con 0x7f69f015d290 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f69f0169510 con 0x7f69f015eee0 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f015b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42232/0 (socket says 172.21.15.73:42232) 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 -- 172.21.15.73:0/1086165499 learned_addr learned my addr 172.21.15.73:0/1086165499 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f5569640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f015b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f5d6a640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f015d290 0x7f69f0146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 -- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 msgr2=0x7f69f015b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f015b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 -- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f015d290 msgr2=0x7f69f0146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f015d290 0x7f69f0146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:53.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 -- 172.21.15.73:0/1086165499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f014e7d0 con 0x7f69f015f830 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f5d6a640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f015d290 0x7f69f0146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f656b640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f015b890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69e800cd60 tx=0x7f69e800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69e67fc640 1 -- 172.21.15.73:0/1086165499 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8003ba0 con 0x7f69f015f830 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69e67fc640 1 -- 172.21.15.73:0/1086165499 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e8003d60 con 0x7f69f015f830 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69e67fc640 1 -- 172.21.15.73:0/1086165499 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8004260 con 0x7f69f015f830 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f01474c0 con 0x7f69f015f830 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.948+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f0152100 con 0x7f69f015f830 2024-09-12T03:34:53.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.952+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f015fe70 con 0x7f69f015f830 2024-09-12T03:34:53.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.952+0000 7f69e67fc640 1 -- 172.21.15.73:0/1086165499 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f69e8004400 con 0x7f69f015f830 2024-09-12T03:34:53.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.952+0000 7f69e67fc640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69d40678c0 0x7f69d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:53.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.952+0000 7f69e67fc640 1 -- 172.21.15.73:0/1086165499 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f69e8086b50 con 0x7f69f015f830 2024-09-12T03:34:53.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.952+0000 7f69f5d6a640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69d40678c0 0x7f69d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:53.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.952+0000 7f69f5d6a640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69d40678c0 0x7f69d4069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0af000 tx=0x7f69ec0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:53.956+0000 7f69e67fc640 1 -- 172.21.15.73:0/1086165499 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f69e801d340 con 0x7f69f015f830 2024-09-12T03:34:54.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.108+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69f006e7c0 con 0x7f69d40678c0 2024-09-12T03:34:54.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.132+0000 7f69e67fc640 1 -- 172.21.15.73:0/1086165499 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f69f006e7c0 con 0x7f69d40678c0 2024-09-12T03:34:54.139 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:54.143 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:34:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69d40678c0 msgr2=0x7f69d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69d40678c0 0x7f69d4069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0af000 tx=0x7f69ec0a7000 comp rx=0 tx=0).stop 2024-09-12T03:34:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 msgr2=0x7f69f015b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f015b890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69e800cd60 tx=0x7f69e800a660 comp rx=0 tx=0).stop 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 shutdown_connections 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69d40678c0 0x7f69d4069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69f015f830 0x7f69f015b890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f69f015eee0 0x7f69f015b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 --2- 172.21.15.73:0/1086165499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69f015d290 0x7f69f0146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 >> 172.21.15.73:0/1086165499 conn(0x7f69f00b6800 msgr2=0x7f69f0156610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 shutdown_connections 2024-09-12T03:34:54.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.140+0000 7f69f7fce640 1 -- 172.21.15.73:0/1086165499 wait complete. 2024-09-12T03:34:54.161 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-12T03:34:53.791531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2006572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003444"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012394+0000","last_change":"2024-09-12T03:34:38.010797+0000","last_active":"2024-09-12T03:34:45.012394+0000","last_peered":"2024-09-12T03:34:45.012394+0000","last_clean":"2024-09-12T03:34:45.012394+0000","last_became_active":"2024-09-12T03:34:38.010433+0000","last_became_peered":"2024-09-12T03:34:38.010433+0000","last_unstale":"2024-09-12T03:34:45.012394+0000","last_undegraded":"2024-09-12T03:34:45.012394+0000","last_fullsized":"2024-09-12T03:34:45.012394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009665+0000","last_change":"2024-09-12T03:34:39.074559+0000","last_active":"2024-09-12T03:34:45.009665+0000","last_peered":"2024-09-12T03:34:45.009665+0000","last_clean":"2024-09-12T03:34:45.009665+0000","last_became_active":"2024-09-12T03:34:39.074317+0000","last_became_peered":"2024-09-12T03:34:39.074317+0000","last_unstale":"2024-09-12T03:34:45.009665+0000","last_undegraded":"2024-09-12T03:34:45.009665+0000","last_fullsized":"2024-09-12T03:34:45.009665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007763+0000","last_change":"2024-09-12T03:34:43.218439+0000","last_active":"2024-09-12T03:34:45.007763+0000","last_peered":"2024-09-12T03:34:45.007763+0000","last_clean":"2024-09-12T03:34:45.007763+0000","last_became_active":"2024-09-12T03:34:43.216661+0000","last_became_peered":"2024-09-12T03:34:43.216661+0000","last_unstale":"2024-09-12T03:34:45.007763+0000","last_undegraded":"2024-09-12T03:34:45.007763+0000","last_fullsized":"2024-09-12T03:34:45.007763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:12.169699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010114+0000","last_change":"2024-09-12T03:34:38.014275+0000","last_active":"2024-09-12T03:34:45.010114+0000","last_peered":"2024-09-12T03:34:45.010114+0000","last_clean":"2024-09-12T03:34:45.010114+0000","last_became_active":"2024-09-12T03:34:38.013821+0000","last_became_peered":"2024-09-12T03:34:38.013821+0000","last_unstale":"2024-09-12T03:34:45.010114+0000","last_undegraded":"2024-09-12T03:34:45.010114+0000","last_fullsized":"2024-09-12T03:34:45.010114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012133+0000","last_change":"2024-09-12T03:34:39.088423+0000","last_active":"2024-09-12T03:34:45.012133+0000","last_peered":"2024-09-12T03:34:45.012133+0000","last_clean":"2024-09-12T03:34:45.012133+0000","last_became_active":"2024-09-12T03:34:39.088198+0000","last_became_peered":"2024-09-12T03:34:39.088198+0000","last_unstale":"2024-09-12T03:34:45.012133+0000","last_undegraded":"2024-09-12T03:34:45.012133+0000","last_fullsized":"2024-09-12T03:34:45.012133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097304+0000","last_change":"2024-09-12T03:34:43.134447+0000","last_active":"2024-09-12T03:34:44.097304+0000","last_peered":"2024-09-12T03:34:44.097304+0000","last_clean":"2024-09-12T03:34:44.097304+0000","last_became_active":"2024-09-12T03:34:43.131156+0000","last_became_peered":"2024-09-12T03:34:43.131156+0000","last_unstale":"2024-09-12T03:34:44.097304+0000","last_undegraded":"2024-09-12T03:34:44.097304+0000","last_fullsized":"2024-09-12T03:34:44.097304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010783+0000","last_change":"2024-09-12T03:34:38.029333+0000","last_active":"2024-09-12T03:34:45.010783+0000","last_peered":"2024-09-12T03:34:45.010783+0000","last_clean":"2024-09-12T03:34:45.010783+0000","last_became_active":"2024-09-12T03:34:38.028881+0000","last_became_peered":"2024-09-12T03:34:38.028881+0000","last_unstale":"2024-09-12T03:34:45.010783+0000","last_undegraded":"2024-09-12T03:34:45.010783+0000","last_fullsized":"2024-09-12T03:34:45.010783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097344+0000","last_change":"2024-09-12T03:34:39.099744+0000","last_active":"2024-09-12T03:34:44.097344+0000","last_peered":"2024-09-12T03:34:44.097344+0000","last_clean":"2024-09-12T03:34:44.097344+0000","last_became_active":"2024-09-12T03:34:39.098494+0000","last_became_peered":"2024-09-12T03:34:39.098494+0000","last_unstale":"2024-09-12T03:34:44.097344+0000","last_undegraded":"2024-09-12T03:34:44.097344+0000","last_fullsized":"2024-09-12T03:34:44.097344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096627+0000","last_change":"2024-09-12T03:34:43.136579+0000","last_active":"2024-09-12T03:34:44.096627+0000","last_peered":"2024-09-12T03:34:44.096627+0000","last_clean":"2024-09-12T03:34:44.096627+0000","last_became_active":"2024-09-12T03:34:43.131614+0000","last_became_peered":"2024-09-12T03:34:43.131614+0000","last_unstale":"2024-09-12T03:34:44.096627+0000","last_undegraded":"2024-09-12T03:34:44.096627+0000","last_fullsized":"2024-09-12T03:34:44.096627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:04.948070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010371+0000","last_change":"2024-09-12T03:34:38.031062+0000","last_active":"2024-09-12T03:34:45.010371+0000","last_peered":"2024-09-12T03:34:45.010371+0000","last_clean":"2024-09-12T03:34:45.010371+0000","last_became_active":"2024-09-12T03:34:38.030527+0000","last_became_peered":"2024-09-12T03:34:38.030527+0000","last_unstale":"2024-09-12T03:34:45.010371+0000","last_undegraded":"2024-09-12T03:34:45.010371+0000","last_fullsized":"2024-09-12T03:34:45.010371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098474+0000","last_change":"2024-09-12T03:34:39.101380+0000","last_active":"2024-09-12T03:34:44.098474+0000","last_peered":"2024-09-12T03:34:44.098474+0000","last_clean":"2024-09-12T03:34:44.098474+0000","last_became_active":"2024-09-12T03:34:39.099679+0000","last_became_peered":"2024-09-12T03:34:39.099679+0000","last_unstale":"2024-09-12T03:34:44.098474+0000","last_undegraded":"2024-09-12T03:34:44.098474+0000","last_fullsized":"2024-09-12T03:34:44.098474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095057+0000","last_change":"2024-09-12T03:34:43.128313+0000","last_active":"2024-09-12T03:34:44.095057+0000","last_peered":"2024-09-12T03:34:44.095057+0000","last_clean":"2024-09-12T03:34:44.095057+0000","last_became_active":"2024-09-12T03:34:43.126843+0000","last_became_peered":"2024-09-12T03:34:43.126843+0000","last_unstale":"2024-09-12T03:34:44.095057+0000","last_undegraded":"2024-09-12T03:34:44.095057+0000","last_fullsized":"2024-09-12T03:34:44.095057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:23.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187338+0000","last_change":"2024-09-12T03:34:39.093427+0000","last_active":"2024-09-12T03:34:44.187338+0000","last_peered":"2024-09-12T03:34:44.187338+0000","last_clean":"2024-09-12T03:34:44.187338+0000","last_became_active":"2024-09-12T03:34:39.092380+0000","last_became_peered":"2024-09-12T03:34:39.092380+0000","last_unstale":"2024-09-12T03:34:44.187338+0000","last_undegraded":"2024-09-12T03:34:44.187338+0000","last_fullsized":"2024-09-12T03:34:44.187338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010267+0000","last_change":"2024-09-12T03:34:38.029799+0000","last_active":"2024-09-12T03:34:45.010267+0000","last_peered":"2024-09-12T03:34:45.010267+0000","last_clean":"2024-09-12T03:34:45.010267+0000","last_became_active":"2024-09-12T03:34:38.027974+0000","last_became_peered":"2024-09-12T03:34:38.027974+0000","last_unstale":"2024-09-12T03:34:45.010267+0000","last_undegraded":"2024-09-12T03:34:45.010267+0000","last_fullsized":"2024-09-12T03:34:45.010267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095984+0000","last_change":"2024-09-12T03:34:43.124251+0000","last_active":"2024-09-12T03:34:44.095984+0000","last_peered":"2024-09-12T03:34:44.095984+0000","last_clean":"2024-09-12T03:34:44.095984+0000","last_became_active":"2024-09-12T03:34:43.123246+0000","last_became_peered":"2024-09-12T03:34:43.123246+0000","last_unstale":"2024-09-12T03:34:44.095984+0000","last_undegraded":"2024-09-12T03:34:44.095984+0000","last_fullsized":"2024-09-12T03:34:44.095984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010770+0000","last_change":"2024-09-12T03:34:39.066746+0000","last_active":"2024-09-12T03:34:45.010770+0000","last_peered":"2024-09-12T03:34:45.010770+0000","last_clean":"2024-09-12T03:34:45.010770+0000","last_became_active":"2024-09-12T03:34:39.066399+0000","last_became_peered":"2024-09-12T03:34:39.066399+0000","last_unstale":"2024-09-12T03:34:45.010770+0000","last_undegraded":"2024-09-12T03:34:45.010770+0000","last_fullsized":"2024-09-12T03:34:45.010770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093375+0000","last_change":"2024-09-12T03:34:38.005663+0000","last_active":"2024-09-12T03:34:44.093375+0000","last_peered":"2024-09-12T03:34:44.093375+0000","last_clean":"2024-09-12T03:34:44.093375+0000","last_became_active":"2024-09-12T03:34:38.005160+0000","last_became_peered":"2024-09-12T03:34:38.005160+0000","last_unstale":"2024-09-12T03:34:44.093375+0000","last_undegraded":"2024-09-12T03:34:44.093375+0000","last_fullsized":"2024-09-12T03:34:44.093375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095966+0000","last_change":"2024-09-12T03:34:43.131000+0000","last_active":"2024-09-12T03:34:44.095966+0000","last_peered":"2024-09-12T03:34:44.095966+0000","last_clean":"2024-09-12T03:34:44.095966+0000","last_became_active":"2024-09-12T03:34:43.129785+0000","last_became_peered":"2024-09-12T03:34:43.129785+0000","last_unstale":"2024-09-12T03:34:44.095966+0000","last_undegraded":"2024-09-12T03:34:44.095966+0000","last_fullsized":"2024-09-12T03:34:44.095966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:17.250004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008215+0000","last_change":"2024-09-12T03:34:39.065304+0000","last_active":"2024-09-12T03:34:45.008215+0000","last_peered":"2024-09-12T03:34:45.008215+0000","last_clean":"2024-09-12T03:34:45.008215+0000","last_became_active":"2024-09-12T03:34:39.065027+0000","last_became_peered":"2024-09-12T03:34:39.065027+0000","last_unstale":"2024-09-12T03:34:45.008215+0000","last_undegraded":"2024-09-12T03:34:45.008215+0000","last_fullsized":"2024-09-12T03:34:45.008215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092648+0000","last_change":"2024-09-12T03:34:38.020702+0000","last_active":"2024-09-12T03:34:44.092648+0000","last_peered":"2024-09-12T03:34:44.092648+0000","last_clean":"2024-09-12T03:34:44.092648+0000","last_became_active":"2024-09-12T03:34:38.020279+0000","last_became_peered":"2024-09-12T03:34:38.020279+0000","last_unstale":"2024-09-12T03:34:44.092648+0000","last_undegraded":"2024-09-12T03:34:44.092648+0000","last_fullsized":"2024-09-12T03:34:44.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094739+0000","last_change":"2024-09-12T03:34:43.215466+0000","last_active":"2024-09-12T03:34:44.094739+0000","last_peered":"2024-09-12T03:34:44.094739+0000","last_clean":"2024-09-12T03:34:44.094739+0000","last_became_active":"2024-09-12T03:34:43.214416+0000","last_became_peered":"2024-09-12T03:34:43.214416+0000","last_unstale":"2024-09-12T03:34:44.094739+0000","last_undegraded":"2024-09-12T03:34:44.094739+0000","last_fullsized":"2024-09-12T03:34:44.094739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:09.728873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095570+0000","last_change":"2024-09-12T03:34:39.063489+0000","last_active":"2024-09-12T03:34:44.095570+0000","last_peered":"2024-09-12T03:34:44.095570+0000","last_clean":"2024-09-12T03:34:44.095570+0000","last_became_active":"2024-09-12T03:34:39.062768+0000","last_became_peered":"2024-09-12T03:34:39.062768+0000","last_unstale":"2024-09-12T03:34:44.095570+0000","last_undegraded":"2024-09-12T03:34:44.095570+0000","last_fullsized":"2024-09-12T03:34:44.095570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009376+0000","last_change":"2024-09-12T03:34:38.015940+0000","last_active":"2024-09-12T03:34:45.009376+0000","last_peered":"2024-09-12T03:34:45.009376+0000","last_clean":"2024-09-12T03:34:45.009376+0000","last_became_active":"2024-09-12T03:34:38.015461+0000","last_became_peered":"2024-09-12T03:34:38.015461+0000","last_unstale":"2024-09-12T03:34:45.009376+0000","last_undegraded":"2024-09-12T03:34:45.009376+0000","last_fullsized":"2024-09-12T03:34:45.009376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095326+0000","last_change":"2024-09-12T03:34:43.129118+0000","last_active":"2024-09-12T03:34:44.095326+0000","last_peered":"2024-09-12T03:34:44.095326+0000","last_clean":"2024-09-12T03:34:44.095326+0000","last_became_active":"2024-09-12T03:34:43.127925+0000","last_became_peered":"2024-09-12T03:34:43.127925+0000","last_unstale":"2024-09-12T03:34:44.095326+0000","last_undegraded":"2024-09-12T03:34:44.095326+0000","last_fullsized":"2024-09-12T03:34:44.095326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:47.375563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013122+0000","last_change":"2024-09-12T03:34:39.058932+0000","last_active":"2024-09-12T03:34:45.013122+0000","last_peered":"2024-09-12T03:34:45.013122+0000","last_clean":"2024-09-12T03:34:45.013122+0000","last_became_active":"2024-09-12T03:34:39.058293+0000","last_became_peered":"2024-09-12T03:34:39.058293+0000","last_unstale":"2024-09-12T03:34:45.013122+0000","last_undegraded":"2024-09-12T03:34:45.013122+0000","last_fullsized":"2024-09-12T03:34:45.013122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:38.023773+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:38.023187+0000","last_became_peered":"2024-09-12T03:34:38.023187+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.688103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095125+0000","last_change":"2024-09-12T03:34:43.216377+0000","last_active":"2024-09-12T03:34:44.095125+0000","last_peered":"2024-09-12T03:34:44.095125+0000","last_clean":"2024-09-12T03:34:44.095125+0000","last_became_active":"2024-09-12T03:34:43.215337+0000","last_became_peered":"2024-09-12T03:34:43.215337+0000","last_unstale":"2024-09-12T03:34:44.095125+0000","last_undegraded":"2024-09-12T03:34:44.095125+0000","last_fullsized":"2024-09-12T03:34:44.095125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:38.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010397+0000","last_change":"2024-09-12T03:34:39.084538+0000","last_active":"2024-09-12T03:34:45.010397+0000","last_peered":"2024-09-12T03:34:45.010397+0000","last_clean":"2024-09-12T03:34:45.010397+0000","last_became_active":"2024-09-12T03:34:39.084268+0000","last_became_peered":"2024-09-12T03:34:39.084268+0000","last_unstale":"2024-09-12T03:34:45.010397+0000","last_undegraded":"2024-09-12T03:34:45.010397+0000","last_fullsized":"2024-09-12T03:34:45.010397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094541+0000","last_change":"2024-09-12T03:34:38.019195+0000","last_active":"2024-09-12T03:34:44.094541+0000","last_peered":"2024-09-12T03:34:44.094541+0000","last_clean":"2024-09-12T03:34:44.094541+0000","last_became_active":"2024-09-12T03:34:38.018785+0000","last_became_peered":"2024-09-12T03:34:38.018785+0000","last_unstale":"2024-09-12T03:34:44.094541+0000","last_undegraded":"2024-09-12T03:34:44.094541+0000","last_fullsized":"2024-09-12T03:34:44.094541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007530+0000","last_change":"2024-09-12T03:34:43.214340+0000","last_active":"2024-09-12T03:34:45.007530+0000","last_peered":"2024-09-12T03:34:45.007530+0000","last_clean":"2024-09-12T03:34:45.007530+0000","last_became_active":"2024-09-12T03:34:43.213920+0000","last_became_peered":"2024-09-12T03:34:43.213920+0000","last_unstale":"2024-09-12T03:34:45.007530+0000","last_undegraded":"2024-09-12T03:34:45.007530+0000","last_fullsized":"2024-09-12T03:34:45.007530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:12.709218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094005+0000","last_change":"2024-09-12T03:34:39.060173+0000","last_active":"2024-09-12T03:34:44.094005+0000","last_peered":"2024-09-12T03:34:44.094005+0000","last_clean":"2024-09-12T03:34:44.094005+0000","last_became_active":"2024-09-12T03:34:39.059915+0000","last_became_peered":"2024-09-12T03:34:39.059915+0000","last_unstale":"2024-09-12T03:34:44.094005+0000","last_undegraded":"2024-09-12T03:34:44.094005+0000","last_fullsized":"2024-09-12T03:34:44.094005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011065+0000","last_change":"2024-09-12T03:34:38.021938+0000","last_active":"2024-09-12T03:34:45.011065+0000","last_peered":"2024-09-12T03:34:45.011065+0000","last_clean":"2024-09-12T03:34:45.011065+0000","last_became_active":"2024-09-12T03:34:38.020605+0000","last_became_peered":"2024-09-12T03:34:38.020605+0000","last_unstale":"2024-09-12T03:34:45.011065+0000","last_undegraded":"2024-09-12T03:34:45.011065+0000","last_fullsized":"2024-09-12T03:34:45.011065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013038+0000","last_change":"2024-09-12T03:34:43.217230+0000","last_active":"2024-09-12T03:34:45.013038+0000","last_peered":"2024-09-12T03:34:45.013038+0000","last_clean":"2024-09-12T03:34:45.013038+0000","last_became_active":"2024-09-12T03:34:43.214307+0000","last_became_peered":"2024-09-12T03:34:43.214307+0000","last_unstale":"2024-09-12T03:34:45.013038+0000","last_undegraded":"2024-09-12T03:34:45.013038+0000","last_fullsized":"2024-09-12T03:34:45.013038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:03.198301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098650+0000","last_change":"2024-09-12T03:34:39.100077+0000","last_active":"2024-09-12T03:34:44.098650+0000","last_peered":"2024-09-12T03:34:44.098650+0000","last_clean":"2024-09-12T03:34:44.098650+0000","last_became_active":"2024-09-12T03:34:39.097599+0000","last_became_peered":"2024-09-12T03:34:39.097599+0000","last_unstale":"2024-09-12T03:34:44.098650+0000","last_undegraded":"2024-09-12T03:34:44.098650+0000","last_fullsized":"2024-09-12T03:34:44.098650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094119+0000","last_change":"2024-09-12T03:34:38.013282+0000","last_active":"2024-09-12T03:34:44.094119+0000","last_peered":"2024-09-12T03:34:44.094119+0000","last_clean":"2024-09-12T03:34:44.094119+0000","last_became_active":"2024-09-12T03:34:38.013066+0000","last_became_peered":"2024-09-12T03:34:38.013066+0000","last_unstale":"2024-09-12T03:34:44.094119+0000","last_undegraded":"2024-09-12T03:34:44.094119+0000","last_fullsized":"2024-09-12T03:34:44.094119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092815+0000","last_change":"2024-09-12T03:34:43.124967+0000","last_active":"2024-09-12T03:34:44.092815+0000","last_peered":"2024-09-12T03:34:44.092815+0000","last_clean":"2024-09-12T03:34:44.092815+0000","last_became_active":"2024-09-12T03:34:43.124439+0000","last_became_peered":"2024-09-12T03:34:43.124439+0000","last_unstale":"2024-09-12T03:34:44.092815+0000","last_undegraded":"2024-09-12T03:34:44.092815+0000","last_fullsized":"2024-09-12T03:34:44.092815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097630+0000","last_change":"2024-09-12T03:34:39.069126+0000","last_active":"2024-09-12T03:34:44.097630+0000","last_peered":"2024-09-12T03:34:44.097630+0000","last_clean":"2024-09-12T03:34:44.097630+0000","last_became_active":"2024-09-12T03:34:39.068202+0000","last_became_peered":"2024-09-12T03:34:39.068202+0000","last_unstale":"2024-09-12T03:34:44.097630+0000","last_undegraded":"2024-09-12T03:34:44.097630+0000","last_fullsized":"2024-09-12T03:34:44.097630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097368+0000","last_change":"2024-09-12T03:34:38.025161+0000","last_active":"2024-09-12T03:34:44.097368+0000","last_peered":"2024-09-12T03:34:44.097368+0000","last_clean":"2024-09-12T03:34:44.097368+0000","last_became_active":"2024-09-12T03:34:38.024569+0000","last_became_peered":"2024-09-12T03:34:38.024569+0000","last_unstale":"2024-09-12T03:34:44.097368+0000","last_undegraded":"2024-09-12T03:34:44.097368+0000","last_fullsized":"2024-09-12T03:34:44.097368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093825+0000","last_change":"2024-09-12T03:34:43.119701+0000","last_active":"2024-09-12T03:34:44.093825+0000","last_peered":"2024-09-12T03:34:44.093825+0000","last_clean":"2024-09-12T03:34:44.093825+0000","last_became_active":"2024-09-12T03:34:43.118522+0000","last_became_peered":"2024-09-12T03:34:43.118522+0000","last_unstale":"2024-09-12T03:34:44.093825+0000","last_undegraded":"2024-09-12T03:34:44.093825+0000","last_fullsized":"2024-09-12T03:34:44.093825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:53.891623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092997+0000","last_change":"2024-09-12T03:34:39.060677+0000","last_active":"2024-09-12T03:34:44.092997+0000","last_peered":"2024-09-12T03:34:44.092997+0000","last_clean":"2024-09-12T03:34:44.092997+0000","last_became_active":"2024-09-12T03:34:39.060405+0000","last_became_peered":"2024-09-12T03:34:39.060405+0000","last_unstale":"2024-09-12T03:34:44.092997+0000","last_undegraded":"2024-09-12T03:34:44.092997+0000","last_fullsized":"2024-09-12T03:34:44.092997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009942+0000","last_change":"2024-09-12T03:34:38.004523+0000","last_active":"2024-09-12T03:34:45.009942+0000","last_peered":"2024-09-12T03:34:45.009942+0000","last_clean":"2024-09-12T03:34:45.009942+0000","last_became_active":"2024-09-12T03:34:38.004151+0000","last_became_peered":"2024-09-12T03:34:38.004151+0000","last_unstale":"2024-09-12T03:34:45.009942+0000","last_undegraded":"2024-09-12T03:34:45.009942+0000","last_fullsized":"2024-09-12T03:34:45.009942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095029+0000","last_change":"2024-09-12T03:34:43.123712+0000","last_active":"2024-09-12T03:34:44.095029+0000","last_peered":"2024-09-12T03:34:44.095029+0000","last_clean":"2024-09-12T03:34:44.095029+0000","last_became_active":"2024-09-12T03:34:43.123329+0000","last_became_peered":"2024-09-12T03:34:43.123329+0000","last_unstale":"2024-09-12T03:34:44.095029+0000","last_undegraded":"2024-09-12T03:34:44.095029+0000","last_fullsized":"2024-09-12T03:34:44.095029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:30.312088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011415+0000","last_change":"2024-09-12T03:34:39.053892+0000","last_active":"2024-09-12T03:34:45.011415+0000","last_peered":"2024-09-12T03:34:45.011415+0000","last_clean":"2024-09-12T03:34:45.011415+0000","last_became_active":"2024-09-12T03:34:39.053583+0000","last_became_peered":"2024-09-12T03:34:39.053583+0000","last_unstale":"2024-09-12T03:34:45.011415+0000","last_undegraded":"2024-09-12T03:34:45.011415+0000","last_fullsized":"2024-09-12T03:34:45.011415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:20.973812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009534+0000","last_change":"2024-09-12T03:34:38.019954+0000","last_active":"2024-09-12T03:34:45.009534+0000","last_peered":"2024-09-12T03:34:45.009534+0000","last_clean":"2024-09-12T03:34:45.009534+0000","last_became_active":"2024-09-12T03:34:38.017677+0000","last_became_peered":"2024-09-12T03:34:38.017677+0000","last_unstale":"2024-09-12T03:34:45.009534+0000","last_undegraded":"2024-09-12T03:34:45.009534+0000","last_fullsized":"2024-09-12T03:34:45.009534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012804+0000","last_change":"2024-09-12T03:34:43.211560+0000","last_active":"2024-09-12T03:34:45.012804+0000","last_peered":"2024-09-12T03:34:45.012804+0000","last_clean":"2024-09-12T03:34:45.012804+0000","last_became_active":"2024-09-12T03:34:43.210313+0000","last_became_peered":"2024-09-12T03:34:43.210313+0000","last_unstale":"2024-09-12T03:34:45.012804+0000","last_undegraded":"2024-09-12T03:34:45.012804+0000","last_fullsized":"2024-09-12T03:34:45.012804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008264+0000","last_change":"2024-09-12T03:34:39.099469+0000","last_active":"2024-09-12T03:34:45.008264+0000","last_peered":"2024-09-12T03:34:45.008264+0000","last_clean":"2024-09-12T03:34:45.008264+0000","last_became_active":"2024-09-12T03:34:39.099241+0000","last_became_peered":"2024-09-12T03:34:39.099241+0000","last_unstale":"2024-09-12T03:34:45.008264+0000","last_undegraded":"2024-09-12T03:34:45.008264+0000","last_fullsized":"2024-09-12T03:34:45.008264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096283+0000","last_change":"2024-09-12T03:34:38.012498+0000","last_active":"2024-09-12T03:34:44.096283+0000","last_peered":"2024-09-12T03:34:44.096283+0000","last_clean":"2024-09-12T03:34:44.096283+0000","last_became_active":"2024-09-12T03:34:38.011287+0000","last_became_peered":"2024-09-12T03:34:38.011287+0000","last_unstale":"2024-09-12T03:34:44.096283+0000","last_undegraded":"2024-09-12T03:34:44.096283+0000","last_fullsized":"2024-09-12T03:34:44.096283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009617+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:34:45.009617+0000","last_peered":"2024-09-12T03:34:45.009617+0000","last_clean":"2024-09-12T03:34:45.009617+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:34:45.009617+0000","last_undegraded":"2024-09-12T03:34:45.009617+0000","last_fullsized":"2024-09-12T03:34:45.009617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187899+0000","last_change":"2024-09-12T03:34:43.217542+0000","last_active":"2024-09-12T03:34:44.187899+0000","last_peered":"2024-09-12T03:34:44.187899+0000","last_clean":"2024-09-12T03:34:44.187899+0000","last_became_active":"2024-09-12T03:34:43.216519+0000","last_became_peered":"2024-09-12T03:34:43.216519+0000","last_unstale":"2024-09-12T03:34:44.187899+0000","last_undegraded":"2024-09-12T03:34:44.187899+0000","last_fullsized":"2024-09-12T03:34:44.187899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010497+0000","last_change":"2024-09-12T03:34:39.102583+0000","last_active":"2024-09-12T03:34:45.010497+0000","last_peered":"2024-09-12T03:34:45.010497+0000","last_clean":"2024-09-12T03:34:45.010497+0000","last_became_active":"2024-09-12T03:34:39.102127+0000","last_became_peered":"2024-09-12T03:34:39.102127+0000","last_unstale":"2024-09-12T03:34:45.010497+0000","last_undegraded":"2024-09-12T03:34:45.010497+0000","last_fullsized":"2024-09-12T03:34:45.010497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011031+0000","last_change":"2024-09-12T03:34:38.005330+0000","last_active":"2024-09-12T03:34:45.011031+0000","last_peered":"2024-09-12T03:34:45.011031+0000","last_clean":"2024-09-12T03:34:45.011031+0000","last_became_active":"2024-09-12T03:34:38.004948+0000","last_became_peered":"2024-09-12T03:34:38.004948+0000","last_unstale":"2024-09-12T03:34:45.011031+0000","last_undegraded":"2024-09-12T03:34:45.011031+0000","last_fullsized":"2024-09-12T03:34:45.011031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187730+0000","last_change":"2024-09-12T03:34:43.214134+0000","last_active":"2024-09-12T03:34:44.187730+0000","last_peered":"2024-09-12T03:34:44.187730+0000","last_clean":"2024-09-12T03:34:44.187730+0000","last_became_active":"2024-09-12T03:34:43.212887+0000","last_became_peered":"2024-09-12T03:34:43.212887+0000","last_unstale":"2024-09-12T03:34:44.187730+0000","last_undegraded":"2024-09-12T03:34:44.187730+0000","last_fullsized":"2024-09-12T03:34:44.187730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:50.420633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097609+0000","last_change":"2024-09-12T03:34:39.097188+0000","last_active":"2024-09-12T03:34:44.097609+0000","last_peered":"2024-09-12T03:34:44.097609+0000","last_clean":"2024-09-12T03:34:44.097609+0000","last_became_active":"2024-09-12T03:34:39.088779+0000","last_became_peered":"2024-09-12T03:34:39.088779+0000","last_unstale":"2024-09-12T03:34:44.097609+0000","last_undegraded":"2024-09-12T03:34:44.097609+0000","last_fullsized":"2024-09-12T03:34:44.097609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094237+0000","last_change":"2024-09-12T03:34:38.016976+0000","last_active":"2024-09-12T03:34:44.094237+0000","last_peered":"2024-09-12T03:34:44.094237+0000","last_clean":"2024-09-12T03:34:44.094237+0000","last_became_active":"2024-09-12T03:34:38.016660+0000","last_became_peered":"2024-09-12T03:34:38.016660+0000","last_unstale":"2024-09-12T03:34:44.094237+0000","last_undegraded":"2024-09-12T03:34:44.094237+0000","last_fullsized":"2024-09-12T03:34:44.094237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013574+0000","last_change":"2024-09-12T03:34:43.120906+0000","last_active":"2024-09-12T03:34:45.013574+0000","last_peered":"2024-09-12T03:34:45.013574+0000","last_clean":"2024-09-12T03:34:45.013574+0000","last_became_active":"2024-09-12T03:34:43.120173+0000","last_became_peered":"2024-09-12T03:34:43.120173+0000","last_unstale":"2024-09-12T03:34:45.013574+0000","last_undegraded":"2024-09-12T03:34:45.013574+0000","last_fullsized":"2024-09-12T03:34:45.013574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:47.645139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011129+0000","last_change":"2024-09-12T03:34:39.091419+0000","last_active":"2024-09-12T03:34:45.011129+0000","last_peered":"2024-09-12T03:34:45.011129+0000","last_clean":"2024-09-12T03:34:45.011129+0000","last_became_active":"2024-09-12T03:34:39.090855+0000","last_became_peered":"2024-09-12T03:34:39.090855+0000","last_unstale":"2024-09-12T03:34:45.011129+0000","last_undegraded":"2024-09-12T03:34:45.011129+0000","last_fullsized":"2024-09-12T03:34:45.011129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011991+0000","last_change":"2024-09-12T03:34:38.008658+0000","last_active":"2024-09-12T03:34:45.011991+0000","last_peered":"2024-09-12T03:34:45.011991+0000","last_clean":"2024-09-12T03:34:45.011991+0000","last_became_active":"2024-09-12T03:34:38.007921+0000","last_became_peered":"2024-09-12T03:34:38.007921+0000","last_unstale":"2024-09-12T03:34:45.011991+0000","last_undegraded":"2024-09-12T03:34:45.011991+0000","last_fullsized":"2024-09-12T03:34:45.011991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:55.788731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094885+0000","last_change":"2024-09-12T03:34:43.216644+0000","last_active":"2024-09-12T03:34:44.094885+0000","last_peered":"2024-09-12T03:34:44.094885+0000","last_clean":"2024-09-12T03:34:44.094885+0000","last_became_active":"2024-09-12T03:34:43.215467+0000","last_became_peered":"2024-09-12T03:34:43.215467+0000","last_unstale":"2024-09-12T03:34:44.094885+0000","last_undegraded":"2024-09-12T03:34:44.094885+0000","last_fullsized":"2024-09-12T03:34:44.094885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010860+0000","last_change":"2024-09-12T03:34:39.091357+0000","last_active":"2024-09-12T03:34:45.010860+0000","last_peered":"2024-09-12T03:34:45.010860+0000","last_clean":"2024-09-12T03:34:45.010860+0000","last_became_active":"2024-09-12T03:34:39.090805+0000","last_became_peered":"2024-09-12T03:34:39.090805+0000","last_unstale":"2024-09-12T03:34:45.010860+0000","last_undegraded":"2024-09-12T03:34:45.010860+0000","last_fullsized":"2024-09-12T03:34:45.010860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095561+0000","last_change":"2024-09-12T03:34:38.017119+0000","last_active":"2024-09-12T03:34:44.095561+0000","last_peered":"2024-09-12T03:34:44.095561+0000","last_clean":"2024-09-12T03:34:44.095561+0000","last_became_active":"2024-09-12T03:34:38.016642+0000","last_became_peered":"2024-09-12T03:34:38.016642+0000","last_unstale":"2024-09-12T03:34:44.095561+0000","last_undegraded":"2024-09-12T03:34:44.095561+0000","last_fullsized":"2024-09-12T03:34:44.095561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094658+0000","last_change":"2024-09-12T03:34:43.128636+0000","last_active":"2024-09-12T03:34:44.094658+0000","last_peered":"2024-09-12T03:34:44.094658+0000","last_clean":"2024-09-12T03:34:44.094658+0000","last_became_active":"2024-09-12T03:34:43.127210+0000","last_became_peered":"2024-09-12T03:34:43.127210+0000","last_unstale":"2024-09-12T03:34:44.094658+0000","last_undegraded":"2024-09-12T03:34:44.094658+0000","last_fullsized":"2024-09-12T03:34:44.094658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.156353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010031+0000","last_change":"2024-09-12T03:34:39.091653+0000","last_active":"2024-09-12T03:34:45.010031+0000","last_peered":"2024-09-12T03:34:45.010031+0000","last_clean":"2024-09-12T03:34:45.010031+0000","last_became_active":"2024-09-12T03:34:39.090971+0000","last_became_peered":"2024-09-12T03:34:39.090971+0000","last_unstale":"2024-09-12T03:34:45.010031+0000","last_undegraded":"2024-09-12T03:34:45.010031+0000","last_fullsized":"2024-09-12T03:34:45.010031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009309+0000","last_change":"2024-09-12T03:34:38.007157+0000","last_active":"2024-09-12T03:34:45.009309+0000","last_peered":"2024-09-12T03:34:45.009309+0000","last_clean":"2024-09-12T03:34:45.009309+0000","last_became_active":"2024-09-12T03:34:38.006706+0000","last_became_peered":"2024-09-12T03:34:38.006706+0000","last_unstale":"2024-09-12T03:34:45.009309+0000","last_undegraded":"2024-09-12T03:34:45.009309+0000","last_fullsized":"2024-09-12T03:34:45.009309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012527+0000","last_change":"2024-09-12T03:34:43.126450+0000","last_active":"2024-09-12T03:34:45.012527+0000","last_peered":"2024-09-12T03:34:45.012527+0000","last_clean":"2024-09-12T03:34:45.012527+0000","last_became_active":"2024-09-12T03:34:43.126083+0000","last_became_peered":"2024-09-12T03:34:43.126083+0000","last_unstale":"2024-09-12T03:34:45.012527+0000","last_undegraded":"2024-09-12T03:34:45.012527+0000","last_fullsized":"2024-09-12T03:34:45.012527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187658+0000","last_change":"2024-09-12T03:34:39.073954+0000","last_active":"2024-09-12T03:34:44.187658+0000","last_peered":"2024-09-12T03:34:44.187658+0000","last_clean":"2024-09-12T03:34:44.187658+0000","last_became_active":"2024-09-12T03:34:39.073238+0000","last_became_peered":"2024-09-12T03:34:39.073238+0000","last_unstale":"2024-09-12T03:34:44.187658+0000","last_undegraded":"2024-09-12T03:34:44.187658+0000","last_fullsized":"2024-09-12T03:34:44.187658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187978+0000","last_change":"2024-09-12T03:34:38.023260+0000","last_active":"2024-09-12T03:34:44.187978+0000","last_peered":"2024-09-12T03:34:44.187978+0000","last_clean":"2024-09-12T03:34:44.187978+0000","last_became_active":"2024-09-12T03:34:38.022602+0000","last_became_peered":"2024-09-12T03:34:38.022602+0000","last_unstale":"2024-09-12T03:34:44.187978+0000","last_undegraded":"2024-09-12T03:34:44.187978+0000","last_fullsized":"2024-09-12T03:34:44.187978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:20.254507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010135+0000","last_change":"2024-09-12T03:34:43.216165+0000","last_active":"2024-09-12T03:34:45.010135+0000","last_peered":"2024-09-12T03:34:45.010135+0000","last_clean":"2024-09-12T03:34:45.010135+0000","last_became_active":"2024-09-12T03:34:43.214989+0000","last_became_peered":"2024-09-12T03:34:43.214989+0000","last_unstale":"2024-09-12T03:34:45.010135+0000","last_undegraded":"2024-09-12T03:34:45.010135+0000","last_fullsized":"2024-09-12T03:34:45.010135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.591844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010173+0000","last_change":"2024-09-12T03:34:39.090006+0000","last_active":"2024-09-12T03:34:45.010173+0000","last_peered":"2024-09-12T03:34:45.010173+0000","last_clean":"2024-09-12T03:34:45.010173+0000","last_became_active":"2024-09-12T03:34:39.089165+0000","last_became_peered":"2024-09-12T03:34:39.089165+0000","last_unstale":"2024-09-12T03:34:45.010173+0000","last_undegraded":"2024-09-12T03:34:45.010173+0000","last_fullsized":"2024-09-12T03:34:45.010173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097113+0000","last_change":"2024-09-12T03:34:38.014916+0000","last_active":"2024-09-12T03:34:44.097113+0000","last_peered":"2024-09-12T03:34:44.097113+0000","last_clean":"2024-09-12T03:34:44.097113+0000","last_became_active":"2024-09-12T03:34:38.014447+0000","last_became_peered":"2024-09-12T03:34:38.014447+0000","last_unstale":"2024-09-12T03:34:44.097113+0000","last_undegraded":"2024-09-12T03:34:44.097113+0000","last_fullsized":"2024-09-12T03:34:44.097113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008970+0000","last_change":"2024-09-12T03:34:43.211049+0000","last_active":"2024-09-12T03:34:45.008970+0000","last_peered":"2024-09-12T03:34:45.008970+0000","last_clean":"2024-09-12T03:34:45.008970+0000","last_became_active":"2024-09-12T03:34:43.210561+0000","last_became_peered":"2024-09-12T03:34:43.210561+0000","last_unstale":"2024-09-12T03:34:45.008970+0000","last_undegraded":"2024-09-12T03:34:45.008970+0000","last_fullsized":"2024-09-12T03:34:45.008970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:22.633242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012235+0000","last_change":"2024-09-12T03:34:39.082890+0000","last_active":"2024-09-12T03:34:45.012235+0000","last_peered":"2024-09-12T03:34:45.012235+0000","last_clean":"2024-09-12T03:34:45.012235+0000","last_became_active":"2024-09-12T03:34:39.082674+0000","last_became_peered":"2024-09-12T03:34:39.082674+0000","last_unstale":"2024-09-12T03:34:45.012235+0000","last_undegraded":"2024-09-12T03:34:45.012235+0000","last_fullsized":"2024-09-12T03:34:45.012235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013716+0000","last_change":"2024-09-12T03:34:38.017260+0000","last_active":"2024-09-12T03:34:45.013716+0000","last_peered":"2024-09-12T03:34:45.013716+0000","last_clean":"2024-09-12T03:34:45.013716+0000","last_became_active":"2024-09-12T03:34:38.016781+0000","last_became_peered":"2024-09-12T03:34:38.016781+0000","last_unstale":"2024-09-12T03:34:45.013716+0000","last_undegraded":"2024-09-12T03:34:45.013716+0000","last_fullsized":"2024-09-12T03:34:45.013716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:49.748803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098324+0000","last_change":"2024-09-12T03:34:43.213204+0000","last_active":"2024-09-12T03:34:44.098324+0000","last_peered":"2024-09-12T03:34:44.098324+0000","last_clean":"2024-09-12T03:34:44.098324+0000","last_became_active":"2024-09-12T03:34:43.212190+0000","last_became_peered":"2024-09-12T03:34:43.212190+0000","last_unstale":"2024-09-12T03:34:44.098324+0000","last_undegraded":"2024-09-12T03:34:44.098324+0000","last_fullsized":"2024-09-12T03:34:44.098324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010365+0000","last_change":"2024-09-12T03:34:39.087244+0000","last_active":"2024-09-12T03:34:45.010365+0000","last_peered":"2024-09-12T03:34:45.010365+0000","last_clean":"2024-09-12T03:34:45.010365+0000","last_became_active":"2024-09-12T03:34:39.085708+0000","last_became_peered":"2024-09-12T03:34:39.085708+0000","last_unstale":"2024-09-12T03:34:45.010365+0000","last_undegraded":"2024-09-12T03:34:45.010365+0000","last_fullsized":"2024-09-12T03:34:45.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:49.528251+0000","last_change":"2024-09-12T03:34:38.020300+0000","last_active":"2024-09-12T03:34:49.528251+0000","last_peered":"2024-09-12T03:34:49.528251+0000","last_clean":"2024-09-12T03:34:49.528251+0000","last_became_active":"2024-09-12T03:34:38.019416+0000","last_became_peered":"2024-09-12T03:34:38.019416+0000","last_unstale":"2024-09-12T03:34:49.528251+0000","last_undegraded":"2024-09-12T03:34:49.528251+0000","last_fullsized":"2024-09-12T03:34:49.528251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:57.206207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093034+0000","last_change":"2024-09-12T03:34:43.127205+0000","last_active":"2024-09-12T03:34:44.093034+0000","last_peered":"2024-09-12T03:34:44.093034+0000","last_clean":"2024-09-12T03:34:44.093034+0000","last_became_active":"2024-09-12T03:34:43.126473+0000","last_became_peered":"2024-09-12T03:34:43.126473+0000","last_unstale":"2024-09-12T03:34:44.093034+0000","last_undegraded":"2024-09-12T03:34:44.093034+0000","last_fullsized":"2024-09-12T03:34:44.093034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:08.474524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096722+0000","last_change":"2024-09-12T03:34:39.076678+0000","last_active":"2024-09-12T03:34:44.096722+0000","last_peered":"2024-09-12T03:34:44.096722+0000","last_clean":"2024-09-12T03:34:44.096722+0000","last_became_active":"2024-09-12T03:34:39.076007+0000","last_became_peered":"2024-09-12T03:34:39.076007+0000","last_unstale":"2024-09-12T03:34:44.096722+0000","last_undegraded":"2024-09-12T03:34:44.096722+0000","last_fullsized":"2024-09-12T03:34:44.096722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:29.999907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094072+0000","last_change":"2024-09-12T03:34:38.028753+0000","last_active":"2024-09-12T03:34:44.094072+0000","last_peered":"2024-09-12T03:34:44.094072+0000","last_clean":"2024-09-12T03:34:44.094072+0000","last_became_active":"2024-09-12T03:34:38.028499+0000","last_became_peered":"2024-09-12T03:34:38.028499+0000","last_unstale":"2024-09-12T03:34:44.094072+0000","last_undegraded":"2024-09-12T03:34:44.094072+0000","last_fullsized":"2024-09-12T03:34:44.094072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096751+0000","last_change":"2024-09-12T03:34:43.135662+0000","last_active":"2024-09-12T03:34:44.096751+0000","last_peered":"2024-09-12T03:34:44.096751+0000","last_clean":"2024-09-12T03:34:44.096751+0000","last_became_active":"2024-09-12T03:34:43.128133+0000","last_became_peered":"2024-09-12T03:34:43.128133+0000","last_unstale":"2024-09-12T03:34:44.096751+0000","last_undegraded":"2024-09-12T03:34:44.096751+0000","last_fullsized":"2024-09-12T03:34:44.096751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:41.314336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012301+0000","last_change":"2024-09-12T03:34:39.088237+0000","last_active":"2024-09-12T03:34:45.012301+0000","last_peered":"2024-09-12T03:34:45.012301+0000","last_clean":"2024-09-12T03:34:45.012301+0000","last_became_active":"2024-09-12T03:34:39.087952+0000","last_became_peered":"2024-09-12T03:34:39.087952+0000","last_unstale":"2024-09-12T03:34:45.012301+0000","last_undegraded":"2024-09-12T03:34:45.012301+0000","last_fullsized":"2024-09-12T03:34:45.012301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097921+0000","last_change":"2024-09-12T03:34:38.012565+0000","last_active":"2024-09-12T03:34:44.097921+0000","last_peered":"2024-09-12T03:34:44.097921+0000","last_clean":"2024-09-12T03:34:44.097921+0000","last_became_active":"2024-09-12T03:34:38.012023+0000","last_became_peered":"2024-09-12T03:34:38.012023+0000","last_unstale":"2024-09-12T03:34:44.097921+0000","last_undegraded":"2024-09-12T03:34:44.097921+0000","last_fullsized":"2024-09-12T03:34:44.097921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007983+0000","last_change":"2024-09-12T03:34:43.127550+0000","last_active":"2024-09-12T03:34:45.007983+0000","last_peered":"2024-09-12T03:34:45.007983+0000","last_clean":"2024-09-12T03:34:45.007983+0000","last_became_active":"2024-09-12T03:34:43.118399+0000","last_became_peered":"2024-09-12T03:34:43.118399+0000","last_unstale":"2024-09-12T03:34:45.007983+0000","last_undegraded":"2024-09-12T03:34:45.007983+0000","last_fullsized":"2024-09-12T03:34:45.007983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097682+0000","last_change":"2024-09-12T03:34:39.103021+0000","last_active":"2024-09-12T03:34:44.097682+0000","last_peered":"2024-09-12T03:34:44.097682+0000","last_clean":"2024-09-12T03:34:44.097682+0000","last_became_active":"2024-09-12T03:34:39.102537+0000","last_became_peered":"2024-09-12T03:34:39.102537+0000","last_unstale":"2024-09-12T03:34:44.097682+0000","last_undegraded":"2024-09-12T03:34:44.097682+0000","last_fullsized":"2024-09-12T03:34:44.097682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188469+0000","last_change":"2024-09-12T03:34:38.026833+0000","last_active":"2024-09-12T03:34:44.188469+0000","last_peered":"2024-09-12T03:34:44.188469+0000","last_clean":"2024-09-12T03:34:44.188469+0000","last_became_active":"2024-09-12T03:34:38.026268+0000","last_became_peered":"2024-09-12T03:34:38.026268+0000","last_unstale":"2024-09-12T03:34:44.188469+0000","last_undegraded":"2024-09-12T03:34:44.188469+0000","last_fullsized":"2024-09-12T03:34:44.188469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:52.708505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008838+0000","last_change":"2024-09-12T03:34:43.212792+0000","last_active":"2024-09-12T03:34:45.008838+0000","last_peered":"2024-09-12T03:34:45.008838+0000","last_clean":"2024-09-12T03:34:45.008838+0000","last_became_active":"2024-09-12T03:34:43.211671+0000","last_became_peered":"2024-09-12T03:34:43.211671+0000","last_unstale":"2024-09-12T03:34:45.008838+0000","last_undegraded":"2024-09-12T03:34:45.008838+0000","last_fullsized":"2024-09-12T03:34:45.008838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013459+0000","last_change":"2024-09-12T03:34:43.218438+0000","last_active":"2024-09-12T03:34:45.013459+0000","last_peered":"2024-09-12T03:34:45.013459+0000","last_clean":"2024-09-12T03:34:45.013459+0000","last_became_active":"2024-09-12T03:34:43.217735+0000","last_became_peered":"2024-09-12T03:34:43.217735+0000","last_unstale":"2024-09-12T03:34:45.013459+0000","last_undegraded":"2024-09-12T03:34:45.013459+0000","last_fullsized":"2024-09-12T03:34:45.013459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:19.562019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092348+0000","last_change":"2024-09-12T03:34:39.063362+0000","last_active":"2024-09-12T03:34:44.092348+0000","last_peered":"2024-09-12T03:34:44.092348+0000","last_clean":"2024-09-12T03:34:44.092348+0000","last_became_active":"2024-09-12T03:34:39.063020+0000","last_became_peered":"2024-09-12T03:34:39.063020+0000","last_unstale":"2024-09-12T03:34:44.092348+0000","last_undegraded":"2024-09-12T03:34:44.092348+0000","last_fullsized":"2024-09-12T03:34:44.092348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095747+0000","last_change":"2024-09-12T03:34:38.027195+0000","last_active":"2024-09-12T03:34:44.095747+0000","last_peered":"2024-09-12T03:34:44.095747+0000","last_clean":"2024-09-12T03:34:44.095747+0000","last_became_active":"2024-09-12T03:34:38.026662+0000","last_became_peered":"2024-09-12T03:34:38.026662+0000","last_unstale":"2024-09-12T03:34:44.095747+0000","last_undegraded":"2024-09-12T03:34:44.095747+0000","last_fullsized":"2024-09-12T03:34:44.095747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188079+0000","last_change":"2024-09-12T03:34:43.134866+0000","last_active":"2024-09-12T03:34:44.188079+0000","last_peered":"2024-09-12T03:34:44.188079+0000","last_clean":"2024-09-12T03:34:44.188079+0000","last_became_active":"2024-09-12T03:34:43.133525+0000","last_became_peered":"2024-09-12T03:34:43.133525+0000","last_unstale":"2024-09-12T03:34:44.188079+0000","last_undegraded":"2024-09-12T03:34:44.188079+0000","last_fullsized":"2024-09-12T03:34:44.188079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008011+0000","last_change":"2024-09-12T03:34:39.063056+0000","last_active":"2024-09-12T03:34:45.008011+0000","last_peered":"2024-09-12T03:34:45.008011+0000","last_clean":"2024-09-12T03:34:45.008011+0000","last_became_active":"2024-09-12T03:34:39.062761+0000","last_became_peered":"2024-09-12T03:34:39.062761+0000","last_unstale":"2024-09-12T03:34:45.008011+0000","last_undegraded":"2024-09-12T03:34:45.008011+0000","last_fullsized":"2024-09-12T03:34:45.008011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008537+0000","last_change":"2024-09-12T03:34:38.018201+0000","last_active":"2024-09-12T03:34:45.008537+0000","last_peered":"2024-09-12T03:34:45.008537+0000","last_clean":"2024-09-12T03:34:45.008537+0000","last_became_active":"2024-09-12T03:34:38.017942+0000","last_became_peered":"2024-09-12T03:34:38.017942+0000","last_unstale":"2024-09-12T03:34:45.008537+0000","last_undegraded":"2024-09-12T03:34:45.008537+0000","last_fullsized":"2024-09-12T03:34:45.008537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188411+0000","last_change":"2024-09-12T03:34:38.022415+0000","last_active":"2024-09-12T03:34:44.188411+0000","last_peered":"2024-09-12T03:34:44.188411+0000","last_clean":"2024-09-12T03:34:44.188411+0000","last_became_active":"2024-09-12T03:34:38.019452+0000","last_became_peered":"2024-09-12T03:34:38.019452+0000","last_unstale":"2024-09-12T03:34:44.188411+0000","last_undegraded":"2024-09-12T03:34:44.188411+0000","last_fullsized":"2024-09-12T03:34:44.188411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:48.971400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013639+0000","last_change":"2024-09-12T03:34:39.054095+0000","last_active":"2024-09-12T03:34:45.013639+0000","last_peered":"2024-09-12T03:34:45.013639+0000","last_clean":"2024-09-12T03:34:45.013639+0000","last_became_active":"2024-09-12T03:34:39.053738+0000","last_became_peered":"2024-09-12T03:34:39.053738+0000","last_unstale":"2024-09-12T03:34:45.013639+0000","last_undegraded":"2024-09-12T03:34:45.013639+0000","last_fullsized":"2024-09-12T03:34:45.013639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010585+0000","last_change":"2024-09-12T03:34:43.114138+0000","last_active":"2024-09-12T03:34:45.010585+0000","last_peered":"2024-09-12T03:34:45.010585+0000","last_clean":"2024-09-12T03:34:45.010585+0000","last_became_active":"2024-09-12T03:34:43.113549+0000","last_became_peered":"2024-09-12T03:34:43.113549+0000","last_unstale":"2024-09-12T03:34:45.010585+0000","last_undegraded":"2024-09-12T03:34:45.010585+0000","last_fullsized":"2024-09-12T03:34:45.010585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:38.432588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008571+0000","last_change":"2024-09-12T03:34:38.030379+0000","last_active":"2024-09-12T03:34:45.008571+0000","last_peered":"2024-09-12T03:34:45.008571+0000","last_clean":"2024-09-12T03:34:45.008571+0000","last_became_active":"2024-09-12T03:34:38.030041+0000","last_became_peered":"2024-09-12T03:34:38.030041+0000","last_unstale":"2024-09-12T03:34:45.008571+0000","last_undegraded":"2024-09-12T03:34:45.008571+0000","last_fullsized":"2024-09-12T03:34:45.008571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095998+0000","last_change":"2024-09-12T03:34:39.064296+0000","last_active":"2024-09-12T03:34:44.095998+0000","last_peered":"2024-09-12T03:34:44.095998+0000","last_clean":"2024-09-12T03:34:44.095998+0000","last_became_active":"2024-09-12T03:34:39.063569+0000","last_became_peered":"2024-09-12T03:34:39.063569+0000","last_unstale":"2024-09-12T03:34:44.095998+0000","last_undegraded":"2024-09-12T03:34:44.095998+0000","last_fullsized":"2024-09-12T03:34:44.095998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:42.375906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009228+0000","last_change":"2024-09-12T03:34:43.118123+0000","last_active":"2024-09-12T03:34:45.009228+0000","last_peered":"2024-09-12T03:34:45.009228+0000","last_clean":"2024-09-12T03:34:45.009228+0000","last_became_active":"2024-09-12T03:34:43.117722+0000","last_became_peered":"2024-09-12T03:34:43.117722+0000","last_unstale":"2024-09-12T03:34:45.009228+0000","last_undegraded":"2024-09-12T03:34:45.009228+0000","last_fullsized":"2024-09-12T03:34:45.009228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:08.248672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187424+0000","last_change":"2024-09-12T03:34:39.077386+0000","last_active":"2024-09-12T03:34:44.187424+0000","last_peered":"2024-09-12T03:34:44.187424+0000","last_clean":"2024-09-12T03:34:44.187424+0000","last_became_active":"2024-09-12T03:34:39.076662+0000","last_became_peered":"2024-09-12T03:34:39.076662+0000","last_unstale":"2024-09-12T03:34:44.187424+0000","last_undegraded":"2024-09-12T03:34:44.187424+0000","last_fullsized":"2024-09-12T03:34:44.187424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009701+0000","last_change":"2024-09-12T03:34:39.087463+0000","last_active":"2024-09-12T03:34:45.009701+0000","last_peered":"2024-09-12T03:34:45.009701+0000","last_clean":"2024-09-12T03:34:45.009701+0000","last_became_active":"2024-09-12T03:34:39.087165+0000","last_became_peered":"2024-09-12T03:34:39.087165+0000","last_unstale":"2024-09-12T03:34:45.009701+0000","last_undegraded":"2024-09-12T03:34:45.009701+0000","last_fullsized":"2024-09-12T03:34:45.009701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096888+0000","last_change":"2024-09-12T03:34:39.098154+0000","last_active":"2024-09-12T03:34:44.096888+0000","last_peered":"2024-09-12T03:34:44.096888+0000","last_clean":"2024-09-12T03:34:44.096888+0000","last_became_active":"2024-09-12T03:34:39.097223+0000","last_became_peered":"2024-09-12T03:34:39.097223+0000","last_unstale":"2024-09-12T03:34:44.096888+0000","last_undegraded":"2024-09-12T03:34:44.096888+0000","last_fullsized":"2024-09-12T03:34:44.096888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013401+0000","last_change":"2024-09-12T03:34:39.065566+0000","last_active":"2024-09-12T03:34:45.013401+0000","last_peered":"2024-09-12T03:34:45.013401+0000","last_clean":"2024-09-12T03:34:45.013401+0000","last_became_active":"2024-09-12T03:34:39.065271+0000","last_became_peered":"2024-09-12T03:34:39.065271+0000","last_unstale":"2024-09-12T03:34:45.013401+0000","last_undegraded":"2024-09-12T03:34:45.013401+0000","last_fullsized":"2024-09-12T03:34:45.013401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:21.031062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009257+0000","last_change":"2024-09-12T03:34:39.080421+0000","last_active":"2024-09-12T03:34:45.009257+0000","last_peered":"2024-09-12T03:34:45.009257+0000","last_clean":"2024-09-12T03:34:45.009257+0000","last_became_active":"2024-09-12T03:34:39.080177+0000","last_became_peered":"2024-09-12T03:34:39.080177+0000","last_unstale":"2024-09-12T03:34:45.009257+0000","last_undegraded":"2024-09-12T03:34:45.009257+0000","last_fullsized":"2024-09-12T03:34:45.009257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093781+0000","last_change":"2024-09-12T03:34:39.064463+0000","last_active":"2024-09-12T03:34:44.093781+0000","last_peered":"2024-09-12T03:34:44.093781+0000","last_clean":"2024-09-12T03:34:44.093781+0000","last_became_active":"2024-09-12T03:34:39.064221+0000","last_became_peered":"2024-09-12T03:34:39.064221+0000","last_unstale":"2024-09-12T03:34:44.093781+0000","last_undegraded":"2024-09-12T03:34:44.093781+0000","last_fullsized":"2024-09-12T03:34:44.093781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188514+0000","last_change":"2024-09-12T03:34:39.104917+0000","last_active":"2024-09-12T03:34:44.188514+0000","last_peered":"2024-09-12T03:34:44.188514+0000","last_clean":"2024-09-12T03:34:44.188514+0000","last_became_active":"2024-09-12T03:34:39.104399+0000","last_became_peered":"2024-09-12T03:34:39.104399+0000","last_unstale":"2024-09-12T03:34:44.188514+0000","last_undegraded":"2024-09-12T03:34:44.188514+0000","last_fullsized":"2024-09-12T03:34:44.188514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:03.567787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010275+0000","last_change":"2024-09-12T03:34:39.081674+0000","last_active":"2024-09-12T03:34:45.010275+0000","last_peered":"2024-09-12T03:34:45.010275+0000","last_clean":"2024-09-12T03:34:45.010275+0000","last_became_active":"2024-09-12T03:34:39.081415+0000","last_became_peered":"2024-09-12T03:34:39.081415+0000","last_unstale":"2024-09-12T03:34:45.010275+0000","last_undegraded":"2024-09-12T03:34:45.010275+0000","last_fullsized":"2024-09-12T03:34:45.010275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095516+0000","last_change":"2024-09-12T03:34:39.105000+0000","last_active":"2024-09-12T03:34:44.095516+0000","last_peered":"2024-09-12T03:34:44.095516+0000","last_clean":"2024-09-12T03:34:44.095516+0000","last_became_active":"2024-09-12T03:34:39.104552+0000","last_became_peered":"2024-09-12T03:34:39.104552+0000","last_unstale":"2024-09-12T03:34:44.095516+0000","last_undegraded":"2024-09-12T03:34:44.095516+0000","last_fullsized":"2024-09-12T03:34:44.095516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008305+0000","last_change":"2024-09-12T03:34:39.081413+0000","last_active":"2024-09-12T03:34:45.008305+0000","last_peered":"2024-09-12T03:34:45.008305+0000","last_clean":"2024-09-12T03:34:45.008305+0000","last_became_active":"2024-09-12T03:34:39.081124+0000","last_became_peered":"2024-09-12T03:34:39.081124+0000","last_unstale":"2024-09-12T03:34:45.008305+0000","last_undegraded":"2024-09-12T03:34:45.008305+0000","last_fullsized":"2024-09-12T03:34:45.008305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096657+0000","last_change":"2024-09-12T03:34:39.103486+0000","last_active":"2024-09-12T03:34:44.096657+0000","last_peered":"2024-09-12T03:34:44.096657+0000","last_clean":"2024-09-12T03:34:44.096657+0000","last_became_active":"2024-09-12T03:34:39.102713+0000","last_became_peered":"2024-09-12T03:34:39.102713+0000","last_unstale":"2024-09-12T03:34:44.096657+0000","last_undegraded":"2024-09-12T03:34:44.096657+0000","last_fullsized":"2024-09-12T03:34:44.096657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013159+0000","last_change":"2024-09-12T03:34:39.084516+0000","last_active":"2024-09-12T03:34:45.013159+0000","last_peered":"2024-09-12T03:34:45.013159+0000","last_clean":"2024-09-12T03:34:45.013159+0000","last_became_active":"2024-09-12T03:34:39.084230+0000","last_became_peered":"2024-09-12T03:34:39.084230+0000","last_unstale":"2024-09-12T03:34:45.013159+0000","last_undegraded":"2024-09-12T03:34:45.013159+0000","last_fullsized":"2024-09-12T03:34:45.013159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:35.100430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:39.107212+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:39.106301+0000","last_became_peered":"2024-09-12T03:34:39.106301+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010903+0000","last_change":"2024-09-12T03:34:39.087886+0000","last_active":"2024-09-12T03:34:45.010903+0000","last_peered":"2024-09-12T03:34:45.010903+0000","last_clean":"2024-09-12T03:34:45.010903+0000","last_became_active":"2024-09-12T03:34:39.086540+0000","last_became_peered":"2024-09-12T03:34:39.086540+0000","last_unstale":"2024-09-12T03:34:45.010903+0000","last_undegraded":"2024-09-12T03:34:45.010903+0000","last_fullsized":"2024-09-12T03:34:45.010903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011752+0000","last_change":"2024-09-12T03:34:39.090922+0000","last_active":"2024-09-12T03:34:45.011752+0000","last_peered":"2024-09-12T03:34:45.011752+0000","last_clean":"2024-09-12T03:34:45.011752+0000","last_became_active":"2024-09-12T03:34:39.090678+0000","last_became_peered":"2024-09-12T03:34:39.090678+0000","last_unstale":"2024-09-12T03:34:45.011752+0000","last_undegraded":"2024-09-12T03:34:45.011752+0000","last_fullsized":"2024-09-12T03:34:45.011752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.099310+0000","last_change":"2024-09-12T03:34:39.103626+0000","last_active":"2024-09-12T03:34:44.099310+0000","last_peered":"2024-09-12T03:34:44.099310+0000","last_clean":"2024-09-12T03:34:44.099310+0000","last_became_active":"2024-09-12T03:34:39.102752+0000","last_became_peered":"2024-09-12T03:34:39.102752+0000","last_unstale":"2024-09-12T03:34:44.099310+0000","last_undegraded":"2024-09-12T03:34:44.099310+0000","last_fullsized":"2024-09-12T03:34:44.099310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095270+0000","last_change":"2024-09-12T03:34:39.088569+0000","last_active":"2024-09-12T03:34:44.095270+0000","last_peered":"2024-09-12T03:34:44.095270+0000","last_clean":"2024-09-12T03:34:44.095270+0000","last_became_active":"2024-09-12T03:34:39.088031+0000","last_became_peered":"2024-09-12T03:34:39.088031+0000","last_unstale":"2024-09-12T03:34:44.095270+0000","last_undegraded":"2024-09-12T03:34:44.095270+0000","last_fullsized":"2024-09-12T03:34:44.095270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092516+0000","last_change":"2024-09-12T03:34:39.081983+0000","last_active":"2024-09-12T03:34:44.092516+0000","last_peered":"2024-09-12T03:34:44.092516+0000","last_clean":"2024-09-12T03:34:44.092516+0000","last_became_active":"2024-09-12T03:34:39.081670+0000","last_became_peered":"2024-09-12T03:34:39.081670+0000","last_unstale":"2024-09-12T03:34:44.092516+0000","last_undegraded":"2024-09-12T03:34:44.092516+0000","last_fullsized":"2024-09-12T03:34:44.092516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012007+0000","last_change":"2024-09-12T03:34:39.058851+0000","last_active":"2024-09-12T03:34:45.012007+0000","last_peered":"2024-09-12T03:34:45.012007+0000","last_clean":"2024-09-12T03:34:45.012007+0000","last_became_active":"2024-09-12T03:34:39.058122+0000","last_became_peered":"2024-09-12T03:34:39.058122+0000","last_unstale":"2024-09-12T03:34:45.012007+0000","last_undegraded":"2024-09-12T03:34:45.012007+0000","last_fullsized":"2024-09-12T03:34:45.012007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:12.193080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008220+0000","last_change":"2024-09-12T03:34:39.067672+0000","last_active":"2024-09-12T03:34:45.008220+0000","last_peered":"2024-09-12T03:34:45.008220+0000","last_clean":"2024-09-12T03:34:45.008220+0000","last_became_active":"2024-09-12T03:34:39.067402+0000","last_became_peered":"2024-09-12T03:34:39.067402+0000","last_unstale":"2024-09-12T03:34:45.008220+0000","last_undegraded":"2024-09-12T03:34:45.008220+0000","last_fullsized":"2024-09-12T03:34:45.008220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096493+0000","last_change":"2024-09-12T03:34:39.108544+0000","last_active":"2024-09-12T03:34:44.096493+0000","last_peered":"2024-09-12T03:34:44.096493+0000","last_clean":"2024-09-12T03:34:44.096493+0000","last_became_active":"2024-09-12T03:34:39.108009+0000","last_became_peered":"2024-09-12T03:34:39.108009+0000","last_unstale":"2024-09-12T03:34:44.096493+0000","last_undegraded":"2024-09-12T03:34:44.096493+0000","last_fullsized":"2024-09-12T03:34:44.096493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188461+0000","last_change":"2024-09-12T03:34:39.104075+0000","last_active":"2024-09-12T03:34:44.188461+0000","last_peered":"2024-09-12T03:34:44.188461+0000","last_clean":"2024-09-12T03:34:44.188461+0000","last_became_active":"2024-09-12T03:34:39.094220+0000","last_became_peered":"2024-09-12T03:34:39.094220+0000","last_unstale":"2024-09-12T03:34:44.188461+0000","last_undegraded":"2024-09-12T03:34:44.188461+0000","last_fullsized":"2024-09-12T03:34:44.188461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188458+0000","last_change":"2024-09-12T03:34:39.093290+0000","last_active":"2024-09-12T03:34:44.188458+0000","last_peered":"2024-09-12T03:34:44.188458+0000","last_clean":"2024-09-12T03:34:44.188458+0000","last_became_active":"2024-09-12T03:34:39.092378+0000","last_became_peered":"2024-09-12T03:34:39.092378+0000","last_unstale":"2024-09-12T03:34:44.188458+0000","last_undegraded":"2024-09-12T03:34:44.188458+0000","last_fullsized":"2024-09-12T03:34:44.188458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011121+0000","last_change":"2024-09-12T03:34:39.099671+0000","last_active":"2024-09-12T03:34:45.011121+0000","last_peered":"2024-09-12T03:34:45.011121+0000","last_clean":"2024-09-12T03:34:45.011121+0000","last_became_active":"2024-09-12T03:34:39.099044+0000","last_became_peered":"2024-09-12T03:34:39.099044+0000","last_unstale":"2024-09-12T03:34:45.011121+0000","last_undegraded":"2024-09-12T03:34:45.011121+0000","last_fullsized":"2024-09-12T03:34:45.011121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007754+0000","last_change":"2024-09-12T03:34:39.097597+0000","last_active":"2024-09-12T03:34:45.007754+0000","last_peered":"2024-09-12T03:34:45.007754+0000","last_clean":"2024-09-12T03:34:45.007754+0000","last_became_active":"2024-09-12T03:34:39.097301+0000","last_became_peered":"2024-09-12T03:34:39.097301+0000","last_unstale":"2024-09-12T03:34:45.007754+0000","last_undegraded":"2024-09-12T03:34:45.007754+0000","last_fullsized":"2024-09-12T03:34:45.007754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:24.666071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009891+0000","last_change":"2024-09-12T03:34:39.084776+0000","last_active":"2024-09-12T03:34:45.009891+0000","last_peered":"2024-09-12T03:34:45.009891+0000","last_clean":"2024-09-12T03:34:45.009891+0000","last_became_active":"2024-09-12T03:34:39.083987+0000","last_became_peered":"2024-09-12T03:34:39.083987+0000","last_unstale":"2024-09-12T03:34:45.009891+0000","last_undegraded":"2024-09-12T03:34:45.009891+0000","last_fullsized":"2024-09-12T03:34:45.009891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096430+0000","last_change":"2024-09-12T03:34:39.088318+0000","last_active":"2024-09-12T03:34:44.096430+0000","last_peered":"2024-09-12T03:34:44.096430+0000","last_clean":"2024-09-12T03:34:44.096430+0000","last_became_active":"2024-09-12T03:34:39.087777+0000","last_became_peered":"2024-09-12T03:34:39.087777+0000","last_unstale":"2024-09-12T03:34:44.096430+0000","last_undegraded":"2024-09-12T03:34:44.096430+0000","last_fullsized":"2024-09-12T03:34:44.096430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009971+0000","last_change":"2024-09-12T03:34:39.085197+0000","last_active":"2024-09-12T03:34:45.009971+0000","last_peered":"2024-09-12T03:34:45.009971+0000","last_clean":"2024-09-12T03:34:45.009971+0000","last_became_active":"2024-09-12T03:34:39.084478+0000","last_became_peered":"2024-09-12T03:34:39.084478+0000","last_unstale":"2024-09-12T03:34:45.009971+0000","last_undegraded":"2024-09-12T03:34:45.009971+0000","last_fullsized":"2024-09-12T03:34:45.009971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097330+0000","last_change":"2024-09-12T03:34:39.097105+0000","last_active":"2024-09-12T03:34:44.097330+0000","last_peered":"2024-09-12T03:34:44.097330+0000","last_clean":"2024-09-12T03:34:44.097330+0000","last_became_active":"2024-09-12T03:34:39.088754+0000","last_became_peered":"2024-09-12T03:34:39.088754+0000","last_unstale":"2024-09-12T03:34:44.097330+0000","last_undegraded":"2024-09-12T03:34:44.097330+0000","last_fullsized":"2024-09-12T03:34:44.097330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011922+0000","last_change":"2024-09-12T03:34:39.049548+0000","last_active":"2024-09-12T03:34:45.011922+0000","last_peered":"2024-09-12T03:34:45.011922+0000","last_clean":"2024-09-12T03:34:45.011922+0000","last_became_active":"2024-09-12T03:34:39.049247+0000","last_became_peered":"2024-09-12T03:34:39.049247+0000","last_unstale":"2024-09-12T03:34:45.011922+0000","last_undegraded":"2024-09-12T03:34:45.011922+0000","last_fullsized":"2024-09-12T03:34:45.011922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094491+0000","last_change":"2024-09-12T03:34:39.061225+0000","last_active":"2024-09-12T03:34:44.094491+0000","last_peered":"2024-09-12T03:34:44.094491+0000","last_clean":"2024-09-12T03:34:44.094491+0000","last_became_active":"2024-09-12T03:34:39.060943+0000","last_became_peered":"2024-09-12T03:34:39.060943+0000","last_unstale":"2024-09-12T03:34:44.094491+0000","last_undegraded":"2024-09-12T03:34:44.094491+0000","last_fullsized":"2024-09-12T03:34:44.094491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010849+0000","last_change":"2024-09-12T03:34:39.105481+0000","last_active":"2024-09-12T03:34:45.010849+0000","last_peered":"2024-09-12T03:34:45.010849+0000","last_clean":"2024-09-12T03:34:45.010849+0000","last_became_active":"2024-09-12T03:34:39.105018+0000","last_became_peered":"2024-09-12T03:34:39.105018+0000","last_unstale":"2024-09-12T03:34:45.010849+0000","last_undegraded":"2024-09-12T03:34:45.010849+0000","last_fullsized":"2024-09-12T03:34:45.010849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:34:54.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:34:54.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.316+0000 7fa3c269c640 1 Processor -- start 2024-09-12T03:34:54.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.316+0000 7fa3c269c640 1 -- start start 2024-09-12T03:34:54.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c269c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa3bc15c2a0 0x7fa3bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c269c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa3bc0af2a0 0x7fa3bc06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c269c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3bc0b3290 con 0x7fa3bc15bec0 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c269c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa3bc0b3570 con 0x7fa3bc0af2a0 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c269c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa3bc0b3850 con 0x7fa3bc15c2a0 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3bbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa3bc15bec0 0x7fa3bc0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42232/0 (socket says 172.21.15.73:42232) 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3bbfff640 1 -- 172.21.15.73:0/2372279829 learned_addr learned my addr 172.21.15.73:0/2372279829 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c0c39640 1 --2- 172.21.15.73:0/2372279829 >> v2:172.21.15.73:3300/0 conn(0x7fa3bc0af2a0 0x7fa3bc06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3baffd640 1 -- 172.21.15.73:0/2372279829 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668259070 0 0) 0x7fa3bc0b3290 con 0x7fa3bc15bec0 2024-09-12T03:34:54.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3bb7fe640 1 --2- 172.21.15.73:0/2372279829 >> v2:172.21.15.150:3300/0 conn(0x7fa3bc15c2a0 0x7fa3bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3baffd640 1 -- 172.21.15.73:0/2372279829 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a4003530 con 0x7fa3bc15bec0 2024-09-12T03:34:54.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c0c39640 1 -- 172.21.15.73:0/2372279829 >> v2:172.21.15.150:3300/0 conn(0x7fa3bc15c2a0 msgr2=0x7fa3bc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:54.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c0c39640 1 --2- 172.21.15.73:0/2372279829 >> v2:172.21.15.150:3300/0 conn(0x7fa3bc15c2a0 0x7fa3bc0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c0c39640 1 -- 172.21.15.73:0/2372279829 >> v1:172.21.15.73:6789/0 conn(0x7fa3bc15bec0 legacy=0x7fa3bc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c0c39640 1 -- 172.21.15.73:0/2372279829 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc0b3b30 con 0x7fa3bc0af2a0 2024-09-12T03:34:54.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3c0c39640 1 --2- 172.21.15.73:0/2372279829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc0af2a0 0x7fa3bc06e000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0ae510 tx=0x7fa3b401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fccebbe4dfb590 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:54.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3baffd640 1 -- 172.21.15.73:0/2372279829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40b2070 con 0x7fa3bc0af2a0 2024-09-12T03:34:54.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3baffd640 1 -- 172.21.15.73:0/2372279829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b40a59c0 con 0x7fa3bc0af2a0 2024-09-12T03:34:54.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.320+0000 7fa3baffd640 1 -- 172.21.15.73:0/2372279829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40a5d90 con 0x7fa3bc0af2a0 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2372279829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc0af2a0 msgr2=0x7fa3bc06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2372279829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc0af2a0 0x7fa3bc06e000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0ae510 tx=0x7fa3b401c900 comp rx=0 tx=0).stop 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2372279829 shutdown_connections 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2372279829 >> v2:172.21.15.150:3300/0 conn(0x7fa3bc15c2a0 0x7fa3bc0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2372279829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc0af2a0 0x7fa3bc06e000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2372279829 >> 172.21.15.73:0/2372279829 conn(0x7fa3bc0b1f90 msgr2=0x7fa3bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2372279829 shutdown_connections 2024-09-12T03:34:54.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2372279829 wait complete. 2024-09-12T03:34:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 Processor -- start 2024-09-12T03:34:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- start start 2024-09-12T03:34:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3bc0af2a0 0x7fa3bc14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc15bec0 0x7fa3bc14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3bc15c2a0 0x7fa3bc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc06ed50 con 0x7fa3bc15bec0 2024-09-12T03:34:54.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc0af710 con 0x7fa3bc15c2a0 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa3bc06eed0 con 0x7fa3bc0af2a0 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc15bec0 0x7fa3bc14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc15bec0 0x7fa3bc14c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42256/0 (socket says 172.21.15.73:42256) 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 -- 172.21.15.73:0/2709066441 learned_addr learned my addr 172.21.15.73:0/2709066441 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 -- 172.21.15.73:0/2709066441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3bc0af2a0 msgr2=0x7fa3bc14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3bc0af2a0 0x7fa3bc14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 -- 172.21.15.73:0/2709066441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3bc15c2a0 msgr2=0x7fa3bc156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3bc15c2a0 0x7fa3bc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 -- 172.21.15.73:0/2709066441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc14e590 con 0x7fa3bc15bec0 2024-09-12T03:34:54.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3bb7fe640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc15bec0 0x7fa3bc14c910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00d800 tx=0x7fa3ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:54.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3b8ff9640 1 -- 172.21.15.73:0/2709066441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00b6c0 con 0x7fa3bc15bec0 2024-09-12T03:34:54.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3b8ff9640 1 -- 172.21.15.73:0/2709066441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac019070 con 0x7fa3bc15bec0 2024-09-12T03:34:54.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc14e870 con 0x7fa3bc15bec0 2024-09-12T03:34:54.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3b8ff9640 1 -- 172.21.15.73:0/2709066441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00ba80 con 0x7fa3bc15bec0 2024-09-12T03:34:54.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc0721f0 con 0x7fa3bc15bec0 2024-09-12T03:34:54.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.324+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3bc06f260 con 0x7fa3bc15bec0 2024-09-12T03:34:54.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.328+0000 7fa3b8ff9640 1 -- 172.21.15.73:0/2709066441 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3ac00bc20 con 0x7fa3bc15bec0 2024-09-12T03:34:54.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.328+0000 7fa3b8ff9640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3a80678c0 0x7fa3a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.328+0000 7fa3b8ff9640 1 -- 172.21.15.73:0/2709066441 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa3ac0863a0 con 0x7fa3bc15bec0 2024-09-12T03:34:54.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.328+0000 7fa3bbfff640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3a80678c0 0x7fa3a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.328+0000 7fa3bbfff640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3a80678c0 0x7fa3a8069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0007fd0 tx=0x7fa3b0007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:54.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.332+0000 7fa3b8ff9640 1 -- 172.21.15.73:0/2709066441 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3ac056ba0 con 0x7fa3bc15bec0 2024-09-12T03:34:54.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.488+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3bc0b2c60 con 0x7fa3a80678c0 2024-09-12T03:34:54.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.500+0000 7fa3b8ff9640 1 -- 172.21.15.73:0/2709066441 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7fa3bc0b2c60 con 0x7fa3a80678c0 2024-09-12T03:34:54.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:54.508 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3a80678c0 msgr2=0x7fa3a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3a80678c0 0x7fa3a8069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0007fd0 tx=0x7fa3b0007900 comp rx=0 tx=0).stop 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc15bec0 msgr2=0x7fa3bc14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc15bec0 0x7fa3bc14c910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00d800 tx=0x7fa3ac00dcc0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 shutdown_connections 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3a80678c0 0x7fa3a8069d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3bc15bec0 0x7fa3bc14c910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3bc15c2a0 0x7fa3bc156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 --2- 172.21.15.73:0/2709066441 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa3bc0af2a0 0x7fa3bc14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 >> 172.21.15.73:0/2709066441 conn(0x7fa3bc0b1f90 msgr2=0x7fa3bc075260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 shutdown_connections 2024-09-12T03:34:54.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.504+0000 7fa3c269c640 1 -- 172.21.15.73:0/2709066441 wait complete. 2024-09-12T03:34:54.525 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-12T03:34:53.791531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2006572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003444"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012394+0000","last_change":"2024-09-12T03:34:38.010797+0000","last_active":"2024-09-12T03:34:45.012394+0000","last_peered":"2024-09-12T03:34:45.012394+0000","last_clean":"2024-09-12T03:34:45.012394+0000","last_became_active":"2024-09-12T03:34:38.010433+0000","last_became_peered":"2024-09-12T03:34:38.010433+0000","last_unstale":"2024-09-12T03:34:45.012394+0000","last_undegraded":"2024-09-12T03:34:45.012394+0000","last_fullsized":"2024-09-12T03:34:45.012394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009665+0000","last_change":"2024-09-12T03:34:39.074559+0000","last_active":"2024-09-12T03:34:45.009665+0000","last_peered":"2024-09-12T03:34:45.009665+0000","last_clean":"2024-09-12T03:34:45.009665+0000","last_became_active":"2024-09-12T03:34:39.074317+0000","last_became_peered":"2024-09-12T03:34:39.074317+0000","last_unstale":"2024-09-12T03:34:45.009665+0000","last_undegraded":"2024-09-12T03:34:45.009665+0000","last_fullsized":"2024-09-12T03:34:45.009665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007763+0000","last_change":"2024-09-12T03:34:43.218439+0000","last_active":"2024-09-12T03:34:45.007763+0000","last_peered":"2024-09-12T03:34:45.007763+0000","last_clean":"2024-09-12T03:34:45.007763+0000","last_became_active":"2024-09-12T03:34:43.216661+0000","last_became_peered":"2024-09-12T03:34:43.216661+0000","last_unstale":"2024-09-12T03:34:45.007763+0000","last_undegraded":"2024-09-12T03:34:45.007763+0000","last_fullsized":"2024-09-12T03:34:45.007763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:12.169699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010114+0000","last_change":"2024-09-12T03:34:38.014275+0000","last_active":"2024-09-12T03:34:45.010114+0000","last_peered":"2024-09-12T03:34:45.010114+0000","last_clean":"2024-09-12T03:34:45.010114+0000","last_became_active":"2024-09-12T03:34:38.013821+0000","last_became_peered":"2024-09-12T03:34:38.013821+0000","last_unstale":"2024-09-12T03:34:45.010114+0000","last_undegraded":"2024-09-12T03:34:45.010114+0000","last_fullsized":"2024-09-12T03:34:45.010114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012133+0000","last_change":"2024-09-12T03:34:39.088423+0000","last_active":"2024-09-12T03:34:45.012133+0000","last_peered":"2024-09-12T03:34:45.012133+0000","last_clean":"2024-09-12T03:34:45.012133+0000","last_became_active":"2024-09-12T03:34:39.088198+0000","last_became_peered":"2024-09-12T03:34:39.088198+0000","last_unstale":"2024-09-12T03:34:45.012133+0000","last_undegraded":"2024-09-12T03:34:45.012133+0000","last_fullsized":"2024-09-12T03:34:45.012133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097304+0000","last_change":"2024-09-12T03:34:43.134447+0000","last_active":"2024-09-12T03:34:44.097304+0000","last_peered":"2024-09-12T03:34:44.097304+0000","last_clean":"2024-09-12T03:34:44.097304+0000","last_became_active":"2024-09-12T03:34:43.131156+0000","last_became_peered":"2024-09-12T03:34:43.131156+0000","last_unstale":"2024-09-12T03:34:44.097304+0000","last_undegraded":"2024-09-12T03:34:44.097304+0000","last_fullsized":"2024-09-12T03:34:44.097304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010783+0000","last_change":"2024-09-12T03:34:38.029333+0000","last_active":"2024-09-12T03:34:45.010783+0000","last_peered":"2024-09-12T03:34:45.010783+0000","last_clean":"2024-09-12T03:34:45.010783+0000","last_became_active":"2024-09-12T03:34:38.028881+0000","last_became_peered":"2024-09-12T03:34:38.028881+0000","last_unstale":"2024-09-12T03:34:45.010783+0000","last_undegraded":"2024-09-12T03:34:45.010783+0000","last_fullsized":"2024-09-12T03:34:45.010783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097344+0000","last_change":"2024-09-12T03:34:39.099744+0000","last_active":"2024-09-12T03:34:44.097344+0000","last_peered":"2024-09-12T03:34:44.097344+0000","last_clean":"2024-09-12T03:34:44.097344+0000","last_became_active":"2024-09-12T03:34:39.098494+0000","last_became_peered":"2024-09-12T03:34:39.098494+0000","last_unstale":"2024-09-12T03:34:44.097344+0000","last_undegraded":"2024-09-12T03:34:44.097344+0000","last_fullsized":"2024-09-12T03:34:44.097344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096627+0000","last_change":"2024-09-12T03:34:43.136579+0000","last_active":"2024-09-12T03:34:44.096627+0000","last_peered":"2024-09-12T03:34:44.096627+0000","last_clean":"2024-09-12T03:34:44.096627+0000","last_became_active":"2024-09-12T03:34:43.131614+0000","last_became_peered":"2024-09-12T03:34:43.131614+0000","last_unstale":"2024-09-12T03:34:44.096627+0000","last_undegraded":"2024-09-12T03:34:44.096627+0000","last_fullsized":"2024-09-12T03:34:44.096627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:04.948070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010371+0000","last_change":"2024-09-12T03:34:38.031062+0000","last_active":"2024-09-12T03:34:45.010371+0000","last_peered":"2024-09-12T03:34:45.010371+0000","last_clean":"2024-09-12T03:34:45.010371+0000","last_became_active":"2024-09-12T03:34:38.030527+0000","last_became_peered":"2024-09-12T03:34:38.030527+0000","last_unstale":"2024-09-12T03:34:45.010371+0000","last_undegraded":"2024-09-12T03:34:45.010371+0000","last_fullsized":"2024-09-12T03:34:45.010371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098474+0000","last_change":"2024-09-12T03:34:39.101380+0000","last_active":"2024-09-12T03:34:44.098474+0000","last_peered":"2024-09-12T03:34:44.098474+0000","last_clean":"2024-09-12T03:34:44.098474+0000","last_became_active":"2024-09-12T03:34:39.099679+0000","last_became_peered":"2024-09-12T03:34:39.099679+0000","last_unstale":"2024-09-12T03:34:44.098474+0000","last_undegraded":"2024-09-12T03:34:44.098474+0000","last_fullsized":"2024-09-12T03:34:44.098474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095057+0000","last_change":"2024-09-12T03:34:43.128313+0000","last_active":"2024-09-12T03:34:44.095057+0000","last_peered":"2024-09-12T03:34:44.095057+0000","last_clean":"2024-09-12T03:34:44.095057+0000","last_became_active":"2024-09-12T03:34:43.126843+0000","last_became_peered":"2024-09-12T03:34:43.126843+0000","last_unstale":"2024-09-12T03:34:44.095057+0000","last_undegraded":"2024-09-12T03:34:44.095057+0000","last_fullsized":"2024-09-12T03:34:44.095057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:23.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187338+0000","last_change":"2024-09-12T03:34:39.093427+0000","last_active":"2024-09-12T03:34:44.187338+0000","last_peered":"2024-09-12T03:34:44.187338+0000","last_clean":"2024-09-12T03:34:44.187338+0000","last_became_active":"2024-09-12T03:34:39.092380+0000","last_became_peered":"2024-09-12T03:34:39.092380+0000","last_unstale":"2024-09-12T03:34:44.187338+0000","last_undegraded":"2024-09-12T03:34:44.187338+0000","last_fullsized":"2024-09-12T03:34:44.187338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010267+0000","last_change":"2024-09-12T03:34:38.029799+0000","last_active":"2024-09-12T03:34:45.010267+0000","last_peered":"2024-09-12T03:34:45.010267+0000","last_clean":"2024-09-12T03:34:45.010267+0000","last_became_active":"2024-09-12T03:34:38.027974+0000","last_became_peered":"2024-09-12T03:34:38.027974+0000","last_unstale":"2024-09-12T03:34:45.010267+0000","last_undegraded":"2024-09-12T03:34:45.010267+0000","last_fullsized":"2024-09-12T03:34:45.010267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095984+0000","last_change":"2024-09-12T03:34:43.124251+0000","last_active":"2024-09-12T03:34:44.095984+0000","last_peered":"2024-09-12T03:34:44.095984+0000","last_clean":"2024-09-12T03:34:44.095984+0000","last_became_active":"2024-09-12T03:34:43.123246+0000","last_became_peered":"2024-09-12T03:34:43.123246+0000","last_unstale":"2024-09-12T03:34:44.095984+0000","last_undegraded":"2024-09-12T03:34:44.095984+0000","last_fullsized":"2024-09-12T03:34:44.095984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010770+0000","last_change":"2024-09-12T03:34:39.066746+0000","last_active":"2024-09-12T03:34:45.010770+0000","last_peered":"2024-09-12T03:34:45.010770+0000","last_clean":"2024-09-12T03:34:45.010770+0000","last_became_active":"2024-09-12T03:34:39.066399+0000","last_became_peered":"2024-09-12T03:34:39.066399+0000","last_unstale":"2024-09-12T03:34:45.010770+0000","last_undegraded":"2024-09-12T03:34:45.010770+0000","last_fullsized":"2024-09-12T03:34:45.010770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093375+0000","last_change":"2024-09-12T03:34:38.005663+0000","last_active":"2024-09-12T03:34:44.093375+0000","last_peered":"2024-09-12T03:34:44.093375+0000","last_clean":"2024-09-12T03:34:44.093375+0000","last_became_active":"2024-09-12T03:34:38.005160+0000","last_became_peered":"2024-09-12T03:34:38.005160+0000","last_unstale":"2024-09-12T03:34:44.093375+0000","last_undegraded":"2024-09-12T03:34:44.093375+0000","last_fullsized":"2024-09-12T03:34:44.093375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095966+0000","last_change":"2024-09-12T03:34:43.131000+0000","last_active":"2024-09-12T03:34:44.095966+0000","last_peered":"2024-09-12T03:34:44.095966+0000","last_clean":"2024-09-12T03:34:44.095966+0000","last_became_active":"2024-09-12T03:34:43.129785+0000","last_became_peered":"2024-09-12T03:34:43.129785+0000","last_unstale":"2024-09-12T03:34:44.095966+0000","last_undegraded":"2024-09-12T03:34:44.095966+0000","last_fullsized":"2024-09-12T03:34:44.095966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:17.250004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008215+0000","last_change":"2024-09-12T03:34:39.065304+0000","last_active":"2024-09-12T03:34:45.008215+0000","last_peered":"2024-09-12T03:34:45.008215+0000","last_clean":"2024-09-12T03:34:45.008215+0000","last_became_active":"2024-09-12T03:34:39.065027+0000","last_became_peered":"2024-09-12T03:34:39.065027+0000","last_unstale":"2024-09-12T03:34:45.008215+0000","last_undegraded":"2024-09-12T03:34:45.008215+0000","last_fullsized":"2024-09-12T03:34:45.008215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092648+0000","last_change":"2024-09-12T03:34:38.020702+0000","last_active":"2024-09-12T03:34:44.092648+0000","last_peered":"2024-09-12T03:34:44.092648+0000","last_clean":"2024-09-12T03:34:44.092648+0000","last_became_active":"2024-09-12T03:34:38.020279+0000","last_became_peered":"2024-09-12T03:34:38.020279+0000","last_unstale":"2024-09-12T03:34:44.092648+0000","last_undegraded":"2024-09-12T03:34:44.092648+0000","last_fullsized":"2024-09-12T03:34:44.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094739+0000","last_change":"2024-09-12T03:34:43.215466+0000","last_active":"2024-09-12T03:34:44.094739+0000","last_peered":"2024-09-12T03:34:44.094739+0000","last_clean":"2024-09-12T03:34:44.094739+0000","last_became_active":"2024-09-12T03:34:43.214416+0000","last_became_peered":"2024-09-12T03:34:43.214416+0000","last_unstale":"2024-09-12T03:34:44.094739+0000","last_undegraded":"2024-09-12T03:34:44.094739+0000","last_fullsized":"2024-09-12T03:34:44.094739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:09.728873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095570+0000","last_change":"2024-09-12T03:34:39.063489+0000","last_active":"2024-09-12T03:34:44.095570+0000","last_peered":"2024-09-12T03:34:44.095570+0000","last_clean":"2024-09-12T03:34:44.095570+0000","last_became_active":"2024-09-12T03:34:39.062768+0000","last_became_peered":"2024-09-12T03:34:39.062768+0000","last_unstale":"2024-09-12T03:34:44.095570+0000","last_undegraded":"2024-09-12T03:34:44.095570+0000","last_fullsized":"2024-09-12T03:34:44.095570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009376+0000","last_change":"2024-09-12T03:34:38.015940+0000","last_active":"2024-09-12T03:34:45.009376+0000","last_peered":"2024-09-12T03:34:45.009376+0000","last_clean":"2024-09-12T03:34:45.009376+0000","last_became_active":"2024-09-12T03:34:38.015461+0000","last_became_peered":"2024-09-12T03:34:38.015461+0000","last_unstale":"2024-09-12T03:34:45.009376+0000","last_undegraded":"2024-09-12T03:34:45.009376+0000","last_fullsized":"2024-09-12T03:34:45.009376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095326+0000","last_change":"2024-09-12T03:34:43.129118+0000","last_active":"2024-09-12T03:34:44.095326+0000","last_peered":"2024-09-12T03:34:44.095326+0000","last_clean":"2024-09-12T03:34:44.095326+0000","last_became_active":"2024-09-12T03:34:43.127925+0000","last_became_peered":"2024-09-12T03:34:43.127925+0000","last_unstale":"2024-09-12T03:34:44.095326+0000","last_undegraded":"2024-09-12T03:34:44.095326+0000","last_fullsized":"2024-09-12T03:34:44.095326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:47.375563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013122+0000","last_change":"2024-09-12T03:34:39.058932+0000","last_active":"2024-09-12T03:34:45.013122+0000","last_peered":"2024-09-12T03:34:45.013122+0000","last_clean":"2024-09-12T03:34:45.013122+0000","last_became_active":"2024-09-12T03:34:39.058293+0000","last_became_peered":"2024-09-12T03:34:39.058293+0000","last_unstale":"2024-09-12T03:34:45.013122+0000","last_undegraded":"2024-09-12T03:34:45.013122+0000","last_fullsized":"2024-09-12T03:34:45.013122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:38.023773+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:38.023187+0000","last_became_peered":"2024-09-12T03:34:38.023187+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.688103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095125+0000","last_change":"2024-09-12T03:34:43.216377+0000","last_active":"2024-09-12T03:34:44.095125+0000","last_peered":"2024-09-12T03:34:44.095125+0000","last_clean":"2024-09-12T03:34:44.095125+0000","last_became_active":"2024-09-12T03:34:43.215337+0000","last_became_peered":"2024-09-12T03:34:43.215337+0000","last_unstale":"2024-09-12T03:34:44.095125+0000","last_undegraded":"2024-09-12T03:34:44.095125+0000","last_fullsized":"2024-09-12T03:34:44.095125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:38.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010397+0000","last_change":"2024-09-12T03:34:39.084538+0000","last_active":"2024-09-12T03:34:45.010397+0000","last_peered":"2024-09-12T03:34:45.010397+0000","last_clean":"2024-09-12T03:34:45.010397+0000","last_became_active":"2024-09-12T03:34:39.084268+0000","last_became_peered":"2024-09-12T03:34:39.084268+0000","last_unstale":"2024-09-12T03:34:45.010397+0000","last_undegraded":"2024-09-12T03:34:45.010397+0000","last_fullsized":"2024-09-12T03:34:45.010397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094541+0000","last_change":"2024-09-12T03:34:38.019195+0000","last_active":"2024-09-12T03:34:44.094541+0000","last_peered":"2024-09-12T03:34:44.094541+0000","last_clean":"2024-09-12T03:34:44.094541+0000","last_became_active":"2024-09-12T03:34:38.018785+0000","last_became_peered":"2024-09-12T03:34:38.018785+0000","last_unstale":"2024-09-12T03:34:44.094541+0000","last_undegraded":"2024-09-12T03:34:44.094541+0000","last_fullsized":"2024-09-12T03:34:44.094541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007530+0000","last_change":"2024-09-12T03:34:43.214340+0000","last_active":"2024-09-12T03:34:45.007530+0000","last_peered":"2024-09-12T03:34:45.007530+0000","last_clean":"2024-09-12T03:34:45.007530+0000","last_became_active":"2024-09-12T03:34:43.213920+0000","last_became_peered":"2024-09-12T03:34:43.213920+0000","last_unstale":"2024-09-12T03:34:45.007530+0000","last_undegraded":"2024-09-12T03:34:45.007530+0000","last_fullsized":"2024-09-12T03:34:45.007530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:12.709218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094005+0000","last_change":"2024-09-12T03:34:39.060173+0000","last_active":"2024-09-12T03:34:44.094005+0000","last_peered":"2024-09-12T03:34:44.094005+0000","last_clean":"2024-09-12T03:34:44.094005+0000","last_became_active":"2024-09-12T03:34:39.059915+0000","last_became_peered":"2024-09-12T03:34:39.059915+0000","last_unstale":"2024-09-12T03:34:44.094005+0000","last_undegraded":"2024-09-12T03:34:44.094005+0000","last_fullsized":"2024-09-12T03:34:44.094005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011065+0000","last_change":"2024-09-12T03:34:38.021938+0000","last_active":"2024-09-12T03:34:45.011065+0000","last_peered":"2024-09-12T03:34:45.011065+0000","last_clean":"2024-09-12T03:34:45.011065+0000","last_became_active":"2024-09-12T03:34:38.020605+0000","last_became_peered":"2024-09-12T03:34:38.020605+0000","last_unstale":"2024-09-12T03:34:45.011065+0000","last_undegraded":"2024-09-12T03:34:45.011065+0000","last_fullsized":"2024-09-12T03:34:45.011065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013038+0000","last_change":"2024-09-12T03:34:43.217230+0000","last_active":"2024-09-12T03:34:45.013038+0000","last_peered":"2024-09-12T03:34:45.013038+0000","last_clean":"2024-09-12T03:34:45.013038+0000","last_became_active":"2024-09-12T03:34:43.214307+0000","last_became_peered":"2024-09-12T03:34:43.214307+0000","last_unstale":"2024-09-12T03:34:45.013038+0000","last_undegraded":"2024-09-12T03:34:45.013038+0000","last_fullsized":"2024-09-12T03:34:45.013038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:03.198301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098650+0000","last_change":"2024-09-12T03:34:39.100077+0000","last_active":"2024-09-12T03:34:44.098650+0000","last_peered":"2024-09-12T03:34:44.098650+0000","last_clean":"2024-09-12T03:34:44.098650+0000","last_became_active":"2024-09-12T03:34:39.097599+0000","last_became_peered":"2024-09-12T03:34:39.097599+0000","last_unstale":"2024-09-12T03:34:44.098650+0000","last_undegraded":"2024-09-12T03:34:44.098650+0000","last_fullsized":"2024-09-12T03:34:44.098650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094119+0000","last_change":"2024-09-12T03:34:38.013282+0000","last_active":"2024-09-12T03:34:44.094119+0000","last_peered":"2024-09-12T03:34:44.094119+0000","last_clean":"2024-09-12T03:34:44.094119+0000","last_became_active":"2024-09-12T03:34:38.013066+0000","last_became_peered":"2024-09-12T03:34:38.013066+0000","last_unstale":"2024-09-12T03:34:44.094119+0000","last_undegraded":"2024-09-12T03:34:44.094119+0000","last_fullsized":"2024-09-12T03:34:44.094119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092815+0000","last_change":"2024-09-12T03:34:43.124967+0000","last_active":"2024-09-12T03:34:44.092815+0000","last_peered":"2024-09-12T03:34:44.092815+0000","last_clean":"2024-09-12T03:34:44.092815+0000","last_became_active":"2024-09-12T03:34:43.124439+0000","last_became_peered":"2024-09-12T03:34:43.124439+0000","last_unstale":"2024-09-12T03:34:44.092815+0000","last_undegraded":"2024-09-12T03:34:44.092815+0000","last_fullsized":"2024-09-12T03:34:44.092815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097630+0000","last_change":"2024-09-12T03:34:39.069126+0000","last_active":"2024-09-12T03:34:44.097630+0000","last_peered":"2024-09-12T03:34:44.097630+0000","last_clean":"2024-09-12T03:34:44.097630+0000","last_became_active":"2024-09-12T03:34:39.068202+0000","last_became_peered":"2024-09-12T03:34:39.068202+0000","last_unstale":"2024-09-12T03:34:44.097630+0000","last_undegraded":"2024-09-12T03:34:44.097630+0000","last_fullsized":"2024-09-12T03:34:44.097630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097368+0000","last_change":"2024-09-12T03:34:38.025161+0000","last_active":"2024-09-12T03:34:44.097368+0000","last_peered":"2024-09-12T03:34:44.097368+0000","last_clean":"2024-09-12T03:34:44.097368+0000","last_became_active":"2024-09-12T03:34:38.024569+0000","last_became_peered":"2024-09-12T03:34:38.024569+0000","last_unstale":"2024-09-12T03:34:44.097368+0000","last_undegraded":"2024-09-12T03:34:44.097368+0000","last_fullsized":"2024-09-12T03:34:44.097368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093825+0000","last_change":"2024-09-12T03:34:43.119701+0000","last_active":"2024-09-12T03:34:44.093825+0000","last_peered":"2024-09-12T03:34:44.093825+0000","last_clean":"2024-09-12T03:34:44.093825+0000","last_became_active":"2024-09-12T03:34:43.118522+0000","last_became_peered":"2024-09-12T03:34:43.118522+0000","last_unstale":"2024-09-12T03:34:44.093825+0000","last_undegraded":"2024-09-12T03:34:44.093825+0000","last_fullsized":"2024-09-12T03:34:44.093825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:53.891623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092997+0000","last_change":"2024-09-12T03:34:39.060677+0000","last_active":"2024-09-12T03:34:44.092997+0000","last_peered":"2024-09-12T03:34:44.092997+0000","last_clean":"2024-09-12T03:34:44.092997+0000","last_became_active":"2024-09-12T03:34:39.060405+0000","last_became_peered":"2024-09-12T03:34:39.060405+0000","last_unstale":"2024-09-12T03:34:44.092997+0000","last_undegraded":"2024-09-12T03:34:44.092997+0000","last_fullsized":"2024-09-12T03:34:44.092997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009942+0000","last_change":"2024-09-12T03:34:38.004523+0000","last_active":"2024-09-12T03:34:45.009942+0000","last_peered":"2024-09-12T03:34:45.009942+0000","last_clean":"2024-09-12T03:34:45.009942+0000","last_became_active":"2024-09-12T03:34:38.004151+0000","last_became_peered":"2024-09-12T03:34:38.004151+0000","last_unstale":"2024-09-12T03:34:45.009942+0000","last_undegraded":"2024-09-12T03:34:45.009942+0000","last_fullsized":"2024-09-12T03:34:45.009942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095029+0000","last_change":"2024-09-12T03:34:43.123712+0000","last_active":"2024-09-12T03:34:44.095029+0000","last_peered":"2024-09-12T03:34:44.095029+0000","last_clean":"2024-09-12T03:34:44.095029+0000","last_became_active":"2024-09-12T03:34:43.123329+0000","last_became_peered":"2024-09-12T03:34:43.123329+0000","last_unstale":"2024-09-12T03:34:44.095029+0000","last_undegraded":"2024-09-12T03:34:44.095029+0000","last_fullsized":"2024-09-12T03:34:44.095029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:30.312088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011415+0000","last_change":"2024-09-12T03:34:39.053892+0000","last_active":"2024-09-12T03:34:45.011415+0000","last_peered":"2024-09-12T03:34:45.011415+0000","last_clean":"2024-09-12T03:34:45.011415+0000","last_became_active":"2024-09-12T03:34:39.053583+0000","last_became_peered":"2024-09-12T03:34:39.053583+0000","last_unstale":"2024-09-12T03:34:45.011415+0000","last_undegraded":"2024-09-12T03:34:45.011415+0000","last_fullsized":"2024-09-12T03:34:45.011415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:20.973812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009534+0000","last_change":"2024-09-12T03:34:38.019954+0000","last_active":"2024-09-12T03:34:45.009534+0000","last_peered":"2024-09-12T03:34:45.009534+0000","last_clean":"2024-09-12T03:34:45.009534+0000","last_became_active":"2024-09-12T03:34:38.017677+0000","last_became_peered":"2024-09-12T03:34:38.017677+0000","last_unstale":"2024-09-12T03:34:45.009534+0000","last_undegraded":"2024-09-12T03:34:45.009534+0000","last_fullsized":"2024-09-12T03:34:45.009534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012804+0000","last_change":"2024-09-12T03:34:43.211560+0000","last_active":"2024-09-12T03:34:45.012804+0000","last_peered":"2024-09-12T03:34:45.012804+0000","last_clean":"2024-09-12T03:34:45.012804+0000","last_became_active":"2024-09-12T03:34:43.210313+0000","last_became_peered":"2024-09-12T03:34:43.210313+0000","last_unstale":"2024-09-12T03:34:45.012804+0000","last_undegraded":"2024-09-12T03:34:45.012804+0000","last_fullsized":"2024-09-12T03:34:45.012804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008264+0000","last_change":"2024-09-12T03:34:39.099469+0000","last_active":"2024-09-12T03:34:45.008264+0000","last_peered":"2024-09-12T03:34:45.008264+0000","last_clean":"2024-09-12T03:34:45.008264+0000","last_became_active":"2024-09-12T03:34:39.099241+0000","last_became_peered":"2024-09-12T03:34:39.099241+0000","last_unstale":"2024-09-12T03:34:45.008264+0000","last_undegraded":"2024-09-12T03:34:45.008264+0000","last_fullsized":"2024-09-12T03:34:45.008264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096283+0000","last_change":"2024-09-12T03:34:38.012498+0000","last_active":"2024-09-12T03:34:44.096283+0000","last_peered":"2024-09-12T03:34:44.096283+0000","last_clean":"2024-09-12T03:34:44.096283+0000","last_became_active":"2024-09-12T03:34:38.011287+0000","last_became_peered":"2024-09-12T03:34:38.011287+0000","last_unstale":"2024-09-12T03:34:44.096283+0000","last_undegraded":"2024-09-12T03:34:44.096283+0000","last_fullsized":"2024-09-12T03:34:44.096283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009617+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:34:45.009617+0000","last_peered":"2024-09-12T03:34:45.009617+0000","last_clean":"2024-09-12T03:34:45.009617+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:34:45.009617+0000","last_undegraded":"2024-09-12T03:34:45.009617+0000","last_fullsized":"2024-09-12T03:34:45.009617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187899+0000","last_change":"2024-09-12T03:34:43.217542+0000","last_active":"2024-09-12T03:34:44.187899+0000","last_peered":"2024-09-12T03:34:44.187899+0000","last_clean":"2024-09-12T03:34:44.187899+0000","last_became_active":"2024-09-12T03:34:43.216519+0000","last_became_peered":"2024-09-12T03:34:43.216519+0000","last_unstale":"2024-09-12T03:34:44.187899+0000","last_undegraded":"2024-09-12T03:34:44.187899+0000","last_fullsized":"2024-09-12T03:34:44.187899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010497+0000","last_change":"2024-09-12T03:34:39.102583+0000","last_active":"2024-09-12T03:34:45.010497+0000","last_peered":"2024-09-12T03:34:45.010497+0000","last_clean":"2024-09-12T03:34:45.010497+0000","last_became_active":"2024-09-12T03:34:39.102127+0000","last_became_peered":"2024-09-12T03:34:39.102127+0000","last_unstale":"2024-09-12T03:34:45.010497+0000","last_undegraded":"2024-09-12T03:34:45.010497+0000","last_fullsized":"2024-09-12T03:34:45.010497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011031+0000","last_change":"2024-09-12T03:34:38.005330+0000","last_active":"2024-09-12T03:34:45.011031+0000","last_peered":"2024-09-12T03:34:45.011031+0000","last_clean":"2024-09-12T03:34:45.011031+0000","last_became_active":"2024-09-12T03:34:38.004948+0000","last_became_peered":"2024-09-12T03:34:38.004948+0000","last_unstale":"2024-09-12T03:34:45.011031+0000","last_undegraded":"2024-09-12T03:34:45.011031+0000","last_fullsized":"2024-09-12T03:34:45.011031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187730+0000","last_change":"2024-09-12T03:34:43.214134+0000","last_active":"2024-09-12T03:34:44.187730+0000","last_peered":"2024-09-12T03:34:44.187730+0000","last_clean":"2024-09-12T03:34:44.187730+0000","last_became_active":"2024-09-12T03:34:43.212887+0000","last_became_peered":"2024-09-12T03:34:43.212887+0000","last_unstale":"2024-09-12T03:34:44.187730+0000","last_undegraded":"2024-09-12T03:34:44.187730+0000","last_fullsized":"2024-09-12T03:34:44.187730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:50.420633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097609+0000","last_change":"2024-09-12T03:34:39.097188+0000","last_active":"2024-09-12T03:34:44.097609+0000","last_peered":"2024-09-12T03:34:44.097609+0000","last_clean":"2024-09-12T03:34:44.097609+0000","last_became_active":"2024-09-12T03:34:39.088779+0000","last_became_peered":"2024-09-12T03:34:39.088779+0000","last_unstale":"2024-09-12T03:34:44.097609+0000","last_undegraded":"2024-09-12T03:34:44.097609+0000","last_fullsized":"2024-09-12T03:34:44.097609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094237+0000","last_change":"2024-09-12T03:34:38.016976+0000","last_active":"2024-09-12T03:34:44.094237+0000","last_peered":"2024-09-12T03:34:44.094237+0000","last_clean":"2024-09-12T03:34:44.094237+0000","last_became_active":"2024-09-12T03:34:38.016660+0000","last_became_peered":"2024-09-12T03:34:38.016660+0000","last_unstale":"2024-09-12T03:34:44.094237+0000","last_undegraded":"2024-09-12T03:34:44.094237+0000","last_fullsized":"2024-09-12T03:34:44.094237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013574+0000","last_change":"2024-09-12T03:34:43.120906+0000","last_active":"2024-09-12T03:34:45.013574+0000","last_peered":"2024-09-12T03:34:45.013574+0000","last_clean":"2024-09-12T03:34:45.013574+0000","last_became_active":"2024-09-12T03:34:43.120173+0000","last_became_peered":"2024-09-12T03:34:43.120173+0000","last_unstale":"2024-09-12T03:34:45.013574+0000","last_undegraded":"2024-09-12T03:34:45.013574+0000","last_fullsized":"2024-09-12T03:34:45.013574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:47.645139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011129+0000","last_change":"2024-09-12T03:34:39.091419+0000","last_active":"2024-09-12T03:34:45.011129+0000","last_peered":"2024-09-12T03:34:45.011129+0000","last_clean":"2024-09-12T03:34:45.011129+0000","last_became_active":"2024-09-12T03:34:39.090855+0000","last_became_peered":"2024-09-12T03:34:39.090855+0000","last_unstale":"2024-09-12T03:34:45.011129+0000","last_undegraded":"2024-09-12T03:34:45.011129+0000","last_fullsized":"2024-09-12T03:34:45.011129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011991+0000","last_change":"2024-09-12T03:34:38.008658+0000","last_active":"2024-09-12T03:34:45.011991+0000","last_peered":"2024-09-12T03:34:45.011991+0000","last_clean":"2024-09-12T03:34:45.011991+0000","last_became_active":"2024-09-12T03:34:38.007921+0000","last_became_peered":"2024-09-12T03:34:38.007921+0000","last_unstale":"2024-09-12T03:34:45.011991+0000","last_undegraded":"2024-09-12T03:34:45.011991+0000","last_fullsized":"2024-09-12T03:34:45.011991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:55.788731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094885+0000","last_change":"2024-09-12T03:34:43.216644+0000","last_active":"2024-09-12T03:34:44.094885+0000","last_peered":"2024-09-12T03:34:44.094885+0000","last_clean":"2024-09-12T03:34:44.094885+0000","last_became_active":"2024-09-12T03:34:43.215467+0000","last_became_peered":"2024-09-12T03:34:43.215467+0000","last_unstale":"2024-09-12T03:34:44.094885+0000","last_undegraded":"2024-09-12T03:34:44.094885+0000","last_fullsized":"2024-09-12T03:34:44.094885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010860+0000","last_change":"2024-09-12T03:34:39.091357+0000","last_active":"2024-09-12T03:34:45.010860+0000","last_peered":"2024-09-12T03:34:45.010860+0000","last_clean":"2024-09-12T03:34:45.010860+0000","last_became_active":"2024-09-12T03:34:39.090805+0000","last_became_peered":"2024-09-12T03:34:39.090805+0000","last_unstale":"2024-09-12T03:34:45.010860+0000","last_undegraded":"2024-09-12T03:34:45.010860+0000","last_fullsized":"2024-09-12T03:34:45.010860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095561+0000","last_change":"2024-09-12T03:34:38.017119+0000","last_active":"2024-09-12T03:34:44.095561+0000","last_peered":"2024-09-12T03:34:44.095561+0000","last_clean":"2024-09-12T03:34:44.095561+0000","last_became_active":"2024-09-12T03:34:38.016642+0000","last_became_peered":"2024-09-12T03:34:38.016642+0000","last_unstale":"2024-09-12T03:34:44.095561+0000","last_undegraded":"2024-09-12T03:34:44.095561+0000","last_fullsized":"2024-09-12T03:34:44.095561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094658+0000","last_change":"2024-09-12T03:34:43.128636+0000","last_active":"2024-09-12T03:34:44.094658+0000","last_peered":"2024-09-12T03:34:44.094658+0000","last_clean":"2024-09-12T03:34:44.094658+0000","last_became_active":"2024-09-12T03:34:43.127210+0000","last_became_peered":"2024-09-12T03:34:43.127210+0000","last_unstale":"2024-09-12T03:34:44.094658+0000","last_undegraded":"2024-09-12T03:34:44.094658+0000","last_fullsized":"2024-09-12T03:34:44.094658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.156353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010031+0000","last_change":"2024-09-12T03:34:39.091653+0000","last_active":"2024-09-12T03:34:45.010031+0000","last_peered":"2024-09-12T03:34:45.010031+0000","last_clean":"2024-09-12T03:34:45.010031+0000","last_became_active":"2024-09-12T03:34:39.090971+0000","last_became_peered":"2024-09-12T03:34:39.090971+0000","last_unstale":"2024-09-12T03:34:45.010031+0000","last_undegraded":"2024-09-12T03:34:45.010031+0000","last_fullsized":"2024-09-12T03:34:45.010031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009309+0000","last_change":"2024-09-12T03:34:38.007157+0000","last_active":"2024-09-12T03:34:45.009309+0000","last_peered":"2024-09-12T03:34:45.009309+0000","last_clean":"2024-09-12T03:34:45.009309+0000","last_became_active":"2024-09-12T03:34:38.006706+0000","last_became_peered":"2024-09-12T03:34:38.006706+0000","last_unstale":"2024-09-12T03:34:45.009309+0000","last_undegraded":"2024-09-12T03:34:45.009309+0000","last_fullsized":"2024-09-12T03:34:45.009309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012527+0000","last_change":"2024-09-12T03:34:43.126450+0000","last_active":"2024-09-12T03:34:45.012527+0000","last_peered":"2024-09-12T03:34:45.012527+0000","last_clean":"2024-09-12T03:34:45.012527+0000","last_became_active":"2024-09-12T03:34:43.126083+0000","last_became_peered":"2024-09-12T03:34:43.126083+0000","last_unstale":"2024-09-12T03:34:45.012527+0000","last_undegraded":"2024-09-12T03:34:45.012527+0000","last_fullsized":"2024-09-12T03:34:45.012527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187658+0000","last_change":"2024-09-12T03:34:39.073954+0000","last_active":"2024-09-12T03:34:44.187658+0000","last_peered":"2024-09-12T03:34:44.187658+0000","last_clean":"2024-09-12T03:34:44.187658+0000","last_became_active":"2024-09-12T03:34:39.073238+0000","last_became_peered":"2024-09-12T03:34:39.073238+0000","last_unstale":"2024-09-12T03:34:44.187658+0000","last_undegraded":"2024-09-12T03:34:44.187658+0000","last_fullsized":"2024-09-12T03:34:44.187658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187978+0000","last_change":"2024-09-12T03:34:38.023260+0000","last_active":"2024-09-12T03:34:44.187978+0000","last_peered":"2024-09-12T03:34:44.187978+0000","last_clean":"2024-09-12T03:34:44.187978+0000","last_became_active":"2024-09-12T03:34:38.022602+0000","last_became_peered":"2024-09-12T03:34:38.022602+0000","last_unstale":"2024-09-12T03:34:44.187978+0000","last_undegraded":"2024-09-12T03:34:44.187978+0000","last_fullsized":"2024-09-12T03:34:44.187978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:20.254507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010135+0000","last_change":"2024-09-12T03:34:43.216165+0000","last_active":"2024-09-12T03:34:45.010135+0000","last_peered":"2024-09-12T03:34:45.010135+0000","last_clean":"2024-09-12T03:34:45.010135+0000","last_became_active":"2024-09-12T03:34:43.214989+0000","last_became_peered":"2024-09-12T03:34:43.214989+0000","last_unstale":"2024-09-12T03:34:45.010135+0000","last_undegraded":"2024-09-12T03:34:45.010135+0000","last_fullsized":"2024-09-12T03:34:45.010135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.591844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010173+0000","last_change":"2024-09-12T03:34:39.090006+0000","last_active":"2024-09-12T03:34:45.010173+0000","last_peered":"2024-09-12T03:34:45.010173+0000","last_clean":"2024-09-12T03:34:45.010173+0000","last_became_active":"2024-09-12T03:34:39.089165+0000","last_became_peered":"2024-09-12T03:34:39.089165+0000","last_unstale":"2024-09-12T03:34:45.010173+0000","last_undegraded":"2024-09-12T03:34:45.010173+0000","last_fullsized":"2024-09-12T03:34:45.010173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097113+0000","last_change":"2024-09-12T03:34:38.014916+0000","last_active":"2024-09-12T03:34:44.097113+0000","last_peered":"2024-09-12T03:34:44.097113+0000","last_clean":"2024-09-12T03:34:44.097113+0000","last_became_active":"2024-09-12T03:34:38.014447+0000","last_became_peered":"2024-09-12T03:34:38.014447+0000","last_unstale":"2024-09-12T03:34:44.097113+0000","last_undegraded":"2024-09-12T03:34:44.097113+0000","last_fullsized":"2024-09-12T03:34:44.097113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008970+0000","last_change":"2024-09-12T03:34:43.211049+0000","last_active":"2024-09-12T03:34:45.008970+0000","last_peered":"2024-09-12T03:34:45.008970+0000","last_clean":"2024-09-12T03:34:45.008970+0000","last_became_active":"2024-09-12T03:34:43.210561+0000","last_became_peered":"2024-09-12T03:34:43.210561+0000","last_unstale":"2024-09-12T03:34:45.008970+0000","last_undegraded":"2024-09-12T03:34:45.008970+0000","last_fullsized":"2024-09-12T03:34:45.008970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:22.633242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012235+0000","last_change":"2024-09-12T03:34:39.082890+0000","last_active":"2024-09-12T03:34:45.012235+0000","last_peered":"2024-09-12T03:34:45.012235+0000","last_clean":"2024-09-12T03:34:45.012235+0000","last_became_active":"2024-09-12T03:34:39.082674+0000","last_became_peered":"2024-09-12T03:34:39.082674+0000","last_unstale":"2024-09-12T03:34:45.012235+0000","last_undegraded":"2024-09-12T03:34:45.012235+0000","last_fullsized":"2024-09-12T03:34:45.012235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013716+0000","last_change":"2024-09-12T03:34:38.017260+0000","last_active":"2024-09-12T03:34:45.013716+0000","last_peered":"2024-09-12T03:34:45.013716+0000","last_clean":"2024-09-12T03:34:45.013716+0000","last_became_active":"2024-09-12T03:34:38.016781+0000","last_became_peered":"2024-09-12T03:34:38.016781+0000","last_unstale":"2024-09-12T03:34:45.013716+0000","last_undegraded":"2024-09-12T03:34:45.013716+0000","last_fullsized":"2024-09-12T03:34:45.013716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:49.748803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098324+0000","last_change":"2024-09-12T03:34:43.213204+0000","last_active":"2024-09-12T03:34:44.098324+0000","last_peered":"2024-09-12T03:34:44.098324+0000","last_clean":"2024-09-12T03:34:44.098324+0000","last_became_active":"2024-09-12T03:34:43.212190+0000","last_became_peered":"2024-09-12T03:34:43.212190+0000","last_unstale":"2024-09-12T03:34:44.098324+0000","last_undegraded":"2024-09-12T03:34:44.098324+0000","last_fullsized":"2024-09-12T03:34:44.098324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010365+0000","last_change":"2024-09-12T03:34:39.087244+0000","last_active":"2024-09-12T03:34:45.010365+0000","last_peered":"2024-09-12T03:34:45.010365+0000","last_clean":"2024-09-12T03:34:45.010365+0000","last_became_active":"2024-09-12T03:34:39.085708+0000","last_became_peered":"2024-09-12T03:34:39.085708+0000","last_unstale":"2024-09-12T03:34:45.010365+0000","last_undegraded":"2024-09-12T03:34:45.010365+0000","last_fullsized":"2024-09-12T03:34:45.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:49.528251+0000","last_change":"2024-09-12T03:34:38.020300+0000","last_active":"2024-09-12T03:34:49.528251+0000","last_peered":"2024-09-12T03:34:49.528251+0000","last_clean":"2024-09-12T03:34:49.528251+0000","last_became_active":"2024-09-12T03:34:38.019416+0000","last_became_peered":"2024-09-12T03:34:38.019416+0000","last_unstale":"2024-09-12T03:34:49.528251+0000","last_undegraded":"2024-09-12T03:34:49.528251+0000","last_fullsized":"2024-09-12T03:34:49.528251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:57.206207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093034+0000","last_change":"2024-09-12T03:34:43.127205+0000","last_active":"2024-09-12T03:34:44.093034+0000","last_peered":"2024-09-12T03:34:44.093034+0000","last_clean":"2024-09-12T03:34:44.093034+0000","last_became_active":"2024-09-12T03:34:43.126473+0000","last_became_peered":"2024-09-12T03:34:43.126473+0000","last_unstale":"2024-09-12T03:34:44.093034+0000","last_undegraded":"2024-09-12T03:34:44.093034+0000","last_fullsized":"2024-09-12T03:34:44.093034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:08.474524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096722+0000","last_change":"2024-09-12T03:34:39.076678+0000","last_active":"2024-09-12T03:34:44.096722+0000","last_peered":"2024-09-12T03:34:44.096722+0000","last_clean":"2024-09-12T03:34:44.096722+0000","last_became_active":"2024-09-12T03:34:39.076007+0000","last_became_peered":"2024-09-12T03:34:39.076007+0000","last_unstale":"2024-09-12T03:34:44.096722+0000","last_undegraded":"2024-09-12T03:34:44.096722+0000","last_fullsized":"2024-09-12T03:34:44.096722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:29.999907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094072+0000","last_change":"2024-09-12T03:34:38.028753+0000","last_active":"2024-09-12T03:34:44.094072+0000","last_peered":"2024-09-12T03:34:44.094072+0000","last_clean":"2024-09-12T03:34:44.094072+0000","last_became_active":"2024-09-12T03:34:38.028499+0000","last_became_peered":"2024-09-12T03:34:38.028499+0000","last_unstale":"2024-09-12T03:34:44.094072+0000","last_undegraded":"2024-09-12T03:34:44.094072+0000","last_fullsized":"2024-09-12T03:34:44.094072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096751+0000","last_change":"2024-09-12T03:34:43.135662+0000","last_active":"2024-09-12T03:34:44.096751+0000","last_peered":"2024-09-12T03:34:44.096751+0000","last_clean":"2024-09-12T03:34:44.096751+0000","last_became_active":"2024-09-12T03:34:43.128133+0000","last_became_peered":"2024-09-12T03:34:43.128133+0000","last_unstale":"2024-09-12T03:34:44.096751+0000","last_undegraded":"2024-09-12T03:34:44.096751+0000","last_fullsized":"2024-09-12T03:34:44.096751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:41.314336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012301+0000","last_change":"2024-09-12T03:34:39.088237+0000","last_active":"2024-09-12T03:34:45.012301+0000","last_peered":"2024-09-12T03:34:45.012301+0000","last_clean":"2024-09-12T03:34:45.012301+0000","last_became_active":"2024-09-12T03:34:39.087952+0000","last_became_peered":"2024-09-12T03:34:39.087952+0000","last_unstale":"2024-09-12T03:34:45.012301+0000","last_undegraded":"2024-09-12T03:34:45.012301+0000","last_fullsized":"2024-09-12T03:34:45.012301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097921+0000","last_change":"2024-09-12T03:34:38.012565+0000","last_active":"2024-09-12T03:34:44.097921+0000","last_peered":"2024-09-12T03:34:44.097921+0000","last_clean":"2024-09-12T03:34:44.097921+0000","last_became_active":"2024-09-12T03:34:38.012023+0000","last_became_peered":"2024-09-12T03:34:38.012023+0000","last_unstale":"2024-09-12T03:34:44.097921+0000","last_undegraded":"2024-09-12T03:34:44.097921+0000","last_fullsized":"2024-09-12T03:34:44.097921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007983+0000","last_change":"2024-09-12T03:34:43.127550+0000","last_active":"2024-09-12T03:34:45.007983+0000","last_peered":"2024-09-12T03:34:45.007983+0000","last_clean":"2024-09-12T03:34:45.007983+0000","last_became_active":"2024-09-12T03:34:43.118399+0000","last_became_peered":"2024-09-12T03:34:43.118399+0000","last_unstale":"2024-09-12T03:34:45.007983+0000","last_undegraded":"2024-09-12T03:34:45.007983+0000","last_fullsized":"2024-09-12T03:34:45.007983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097682+0000","last_change":"2024-09-12T03:34:39.103021+0000","last_active":"2024-09-12T03:34:44.097682+0000","last_peered":"2024-09-12T03:34:44.097682+0000","last_clean":"2024-09-12T03:34:44.097682+0000","last_became_active":"2024-09-12T03:34:39.102537+0000","last_became_peered":"2024-09-12T03:34:39.102537+0000","last_unstale":"2024-09-12T03:34:44.097682+0000","last_undegraded":"2024-09-12T03:34:44.097682+0000","last_fullsized":"2024-09-12T03:34:44.097682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188469+0000","last_change":"2024-09-12T03:34:38.026833+0000","last_active":"2024-09-12T03:34:44.188469+0000","last_peered":"2024-09-12T03:34:44.188469+0000","last_clean":"2024-09-12T03:34:44.188469+0000","last_became_active":"2024-09-12T03:34:38.026268+0000","last_became_peered":"2024-09-12T03:34:38.026268+0000","last_unstale":"2024-09-12T03:34:44.188469+0000","last_undegraded":"2024-09-12T03:34:44.188469+0000","last_fullsized":"2024-09-12T03:34:44.188469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:52.708505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008838+0000","last_change":"2024-09-12T03:34:43.212792+0000","last_active":"2024-09-12T03:34:45.008838+0000","last_peered":"2024-09-12T03:34:45.008838+0000","last_clean":"2024-09-12T03:34:45.008838+0000","last_became_active":"2024-09-12T03:34:43.211671+0000","last_became_peered":"2024-09-12T03:34:43.211671+0000","last_unstale":"2024-09-12T03:34:45.008838+0000","last_undegraded":"2024-09-12T03:34:45.008838+0000","last_fullsized":"2024-09-12T03:34:45.008838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013459+0000","last_change":"2024-09-12T03:34:43.218438+0000","last_active":"2024-09-12T03:34:45.013459+0000","last_peered":"2024-09-12T03:34:45.013459+0000","last_clean":"2024-09-12T03:34:45.013459+0000","last_became_active":"2024-09-12T03:34:43.217735+0000","last_became_peered":"2024-09-12T03:34:43.217735+0000","last_unstale":"2024-09-12T03:34:45.013459+0000","last_undegraded":"2024-09-12T03:34:45.013459+0000","last_fullsized":"2024-09-12T03:34:45.013459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:19.562019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092348+0000","last_change":"2024-09-12T03:34:39.063362+0000","last_active":"2024-09-12T03:34:44.092348+0000","last_peered":"2024-09-12T03:34:44.092348+0000","last_clean":"2024-09-12T03:34:44.092348+0000","last_became_active":"2024-09-12T03:34:39.063020+0000","last_became_peered":"2024-09-12T03:34:39.063020+0000","last_unstale":"2024-09-12T03:34:44.092348+0000","last_undegraded":"2024-09-12T03:34:44.092348+0000","last_fullsized":"2024-09-12T03:34:44.092348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095747+0000","last_change":"2024-09-12T03:34:38.027195+0000","last_active":"2024-09-12T03:34:44.095747+0000","last_peered":"2024-09-12T03:34:44.095747+0000","last_clean":"2024-09-12T03:34:44.095747+0000","last_became_active":"2024-09-12T03:34:38.026662+0000","last_became_peered":"2024-09-12T03:34:38.026662+0000","last_unstale":"2024-09-12T03:34:44.095747+0000","last_undegraded":"2024-09-12T03:34:44.095747+0000","last_fullsized":"2024-09-12T03:34:44.095747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188079+0000","last_change":"2024-09-12T03:34:43.134866+0000","last_active":"2024-09-12T03:34:44.188079+0000","last_peered":"2024-09-12T03:34:44.188079+0000","last_clean":"2024-09-12T03:34:44.188079+0000","last_became_active":"2024-09-12T03:34:43.133525+0000","last_became_peered":"2024-09-12T03:34:43.133525+0000","last_unstale":"2024-09-12T03:34:44.188079+0000","last_undegraded":"2024-09-12T03:34:44.188079+0000","last_fullsized":"2024-09-12T03:34:44.188079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008011+0000","last_change":"2024-09-12T03:34:39.063056+0000","last_active":"2024-09-12T03:34:45.008011+0000","last_peered":"2024-09-12T03:34:45.008011+0000","last_clean":"2024-09-12T03:34:45.008011+0000","last_became_active":"2024-09-12T03:34:39.062761+0000","last_became_peered":"2024-09-12T03:34:39.062761+0000","last_unstale":"2024-09-12T03:34:45.008011+0000","last_undegraded":"2024-09-12T03:34:45.008011+0000","last_fullsized":"2024-09-12T03:34:45.008011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008537+0000","last_change":"2024-09-12T03:34:38.018201+0000","last_active":"2024-09-12T03:34:45.008537+0000","last_peered":"2024-09-12T03:34:45.008537+0000","last_clean":"2024-09-12T03:34:45.008537+0000","last_became_active":"2024-09-12T03:34:38.017942+0000","last_became_peered":"2024-09-12T03:34:38.017942+0000","last_unstale":"2024-09-12T03:34:45.008537+0000","last_undegraded":"2024-09-12T03:34:45.008537+0000","last_fullsized":"2024-09-12T03:34:45.008537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188411+0000","last_change":"2024-09-12T03:34:38.022415+0000","last_active":"2024-09-12T03:34:44.188411+0000","last_peered":"2024-09-12T03:34:44.188411+0000","last_clean":"2024-09-12T03:34:44.188411+0000","last_became_active":"2024-09-12T03:34:38.019452+0000","last_became_peered":"2024-09-12T03:34:38.019452+0000","last_unstale":"2024-09-12T03:34:44.188411+0000","last_undegraded":"2024-09-12T03:34:44.188411+0000","last_fullsized":"2024-09-12T03:34:44.188411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:48.971400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013639+0000","last_change":"2024-09-12T03:34:39.054095+0000","last_active":"2024-09-12T03:34:45.013639+0000","last_peered":"2024-09-12T03:34:45.013639+0000","last_clean":"2024-09-12T03:34:45.013639+0000","last_became_active":"2024-09-12T03:34:39.053738+0000","last_became_peered":"2024-09-12T03:34:39.053738+0000","last_unstale":"2024-09-12T03:34:45.013639+0000","last_undegraded":"2024-09-12T03:34:45.013639+0000","last_fullsized":"2024-09-12T03:34:45.013639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010585+0000","last_change":"2024-09-12T03:34:43.114138+0000","last_active":"2024-09-12T03:34:45.010585+0000","last_peered":"2024-09-12T03:34:45.010585+0000","last_clean":"2024-09-12T03:34:45.010585+0000","last_became_active":"2024-09-12T03:34:43.113549+0000","last_became_peered":"2024-09-12T03:34:43.113549+0000","last_unstale":"2024-09-12T03:34:45.010585+0000","last_undegraded":"2024-09-12T03:34:45.010585+0000","last_fullsized":"2024-09-12T03:34:45.010585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:38.432588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008571+0000","last_change":"2024-09-12T03:34:38.030379+0000","last_active":"2024-09-12T03:34:45.008571+0000","last_peered":"2024-09-12T03:34:45.008571+0000","last_clean":"2024-09-12T03:34:45.008571+0000","last_became_active":"2024-09-12T03:34:38.030041+0000","last_became_peered":"2024-09-12T03:34:38.030041+0000","last_unstale":"2024-09-12T03:34:45.008571+0000","last_undegraded":"2024-09-12T03:34:45.008571+0000","last_fullsized":"2024-09-12T03:34:45.008571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095998+0000","last_change":"2024-09-12T03:34:39.064296+0000","last_active":"2024-09-12T03:34:44.095998+0000","last_peered":"2024-09-12T03:34:44.095998+0000","last_clean":"2024-09-12T03:34:44.095998+0000","last_became_active":"2024-09-12T03:34:39.063569+0000","last_became_peered":"2024-09-12T03:34:39.063569+0000","last_unstale":"2024-09-12T03:34:44.095998+0000","last_undegraded":"2024-09-12T03:34:44.095998+0000","last_fullsized":"2024-09-12T03:34:44.095998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:42.375906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009228+0000","last_change":"2024-09-12T03:34:43.118123+0000","last_active":"2024-09-12T03:34:45.009228+0000","last_peered":"2024-09-12T03:34:45.009228+0000","last_clean":"2024-09-12T03:34:45.009228+0000","last_became_active":"2024-09-12T03:34:43.117722+0000","last_became_peered":"2024-09-12T03:34:43.117722+0000","last_unstale":"2024-09-12T03:34:45.009228+0000","last_undegraded":"2024-09-12T03:34:45.009228+0000","last_fullsized":"2024-09-12T03:34:45.009228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:08.248672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187424+0000","last_change":"2024-09-12T03:34:39.077386+0000","last_active":"2024-09-12T03:34:44.187424+0000","last_peered":"2024-09-12T03:34:44.187424+0000","last_clean":"2024-09-12T03:34:44.187424+0000","last_became_active":"2024-09-12T03:34:39.076662+0000","last_became_peered":"2024-09-12T03:34:39.076662+0000","last_unstale":"2024-09-12T03:34:44.187424+0000","last_undegraded":"2024-09-12T03:34:44.187424+0000","last_fullsized":"2024-09-12T03:34:44.187424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009701+0000","last_change":"2024-09-12T03:34:39.087463+0000","last_active":"2024-09-12T03:34:45.009701+0000","last_peered":"2024-09-12T03:34:45.009701+0000","last_clean":"2024-09-12T03:34:45.009701+0000","last_became_active":"2024-09-12T03:34:39.087165+0000","last_became_peered":"2024-09-12T03:34:39.087165+0000","last_unstale":"2024-09-12T03:34:45.009701+0000","last_undegraded":"2024-09-12T03:34:45.009701+0000","last_fullsized":"2024-09-12T03:34:45.009701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096888+0000","last_change":"2024-09-12T03:34:39.098154+0000","last_active":"2024-09-12T03:34:44.096888+0000","last_peered":"2024-09-12T03:34:44.096888+0000","last_clean":"2024-09-12T03:34:44.096888+0000","last_became_active":"2024-09-12T03:34:39.097223+0000","last_became_peered":"2024-09-12T03:34:39.097223+0000","last_unstale":"2024-09-12T03:34:44.096888+0000","last_undegraded":"2024-09-12T03:34:44.096888+0000","last_fullsized":"2024-09-12T03:34:44.096888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013401+0000","last_change":"2024-09-12T03:34:39.065566+0000","last_active":"2024-09-12T03:34:45.013401+0000","last_peered":"2024-09-12T03:34:45.013401+0000","last_clean":"2024-09-12T03:34:45.013401+0000","last_became_active":"2024-09-12T03:34:39.065271+0000","last_became_peered":"2024-09-12T03:34:39.065271+0000","last_unstale":"2024-09-12T03:34:45.013401+0000","last_undegraded":"2024-09-12T03:34:45.013401+0000","last_fullsized":"2024-09-12T03:34:45.013401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:21.031062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009257+0000","last_change":"2024-09-12T03:34:39.080421+0000","last_active":"2024-09-12T03:34:45.009257+0000","last_peered":"2024-09-12T03:34:45.009257+0000","last_clean":"2024-09-12T03:34:45.009257+0000","last_became_active":"2024-09-12T03:34:39.080177+0000","last_became_peered":"2024-09-12T03:34:39.080177+0000","last_unstale":"2024-09-12T03:34:45.009257+0000","last_undegraded":"2024-09-12T03:34:45.009257+0000","last_fullsized":"2024-09-12T03:34:45.009257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093781+0000","last_change":"2024-09-12T03:34:39.064463+0000","last_active":"2024-09-12T03:34:44.093781+0000","last_peered":"2024-09-12T03:34:44.093781+0000","last_clean":"2024-09-12T03:34:44.093781+0000","last_became_active":"2024-09-12T03:34:39.064221+0000","last_became_peered":"2024-09-12T03:34:39.064221+0000","last_unstale":"2024-09-12T03:34:44.093781+0000","last_undegraded":"2024-09-12T03:34:44.093781+0000","last_fullsized":"2024-09-12T03:34:44.093781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188514+0000","last_change":"2024-09-12T03:34:39.104917+0000","last_active":"2024-09-12T03:34:44.188514+0000","last_peered":"2024-09-12T03:34:44.188514+0000","last_clean":"2024-09-12T03:34:44.188514+0000","last_became_active":"2024-09-12T03:34:39.104399+0000","last_became_peered":"2024-09-12T03:34:39.104399+0000","last_unstale":"2024-09-12T03:34:44.188514+0000","last_undegraded":"2024-09-12T03:34:44.188514+0000","last_fullsized":"2024-09-12T03:34:44.188514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:03.567787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010275+0000","last_change":"2024-09-12T03:34:39.081674+0000","last_active":"2024-09-12T03:34:45.010275+0000","last_peered":"2024-09-12T03:34:45.010275+0000","last_clean":"2024-09-12T03:34:45.010275+0000","last_became_active":"2024-09-12T03:34:39.081415+0000","last_became_peered":"2024-09-12T03:34:39.081415+0000","last_unstale":"2024-09-12T03:34:45.010275+0000","last_undegraded":"2024-09-12T03:34:45.010275+0000","last_fullsized":"2024-09-12T03:34:45.010275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095516+0000","last_change":"2024-09-12T03:34:39.105000+0000","last_active":"2024-09-12T03:34:44.095516+0000","last_peered":"2024-09-12T03:34:44.095516+0000","last_clean":"2024-09-12T03:34:44.095516+0000","last_became_active":"2024-09-12T03:34:39.104552+0000","last_became_peered":"2024-09-12T03:34:39.104552+0000","last_unstale":"2024-09-12T03:34:44.095516+0000","last_undegraded":"2024-09-12T03:34:44.095516+0000","last_fullsized":"2024-09-12T03:34:44.095516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008305+0000","last_change":"2024-09-12T03:34:39.081413+0000","last_active":"2024-09-12T03:34:45.008305+0000","last_peered":"2024-09-12T03:34:45.008305+0000","last_clean":"2024-09-12T03:34:45.008305+0000","last_became_active":"2024-09-12T03:34:39.081124+0000","last_became_peered":"2024-09-12T03:34:39.081124+0000","last_unstale":"2024-09-12T03:34:45.008305+0000","last_undegraded":"2024-09-12T03:34:45.008305+0000","last_fullsized":"2024-09-12T03:34:45.008305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096657+0000","last_change":"2024-09-12T03:34:39.103486+0000","last_active":"2024-09-12T03:34:44.096657+0000","last_peered":"2024-09-12T03:34:44.096657+0000","last_clean":"2024-09-12T03:34:44.096657+0000","last_became_active":"2024-09-12T03:34:39.102713+0000","last_became_peered":"2024-09-12T03:34:39.102713+0000","last_unstale":"2024-09-12T03:34:44.096657+0000","last_undegraded":"2024-09-12T03:34:44.096657+0000","last_fullsized":"2024-09-12T03:34:44.096657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013159+0000","last_change":"2024-09-12T03:34:39.084516+0000","last_active":"2024-09-12T03:34:45.013159+0000","last_peered":"2024-09-12T03:34:45.013159+0000","last_clean":"2024-09-12T03:34:45.013159+0000","last_became_active":"2024-09-12T03:34:39.084230+0000","last_became_peered":"2024-09-12T03:34:39.084230+0000","last_unstale":"2024-09-12T03:34:45.013159+0000","last_undegraded":"2024-09-12T03:34:45.013159+0000","last_fullsized":"2024-09-12T03:34:45.013159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:35.100430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:39.107212+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:39.106301+0000","last_became_peered":"2024-09-12T03:34:39.106301+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010903+0000","last_change":"2024-09-12T03:34:39.087886+0000","last_active":"2024-09-12T03:34:45.010903+0000","last_peered":"2024-09-12T03:34:45.010903+0000","last_clean":"2024-09-12T03:34:45.010903+0000","last_became_active":"2024-09-12T03:34:39.086540+0000","last_became_peered":"2024-09-12T03:34:39.086540+0000","last_unstale":"2024-09-12T03:34:45.010903+0000","last_undegraded":"2024-09-12T03:34:45.010903+0000","last_fullsized":"2024-09-12T03:34:45.010903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011752+0000","last_change":"2024-09-12T03:34:39.090922+0000","last_active":"2024-09-12T03:34:45.011752+0000","last_peered":"2024-09-12T03:34:45.011752+0000","last_clean":"2024-09-12T03:34:45.011752+0000","last_became_active":"2024-09-12T03:34:39.090678+0000","last_became_peered":"2024-09-12T03:34:39.090678+0000","last_unstale":"2024-09-12T03:34:45.011752+0000","last_undegraded":"2024-09-12T03:34:45.011752+0000","last_fullsized":"2024-09-12T03:34:45.011752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.099310+0000","last_change":"2024-09-12T03:34:39.103626+0000","last_active":"2024-09-12T03:34:44.099310+0000","last_peered":"2024-09-12T03:34:44.099310+0000","last_clean":"2024-09-12T03:34:44.099310+0000","last_became_active":"2024-09-12T03:34:39.102752+0000","last_became_peered":"2024-09-12T03:34:39.102752+0000","last_unstale":"2024-09-12T03:34:44.099310+0000","last_undegraded":"2024-09-12T03:34:44.099310+0000","last_fullsized":"2024-09-12T03:34:44.099310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095270+0000","last_change":"2024-09-12T03:34:39.088569+0000","last_active":"2024-09-12T03:34:44.095270+0000","last_peered":"2024-09-12T03:34:44.095270+0000","last_clean":"2024-09-12T03:34:44.095270+0000","last_became_active":"2024-09-12T03:34:39.088031+0000","last_became_peered":"2024-09-12T03:34:39.088031+0000","last_unstale":"2024-09-12T03:34:44.095270+0000","last_undegraded":"2024-09-12T03:34:44.095270+0000","last_fullsized":"2024-09-12T03:34:44.095270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092516+0000","last_change":"2024-09-12T03:34:39.081983+0000","last_active":"2024-09-12T03:34:44.092516+0000","last_peered":"2024-09-12T03:34:44.092516+0000","last_clean":"2024-09-12T03:34:44.092516+0000","last_became_active":"2024-09-12T03:34:39.081670+0000","last_became_peered":"2024-09-12T03:34:39.081670+0000","last_unstale":"2024-09-12T03:34:44.092516+0000","last_undegraded":"2024-09-12T03:34:44.092516+0000","last_fullsized":"2024-09-12T03:34:44.092516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012007+0000","last_change":"2024-09-12T03:34:39.058851+0000","last_active":"2024-09-12T03:34:45.012007+0000","last_peered":"2024-09-12T03:34:45.012007+0000","last_clean":"2024-09-12T03:34:45.012007+0000","last_became_active":"2024-09-12T03:34:39.058122+0000","last_became_peered":"2024-09-12T03:34:39.058122+0000","last_unstale":"2024-09-12T03:34:45.012007+0000","last_undegraded":"2024-09-12T03:34:45.012007+0000","last_fullsized":"2024-09-12T03:34:45.012007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:12.193080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008220+0000","last_change":"2024-09-12T03:34:39.067672+0000","last_active":"2024-09-12T03:34:45.008220+0000","last_peered":"2024-09-12T03:34:45.008220+0000","last_clean":"2024-09-12T03:34:45.008220+0000","last_became_active":"2024-09-12T03:34:39.067402+0000","last_became_peered":"2024-09-12T03:34:39.067402+0000","last_unstale":"2024-09-12T03:34:45.008220+0000","last_undegraded":"2024-09-12T03:34:45.008220+0000","last_fullsized":"2024-09-12T03:34:45.008220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096493+0000","last_change":"2024-09-12T03:34:39.108544+0000","last_active":"2024-09-12T03:34:44.096493+0000","last_peered":"2024-09-12T03:34:44.096493+0000","last_clean":"2024-09-12T03:34:44.096493+0000","last_became_active":"2024-09-12T03:34:39.108009+0000","last_became_peered":"2024-09-12T03:34:39.108009+0000","last_unstale":"2024-09-12T03:34:44.096493+0000","last_undegraded":"2024-09-12T03:34:44.096493+0000","last_fullsized":"2024-09-12T03:34:44.096493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188461+0000","last_change":"2024-09-12T03:34:39.104075+0000","last_active":"2024-09-12T03:34:44.188461+0000","last_peered":"2024-09-12T03:34:44.188461+0000","last_clean":"2024-09-12T03:34:44.188461+0000","last_became_active":"2024-09-12T03:34:39.094220+0000","last_became_peered":"2024-09-12T03:34:39.094220+0000","last_unstale":"2024-09-12T03:34:44.188461+0000","last_undegraded":"2024-09-12T03:34:44.188461+0000","last_fullsized":"2024-09-12T03:34:44.188461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188458+0000","last_change":"2024-09-12T03:34:39.093290+0000","last_active":"2024-09-12T03:34:44.188458+0000","last_peered":"2024-09-12T03:34:44.188458+0000","last_clean":"2024-09-12T03:34:44.188458+0000","last_became_active":"2024-09-12T03:34:39.092378+0000","last_became_peered":"2024-09-12T03:34:39.092378+0000","last_unstale":"2024-09-12T03:34:44.188458+0000","last_undegraded":"2024-09-12T03:34:44.188458+0000","last_fullsized":"2024-09-12T03:34:44.188458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011121+0000","last_change":"2024-09-12T03:34:39.099671+0000","last_active":"2024-09-12T03:34:45.011121+0000","last_peered":"2024-09-12T03:34:45.011121+0000","last_clean":"2024-09-12T03:34:45.011121+0000","last_became_active":"2024-09-12T03:34:39.099044+0000","last_became_peered":"2024-09-12T03:34:39.099044+0000","last_unstale":"2024-09-12T03:34:45.011121+0000","last_undegraded":"2024-09-12T03:34:45.011121+0000","last_fullsized":"2024-09-12T03:34:45.011121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007754+0000","last_change":"2024-09-12T03:34:39.097597+0000","last_active":"2024-09-12T03:34:45.007754+0000","last_peered":"2024-09-12T03:34:45.007754+0000","last_clean":"2024-09-12T03:34:45.007754+0000","last_became_active":"2024-09-12T03:34:39.097301+0000","last_became_peered":"2024-09-12T03:34:39.097301+0000","last_unstale":"2024-09-12T03:34:45.007754+0000","last_undegraded":"2024-09-12T03:34:45.007754+0000","last_fullsized":"2024-09-12T03:34:45.007754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:24.666071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009891+0000","last_change":"2024-09-12T03:34:39.084776+0000","last_active":"2024-09-12T03:34:45.009891+0000","last_peered":"2024-09-12T03:34:45.009891+0000","last_clean":"2024-09-12T03:34:45.009891+0000","last_became_active":"2024-09-12T03:34:39.083987+0000","last_became_peered":"2024-09-12T03:34:39.083987+0000","last_unstale":"2024-09-12T03:34:45.009891+0000","last_undegraded":"2024-09-12T03:34:45.009891+0000","last_fullsized":"2024-09-12T03:34:45.009891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096430+0000","last_change":"2024-09-12T03:34:39.088318+0000","last_active":"2024-09-12T03:34:44.096430+0000","last_peered":"2024-09-12T03:34:44.096430+0000","last_clean":"2024-09-12T03:34:44.096430+0000","last_became_active":"2024-09-12T03:34:39.087777+0000","last_became_peered":"2024-09-12T03:34:39.087777+0000","last_unstale":"2024-09-12T03:34:44.096430+0000","last_undegraded":"2024-09-12T03:34:44.096430+0000","last_fullsized":"2024-09-12T03:34:44.096430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009971+0000","last_change":"2024-09-12T03:34:39.085197+0000","last_active":"2024-09-12T03:34:45.009971+0000","last_peered":"2024-09-12T03:34:45.009971+0000","last_clean":"2024-09-12T03:34:45.009971+0000","last_became_active":"2024-09-12T03:34:39.084478+0000","last_became_peered":"2024-09-12T03:34:39.084478+0000","last_unstale":"2024-09-12T03:34:45.009971+0000","last_undegraded":"2024-09-12T03:34:45.009971+0000","last_fullsized":"2024-09-12T03:34:45.009971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097330+0000","last_change":"2024-09-12T03:34:39.097105+0000","last_active":"2024-09-12T03:34:44.097330+0000","last_peered":"2024-09-12T03:34:44.097330+0000","last_clean":"2024-09-12T03:34:44.097330+0000","last_became_active":"2024-09-12T03:34:39.088754+0000","last_became_peered":"2024-09-12T03:34:39.088754+0000","last_unstale":"2024-09-12T03:34:44.097330+0000","last_undegraded":"2024-09-12T03:34:44.097330+0000","last_fullsized":"2024-09-12T03:34:44.097330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011922+0000","last_change":"2024-09-12T03:34:39.049548+0000","last_active":"2024-09-12T03:34:45.011922+0000","last_peered":"2024-09-12T03:34:45.011922+0000","last_clean":"2024-09-12T03:34:45.011922+0000","last_became_active":"2024-09-12T03:34:39.049247+0000","last_became_peered":"2024-09-12T03:34:39.049247+0000","last_unstale":"2024-09-12T03:34:45.011922+0000","last_undegraded":"2024-09-12T03:34:45.011922+0000","last_fullsized":"2024-09-12T03:34:45.011922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094491+0000","last_change":"2024-09-12T03:34:39.061225+0000","last_active":"2024-09-12T03:34:44.094491+0000","last_peered":"2024-09-12T03:34:44.094491+0000","last_clean":"2024-09-12T03:34:44.094491+0000","last_became_active":"2024-09-12T03:34:39.060943+0000","last_became_peered":"2024-09-12T03:34:39.060943+0000","last_unstale":"2024-09-12T03:34:44.094491+0000","last_undegraded":"2024-09-12T03:34:44.094491+0000","last_fullsized":"2024-09-12T03:34:44.094491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010849+0000","last_change":"2024-09-12T03:34:39.105481+0000","last_active":"2024-09-12T03:34:45.010849+0000","last_peered":"2024-09-12T03:34:45.010849+0000","last_clean":"2024-09-12T03:34:45.010849+0000","last_became_active":"2024-09-12T03:34:39.105018+0000","last_became_peered":"2024-09-12T03:34:39.105018+0000","last_unstale":"2024-09-12T03:34:45.010849+0000","last_undegraded":"2024-09-12T03:34:45.010849+0000","last_fullsized":"2024-09-12T03:34:45.010849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:34:54.530 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:34:54.530 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T03:34:54.530 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T03:34:54.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T03:34:54.531 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T03:34:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2609632640 1 Processor -- start 2024-09-12T03:34:54.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2609632640 1 -- start start 2024-09-12T03:34:54.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2609632640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2604161a60 0x7f26040d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2609632640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26040cf620 0x7f260406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2609632640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26040d32b0 con 0x7f26040d2e90 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2609632640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f26040d0300 con 0x7f26040cf620 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2609632640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f26040cfa90 con 0x7f2604161a60 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f26037fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26040cf620 0x7f260406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f25fbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f26040d2e90 0x7f26040cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42244/0 (socket says 172.21.15.73:42244) 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f25fbfff640 1 -- 172.21.15.73:0/3541899194 learned_addr learned my addr 172.21.15.73:0/3541899194 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f2602ffd640 1 --2- 172.21.15.73:0/3541899194 >> v2:172.21.15.150:3300/0 conn(0x7f2604161a60 0x7f26040d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f26037fe640 1 -- 172.21.15.73:0/3541899194 >> v2:172.21.15.150:3300/0 conn(0x7f2604161a60 msgr2=0x7f26040d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f26037fe640 1 --2- 172.21.15.73:0/3541899194 >> v2:172.21.15.150:3300/0 conn(0x7f2604161a60 0x7f26040d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f26037fe640 1 -- 172.21.15.73:0/3541899194 >> v1:172.21.15.73:6789/0 conn(0x7f26040d2e90 legacy=0x7f26040cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f26037fe640 1 -- 172.21.15.73:0/3541899194 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26040b0f60 con 0x7f26040cf620 2024-09-12T03:34:54.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.688+0000 7f26027fc640 1 -- 172.21.15.73:0/3541899194 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702826407 0 0) 0x7f26040d32b0 con 0x7f26040d2e90 2024-09-12T03:34:54.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f26037fe640 1 --2- 172.21.15.73:0/3541899194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f260406d6b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f260408e010 tx=0x7f25fc01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ae613436275423 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:54.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f26027fc640 1 -- 172.21.15.73:0/3541899194 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0b2070 con 0x7f26040cf620 2024-09-12T03:34:54.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f26027fc640 1 -- 172.21.15.73:0/3541899194 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc0a5930 con 0x7f26040cf620 2024-09-12T03:34:54.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f26027fc640 1 -- 172.21.15.73:0/3541899194 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0a5d00 con 0x7f26040cf620 2024-09-12T03:34:54.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- 172.21.15.73:0/3541899194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 msgr2=0x7f260406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 --2- 172.21.15.73:0/3541899194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f260406d6b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f260408e010 tx=0x7f25fc01c870 comp rx=0 tx=0).stop 2024-09-12T03:34:54.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- 172.21.15.73:0/3541899194 shutdown_connections 2024-09-12T03:34:54.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 --2- 172.21.15.73:0/3541899194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f260406d6b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 --2- 172.21.15.73:0/3541899194 >> v2:172.21.15.150:3300/0 conn(0x7f2604161a60 0x7f26040d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- 172.21.15.73:0/3541899194 >> 172.21.15.73:0/3541899194 conn(0x7f260408bf90 msgr2=0x7f260409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- 172.21.15.73:0/3541899194 shutdown_connections 2024-09-12T03:34:54.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- 172.21.15.73:0/3541899194 wait complete. 2024-09-12T03:34:54.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 Processor -- start 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- start start 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f2604152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26040d2e90 0x7f2604157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2604161a60 0x7f2604157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f260406e400 con 0x7f26040cf620 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f260406d190 con 0x7f2604161a60 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f260406e580 con 0x7f26040d2e90 2024-09-12T03:34:54.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f2604152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f2604152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42264/0 (socket says 172.21.15.73:42264) 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 -- 172.21.15.73:0/2953780541 learned_addr learned my addr 172.21.15.73:0/2953780541 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 -- 172.21.15.73:0/2953780541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26040d2e90 msgr2=0x7f2604157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26040d2e90 0x7f2604157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 -- 172.21.15.73:0/2953780541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2604161a60 msgr2=0x7f2604157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2604161a60 0x7f2604157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 -- 172.21.15.73:0/2953780541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260415fd80 con 0x7f26040cf620 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2602ffd640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f2604152750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f25f400d800 tx=0x7f25f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f25fb7fe640 1 -- 172.21.15.73:0/2953780541 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f400b6c0 con 0x7f26040cf620 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f25fb7fe640 1 -- 172.21.15.73:0/2953780541 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4019070 con 0x7f26040cf620 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26040b1180 con 0x7f26040cf620 2024-09-12T03:34:54.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f25fb7fe640 1 -- 172.21.15.73:0/2953780541 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f400ba60 con 0x7f26040cf620 2024-09-12T03:34:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.692+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260415f6e0 con 0x7f26040cf620 2024-09-12T03:34:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.696+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260406d6b0 con 0x7f26040cf620 2024-09-12T03:34:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.696+0000 7f25fb7fe640 1 -- 172.21.15.73:0/2953780541 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25f400bc00 con 0x7f26040cf620 2024-09-12T03:34:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.696+0000 7f25fb7fe640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25e40678c0 0x7f25e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.696+0000 7f25fb7fe640 1 -- 172.21.15.73:0/2953780541 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f25f40864c0 con 0x7f26040cf620 2024-09-12T03:34:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.696+0000 7f25fbfff640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25e40678c0 0x7f25e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:54.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.696+0000 7f25fbfff640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25e40678c0 0x7f25e4069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25ec000c10 tx=0x7f25ec007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:54.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.700+0000 7f25fb7fe640 1 -- 172.21.15.73:0/2953780541 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f260415fd80 con 0x7f26040cf620 2024-09-12T03:34:54.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.896+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f26040c7c40 con 0x7f26040cf620 2024-09-12T03:34:54.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.904+0000 7f25fb7fe640 1 -- 172.21.15.73:0/2953780541 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166887 (secure 0 0 0) 0x7f25f4056cc0 con 0x7f26040cf620 2024-09-12T03:34:54.909 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25e40678c0 msgr2=0x7f25e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25e40678c0 0x7f25e4069d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25ec000c10 tx=0x7f25ec007910 comp rx=0 tx=0).stop 2024-09-12T03:34:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 msgr2=0x7f2604152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f2604152750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f25f400d800 tx=0x7f25f400dcc0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 shutdown_connections 2024-09-12T03:34:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25e40678c0 0x7f25e4069d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2604161a60 0x7f2604157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26040d2e90 0x7f2604157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 --2- 172.21.15.73:0/2953780541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26040cf620 0x7f2604152750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 >> 172.21.15.73:0/2953780541 conn(0x7f260408bf90 msgr2=0x7f260409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 shutdown_connections 2024-09-12T03:34:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:54.908+0000 7f2609632640 1 -- 172.21.15.73:0/2953780541 wait complete. 2024-09-12T03:34:54.926 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1640828206},{"type":"v1","addr":"172.21.15.73:6833","nonce":1640828206}]},"active_addr":"172.21.15.73:6833/1640828206","active_change":"2024-09-12T03:34:19.772946+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1678817668}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1033775360}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3681034073}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":4160410326}]}]} 2024-09-12T03:34:54.931 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T03:34:54.931 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T03:34:54.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f347714e640 1 Processor -- start 2024-09-12T03:34:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f347714e640 1 -- start start 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f347714e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34701457a0 0x7f34700d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f347714e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 0x7f34700b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f347714e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700d27a0 con 0x7f34700b4340 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f347714e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f34700b47b0 con 0x7f34701457a0 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f347714e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f34700d1720 con 0x7f34700cf800 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f3474eea640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34701457a0 0x7f34700d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f34756eb640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f34700b4340 0x7f347015ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59676/0 (socket says 172.21.15.73:59676) 2024-09-12T03:34:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f34756eb640 1 -- 172.21.15.73:0/90566 learned_addr learned my addr 172.21.15.73:0/90566 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f3474eea640 1 -- 172.21.15.73:0/90566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 msgr2=0x7f34700b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f3474eea640 1 --2- 172.21.15.73:0/90566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 0x7f34700b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f3474eea640 1 -- 172.21.15.73:0/90566 >> v1:172.21.15.73:6789/0 conn(0x7f34700b4340 legacy=0x7f347015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f3474eea640 1 -- 172.21.15.73:0/90566 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34700d2a80 con 0x7f34701457a0 2024-09-12T03:34:55.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.032+0000 7f346f7fe640 1 -- 172.21.15.73:0/90566 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048338533 0 0) 0x7f34700d27a0 con 0x7f34700b4340 2024-09-12T03:34:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f3474eea640 1 --2- 172.21.15.73:0/90566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f34700d1ea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacbbaa8df6cd70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f346f7fe640 1 -- 172.21.15.73:0/90566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600a66d0 con 0x7f34701457a0 2024-09-12T03:34:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f346f7fe640 1 -- 172.21.15.73:0/90566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34600a6870 con 0x7f34701457a0 2024-09-12T03:34:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f346f7fe640 1 -- 172.21.15.73:0/90566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600a6c40 con 0x7f34701457a0 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 -- 172.21.15.73:0/90566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 msgr2=0x7f34700d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 --2- 172.21.15.73:0/90566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f34700d1ea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3460009d90 tx=0x7f346001c8e0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 -- 172.21.15.73:0/90566 shutdown_connections 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 --2- 172.21.15.73:0/90566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 0x7f34700b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 --2- 172.21.15.73:0/90566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f34700d1ea0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 -- 172.21.15.73:0/90566 >> 172.21.15.73:0/90566 conn(0x7f347006bcc0 msgr2=0x7f347006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 -- 172.21.15.73:0/90566 shutdown_connections 2024-09-12T03:34:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 -- 172.21.15.73:0/90566 wait complete. 2024-09-12T03:34:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 Processor -- start 2024-09-12T03:34:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.036+0000 7f347714e640 1 -- start start 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34700b4340 0x7f34700b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 0x7f3470159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f347015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34700b52f0 con 0x7f34701457a0 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34700b5170 con 0x7f34700b4340 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f34701690b0 con 0x7f34700cf800 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f347015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f347015a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36860/0 (socket says 172.21.15.73:36860) 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 -- 172.21.15.73:0/2901598344 learned_addr learned my addr 172.21.15.73:0/2901598344 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f346ffff640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 0x7f3470159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f3474eea640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34700b4340 0x7f34700b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 -- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 msgr2=0x7f3470159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 0x7f3470159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 -- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34700b4340 msgr2=0x7f34700b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34700b4340 0x7f34700b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 -- 172.21.15.73:0/2901598344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347013e300 con 0x7f34701457a0 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f34756eb640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f347015a4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f346800c480 tx=0x7f346800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f346d7fa640 1 -- 172.21.15.73:0/2901598344 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468018070 con 0x7f34701457a0 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f346d7fa640 1 -- 172.21.15.73:0/2901598344 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34680074e0 con 0x7f34701457a0 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347013e5e0 con 0x7f34701457a0 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f346d7fa640 1 -- 172.21.15.73:0/2901598344 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468004a30 con 0x7f34701457a0 2024-09-12T03:34:55.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347013eba0 con 0x7f34701457a0 2024-09-12T03:34:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34700b3e00 con 0x7f34701457a0 2024-09-12T03:34:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f346d7fa640 1 -- 172.21.15.73:0/2901598344 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f346801b070 con 0x7f34701457a0 2024-09-12T03:34:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f346d7fa640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34500678c0 0x7f3450069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f346d7fa640 1 -- 172.21.15.73:0/2901598344 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3468085290 con 0x7f34701457a0 2024-09-12T03:34:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f3474eea640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34500678c0 0x7f3450069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.040+0000 7f3474eea640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34500678c0 0x7f3450069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34600af000 tx=0x7f34600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.044+0000 7f346d7fa640 1 -- 172.21.15.73:0/2901598344 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3468055b20 con 0x7f34701457a0 2024-09-12T03:34:55.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34700b65a0 con 0x7f34701457a0 2024-09-12T03:34:55.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f346d7fa640 1 -- 172.21.15.73:0/2901598344 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f3468055420 con 0x7f34701457a0 2024-09-12T03:34:55.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:55.208 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34500678c0 msgr2=0x7f3450069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34500678c0 0x7f3450069d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34600af000 tx=0x7f34600a7000 comp rx=0 tx=0).stop 2024-09-12T03:34:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 msgr2=0x7f347015a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f347015a4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f346800c480 tx=0x7f346800c940 comp rx=0 tx=0).stop 2024-09-12T03:34:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 shutdown_connections 2024-09-12T03:34:55.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34500678c0 0x7f3450069d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34701457a0 0x7f347015a4d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34700cf800 0x7f3470159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 --2- 172.21.15.73:0/2901598344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f34700b4340 0x7f34700b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 >> 172.21.15.73:0/2901598344 conn(0x7f347006bcc0 msgr2=0x7f34700d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 shutdown_connections 2024-09-12T03:34:55.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.204+0000 7f347714e640 1 -- 172.21.15.73:0/2901598344 wait complete. 2024-09-12T03:34:55.226 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T03:34:55.226 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:55.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347e738640 1 Processor -- start 2024-09-12T03:34:55.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347e738640 1 -- start start 2024-09-12T03:34:55.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347e738640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3478070020 0x7f347815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347e738640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f347815f1d0 0x7f34780adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347e738640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34780aede0 con 0x7f34781520a0 2024-09-12T03:34:55.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347e738640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3478152480 con 0x7f3478070020 2024-09-12T03:34:55.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347e738640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f347815fa10 con 0x7f347815f1d0 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f34777fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3478070020 0x7f347815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f3477fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f34781520a0 0x7f347806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59692/0 (socket says 172.21.15.73:59692) 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f3477fff640 1 -- 172.21.15.73:0/2469065599 learned_addr learned my addr 172.21.15.73:0/2469065599 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f34777fe640 1 -- 172.21.15.73:0/2469065599 >> v2:172.21.15.150:3300/0 conn(0x7f347815f1d0 msgr2=0x7f34780adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347ccd5640 1 --2- 172.21.15.73:0/2469065599 >> v2:172.21.15.150:3300/0 conn(0x7f347815f1d0 0x7f34780adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f34777fe640 1 --2- 172.21.15.73:0/2469065599 >> v2:172.21.15.150:3300/0 conn(0x7f347815f1d0 0x7f34780adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f3476ffd640 1 -- 172.21.15.73:0/2469065599 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175017090 0 0) 0x7f34780aede0 con 0x7f34781520a0 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f34777fe640 1 -- 172.21.15.73:0/2469065599 >> v1:172.21.15.73:6789/0 conn(0x7f34781520a0 legacy=0x7f347806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f34777fe640 1 -- 172.21.15.73:0/2469065599 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3478074250 con 0x7f3478070020 2024-09-12T03:34:55.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f347ccd5640 1 --2- 172.21.15.73:0/2469065599 >> v2:172.21.15.150:3300/0 conn(0x7f347815f1d0 0x7f34780adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:55.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f34777fe640 1 --2- 172.21.15.73:0/2469065599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f347815ec90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f34780d0250 tx=0x7f346001eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87bf62ec2d3079b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f3476ffd640 1 -- 172.21.15.73:0/2469065599 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600b4070 con 0x7f3478070020 2024-09-12T03:34:55.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f3476ffd640 1 -- 172.21.15.73:0/2469065599 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34600a7bf0 con 0x7f3478070020 2024-09-12T03:34:55.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.340+0000 7f3476ffd640 1 -- 172.21.15.73:0/2469065599 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600af440 con 0x7f3478070020 2024-09-12T03:34:55.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- 172.21.15.73:0/2469065599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 msgr2=0x7f347815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 --2- 172.21.15.73:0/2469065599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f347815ec90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f34780d0250 tx=0x7f346001eb20 comp rx=0 tx=0).stop 2024-09-12T03:34:55.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- 172.21.15.73:0/2469065599 shutdown_connections 2024-09-12T03:34:55.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 --2- 172.21.15.73:0/2469065599 >> v2:172.21.15.150:3300/0 conn(0x7f347815f1d0 0x7f34780adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 --2- 172.21.15.73:0/2469065599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f347815ec90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- 172.21.15.73:0/2469065599 >> 172.21.15.73:0/2469065599 conn(0x7f34780b1f90 msgr2=0x7f34780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- 172.21.15.73:0/2469065599 shutdown_connections 2024-09-12T03:34:55.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- 172.21.15.73:0/2469065599 wait complete. 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 Processor -- start 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- start start 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f3478145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34781520a0 0x7f347814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f347815f1d0 0x7f3478149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f347815f5e0 con 0x7f3478070020 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3478073d30 con 0x7f347815f1d0 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f347815f760 con 0x7f34781520a0 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f3478145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f3478145780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36880/0 (socket says 172.21.15.73:36880) 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 -- 172.21.15.73:0/4073807607 learned_addr learned my addr 172.21.15.73:0/4073807607 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 -- 172.21.15.73:0/4073807607 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34781520a0 msgr2=0x7f347814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34781520a0 0x7f347814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 -- 172.21.15.73:0/4073807607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f347815f1d0 msgr2=0x7f3478149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f347815f1d0 0x7f3478149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 -- 172.21.15.73:0/4073807607 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347815cc00 con 0x7f3478070020 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3477fff640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f3478145780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f34680011f0 tx=0x7f346800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3474ff9640 1 -- 172.21.15.73:0/4073807607 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468018070 con 0x7f3478070020 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3474ff9640 1 -- 172.21.15.73:0/4073807607 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34680074e0 con 0x7f3478070020 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347815cee0 con 0x7f3478070020 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f3474ff9640 1 -- 172.21.15.73:0/4073807607 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3468004a30 con 0x7f3478070020 2024-09-12T03:34:55.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.344+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347814def0 con 0x7f3478070020 2024-09-12T03:34:55.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.348+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347815ec90 con 0x7f3478070020 2024-09-12T03:34:55.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.348+0000 7f3474ff9640 1 -- 172.21.15.73:0/4073807607 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f346801b070 con 0x7f3478070020 2024-09-12T03:34:55.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.348+0000 7f3474ff9640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34580678c0 0x7f3458069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.348+0000 7f3474ff9640 1 -- 172.21.15.73:0/4073807607 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3468085440 con 0x7f3478070020 2024-09-12T03:34:55.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.348+0000 7f34777fe640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34580678c0 0x7f3458069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.348+0000 7f34777fe640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34580678c0 0x7f3458069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34600b1000 tx=0x7f3460004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.352+0000 7f3474ff9640 1 -- 172.21.15.73:0/4073807607 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3468055ba0 con 0x7f3478070020 2024-09-12T03:34:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.500+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f347806e540 con 0x7f3478070020 2024-09-12T03:34:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.500+0000 7f3474ff9640 1 -- 172.21.15.73:0/4073807607 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f34680554a0 con 0x7f3478070020 2024-09-12T03:34:55.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:55.506 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:55.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34580678c0 msgr2=0x7f3458069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34580678c0 0x7f3458069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34600b1000 tx=0x7f3460004740 comp rx=0 tx=0).stop 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 msgr2=0x7f3478145780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f3478145780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f34680011f0 tx=0x7f346800c9b0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 shutdown_connections 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f34580678c0 0x7f3458069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f347815f1d0 0x7f3478149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34781520a0 0x7f347814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 --2- 172.21.15.73:0/4073807607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3478070020 0x7f3478145780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 >> 172.21.15.73:0/4073807607 conn(0x7f34780b1f90 msgr2=0x7f3478071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 shutdown_connections 2024-09-12T03:34:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.504+0000 7f347e738640 1 -- 172.21.15.73:0/4073807607 wait complete. 2024-09-12T03:34:55.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T03:34:55.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T03:34:55.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T03:34:55.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T03:34:55.526 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T03:34:55.526 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T03:34:55.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T03:34:55.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T03:34:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f3e9bd44640 1 Processor -- start 2024-09-12T03:34:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f3e9bd44640 1 -- start start 2024-09-12T03:34:55.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f8daba40640 1 Processor -- start 2024-09-12T03:34:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f3e9bd44640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3e941408d0 0x7f3e9415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f3e9bd44640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3e94140cb0 0x7f3e940ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f3e9bd44640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e940cf190 con 0x7f3e9413d800 2024-09-12T03:34:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f3e9bd44640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940cfd10 con 0x7f3e941408d0 2024-09-12T03:34:55.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f3e9bd44640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940cf470 con 0x7f3e94140cb0 2024-09-12T03:34:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.696+0000 7f8daba40640 1 -- start start 2024-09-12T03:34:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e9a2e1640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3e9413d800 0x7f3e9413dcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59706/0 (socket says 172.21.15.73:59706) 2024-09-12T03:34:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e9a2e1640 1 -- 172.21.15.73:0/2562560076 learned_addr learned my addr 172.21.15.73:0/2562560076 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e99ae0640 1 --2- 172.21.15.73:0/2562560076 >> v2:172.21.15.73:3300/0 conn(0x7f3e941408d0 0x7f3e9415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e992df640 1 --2- 172.21.15.73:0/2562560076 >> v2:172.21.15.150:3300/0 conn(0x7f3e94140cb0 0x7f3e940ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8daba40640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8da41627a0 0x7f8da40b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8daba40640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da40b3c20 con 0x7f8da406e2a0 2024-09-12T03:34:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8daba40640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8da40b3f00 con 0x7f8da41623c0 2024-09-12T03:34:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8daba40640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8da4071f40 con 0x7f8da41627a0 2024-09-12T03:34:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8da406e2a0 0x7f8da40cd810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59708/0 (socket says 172.21.15.73:59708) 2024-09-12T03:34:55.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 -- 172.21.15.73:0/4048085802 learned_addr learned my addr 172.21.15.73:0/4048085802 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e98ade640 1 -- 172.21.15.73:0/2562560076 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186948969 0 0) 0x7f3e940cf190 con 0x7f3e9413d800 2024-09-12T03:34:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e98ade640 1 -- 172.21.15.73:0/2562560076 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e80003530 con 0x7f3e9413d800 2024-09-12T03:34:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e99ae0640 1 -- 172.21.15.73:0/2562560076 >> v2:172.21.15.150:3300/0 conn(0x7f3e94140cb0 msgr2=0x7f3e940ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e99ae0640 1 --2- 172.21.15.73:0/2562560076 >> v2:172.21.15.150:3300/0 conn(0x7f3e94140cb0 0x7f3e940ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e99ae0640 1 -- 172.21.15.73:0/2562560076 >> v1:172.21.15.73:6789/0 conn(0x7f3e9413d800 legacy=0x7f3e9413dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f3e99ae0640 1 -- 172.21.15.73:0/2562560076 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940cf750 con 0x7f3e941408d0 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da8fdb640 1 --2- 172.21.15.73:0/4048085802 >> v2:172.21.15.150:3300/0 conn(0x7f8da41627a0 0x7f8da40b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807666854 0 0) 0x7f8da40b3c20 con 0x7f8da406e2a0 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d90003530 con 0x7f8da406e2a0 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3351131109 0 0) 0x7f8d90003530 con 0x7f8da406e2a0 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 >> v2:172.21.15.150:3300/0 conn(0x7f8da41627a0 msgr2=0x7f8da40b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 --2- 172.21.15.73:0/4048085802 >> v2:172.21.15.150:3300/0 conn(0x7f8da41627a0 0x7f8da40b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 >> v1:172.21.15.150:6789/0 conn(0x7f8da41623c0 legacy=0x7f8da406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da40b41e0 con 0x7f8da406e2a0 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f8d9c001a00 con 0x7f8da406e2a0 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 >> v1:172.21.15.73:6789/0 conn(0x7f8da406e2a0 legacy=0x7f8da40cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90003a10 0x7f8d90003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d90004810 0x7f8d90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d900051d0 0x7f8d9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d900051d0 0x7f8d9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da97dc640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90003a10 0x7f8d90003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4071f40 con 0x7f8d900051d0 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9000c120 con 0x7f8d90003a10 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9000c320 con 0x7f8d90004810 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da8fdb640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d90004810 0x7f8d90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 -- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d90004810 msgr2=0x7f8d90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d90004810 0x7f8d90004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 -- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90003a10 msgr2=0x7f8d90003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d90003a10 0x7f8d90003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7f8da9fdd640 1 -- 172.21.15.73:0/4048085802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d90003530 con 0x7f8d900051d0 2024-09-12T03:34:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7fa2fb644640 1 Processor -- start 2024-09-12T03:34:55.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.700+0000 7fa2fb644640 1 -- start start 2024-09-12T03:34:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e99ae0640 1 --2- 172.21.15.73:0/2562560076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e941408d0 0x7f3e9415bfc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e940ce460 tx=0x7f3e8401eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381fc0c778d48d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e98ade640 1 -- 172.21.15.73:0/2562560076 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840b4070 con 0x7f3e941408d0 2024-09-12T03:34:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e98ade640 1 -- 172.21.15.73:0/2562560076 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e840a7ab0 con 0x7f3e941408d0 2024-09-12T03:34:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e98ade640 1 -- 172.21.15.73:0/2562560076 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840a7e60 con 0x7f3e941408d0 2024-09-12T03:34:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a64f49640 1 Processor -- start 2024-09-12T03:34:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a64f49640 1 -- start start 2024-09-12T03:34:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31eb59e640 1 Processor -- start 2024-09-12T03:34:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31eb59e640 1 -- start start 2024-09-12T03:34:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2fb644640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2f4163000 0x7fa2f41653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 -- 172.21.15.73:0/2562560076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e941408d0 msgr2=0x7f3e9415bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 --2- 172.21.15.73:0/2562560076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e941408d0 0x7f3e9415bfc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e940ce460 tx=0x7f3e8401eac0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2fb644640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f415dcc0 con 0x7fa2f40cc480 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2f8bdf640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa2f40cc480 0x7fa2f40b3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59714/0 (socket says 172.21.15.73:59714) 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2f8bdf640 1 -- 172.21.15.73:0/4222531857 learned_addr learned my addr 172.21.15.73:0/4222531857 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2f9be1640 1 --2- 172.21.15.73:0/4222531857 >> v2:172.21.15.73:3300/0 conn(0x7fa2f4163000 0x7fa2f41653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 -- 172.21.15.73:0/2562560076 shutdown_connections 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 --2- 172.21.15.73:0/2562560076 >> v2:172.21.15.150:3300/0 conn(0x7f3e94140cb0 0x7f3e940ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 --2- 172.21.15.73:0/2562560076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e941408d0 0x7f3e9415bfc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 -- 172.21.15.73:0/2562560076 >> 172.21.15.73:0/2562560076 conn(0x7f3e9406f420 msgr2=0x7f3e9406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a64f49640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a58005a10 0x7f4a5800ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a64f49640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a580eb220 0x7f4a58036030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a64f49640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5800b120 con 0x7f4a580e6f80 2024-09-12T03:34:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a64f49640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5800b400 con 0x7f4a58005a10 2024-09-12T03:34:55.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a64f49640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5800b6e0 con 0x7f4a580eb220 2024-09-12T03:34:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2fb644640 1 -- 172.21.15.73:0/4222531857 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f40735e0 con 0x7fa2f415d8e0 2024-09-12T03:34:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2fb644640 1 -- 172.21.15.73:0/4222531857 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f406fe20 con 0x7fa2f4163000 2024-09-12T03:34:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a58005a10 0x7f4a5800ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a58005a10 0x7f4a5800ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36898/0 (socket says 172.21.15.73:36898) 2024-09-12T03:34:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5dd9b640 1 -- 172.21.15.73:0/3472134154 learned_addr learned my addr 172.21.15.73:0/3472134154 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5ed9d640 1 --2- 172.21.15.73:0/3472134154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a580eb220 0x7f4a58036030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5dd9b640 1 -- 172.21.15.73:0/3472134154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a580eb220 msgr2=0x7f4a58036030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5dd9b640 1 --2- 172.21.15.73:0/3472134154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a580eb220 0x7f4a58036030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5dd9b640 1 -- 172.21.15.73:0/3472134154 >> v1:172.21.15.73:6789/0 conn(0x7f4a580e6f80 legacy=0x7f4a580eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f4a5dd9b640 1 -- 172.21.15.73:0/3472134154 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5800b9c0 con 0x7f4a58005a10 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2ebfff640 1 -- 172.21.15.73:0/4222531857 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164280214 0 0) 0x7fa2f415dcc0 con 0x7fa2f40cc480 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2ebfff640 1 -- 172.21.15.73:0/4222531857 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e0005740 con 0x7fa2f40cc480 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2ebfff640 1 -- 172.21.15.73:0/4222531857 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2845831108 0 0) 0x7fa2f40735e0 con 0x7fa2f415d8e0 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2ebfff640 1 -- 172.21.15.73:0/4222531857 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f415dcc0 con 0x7fa2f415d8e0 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2f9be1640 1 -- 172.21.15.73:0/4222531857 >> v1:172.21.15.150:6789/0 conn(0x7fa2f415d8e0 legacy=0x7fa2f40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2f9be1640 1 -- 172.21.15.73:0/4222531857 >> v1:172.21.15.73:6789/0 conn(0x7fa2f40cc480 legacy=0x7fa2f40b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7fa2f9be1640 1 -- 172.21.15.73:0/4222531857 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f4073300 con 0x7fa2f4163000 2024-09-12T03:34:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 -- 172.21.15.73:0/2562560076 shutdown_connections 2024-09-12T03:34:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f3e9bd44640 1 -- 172.21.15.73:0/2562560076 wait complete. 2024-09-12T03:34:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 Processor -- start 2024-09-12T03:34:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31eb59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31ec0b4900 0x7f31ec0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31eb59e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec0b43c0 con 0x7f31ec15a070 2024-09-12T03:34:55.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31eb59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f31ec0cf550 con 0x7f31ec0b4900 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31eb59e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec0ce0f0 con 0x7f31ec0cebd0 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31e3fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31e3fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec0cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:46896/0 (socket says 172.21.15.73:46896) 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f31e3fff640 1 -- 172.21.15.73:0/58123720 learned_addr learned my addr 172.21.15.73:0/58123720 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f31e3fff640 1 -- 172.21.15.73:0/58123720 >> v2:172.21.15.73:3300/0 conn(0x7f31ec0b4900 msgr2=0x7f31ec0b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f31e3fff640 1 --2- 172.21.15.73:0/58123720 >> v2:172.21.15.73:3300/0 conn(0x7f31ec0b4900 0x7f31ec0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f31e3fff640 1 -- 172.21.15.73:0/58123720 >> v1:172.21.15.73:6789/0 conn(0x7f31ec15a070 legacy=0x7f31ec071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f31e3fff640 1 -- 172.21.15.73:0/58123720 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec0ce3d0 con 0x7f31ec0cebd0 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3dcb2f640 1 Processor -- start 2024-09-12T03:34:55.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3dcb2f640 1 -- start start 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3dcb2f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe3d80702a0 0x7fe3d80ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3dcb2f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d80b4aa0 con 0x7fe3d80addb0 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3dcb2f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3d80b4d80 con 0x7fe3d8070680 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3dcb2f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d80b5060 con 0x7fe3d80702a0 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe3d8070680 0x7fe3d80b5b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44536/0 (socket says 172.21.15.73:44536) 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 -- 172.21.15.73:0/1922221569 learned_addr learned my addr 172.21.15.73:0/1922221569 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f8da9fdd640 1 -- 172.21.15.73:0/4048085802 reap_dead start 2024-09-12T03:34:55.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f8da9fdd640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d900051d0 0x7f8d9000b9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0059b0 tx=0x7f8d9c01ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737bb70eb0711464 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c0055d0 con 0x7f8d900051d0 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c0ad030 con 0x7f8d900051d0 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.704+0000 7f8d9bfff640 1 -- 172.21.15.73:0/4048085802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c0a9e50 con 0x7f8d900051d0 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 -- 172.21.15.73:0/4048085802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d900051d0 msgr2=0x7f8d9000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d900051d0 0x7f8d9000b9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0059b0 tx=0x7f8d9c01ffd0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 -- 172.21.15.73:0/4048085802 shutdown_connections 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 --2- 172.21.15.73:0/4048085802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d900051d0 0x7f8d9000b9d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 -- 172.21.15.73:0/4048085802 >> 172.21.15.73:0/4048085802 conn(0x7f8da406f420 msgr2=0x7f8da406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 -- 172.21.15.73:0/4048085802 shutdown_connections 2024-09-12T03:34:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 -- 172.21.15.73:0/4048085802 wait complete. 2024-09-12T03:34:55.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505b59e640 1 Processor -- start 2024-09-12T03:34:55.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2f9be1640 1 --2- 172.21.15.73:0/4222531857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f4163000 0x7fa2f41653f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009b10 tx=0x7fa2ec0253a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7805f939c0c787 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505b59e640 1 -- start start 2024-09-12T03:34:55.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 -- start start 2024-09-12T03:34:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3805075724 0 0) 0x7fe3d80b4d80 con 0x7fe3d8070680 2024-09-12T03:34:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b8003530 con 0x7fe3d8070680 2024-09-12T03:34:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2ebfff640 1 -- 172.21.15.73:0/4222531857 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0b9070 con 0x7fa2f4163000 2024-09-12T03:34:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2ebfff640 1 -- 172.21.15.73:0/4222531857 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0b4600 con 0x7fa2f4163000 2024-09-12T03:34:55.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2ebfff640 1 -- 172.21.15.73:0/4222531857 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0b4a10 con 0x7fa2f4163000 2024-09-12T03:34:55.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e9413d800 0x7f3e942034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e941408d0 0x7f3e940b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e99ae0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e9413d800 0x7f3e942034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f4a5dd9b640 1 --2- 172.21.15.73:0/3472134154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a58005a10 0x7f4a5800ab20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009870 tx=0x7f4a5401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de934124b0ea387e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3200618169 0 0) 0x7fe3b8003530 con 0x7fe3d8070680 2024-09-12T03:34:55.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 >> v2:172.21.15.73:3300/0 conn(0x7fe3d80702a0 msgr2=0x7fe3d80ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 --2- 172.21.15.73:0/1922221569 >> v2:172.21.15.73:3300/0 conn(0x7fe3d80702a0 0x7fe3d80ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 >> v1:172.21.15.73:6789/0 conn(0x7fe3d80addb0 legacy=0x7fe3d80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80b5340 con 0x7fe3d8070680 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fe3d0001a00 con 0x7fe3d8070680 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 >> v1:172.21.15.150:6789/0 conn(0x7fe3d8070680 legacy=0x7fe3d80b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80039c0 0x7fe3b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b8004810 0x7fe3b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3b80053d0 0x7fe3b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80b5060 con 0x7fe3b80053d0 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b800c270 con 0x7fe3b80039c0 2024-09-12T03:34:55.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b800c470 con 0x7fe3b8004810 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e94140cb0 0x7f3e940b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9406e730 con 0x7f3e94140cb0 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9406e5b0 con 0x7f3e9413d800 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9bd44640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9406e8b0 con 0x7f3e941408d0 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e992df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e941408d0 0x7f3e940b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e99ae0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e9413d800 0x7f3e942034a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33832/0 (socket says 172.21.15.73:33832) 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e99ae0640 1 -- 172.21.15.73:0/722578644 learned_addr learned my addr 172.21.15.73:0/722578644 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e9a2e1640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e94140cb0 0x7f3e940b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3cffff640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b8004810 0x7fe3b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3b80053d0 0x7fe3b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505b59e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f505c147c10 0x7f505c162790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2fb644640 1 -- 172.21.15.73:0/4222531857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f4163000 msgr2=0x7fa2f41653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2fb644640 1 --2- 172.21.15.73:0/4222531857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f4163000 0x7fa2f41653f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009b10 tx=0x7fa2ec0253a0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505b59e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c06bcc0 0x7f505c06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 Processor -- start 2024-09-12T03:34:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505b59e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c0b6540 con 0x7f505c0b60d0 2024-09-12T03:34:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505b59e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f505c06c670 con 0x7f505c147c10 2024-09-12T03:34:55.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505b59e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f505c147ff0 con 0x7f505c06bcc0 2024-09-12T03:34:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f4a5d59a640 1 -- 172.21.15.73:0/3472134154 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540b1070 con 0x7f4a58005a10 2024-09-12T03:34:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2fb644640 1 -- 172.21.15.73:0/4222531857 shutdown_connections 2024-09-12T03:34:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2fb644640 1 --2- 172.21.15.73:0/4222531857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f4163000 0x7fa2f41653f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fa2fb644640 1 -- 172.21.15.73:0/4222531857 >> 172.21.15.73:0/4222531857 conn(0x7fa2f406c740 msgr2=0x7fa2f40b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e992df640 1 -- 172.21.15.73:0/722578644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e9413d800 msgr2=0x7f3e942034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e992df640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e9413d800 0x7f3e942034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e992df640 1 -- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e94140cb0 msgr2=0x7f3e940b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e992df640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e94140cb0 0x7f3e940b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f3e992df640 1 -- 172.21.15.73:0/722578644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e94075590 con 0x7f3e941408d0 2024-09-12T03:34:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f5059d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f505c0b60d0 0x7f505c0ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59754/0 (socket says 172.21.15.73:59754) 2024-09-12T03:34:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f5059d9b640 1 -- 172.21.15.73:0/3016138557 learned_addr learned my addr 172.21.15.73:0/3016138557 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d659c640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80039c0 0x7fe3b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 -- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b8004810 msgr2=0x7fe3b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b8004810 0x7fe3b8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 -- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80039c0 msgr2=0x7fe3b8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80039c0 0x7fe3b8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d6d9d640 1 -- 172.21.15.73:0/1922221569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80b5340 con 0x7fe3b80053d0 2024-09-12T03:34:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7fe3d659c640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3b80039c0 0x7fe3b8003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f505ad9d640 1 --2- 172.21.15.73:0/3016138557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c06bcc0 0x7f505c06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 -- 172.21.15.73:0/4222531857 shutdown_connections 2024-09-12T03:34:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 -- 172.21.15.73:0/4222531857 wait complete. 2024-09-12T03:34:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f505959a640 1 -- 172.21.15.73:0/3016138557 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346055882 0 0) 0x7f505c0b6540 con 0x7f505c0b60d0 2024-09-12T03:34:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f505959a640 1 -- 172.21.15.73:0/3016138557 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5044003530 con 0x7f505c0b60d0 2024-09-12T03:34:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.708+0000 7f8daba40640 1 -- start start 2024-09-12T03:34:55.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900051d0 0x7f8da40cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8da41f8de0 0x7f8da40ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8da41f9260 0x7f8da40ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8da40b4cc0 con 0x7f8da41f8de0 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8da40b47a0 con 0x7f8da41f9260 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8da40b4e40 con 0x7f8d900051d0 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8da41f8de0 0x7f8da40ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8da41f8de0 0x7f8da40ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36948/0 (socket says 172.21.15.73:36948) 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 -- 172.21.15.73:0/3886075214 learned_addr learned my addr 172.21.15.73:0/3886075214 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 -- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900051d0 msgr2=0x7f8da40cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8d900051d0 0x7f8da40cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 -- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8da41f9260 msgr2=0x7f8da40ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8da41f9260 0x7f8da40ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 -- 172.21.15.73:0/3886075214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da40c9110 con 0x7f8da41f8de0 2024-09-12T03:34:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8da8fdb640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8da41f8de0 0x7f8da40ca1b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d94011960 tx=0x7f8d94011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9400faf0 con 0x7f8da41f8de0 2024-09-12T03:34:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f3e992df640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e941408d0 0x7f3e940b4050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00efc0 tx=0x7f3e8c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c018020 con 0x7f3e941408d0 2024-09-12T03:34:55.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f31e3fff640 1 --2- 172.21.15.73:0/58123720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec0cf010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009870 tx=0x7f31d401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d603ddecd7b1d986 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a5d59a640 1 -- 172.21.15.73:0/3472134154 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a540ac640 con 0x7f4a58005a10 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a5d59a640 1 -- 172.21.15.73:0/3472134154 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a540aca10 con 0x7f4a58005a10 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 -- 172.21.15.73:0/3472134154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a58005a10 msgr2=0x7f4a5800ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 --2- 172.21.15.73:0/3472134154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a58005a10 0x7f4a5800ab20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009870 tx=0x7f4a5401c520 comp rx=0 tx=0).stop 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 -- 172.21.15.73:0/3472134154 shutdown_connections 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 --2- 172.21.15.73:0/3472134154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a580eb220 0x7f4a58036030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 --2- 172.21.15.73:0/3472134154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a58005a10 0x7f4a5800ab20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 -- 172.21.15.73:0/3472134154 >> 172.21.15.73:0/3472134154 conn(0x7f4a5801d940 msgr2=0x7f4a580545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f31e9d9b640 1 -- 172.21.15.73:0/58123720 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40b0070 con 0x7f31ec0cebd0 2024-09-12T03:34:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f31e9d9b640 1 -- 172.21.15.73:0/58123720 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d40ab600 con 0x7f31ec0cebd0 2024-09-12T03:34:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f31e9d9b640 1 -- 172.21.15.73:0/58123720 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d40ab9d0 con 0x7f31ec0cebd0 2024-09-12T03:34:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 -- 172.21.15.73:0/3472134154 shutdown_connections 2024-09-12T03:34:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f4a64f49640 1 -- 172.21.15.73:0/3472134154 wait complete. 2024-09-12T03:34:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 Processor -- start 2024-09-12T03:34:55.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 -- start start 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f40cc480 0x7fa2f41647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f415d8e0 0x7fa2f40b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f4163000 0x7fa2f40b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f40ad200 con 0x7fa2f415d8e0 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f4072ae0 con 0x7fa2f40cc480 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2fb644640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f414f740 con 0x7fa2f4163000 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f3e9bd44640 1 -- 172.21.15.73:0/722578644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9413bc30 con 0x7f3e941408d0 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c014480 con 0x7f3e941408d0 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c014850 con 0x7f3e941408d0 2024-09-12T03:34:55.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f3e9bd44640 1 -- 172.21.15.73:0/722578644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e9413c1f0 con 0x7f3e941408d0 2024-09-12T03:34:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f505ad9d640 1 -- 172.21.15.73:0/3016138557 >> v2:172.21.15.150:3300/0 conn(0x7f505c147c10 msgr2=0x7f505c162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f505ad9d640 1 --2- 172.21.15.73:0/3016138557 >> v2:172.21.15.150:3300/0 conn(0x7f505c147c10 0x7f505c162790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f505ad9d640 1 -- 172.21.15.73:0/3016138557 >> v1:172.21.15.73:6789/0 conn(0x7f505c0b60d0 legacy=0x7f505c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f505ad9d640 1 -- 172.21.15.73:0/3016138557 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0b6800 con 0x7f505c06bcc0 2024-09-12T03:34:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fe3d6d9d640 1 -- 172.21.15.73:0/1922221569 reap_dead start 2024-09-12T03:34:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fe3d6d9d640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3b80053d0 0x7fe3b800b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000a8f0 tx=0x7fe3d001fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be721cd371d00b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000a4c0 con 0x7fe3b80053d0 2024-09-12T03:34:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da40c93f0 con 0x7f8da41f8de0 2024-09-12T03:34:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da40c99b0 con 0x7f8da41f8de0 2024-09-12T03:34:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9400fc90 con 0x7f8da41f8de0 2024-09-12T03:34:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94014440 con 0x7f8da41f8de0 2024-09-12T03:34:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f31eb59e640 1 -- 172.21.15.73:0/58123720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 msgr2=0x7f31ec0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f31eb59e640 1 --2- 172.21.15.73:0/58123720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec0cf010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009870 tx=0x7f31d401c520 comp rx=0 tx=0).stop 2024-09-12T03:34:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2f93e0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f40cc480 0x7fa2f41647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2f93e0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f40cc480 0x7fa2f41647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33874/0 (socket says 172.21.15.73:33874) 2024-09-12T03:34:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2f93e0640 1 -- 172.21.15.73:0/2046975276 learned_addr learned my addr 172.21.15.73:0/2046975276 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fa2f8bdf640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f415d8e0 0x7fa2f40b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d84001040 con 0x7f8da41f8de0 2024-09-12T03:34:55.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e9bd44640 1 -- 172.21.15.73:0/722578644 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e9413b9e0 con 0x7f3e941408d0 2024-09-12T03:34:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2f9be1640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f4163000 0x7fa2f40b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f505ad9d640 1 --2- 172.21.15.73:0/3016138557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c06bcc0 0x7f505c06c130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5054009d90 tx=0x7f505401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00d4b6f91748e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2f93e0640 1 -- 172.21.15.73:0/2046975276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f4163000 msgr2=0x7fa2f40b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2f93e0640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa2f4163000 0x7fa2f40b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2f93e0640 1 -- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f415d8e0 msgr2=0x7fa2f40b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2f93e0640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2f415d8e0 0x7fa2f40b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2f93e0640 1 -- 172.21.15.73:0/2046975276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f414eb30 con 0x7fa2f40cc480 2024-09-12T03:34:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d00ad070 con 0x7fe3b80053d0 2024-09-12T03:34:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.712+0000 7fe3d5d9b640 1 -- 172.21.15.73:0/1922221569 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00a99e0 con 0x7fe3b80053d0 2024-09-12T03:34:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/1922221569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3b80053d0 msgr2=0x7fe3b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3b80053d0 0x7fe3b800b9d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000a8f0 tx=0x7fe3d001fb60 comp rx=0 tx=0).stop 2024-09-12T03:34:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f31eb59e640 1 -- 172.21.15.73:0/58123720 shutdown_connections 2024-09-12T03:34:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f31eb59e640 1 --2- 172.21.15.73:0/58123720 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec0cf010 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f31eb59e640 1 --2- 172.21.15.73:0/58123720 >> v2:172.21.15.73:3300/0 conn(0x7f31ec0b4900 0x7f31ec0b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f31eb59e640 1 -- 172.21.15.73:0/58123720 >> 172.21.15.73:0/58123720 conn(0x7f31ec0b1dd0 msgr2=0x7f31ec0b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2f93e0640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f40cc480 0x7fa2f41647c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c430 tx=0x7fa2f000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/1922221569 shutdown_connections 2024-09-12T03:34:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 --2- 172.21.15.73:0/1922221569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3b80053d0 0x7fe3b800b9d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/1922221569 >> 172.21.15.73:0/1922221569 conn(0x7fe3d80d0f30 msgr2=0x7fe3d80d1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f31eb59e640 1 -- 172.21.15.73:0/58123720 shutdown_connections 2024-09-12T03:34:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/1922221569 shutdown_connections 2024-09-12T03:34:55.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 Processor -- start 2024-09-12T03:34:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d94012040 con 0x7f8da41f8de0 2024-09-12T03:34:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/1922221569 wait complete. 2024-09-12T03:34:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 Processor -- start 2024-09-12T03:34:55.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3e8c01b020 con 0x7f3e941408d0 2024-09-12T03:34:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 -- start start 2024-09-12T03:34:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a58005a10 0x7f4a580e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a580e6f80 0x7f4a580df030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a580eb220 0x7f4a58034010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580f41e0 con 0x7f4a580e6f80 2024-09-12T03:34:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580f4060 con 0x7f4a580eb220 2024-09-12T03:34:55.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a64f49640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4a580f4360 con 0x7f4a58005a10 2024-09-12T03:34:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e8a7fc640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3e780678c0 0x7f3e78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8d99ffb640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8d88067940 0x7f8d88069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e8c087650 con 0x7f3e941408d0 2024-09-12T03:34:55.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5e59c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a58005a10 0x7f4a580e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5e59c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a58005a10 0x7f4a580e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:46952/0 (socket says 172.21.15.73:46952) 2024-09-12T03:34:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5ed9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a580eb220 0x7f4a58034010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5e59c640 1 -- 172.21.15.73:0/2346569431 learned_addr learned my addr 172.21.15.73:0/2346569431 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e8a7fc640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f3e78070fc0 0x7f3e78073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 --> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e78073ad0 con 0x7f3e78070fc0 2024-09-12T03:34:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3e8c087ae0 con 0x7f3e941408d0 2024-09-12T03:34:55.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8da97dc640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8d88067940 0x7f8d88069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f505959a640 1 -- 172.21.15.73:0/3016138557 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50540ad070 con 0x7f505c06bcc0 2024-09-12T03:34:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d94086460 con 0x7f8da41f8de0 2024-09-12T03:34:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f505959a640 1 -- 172.21.15.73:0/3016138557 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50540a9680 con 0x7f505c06bcc0 2024-09-12T03:34:55.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f505959a640 1 -- 172.21.15.73:0/3016138557 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50540a9a90 con 0x7f505c06bcc0 2024-09-12T03:34:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f31eb59e640 1 -- 172.21.15.73:0/58123720 wait complete. 2024-09-12T03:34:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f31eb59e640 1 Processor -- start 2024-09-12T03:34:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8d99ffb640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f8d88071030 0x7f8d88073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 --> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d94025ec0 con 0x7f8d88071030 2024-09-12T03:34:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e99ae0640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3e780678c0 0x7f3e78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e9a2e1640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f3e78070fc0 0x7f3e78073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0011850 con 0x7fa2f40cc480 2024-09-12T03:34:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f414ee10 con 0x7fa2f40cc480 2024-09-12T03:34:55.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- start start 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f0017070 con 0x7fa2f40cc480 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0011bf0 con 0x7fa2f40cc480 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80053d0 0x7fe3d8156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3d8156e10 0x7fe3d80abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d815cbc0 0x7fe3d815d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80ad9f0 con 0x7fe3d8156e10 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d80ad870 con 0x7fe3d815cbc0 2024-09-12T03:34:55.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3dcb2f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d80adb70 con 0x7fe3b80053d0 2024-09-12T03:34:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f414f3d0 con 0x7fa2f40cc480 2024-09-12T03:34:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2f40b35a0 con 0x7fa2f40cc480 2024-09-12T03:34:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8da9fdd640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f8d88071030 0x7f8d88073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d9408d050 con 0x7f8da41f8de0 2024-09-12T03:34:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5ed9d640 1 -- 172.21.15.73:0/2346569431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a58005a10 msgr2=0x7f4a580e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5ed9d640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a58005a10 0x7f4a580e9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5ed9d640 1 -- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a580e6f80 msgr2=0x7f4a580df030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5ed9d640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a580e6f80 0x7f4a580df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f4a5ed9d640 1 -- 172.21.15.73:0/2346569431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a580535b0 con 0x7f4a580eb220 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f4a5ed9d640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a580eb220 0x7f4a58034010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a60051960 tx=0x7f4a600697c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a60099070 con 0x7f4a580eb220 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6006de50 con 0x7f4a580eb220 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a600757f0 con 0x7f4a580eb220 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa2f0005080 con 0x7fa2f40cc480 2024-09-12T03:34:55.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2e9ffb640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa2d80678c0 0x7fa2d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f3e9a2e1640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f3e78070fc0 0x7f3e78073400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f3e99ae0640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3e780678c0 0x7f3e78069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e8401c6f0 tx=0x7f3e840a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31eb59e640 1 -- start start 2024-09-12T03:34:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f505b59e640 1 -- 172.21.15.73:0/3016138557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c06bcc0 msgr2=0x7f505c06c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7f505b59e640 1 --2- 172.21.15.73:0/3016138557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c06bcc0 0x7f505c06c130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5054009d90 tx=0x7f505401c990 comp rx=0 tx=0).stop 2024-09-12T03:34:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- 172.21.15.73:0/3016138557 shutdown_connections 2024-09-12T03:34:55.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 --2- 172.21.15.73:0/3016138557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c06bcc0 0x7f505c06c130 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 --2- 172.21.15.73:0/3016138557 >> v2:172.21.15.150:3300/0 conn(0x7f505c147c10 0x7f505c162790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- 172.21.15.73:0/3016138557 >> 172.21.15.73:0/3016138557 conn(0x7f505c06ed30 msgr2=0x7f505c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- 172.21.15.73:0/3016138557 shutdown_connections 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- 172.21.15.73:0/3016138557 wait complete. 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3d659c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80053d0 0x7fe3d8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3d659c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80053d0 0x7fe3d8156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:46966/0 (socket says 172.21.15.73:46966) 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3d659c640 1 -- 172.21.15.73:0/3046063977 learned_addr learned my addr 172.21.15.73:0/3046063977 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.716+0000 7fe3cffff640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3d8156e10 0x7fe3d80abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3cffff640 1 -- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80053d0 msgr2=0x7fe3d8156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3cffff640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3b80053d0 0x7fe3d8156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3cffff640 1 -- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d815cbc0 msgr2=0x7fe3d815d040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T03:34:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3cffff640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3d815cbc0 0x7fe3d815d040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3cffff640 1 -- 172.21.15.73:0/3046063977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d80ac620 con 0x7fe3d8156e10 2024-09-12T03:34:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3cffff640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3d8156e10 0x7fe3d80abd40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800f5a0 tx=0x7fe3c800fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f8da97dc640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8d88067940 0x7f8d88069e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8da0007fd0 tx=0x7f8da0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0b4900 0x7f31ec163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec1facf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31eb59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ec15a070 0x7f31ec160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31eb59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec15a5d0 con 0x7f31ec15a070 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31eb59e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec15a450 con 0x7f31ec0b4900 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31eb59e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec06fcb0 con 0x7f31ec0cebd0 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== osd.2 v2:172.21.15.73:6800/2107491151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e78073ad0 con 0x7f3e78070fc0 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa2f0086490 con 0x7fa2f40cc480 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2e9ffb640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fa2d8071030 0x7fa2d8073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 --> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2d8073b40 con 0x7fa2d8071030 2024-09-12T03:34:55.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2f0086880 con 0x7fa2f40cc480 2024-09-12T03:34:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ea59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0b4900 0x7f31ec163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f8da9fdd640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f8d88071030 0x7f8d88073470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ea59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0b4900 0x7f31ec163f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33894/0 (socket says 172.21.15.73:33894) 2024-09-12T03:34:55.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80069f0 con 0x7fe3d8156e10 2024-09-12T03:34:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ea59c640 1 -- 172.21.15.73:0/1335134984 learned_addr learned my addr 172.21.15.73:0/1335134984 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ead9d640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ec15a070 0x7f31ec160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31e3fff640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec1facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2f8bdf640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa2d80678c0 0x7fa2d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 Processor -- start 2024-09-12T03:34:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2f9be1640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fa2d8071030 0x7fa2d8073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2f9be1640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fa2d8071030 0x7fa2d8073470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fa2f8bdf640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa2d80678c0 0x7fa2d8069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4007fd0 tx=0x7fa2e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ead9d640 1 -- 172.21.15.73:0/1335134984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 msgr2=0x7f31ec1facf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ead9d640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f31ec0cebd0 0x7f31ec1facf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ead9d640 1 -- 172.21.15.73:0/1335134984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0b4900 msgr2=0x7f31ec163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ead9d640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31ec0b4900 0x7f31ec163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ead9d640 1 -- 172.21.15.73:0/1335134984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec0b30d0 con 0x7f31ec15a070 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f31ead9d640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ec15a070 0x7f31ec160f40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31e400be20 tx=0x7f31e400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- start start 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f505c06bcc0 0x7f505c146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c0b60d0 0x7f505c144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c147c10 0x7f505c1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f505c16ae70 con 0x7f505c0b60d0 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f505c0cf0b0 con 0x7f505c06bcc0 2024-09-12T03:34:55.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505b59e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f505c16aff0 con 0x7f505c147c10 2024-09-12T03:34:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/3046063977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d80ac900 con 0x7fe3d8156e10 2024-09-12T03:34:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/3046063977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d80acec0 con 0x7fe3d8156e10 2024-09-12T03:34:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/3046063977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe3d80b5b20 con 0x7fe3d8156e10 2024-09-12T03:34:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f505c06bcc0 0x7f505c146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a58053890 con 0x7f4a580eb220 2024-09-12T03:34:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a58053e50 con 0x7f4a580eb220 2024-09-12T03:34:55.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a5800ab20 con 0x7f4a580eb220 2024-09-12T03:34:55.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505a59c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f505c06bcc0 0x7f505c146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33902/0 (socket says 172.21.15.73:33902) 2024-09-12T03:34:55.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f505a59c640 1 -- 172.21.15.73:0/3416204900 learned_addr learned my addr 172.21.15.73:0/3416204900 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== osd.1 v2:172.21.15.73:6824/2248843894 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2d8073b40 con 0x7fa2d8071030 2024-09-12T03:34:55.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505ad9d640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c147c10 0x7f505c1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3c8018070 con 0x7fe3d8156e10 2024-09-12T03:34:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8006df0 con 0x7fe3d8156e10 2024-09-12T03:34:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.720+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== osd.7 v2:172.21.15.150:6808/1242295682 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d94025ec0 con 0x7f8d88071030 2024-09-12T03:34:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fa8dcbf2640 1 Processor -- start 2024-09-12T03:34:55.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4019070 con 0x7f31ec15a070 2024-09-12T03:34:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4014440 con 0x7f31ec15a070 2024-09-12T03:34:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4014830 con 0x7f31ec15a070 2024-09-12T03:34:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f5059d9b640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c0b60d0 0x7f505c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f31eb59e640 1 -- 172.21.15.73:0/1335134984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec0b6020 con 0x7f31ec15a070 2024-09-12T03:34:55.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f31eb59e640 1 -- 172.21.15.73:0/1335134984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec1631a0 con 0x7f31ec15a070 2024-09-12T03:34:55.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505a59c640 1 -- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c147c10 msgr2=0x7f505c1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505a59c640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f505c147c10 0x7f505c1449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505a59c640 1 -- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c0b60d0 msgr2=0x7f505c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505a59c640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c0b60d0 0x7f505c144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505a59c640 1 -- 172.21.15.73:0/3416204900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c160020 con 0x7f505c06bcc0 2024-09-12T03:34:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505a59c640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f505c06bcc0 0x7f505c146c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f505000b550 tx=0x7f505000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050014070 con 0x7f505c06bcc0 2024-09-12T03:34:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5050010890 con 0x7f505c06bcc0 2024-09-12T03:34:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505c160300 con 0x7f505c06bcc0 2024-09-12T03:34:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5050010c80 con 0x7f505c06bcc0 2024-09-12T03:34:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505c1608c0 con 0x7f505c06bcc0 2024-09-12T03:34:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3c8007050 con 0x7fe3d8156e10 2024-09-12T03:34:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3ceffd640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3bc067910 0x7fe3bc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe3c8085b10 con 0x7fe3d8156e10 2024-09-12T03:34:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3ceffd640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fe3bc071010 0x7fe3bc073450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 --> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3bc073b20 con 0x7fe3bc071010 2024-09-12T03:34:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3d6d9d640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fe3bc071010 0x7fe3bc073450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a600943f0 con 0x7f4a580eb220 2024-09-12T03:34:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f505c06c130 con 0x7f505c06bcc0 2024-09-12T03:34:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.724+0000 7fe3d6d9d640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fe3bc071010 0x7fe3bc073450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== osd.6 v2:172.21.15.150:6800/4177266046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3bc073b20 con 0x7fe3bc071010 2024-09-12T03:34:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a4effd640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a40067a90 0x7f4a40069f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4a60101b00 con 0x7f4a580eb220 2024-09-12T03:34:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a4effd640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7f4a40071190 0x7f4a400735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 --> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a6006dca0 con 0x7f4a40071190 2024-09-12T03:34:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4a60101ef0 con 0x7f4a580eb220 2024-09-12T03:34:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a5dd9b640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7f4a40071190 0x7f4a400735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5050017070 con 0x7f505c06bcc0 2024-09-12T03:34:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a5e59c640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a40067a90 0x7f4a40069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f504affd640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f503c0678f0 0x7f503c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f50500861f0 con 0x7f505c06bcc0 2024-09-12T03:34:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f5059d9b640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f503c0678f0 0x7f503c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f504affd640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f503c070ff0 0x7f503c073430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 --> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f503c073b00 con 0x7f503c070ff0 2024-09-12T03:34:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7fe3d659c640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3bc067910 0x7fe3bc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5050086680 con 0x7f505c06bcc0 2024-09-12T03:34:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f505ad9d640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f503c070ff0 0x7f503c073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7fe3d659c640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3bc067910 0x7fe3bc069dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000aaf0 tx=0x7fe3c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a5e59c640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a40067a90 0x7f4a40069f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a580324a0 tx=0x7f4a50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f5059d9b640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f503c0678f0 0x7f503c069db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f505c13dfd0 tx=0x7f504c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f4a5dd9b640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7f4a40071190 0x7f4a400735d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.728+0000 7f505ad9d640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f503c070ff0 0x7f503c073430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== osd.0 v2:172.21.15.73:6808/1396670758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a6006dca0 con 0x7f4a40071190 2024-09-12T03:34:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31eb59e640 1 -- 172.21.15.73:0/1335134984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31ec0b3e50 con 0x7f31ec15a070 2024-09-12T03:34:55.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== osd.4 v2:172.21.15.150:6816/2236431337 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f503c073b00 con 0x7f503c070ff0 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8dcbf2640 1 -- start start 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8dcbf2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d809b040 0x7fa8d80b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8dcbf2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d8071460 con 0x7fa8d8071030 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8dcbf2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8d80ccda0 con 0x7fa8d809ac60 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8dcbf2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d8070790 con 0x7fa8d809b040 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d77fe640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa8d809ac60 0x7fa8d80cfcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44548/0 (socket says 172.21.15.73:44548) 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d77fe640 1 -- 172.21.15.73:0/3363361648 learned_addr learned my addr 172.21.15.73:0/3363361648 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:55.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d6ffd640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d809b040 0x7fa8d80b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f31e401c070 con 0x7f31ec15a070 2024-09-12T03:34:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800098797 0 0) 0x7fa8d80ccda0 con 0x7fa8d809ac60 2024-09-12T03:34:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c0003530 con 0x7fa8d809ac60 2024-09-12T03:34:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31e2ffd640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31cc0678c0 0x7f31cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31e40865f0 con 0x7f31ec15a070 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31e2ffd640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f31cc070fb0 0x7f31cc0733f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 --> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31cc073ac0 con 0x7f31cc070fb0 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31e3fff640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f31cc070fb0 0x7f31cc0733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7f31ea59c640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31cc0678c0 0x7f31cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7f31e3fff640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f31cc070fb0 0x7f31cc0733f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 272536357 0 0) 0x7fa8c0003530 con 0x7fa8d809ac60 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d809b040 msgr2=0x7fa8d80b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d809b040 0x7fa8d80b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 >> v1:172.21.15.73:6789/0 conn(0x7fa8d8071030 legacy=0x7fa8d80d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d8070a70 con 0x7fa8d809ac60 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fa8c8001a00 con 0x7fa8d809ac60 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 >> v1:172.21.15.150:6789/0 conn(0x7fa8d809ac60 legacy=0x7fa8d80cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00039c0 0x7fa8c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c0004810 0x7fa8c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8c00099c0 0x7fa8c00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8070790 con 0x7fa8c00099c0 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c0014880 con 0x7fa8c00039c0 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c0014a80 con 0x7fa8c0004810 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d77fe640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00039c0 0x7fa8c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d7fff640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8c00099c0 0x7fa8c00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d77fe640 1 -- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c0004810 msgr2=0x7fa8c0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d77fe640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8c0004810 0x7fa8c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d77fe640 1 -- 172.21.15.73:0/3363361648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8c00099c0 msgr2=0x7fa8c00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fa8d77fe640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8c00099c0 0x7fa8c00051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7fa8d77fe640 1 -- 172.21.15.73:0/3363361648 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c0003530 con 0x7fa8c00039c0 2024-09-12T03:34:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.732+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3c8052030 con 0x7fe3d8156e10 2024-09-12T03:34:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7f31ea59c640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31cc0678c0 0x7f31cc069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0099a0 tx=0x7f31dc0090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f31e4052a30 con 0x7f31ec15a070 2024-09-12T03:34:55.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== osd.3 v2:172.21.15.73:6816/3982759394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31cc073ac0 con 0x7f31cc070fb0 2024-09-12T03:34:55.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7fa8d77fe640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00039c0 0x7fa8c0003dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800a7c0 tx=0x7fa8c801fa40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f36aba82fa4ebeb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800a410 con 0x7fa8c00039c0 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c80aa670 con 0x7fa8c00039c0 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.736+0000 7fa8d67fc640 1 -- 172.21.15.73:0/3363361648 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80aaa60 con 0x7fa8c00039c0 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00039c0 msgr2=0x7fa8c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 --2- 172.21.15.73:0/3363361648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8c00039c0 0x7fa8c0003dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800a7c0 tx=0x7fa8c801fa40 comp rx=0 tx=0).stop 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8d7fff640 1 -- 172.21.15.73:0/3363361648 reap_dead start 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/3363361648 shutdown_connections 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/3363361648 >> 172.21.15.73:0/3363361648 conn(0x7fa8d80b3bd0 msgr2=0x7fa8d80b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/3363361648 shutdown_connections 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/3363361648 wait complete. 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 Processor -- start 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.740+0000 7fa8dcbf2640 1 -- start start 2024-09-12T03:34:55.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8dcbf2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d8200360 0x7fa8d80affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8dcbf2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d81571d0 0x7fa8d80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d8200360 0x7fa8d80affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d8200360 0x7fa8d80affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36988/0 (socket says 172.21.15.73:36988) 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 -- 172.21.15.73:0/2971686563 learned_addr learned my addr 172.21.15.73:0/2971686563 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8dcbf2640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8200740 0x7fa8d806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d8071730 con 0x7fa8d8200360 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d6ffd640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d81571d0 0x7fa8d80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d80cd040 con 0x7fa8d8200740 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d7fff640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8200740 0x7fa8d806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d80718b0 con 0x7fa8d81571d0 2024-09-12T03:34:55.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 --> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2f40b35a0 con 0x7fa2d8071030 2024-09-12T03:34:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fe3dcb2f640 1 -- 172.21.15.73:0/3046063977 --> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe3d80b61b0 con 0x7fe3bc071010 2024-09-12T03:34:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 -- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d81571d0 msgr2=0x7fa8d80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d81571d0 0x7fa8d80b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 -- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8200740 msgr2=0x7fa8d806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8200740 0x7fa8d806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d80b5520 con 0x7fa8d8200360 2024-09-12T03:34:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa2e9ffb640 1 -- 172.21.15.73:0/2046975276 <== osd.1 v2:172.21.15.73:6824/2248843894 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa2f40b35a0 con 0x7fa2d8071030 2024-09-12T03:34:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d77fe640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d8200360 0x7fa8d80affb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80202e0 tx=0x7fa8c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fe3ceffd640 1 -- 172.21.15.73:0/3046063977 <== osd.6 v2:172.21.15.150:6800/4177266046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe3d00ad020 con 0x7fe3bc071010 2024-09-12T03:34:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d6ffd640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa8d81571d0 0x7fa8d80b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80c1070 con 0x7fa8d8200360 2024-09-12T03:34:55.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8d7fff640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8d8200740 0x7fa8d806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.744+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c80aa470 con 0x7fa8d8200360 2024-09-12T03:34:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fa2d8071030 msgr2=0x7fa2d8073470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa2fb644640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fa2d8071030 0x7fa2d8073470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 -- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fe3bc071010 msgr2=0x7fe3bc073450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fe3bc071010 0x7fe3bc073450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 -- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3bc067910 msgr2=0x7fe3bc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3bc067910 0x7fe3bc069dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000aaf0 tx=0x7fe3c0008040 comp rx=0 tx=0).stop 2024-09-12T03:34:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 -- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3d8156e10 msgr2=0x7fe3d80abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 --2- 172.21.15.73:0/3046063977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3d8156e10 0x7fe3d80abd40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800f5a0 tx=0x7fe3c800fa60 comp rx=0 tx=0).stop 2024-09-12T03:34:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3d6d9d640 1 -- 172.21.15.73:0/3046063977 reap_dead start 2024-09-12T03:34:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 -- 172.21.15.73:0/3046063977 shutdown_connections 2024-09-12T03:34:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 -- 172.21.15.73:0/3046063977 >> 172.21.15.73:0/3046063977 conn(0x7fe3d80d0f30 msgr2=0x7fe3d80d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80aaa20 con 0x7fa8d8200360 2024-09-12T03:34:55.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d81544f0 con 0x7fa8d8200360 2024-09-12T03:34:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d80b7750 con 0x7fa8d8200360 2024-09-12T03:34:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8d8204b70 con 0x7fa8d8200360 2024-09-12T03:34:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 -- 172.21.15.73:0/3046063977 shutdown_connections 2024-09-12T03:34:55.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fe3ccff9640 1 -- 172.21.15.73:0/3046063977 wait complete. 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8c80c4070 con 0x7fa8d8200360 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8bffff640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8c4067940 0x7fa8c4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa8c8123980 con 0x7fa8d8200360 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8d6ffd640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8c4067940 0x7fa8c4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8bffff640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7fa8c40710b0 0x7fa8c40734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8c4073bc0 con 0x7fa8c40710b0 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa8c81282a0 con 0x7fa8d8200360 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.748+0000 7fa8d7fff640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7fa8c40710b0 0x7fa8c40734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:55.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa8d6ffd640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8c4067940 0x7fa8c4069e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8d815ada0 tx=0x7fa8cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e9bd44640 1 -- 172.21.15.73:0/722578644 --> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e9413b9e0 con 0x7f3e78070fc0 2024-09-12T03:34:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa2d80678c0 msgr2=0x7fa2d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa2d80678c0 0x7fa2d8069d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4007fd0 tx=0x7fa2e4009040 comp rx=0 tx=0).stop 2024-09-12T03:34:55.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e8a7fc640 1 -- 172.21.15.73:0/722578644 <== osd.2 v2:172.21.15.73:6800/2107491151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e9413b9e0 con 0x7f3e78070fc0 2024-09-12T03:34:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f40cc480 msgr2=0x7fa2f41647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 --2- 172.21.15.73:0/2046975276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2f40cc480 0x7fa2f41647c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000c430 tx=0x7fa2f000c8f0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa8d7fff640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7fa8c40710b0 0x7fa8c40734f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:55.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2f9be1640 1 -- 172.21.15.73:0/2046975276 reap_dead start 2024-09-12T03:34:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 -- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f3e78070fc0 msgr2=0x7f3e78073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f3e78070fc0 0x7f3e78073400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 -- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3e780678c0 msgr2=0x7f3e78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3e780678c0 0x7f3e78069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e8401c6f0 tx=0x7f3e840a9070 comp rx=0 tx=0).stop 2024-09-12T03:34:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 -- 172.21.15.73:0/722578644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e941408d0 msgr2=0x7f3e940b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 --2- 172.21.15.73:0/722578644 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3e941408d0 0x7f3e940b4050 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00efc0 tx=0x7f3e8c00c490 comp rx=0 tx=0).stop 2024-09-12T03:34:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e9a2e1640 1 -- 172.21.15.73:0/722578644 reap_dead start 2024-09-12T03:34:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 shutdown_connections 2024-09-12T03:34:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 >> 172.21.15.73:0/2046975276 conn(0x7fa2f406c740 msgr2=0x7fa2f415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 -- 172.21.15.73:0/722578644 shutdown_connections 2024-09-12T03:34:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 -- 172.21.15.73:0/722578644 >> 172.21.15.73:0/722578644 conn(0x7f3e9406f420 msgr2=0x7f3e94157c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 -- 172.21.15.73:0/722578644 shutdown_connections 2024-09-12T03:34:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 shutdown_connections 2024-09-12T03:34:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7f3e77fff640 1 -- 172.21.15.73:0/722578644 wait complete. 2024-09-12T03:34:55.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa2fb644640 1 -- 172.21.15.73:0/2046975276 wait complete. 2024-09-12T03:34:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.752+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== osd.5 v2:172.21.15.150:6824/260644045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa8c4073bc0 con 0x7fa8c40710b0 2024-09-12T03:34:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 --> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a58031450 con 0x7f4a40071190 2024-09-12T03:34:55.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a4effd640 1 -- 172.21.15.73:0/2346569431 <== osd.0 v2:172.21.15.73:6808/1396670758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4a58031450 con 0x7f4a40071190 2024-09-12T03:34:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7f4a40071190 msgr2=0x7f4a400735d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7f4a40071190 0x7f4a400735d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a40067a90 msgr2=0x7f4a40069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a40067a90 0x7f4a40069f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4a580324a0 tx=0x7f4a50009040 comp rx=0 tx=0).stop 2024-09-12T03:34:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a580eb220 msgr2=0x7f4a58034010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 --2- 172.21.15.73:0/2346569431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a580eb220 0x7f4a58034010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a60051960 tx=0x7f4a600697c0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a5ed9d640 1 -- 172.21.15.73:0/2346569431 reap_dead start 2024-09-12T03:34:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 shutdown_connections 2024-09-12T03:34:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 >> 172.21.15.73:0/2346569431 conn(0x7f4a5801d940 msgr2=0x7f4a580dd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 shutdown_connections 2024-09-12T03:34:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.756+0000 7f4a64f49640 1 -- 172.21.15.73:0/2346569431 wait complete. 2024-09-12T03:34:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 --> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f505c0b19e0 con 0x7f503c070ff0 2024-09-12T03:34:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 --> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d84002de0 con 0x7f8d88071030 2024-09-12T03:34:55.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f504affd640 1 -- 172.21.15.73:0/3416204900 <== osd.4 v2:172.21.15.150:6816/2236431337 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f505c0b19e0 con 0x7f503c070ff0 2024-09-12T03:34:55.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8d99ffb640 1 -- 172.21.15.73:0/3886075214 <== osd.7 v2:172.21.15.150:6808/1242295682 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8d84002de0 con 0x7f8d88071030 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f8d88071030 msgr2=0x7f8d88073470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f8d88071030 0x7f8d88073470 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8d88067940 msgr2=0x7f8d88069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8d88067940 0x7f8d88069e00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8da0007fd0 tx=0x7f8da0009040 comp rx=0 tx=0).stop 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8da41f8de0 msgr2=0x7f8da40ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 --2- 172.21.15.73:0/3886075214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8da41f8de0 0x7f8da40ca1b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d94011960 tx=0x7f8d94011e20 comp rx=0 tx=0).stop 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8da9fdd640 1 -- 172.21.15.73:0/3886075214 reap_dead start 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 shutdown_connections 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 >> 172.21.15.73:0/3886075214 conn(0x7f8da406f420 msgr2=0x7f8da4160320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 shutdown_connections 2024-09-12T03:34:55.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.760+0000 7f8daba40640 1 -- 172.21.15.73:0/3886075214 wait complete. 2024-09-12T03:34:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f503c070ff0 msgr2=0x7f503c073430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f503c070ff0 0x7f503c073430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f503c0678f0 msgr2=0x7f503c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f503c0678f0 0x7f503c069db0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f505c13dfd0 tx=0x7f504c007d40 comp rx=0 tx=0).stop 2024-09-12T03:34:55.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f505c06bcc0 msgr2=0x7f505c146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 --2- 172.21.15.73:0/3416204900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f505c06bcc0 0x7f505c146c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f505000b550 tx=0x7f505000ba10 comp rx=0 tx=0).stop 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505ad9d640 1 -- 172.21.15.73:0/3416204900 reap_dead start 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 shutdown_connections 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 >> 172.21.15.73:0/3416204900 conn(0x7f505c06ed30 msgr2=0x7f505c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 shutdown_connections 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f505b59e640 1 -- 172.21.15.73:0/3416204900 wait complete. 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.764+0000 7f31eb59e640 1 -- 172.21.15.73:0/1335134984 --> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31ec1577a0 con 0x7f31cc070fb0 2024-09-12T03:34:55.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e2ffd640 1 -- 172.21.15.73:0/1335134984 <== osd.3 v2:172.21.15.73:6816/3982759394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f31ec1577a0 con 0x7f31cc070fb0 2024-09-12T03:34:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 -- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f31cc070fb0 msgr2=0x7f31cc0733f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f31cc070fb0 0x7f31cc0733f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 -- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31cc0678c0 msgr2=0x7f31cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31cc0678c0 0x7f31cc069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f31dc0099a0 tx=0x7f31dc0090e0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 -- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ec15a070 msgr2=0x7f31ec160f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 --2- 172.21.15.73:0/1335134984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31ec15a070 0x7f31ec160f40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f31e400be20 tx=0x7f31e400bf10 comp rx=0 tx=0).stop 2024-09-12T03:34:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31ead9d640 1 -- 172.21.15.73:0/1335134984 reap_dead start 2024-09-12T03:34:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 -- 172.21.15.73:0/1335134984 shutdown_connections 2024-09-12T03:34:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 -- 172.21.15.73:0/1335134984 >> 172.21.15.73:0/1335134984 conn(0x7f31ec0b1dd0 msgr2=0x7f31ec15c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 -- 172.21.15.73:0/1335134984 shutdown_connections 2024-09-12T03:34:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.776+0000 7f31e0ff9640 1 -- 172.21.15.73:0/1335134984 wait complete. 2024-09-12T03:34:55.806 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-09-12T03:34:55.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T03:34:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 --> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa8d80b5160 con 0x7fa8c40710b0 2024-09-12T03:34:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8bffff640 1 -- 172.21.15.73:0/2971686563 <== osd.5 v2:172.21.15.150:6824/260644045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa8d80b5160 con 0x7fa8c40710b0 2024-09-12T03:34:55.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7fa8c40710b0 msgr2=0x7fa8c40734f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7fa8c40710b0 0x7fa8c40734f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8c4067940 msgr2=0x7fa8c4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8c4067940 0x7fa8c4069e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa8d815ada0 tx=0x7fa8cc008040 comp rx=0 tx=0).stop 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d8200360 msgr2=0x7fa8d80affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 --2- 172.21.15.73:0/2971686563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8d8200360 0x7fa8d80affb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80202e0 tx=0x7fa8c0005840 comp rx=0 tx=0).stop 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8d7fff640 1 -- 172.21.15.73:0/2971686563 reap_dead start 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 shutdown_connections 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 >> 172.21.15.73:0/2971686563 conn(0x7fa8d80b3bd0 msgr2=0x7fa8d80cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 shutdown_connections 2024-09-12T03:34:55.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:55.780+0000 7fa8dcbf2640 1 -- 172.21.15.73:0/2971686563 wait complete. 2024-09-12T03:34:55.809 INFO:teuthology.orchestra.run.smithi073.stdout:64424509449 2024-09-12T03:34:55.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T03:34:55.810 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-09-12T03:34:55.810 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T03:34:55.811 INFO:teuthology.orchestra.run.smithi073.stdout:55834574856 2024-09-12T03:34:55.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T03:34:55.812 INFO:teuthology.orchestra.run.smithi073.stdout:64424509450 2024-09-12T03:34:55.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T03:34:55.813 INFO:teuthology.orchestra.run.smithi073.stdout:64424509449 2024-09-12T03:34:55.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T03:34:55.814 INFO:teuthology.orchestra.run.smithi073.stdout:64424509450 2024-09-12T03:34:55.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T03:34:55.815 INFO:teuthology.orchestra.run.smithi073.stdout:64424509450 2024-09-12T03:34:55.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T03:34:56.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f1a068db640 1 Processor -- start 2024-09-12T03:34:56.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f13414e9640 1 Processor -- start 2024-09-12T03:34:56.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f58bd13c640 1 Processor -- start 2024-09-12T03:34:56.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f58bd13c640 1 -- start start 2024-09-12T03:34:56.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f13414e9640 1 -- start start 2024-09-12T03:34:56.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7facad9e0640 1 Processor -- start 2024-09-12T03:34:56.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7facad9e0640 1 -- start start 2024-09-12T03:34:56.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f1a068db640 1 -- start start 2024-09-12T03:34:56.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f7208301640 1 Processor -- start 2024-09-12T03:34:56.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f7208301640 1 -- start start 2024-09-12T03:34:56.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.016+0000 7f60d15fa640 1 Processor -- start 2024-09-12T03:34:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 Processor -- start 2024-09-12T03:34:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60d15fa640 1 -- start start 2024-09-12T03:34:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 -- start start 2024-09-12T03:34:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13414e9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f133c15f870 0x7f133c070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13414e9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133c0b4730 con 0x7f133c09aa00 2024-09-12T03:34:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13414e9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133c070850 con 0x7f133c09b5a0 2024-09-12T03:34:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13414e9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f133c0b4a10 con 0x7f133c15f870 2024-09-12T03:34:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1a068db640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a0015b290 0x7f1a00072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1a068db640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a000b4c80 con 0x7f1a0015aeb0 2024-09-12T03:34:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1a068db640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a000b4f50 con 0x7f1a00073210 2024-09-12T03:34:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1a068db640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1a00073680 con 0x7f1a0015b290 2024-09-12T03:34:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7facad9e0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faca80b5200 0x7faca80b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7facad9e0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7facad9e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faca8073540 con 0x7faca8145a00 2024-09-12T03:34:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7facad9e0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7faca80b5bb0 con 0x7faca80b5200 2024-09-12T03:34:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32205f640 1 Processor -- start 2024-09-12T03:34:56.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7facad9e0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faca8073820 con 0x7faca815cfc0 2024-09-12T03:34:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58bd13c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58b80b5200 0x7f58b80b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58bd13c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b8073540 con 0x7f58b8145a00 2024-09-12T03:34:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58bd13c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b8073820 con 0x7f58b815cfc0 2024-09-12T03:34:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58bd13c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f58b80b5bb0 con 0x7f58b80b5200 2024-09-12T03:34:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7faca7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faca80b5200 0x7faca80b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f7208301640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7200144e70 0x7f720006c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7faca7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faca80b5200 0x7faca80b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37006/0 (socket says 172.21.15.73:37006) 2024-09-12T03:34:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7faca7fff640 1 -- 172.21.15.73:0/3572406271 learned_addr learned my addr 172.21.15.73:0/3572406271 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f7208301640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72000b3170 con 0x7f720006e2a0 2024-09-12T03:34:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f7208301640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72000b3450 con 0x7f7200145250 2024-09-12T03:34:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f7208301640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7200145ba0 con 0x7f7200144e70 2024-09-12T03:34:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60d15fa640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60c4036740 0x7f60c4006f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f19ff7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a0015b290 0x7f1a00072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1a04e78640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1a00073210 0x7f1a000cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44586/0 (socket says 172.21.15.73:44586) 2024-09-12T03:34:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f19ff7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a0015b290 0x7f1a00072cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36994/0 (socket says 172.21.15.73:36994) 2024-09-12T03:34:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1a04e78640 1 -- 172.21.15.73:0/573290648 learned_addr learned my addr 172.21.15.73:0/573290648 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:56.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7facad1df640 1 --2- 172.21.15.73:0/3572406271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540b27f0 0x7f5554072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5554072db0 0x7f55540b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5554072880 0x7f55540b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f555415b1a0 con 0x7f5554072880 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f555415b480 con 0x7f5554072db0 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555b283640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5554071e20 con 0x7f55540b27f0 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1340ce8640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f133c09b5a0 0x7f133c0cff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44562/0 (socket says 172.21.15.73:44562) 2024-09-12T03:34:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1340ce8640 1 -- 172.21.15.73:0/1979136939 learned_addr learned my addr 172.21.15.73:0/1979136939 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60d15fa640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c4033c50 con 0x7f60c4033870 2024-09-12T03:34:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60d15fa640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60c4039820 con 0x7f60c4039260 2024-09-12T03:34:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f720589c640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f7200145250 0x7f720006db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44594/0 (socket says 172.21.15.73:44594) 2024-09-12T03:34:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f720589c640 1 -- 172.21.15.73:0/3395093603 learned_addr learned my addr 172.21.15.73:0/3395093603 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60d15fa640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f60c40554b0 con 0x7f60c4036740 2024-09-12T03:34:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133bfff640 1 --2- 172.21.15.73:0/1979136939 >> v2:172.21.15.73:3300/0 conn(0x7f133c15f870 0x7f133c070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58bc93b640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f58b815cfc0 0x7f58b815d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44578/0 (socket says 172.21.15.73:44578) 2024-09-12T03:34:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58bc93b640 1 -- 172.21.15.73:0/4052632926 learned_addr learned my addr 172.21.15.73:0/4052632926 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32205f640 1 -- start start 2024-09-12T03:34:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555901f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540b27f0 0x7f5554072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555881e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5554072db0 0x7f55540b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60cb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60c4036740 0x7f60c4006f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60cb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f60c4036740 0x7f60c4006f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37024/0 (socket says 172.21.15.73:37024) 2024-09-12T03:34:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60cb7fe640 1 -- 172.21.15.73:0/3396950937 learned_addr learned my addr 172.21.15.73:0/3396950937 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555881e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5554072db0 0x7f55540b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33916/0 (socket says 172.21.15.73:33916) 2024-09-12T03:34:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555881e640 1 -- 172.21.15.73:0/2576539290 learned_addr learned my addr 172.21.15.73:0/2576539290 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f5559820640 1 --2- 172.21.15.73:0/2576539290 >> v2:172.21.15.73:3300/0 conn(0x7f5554072880 0x7f55540b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f19ff7fe640 1 -- 172.21.15.73:0/573290648 >> v1:172.21.15.150:6789/0 conn(0x7f1a00073210 legacy=0x7f1a000cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f19ff7fe640 1 -- 172.21.15.73:0/573290648 >> v1:172.21.15.73:6789/0 conn(0x7f1a0015aeb0 legacy=0x7f1a000b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f19ff7fe640 1 -- 172.21.15.73:0/573290648 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a00161b20 con 0x7f1a0015b290 2024-09-12T03:34:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891872640 0 0) 0x7f133c070850 con 0x7f133c09b5a0 2024-09-12T03:34:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1328003530 con 0x7f133c09b5a0 2024-09-12T03:34:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32205f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c0b3b90 0x7ff31c0b5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32205f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff31c06ffc0 0x7ff31c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32205f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff31c0b4600 con 0x7ff31c0b5390 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32205f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff31c073e10 con 0x7ff31c06ffc0 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32205f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c0b4040 con 0x7ff31c0b3b90 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 887962270 0 0) 0x7f1328003530 con 0x7f133c09b5a0 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 >> v2:172.21.15.73:3300/0 conn(0x7f133c15f870 msgr2=0x7f133c070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 --2- 172.21.15.73:0/1979136939 >> v2:172.21.15.73:3300/0 conn(0x7f133c15f870 0x7f133c070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 >> v1:172.21.15.73:6789/0 conn(0x7f133c09aa00 legacy=0x7f133c09ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c070b30 con 0x7f133c09b5a0 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f1334001a00 con 0x7f133c09b5a0 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 >> v1:172.21.15.150:6789/0 conn(0x7f133c09b5a0 legacy=0x7f133c0cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1328003a10 0x7f1328003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1328004810 0x7f1328004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13280053d0 0x7f132800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f133c0b4a10 con 0x7f13280053d0 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f132800c2b0 con 0x7f1328003a10 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f132800c4b0 con 0x7f1328004810 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7faca7fff640 1 -- 172.21.15.73:0/3572406271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 msgr2=0x7faca815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7faca7fff640 1 --2- 172.21.15.73:0/3572406271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7faca7fff640 1 -- 172.21.15.73:0/3572406271 >> v1:172.21.15.73:6789/0 conn(0x7faca8145a00 legacy=0x7faca8072ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7faca7fff640 1 -- 172.21.15.73:0/3572406271 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca815c7c0 con 0x7faca80b5200 2024-09-12T03:34:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243072472 0 0) 0x7f72000b3450 con 0x7f7200145250 2024-09-12T03:34:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71f0003530 con 0x7f7200145250 2024-09-12T03:34:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555901f640 1 -- 172.21.15.73:0/2576539290 >> v2:172.21.15.150:3300/0 conn(0x7f5554072db0 msgr2=0x7f55540b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32085c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c0b3b90 0x7ff31c0b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32085c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c0b3b90 0x7ff31c0b5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:47058/0 (socket says 172.21.15.73:47058) 2024-09-12T03:34:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555901f640 1 --2- 172.21.15.73:0/2576539290 >> v2:172.21.15.150:3300/0 conn(0x7f5554072db0 0x7f55540b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32085c640 1 -- 172.21.15.73:0/3959978779 learned_addr learned my addr 172.21.15.73:0/3959978779 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555901f640 1 -- 172.21.15.73:0/2576539290 >> v2:172.21.15.73:3300/0 conn(0x7f5554072880 msgr2=0x7f55540b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13337fe640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1328004810 0x7f1328004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555901f640 1 --2- 172.21.15.73:0/2576539290 >> v2:172.21.15.73:3300/0 conn(0x7f5554072880 0x7f55540b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60cb7fe640 1 -- 172.21.15.73:0/3396950937 >> v1:172.21.15.150:6789/0 conn(0x7f60c4039260 legacy=0x7f60c40de200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60cb7fe640 1 -- 172.21.15.73:0/3396950937 >> v1:172.21.15.73:6789/0 conn(0x7f60c4033870 legacy=0x7f60c4036030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f60cb7fe640 1 -- 172.21.15.73:0/3396950937 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c4039b00 con 0x7f60c4036740 2024-09-12T03:34:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555901f640 1 -- 172.21.15.73:0/2576539290 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555406f020 con 0x7f55540b27f0 2024-09-12T03:34:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f555881e640 1 --2- 172.21.15.73:0/2576539290 >> v2:172.21.15.150:3300/0 conn(0x7f5554072db0 0x7f55540b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791818119 0 0) 0x7f58b8073820 con 0x7f58b815cfc0 2024-09-12T03:34:56.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58a0003530 con 0x7f58b815cfc0 2024-09-12T03:34:56.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32185e640 1 --2- 172.21.15.73:0/3959978779 >> v2:172.21.15.150:3300/0 conn(0x7ff31c06ffc0 0x7ff31c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1358531173 0 0) 0x7f58a0003530 con 0x7f58b815cfc0 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 >> v2:172.21.15.73:3300/0 conn(0x7f58b80b5200 msgr2=0x7f58b80b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/4052632926 >> v2:172.21.15.73:3300/0 conn(0x7f58b80b5200 0x7f58b80b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 >> v1:172.21.15.73:6789/0 conn(0x7f58b8145a00 legacy=0x7f58b8072ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b815c7c0 con 0x7f58b815cfc0 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f58a8001680 con 0x7f58b815cfc0 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 >> v1:172.21.15.150:6789/0 conn(0x7f58b815cfc0 legacy=0x7f58b815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00039c0 0x7f58a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a0004810 0x7f58a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58a00052f0 0x7f58a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f58b80b5bb0 con 0x7f58a0004810 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f58a000c1f0 con 0x7f58a00039c0 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f58a000c3f0 con 0x7f58a00052f0 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58a00052f0 0x7f58a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58b7fff640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00039c0 0x7f58a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 -- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00039c0 msgr2=0x7f58a0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00039c0 0x7f58a0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 -- 172.21.15.73:0/4052632926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a0004810 msgr2=0x7f58a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a0004810 0x7f58a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 -- 172.21.15.73:0/4052632926 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b815c7c0 con 0x7f58a00052f0 2024-09-12T03:34:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13337fe640 1 -- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1328003a10 msgr2=0x7f1328003e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:34:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13337fe640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1328003a10 0x7f1328003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13337fe640 1 -- 172.21.15.73:0/1979136939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13280053d0 msgr2=0x7f132800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13337fe640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13280053d0 0x7f132800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f1340ce8640 1 -- 172.21.15.73:0/1979136939 reap_dead start 2024-09-12T03:34:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7f13337fe640 1 -- 172.21.15.73:0/1979136939 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1328003530 con 0x7f1328004810 2024-09-12T03:34:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f60cb7fe640 1 --2- 172.21.15.73:0/3396950937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 0x7f60c4006f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60b8008870 tx=0x7f60b801ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4822139ac9e30abf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 513020446 0 0) 0x7f71f0003530 con 0x7f7200145250 2024-09-12T03:34:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 >> v2:172.21.15.73:3300/0 conn(0x7f7200144e70 msgr2=0x7f720006c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 --2- 172.21.15.73:0/3395093603 >> v2:172.21.15.73:3300/0 conn(0x7f7200144e70 0x7f720006c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 >> v1:172.21.15.73:6789/0 conn(0x7f720006e2a0 legacy=0x7f72000b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72000b3730 con 0x7f7200145250 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f71f4001a00 con 0x7f7200145250 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 >> v1:172.21.15.150:6789/0 conn(0x7f7200145250 legacy=0x7f720006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003a10 0x7f71f0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f71f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f00053d0 0x7f71f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f71f000c210 con 0x7f71f00053d0 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f71f000c3c0 con 0x7f71f0003a10 2024-09-12T03:34:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f71f000c5c0 con 0x7f71f0004810 2024-09-12T03:34:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f13337fe640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1328004810 0x7f1328004c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f13280057b0 tx=0x7f132401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20b382534fcf41b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720609d640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003a10 0x7f71f0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720589c640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f71f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32085c640 1 -- 172.21.15.73:0/3959978779 >> v2:172.21.15.150:3300/0 conn(0x7ff31c06ffc0 msgr2=0x7ff31c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32085c640 1 --2- 172.21.15.73:0/3959978779 >> v2:172.21.15.150:3300/0 conn(0x7ff31c06ffc0 0x7ff31c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32085c640 1 -- 172.21.15.73:0/3959978779 >> v1:172.21.15.73:6789/0 conn(0x7ff31c0b5390 legacy=0x7ff31c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.020+0000 7ff32085c640 1 -- 172.21.15.73:0/3959978779 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c0b4320 con 0x7ff31c0b3b90 2024-09-12T03:34:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f19ff7fe640 1 --2- 172.21.15.73:0/573290648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015b290 0x7f1a00072cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009740 tx=0x7f19f001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb77956a422b470 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f60caffd640 1 -- 172.21.15.73:0/3396950937 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b80ad070 con 0x7f60c4036740 2024-09-12T03:34:56.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f60caffd640 1 -- 172.21.15.73:0/3396950937 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b80a7a10 con 0x7f60c4036740 2024-09-12T03:34:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720589c640 1 -- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003a10 msgr2=0x7f71f0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f60caffd640 1 -- 172.21.15.73:0/3396950937 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b80a7de0 con 0x7f60c4036740 2024-09-12T03:34:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13240013a0 con 0x7f1328004810 2024-09-12T03:34:56.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f555901f640 1 --2- 172.21.15.73:0/2576539290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540b27f0 0x7f5554072340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f555406fc90 tx=0x7f554401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9d8e2d4f502786 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 -- 172.21.15.73:0/4052632926 reap_dead start 2024-09-12T03:34:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7faca7fff640 1 --2- 172.21.15.73:0/3572406271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 0x7faca80b5670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac94009870 tx=0x7fac9401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76059d1c7d06c10b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7faca77fe640 1 -- 172.21.15.73:0/3572406271 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac940a7070 con 0x7faca80b5200 2024-09-12T03:34:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7faca77fe640 1 -- 172.21.15.73:0/3572406271 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac940b0070 con 0x7faca80b5200 2024-09-12T03:34:56.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7faca77fe640 1 -- 172.21.15.73:0/3572406271 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac940ab690 con 0x7faca80b5200 2024-09-12T03:34:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f554bfff640 1 -- 172.21.15.73:0/2576539290 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440b5070 con 0x7f55540b27f0 2024-09-12T03:34:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f58bc93b640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58a00052f0 0x7f58a000b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c260 tx=0x7f58a801f470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb915ff37c231aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f554bfff640 1 -- 172.21.15.73:0/2576539290 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55440a8930 con 0x7f55540b27f0 2024-09-12T03:34:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13240052f0 con 0x7f1328004810 2024-09-12T03:34:56.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f133b7fe640 1 -- 172.21.15.73:0/1979136939 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324003840 con 0x7f1328004810 2024-09-12T03:34:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f19feffd640 1 -- 172.21.15.73:0/573290648 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f00b0070 con 0x7f1a0015b290 2024-09-12T03:34:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f19feffd640 1 -- 172.21.15.73:0/573290648 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f00ab600 con 0x7f1a0015b290 2024-09-12T03:34:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f19feffd640 1 -- 172.21.15.73:0/573290648 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f00ab9d0 con 0x7f1a0015b290 2024-09-12T03:34:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 -- 172.21.15.73:0/573290648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015b290 msgr2=0x7f1a00072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 --2- 172.21.15.73:0/573290648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015b290 0x7f1a00072cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009740 tx=0x7f19f001c210 comp rx=0 tx=0).stop 2024-09-12T03:34:56.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 -- 172.21.15.73:0/3396950937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 msgr2=0x7f60c4006f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 --2- 172.21.15.73:0/3396950937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 0x7f60c4006f50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60b8008870 tx=0x7f60b801ea30 comp rx=0 tx=0).stop 2024-09-12T03:34:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 -- 172.21.15.73:0/573290648 shutdown_connections 2024-09-12T03:34:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 --2- 172.21.15.73:0/573290648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015b290 0x7f1a00072cd0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009740 tx=0x7f19f001c210 comp rx=0 tx=0).stop 2024-09-12T03:34:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 -- 172.21.15.73:0/573290648 >> 172.21.15.73:0/573290648 conn(0x7f1a0006cdd0 msgr2=0x7f1a0006d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 -- 172.21.15.73:0/573290648 shutdown_connections 2024-09-12T03:34:56.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32085c640 1 --2- 172.21.15.73:0/3959978779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c0b3b90 0x7ff31c0b5770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff314009e50 tx=0x7ff31401f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a591ae516adc5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 -- 172.21.15.73:0/573290648 wait complete. 2024-09-12T03:34:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 -- 172.21.15.73:0/3396950937 shutdown_connections 2024-09-12T03:34:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 -- 172.21.15.73:0/2576539290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540b27f0 msgr2=0x7f5554072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 --2- 172.21.15.73:0/2576539290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540b27f0 0x7f5554072340 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f555406fc90 tx=0x7f554401ec70 comp rx=0 tx=0).stop 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 --2- 172.21.15.73:0/3396950937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 0x7f60c4006f50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 -- 172.21.15.73:0/3572406271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 msgr2=0x7faca80b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 --2- 172.21.15.73:0/3572406271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 0x7faca80b5670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac94009870 tx=0x7fac9401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 -- 172.21.15.73:0/3572406271 shutdown_connections 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 --2- 172.21.15.73:0/3572406271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 --2- 172.21.15.73:0/3572406271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 0x7faca80b5670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 -- 172.21.15.73:0/3572406271 >> 172.21.15.73:0/3572406271 conn(0x7faca80b1bf0 msgr2=0x7faca80b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 -- 172.21.15.73:0/3572406271 shutdown_connections 2024-09-12T03:34:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 -- 172.21.15.73:0/3396950937 >> 172.21.15.73:0/3396950937 conn(0x7f60c401d940 msgr2=0x7f60c40545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f13414e9640 1 -- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1328004810 msgr2=0x7f1328004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f13414e9640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1328004810 0x7f1328004c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f13280057b0 tx=0x7f132401c370 comp rx=0 tx=0).stop 2024-09-12T03:34:56.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 -- 172.21.15.73:0/3572406271 wait complete. 2024-09-12T03:34:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8007d60 con 0x7f58a00052f0 2024-09-12T03:34:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a8005b00 con 0x7f58a00052f0 2024-09-12T03:34:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58b6ffd640 1 -- 172.21.15.73:0/4052632926 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8007070 con 0x7f58a00052f0 2024-09-12T03:34:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 -- 172.21.15.73:0/3396950937 shutdown_connections 2024-09-12T03:34:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f13414e9640 1 -- 172.21.15.73:0/1979136939 shutdown_connections 2024-09-12T03:34:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f13414e9640 1 --2- 172.21.15.73:0/1979136939 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1328004810 0x7f1328004c90 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f13280057b0 tx=0x7f132401c370 comp rx=0 tx=0).stop 2024-09-12T03:34:56.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f13414e9640 1 -- 172.21.15.73:0/1979136939 >> 172.21.15.73:0/1979136939 conn(0x7f133c0b3ae0 msgr2=0x7f133c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 -- 172.21.15.73:0/3396950937 wait complete. 2024-09-12T03:34:56.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 -- 172.21.15.73:0/2576539290 shutdown_connections 2024-09-12T03:34:56.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 --2- 172.21.15.73:0/2576539290 >> v2:172.21.15.73:3300/0 conn(0x7f5554072880 0x7f55540b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 --2- 172.21.15.73:0/2576539290 >> v2:172.21.15.150:3300/0 conn(0x7f5554072db0 0x7f55540b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 --2- 172.21.15.73:0/2576539290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f55540b27f0 0x7f5554072340 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 -- 172.21.15.73:0/2576539290 >> 172.21.15.73:0/2576539290 conn(0x7f55540b1cd0 msgr2=0x7f55540b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58bd13c640 1 -- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58a00052f0 msgr2=0x7f58a000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58bd13c640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58a00052f0 0x7f58a000b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c260 tx=0x7f58a801f470 comp rx=0 tx=0).stop 2024-09-12T03:34:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f13414e9640 1 -- 172.21.15.73:0/1979136939 shutdown_connections 2024-09-12T03:34:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f13414e9640 1 -- 172.21.15.73:0/1979136939 wait complete. 2024-09-12T03:34:56.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 Processor -- start 2024-09-12T03:34:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 Processor -- start 2024-09-12T03:34:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720589c640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003a10 0x7f71f0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720589c640 1 -- 172.21.15.73:0/3395093603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f00053d0 msgr2=0x7f71f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720589c640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f00053d0 0x7f71f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720589c640 1 -- 172.21.15.73:0/3395093603 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0003530 con 0x7f71f0004810 2024-09-12T03:34:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.024+0000 7f720609d640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f71f0003a10 0x7f71f0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:34:56.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f720689e640 1 -- 172.21.15.73:0/3395093603 reap_dead start 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58bd13c640 1 -- 172.21.15.73:0/4052632926 shutdown_connections 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58bd13c640 1 --2- 172.21.15.73:0/4052632926 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58a00052f0 0x7f58a000b9d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58bd13c640 1 -- 172.21.15.73:0/4052632926 >> 172.21.15.73:0/4052632926 conn(0x7f58b80b1bf0 msgr2=0x7f58b80b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff313fff640 1 -- 172.21.15.73:0/3959978779 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3140b4070 con 0x7ff31c0b3b90 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff313fff640 1 -- 172.21.15.73:0/3959978779 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3140af400 con 0x7ff31c0b3b90 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 -- 172.21.15.73:0/3959978779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c0b3b90 msgr2=0x7ff31c0b5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 --2- 172.21.15.73:0/3959978779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c0b3b90 0x7ff31c0b5770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff314009e50 tx=0x7ff31401f1e0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 -- 172.21.15.73:0/3959978779 shutdown_connections 2024-09-12T03:34:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 --2- 172.21.15.73:0/3959978779 >> v2:172.21.15.150:3300/0 conn(0x7ff31c06ffc0 0x7ff31c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 --2- 172.21.15.73:0/3959978779 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c0b3b90 0x7ff31c0b5770 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff314009e50 tx=0x7ff31401f1e0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 -- 172.21.15.73:0/3959978779 >> 172.21.15.73:0/3959978779 conn(0x7ff31c06d960 msgr2=0x7ff31c06dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 -- 172.21.15.73:0/2576539290 shutdown_connections 2024-09-12T03:34:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 -- 172.21.15.73:0/2576539290 wait complete. 2024-09-12T03:34:56.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58bd13c640 1 -- 172.21.15.73:0/4052632926 shutdown_connections 2024-09-12T03:34:56.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f720589c640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f71f0004c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71f400ebd0 tx=0x7f71f40215d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a82c0abd29c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f58bd13c640 1 -- 172.21.15.73:0/4052632926 wait complete. 2024-09-12T03:34:56.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 -- start start 2024-09-12T03:34:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f400e870 con 0x7f71f0004810 2024-09-12T03:34:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f40b2070 con 0x7f71f0004810 2024-09-12T03:34:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f720509b640 1 -- 172.21.15.73:0/3395093603 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f40ad6a0 con 0x7f71f0004810 2024-09-12T03:34:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 Processor -- start 2024-09-12T03:34:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 Processor -- start 2024-09-12T03:34:56.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 -- start start 2024-09-12T03:34:56.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a00073210 0x7f1a001442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015aeb0 0x7f1a00151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f1a068db640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a00151e90 0x7f1a00148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7facad9e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 0x7faca8139f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca8145a00 0x7faca8138740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca8138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 Processor -- start 2024-09-12T03:34:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 Processor -- start 2024-09-12T03:34:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a068db640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00073b40 con 0x7f1a0015aeb0 2024-09-12T03:34:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a068db640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1a000739c0 con 0x7f1a00151e90 2024-09-12T03:34:56.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a068db640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0016c150 con 0x7f1a00073210 2024-09-12T03:34:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 -- 172.21.15.73:0/3959978779 shutdown_connections 2024-09-12T03:34:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7ff32205f640 1 -- 172.21.15.73:0/3959978779 wait complete. 2024-09-12T03:34:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7faca7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca8145a00 0x7faca8138740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7faca7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca8145a00 0x7faca8138740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33974/0 (socket says 172.21.15.73:33974) 2024-09-12T03:34:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7faca7fff640 1 -- 172.21.15.73:0/260435936 learned_addr learned my addr 172.21.15.73:0/260435936 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faca8166ab0 con 0x7faca80b5200 2024-09-12T03:34:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad1df640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca8138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faca8071dc0 con 0x7faca8145a00 2024-09-12T03:34:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faca8166c30 con 0x7faca815cfc0 2024-09-12T03:34:56.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 Processor -- start 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f60d15fa640 1 -- start start 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d15fa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60c4033870 0x7f60c40d7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d15fa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 0x7f60c4048050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d15fa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c4039260 0x7f60c404c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d15fa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f60c40ec8c0 con 0x7f60c4036740 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d15fa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f60c40ec740 con 0x7f60c4033870 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d15fa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f60c40eca40 con 0x7f60c4039260 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f7208301640 1 -- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 msgr2=0x7f71f0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f7208301640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f71f0004c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71f400ebd0 tx=0x7f71f40215d0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.028+0000 7f555b283640 1 -- start start 2024-09-12T03:34:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555b283640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554072880 0x7f555414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555b283640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5554072db0 0x7f55541fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555b283640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55540b27f0 0x7f55541fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555b283640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f555406f790 con 0x7f55540b27f0 2024-09-12T03:34:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555b283640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f555406f610 con 0x7f5554072880 2024-09-12T03:34:56.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555b283640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f555406f910 con 0x7f5554072db0 2024-09-12T03:34:56.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a04e78640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a00151e90 0x7f1a00148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f19fffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a00073210 0x7f1a001442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f19fffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a00073210 0x7f1a001442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:47102/0 (socket says 172.21.15.73:47102) 2024-09-12T03:34:56.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f19fffff640 1 -- 172.21.15.73:0/2084283631 learned_addr learned my addr 172.21.15.73:0/2084283631 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 -- start start 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00052f0 0x7f58b81f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58b81f7a30 0x7f58b813a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58b813aee0 0x7f58b815e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f58b8071dc0 con 0x7f58b813aee0 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f58b815c4b0 con 0x7f58a00052f0 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58bd13c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f58b80b5670 con 0x7f58b81f7a30 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad1df640 1 -- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca8145a00 msgr2=0x7faca8138740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad1df640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca8145a00 0x7faca8138740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c4039260 0x7f60c404c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad1df640 1 -- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 msgr2=0x7faca8139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad1df640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 0x7faca8139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad1df640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca813f0a0 con 0x7faca815cfc0 2024-09-12T03:34:56.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c4039260 0x7f60c404c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:47114/0 (socket says 172.21.15.73:47114) 2024-09-12T03:34:56.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 -- 172.21.15.73:0/2074016209 learned_addr learned my addr 172.21.15.73:0/2074016209 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 -- start start 2024-09-12T03:34:56.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c06ffc0 0x7ff31c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c0b5390 0x7ff31c0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31c200c40 0x7ff31c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c154540 con 0x7ff31c0b5390 2024-09-12T03:34:56.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c071fd0 con 0x7ff31c200c40 2024-09-12T03:34:56.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32205f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c1546c0 con 0x7ff31c06ffc0 2024-09-12T03:34:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad1df640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca8138c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faca000eba0 tx=0x7faca000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60cbfff640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60c4033870 0x7f60c40d7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 -- start start 2024-09-12T03:34:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f133c2018d0 0x7f133c204fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f133c0c7990 0x7f133c0c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f133c0c6060 0x7f133c207ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f133c160780 con 0x7f133c2018d0 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f133c160600 con 0x7f133c0c6060 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13414e9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f133c160900 con 0x7f133c0c7990 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a04e78640 1 -- 172.21.15.73:0/2084283631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a00073210 msgr2=0x7f1a001442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a04e78640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a00073210 0x7f1a001442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a04e78640 1 -- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015aeb0 msgr2=0x7f1a00151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a04e78640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015aeb0 0x7f1a00151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a04e78640 1 -- 172.21.15.73:0/2084283631 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a00144830 con 0x7f1a00151e90 2024-09-12T03:34:56.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7faca57fa640 1 -- 172.21.15.73:0/260435936 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca0018020 con 0x7faca815cfc0 2024-09-12T03:34:56.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f7208301640 1 -- 172.21.15.73:0/3395093603 shutdown_connections 2024-09-12T03:34:56.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f7208301640 1 --2- 172.21.15.73:0/3395093603 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f71f0004c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f7208301640 1 -- 172.21.15.73:0/3395093603 >> 172.21.15.73:0/3395093603 conn(0x7f720006f420 msgr2=0x7f720006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00052f0 0x7f58b81f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554072880 0x7f555414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7faca57fa640 1 -- 172.21.15.73:0/260435936 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca000cd20 con 0x7faca815cfc0 2024-09-12T03:34:56.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c06ffc0 0x7ff31c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555881e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5554072db0 0x7f55541fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca813f380 con 0x7faca815cfc0 2024-09-12T03:34:56.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7faca57fa640 1 -- 172.21.15.73:0/260435936 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca00146c0 con 0x7faca815cfc0 2024-09-12T03:34:56.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554072880 0x7f555414b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33988/0 (socket says 172.21.15.73:33988) 2024-09-12T03:34:56.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 -- 172.21.15.73:0/743439224 learned_addr learned my addr 172.21.15.73:0/743439224 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f7208301640 1 -- 172.21.15.73:0/3395093603 shutdown_connections 2024-09-12T03:34:56.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c06ffc0 0x7ff31c14ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:47126/0 (socket says 172.21.15.73:47126) 2024-09-12T03:34:56.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 -- 172.21.15.73:0/363714995 learned_addr learned my addr 172.21.15.73:0/363714995 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faca813f940 con 0x7faca815cfc0 2024-09-12T03:34:56.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f7208301640 1 -- 172.21.15.73:0/3395093603 wait complete. 2024-09-12T03:34:56.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00052f0 0x7f58b81f74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33992/0 (socket says 172.21.15.73:33992) 2024-09-12T03:34:56.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 -- 172.21.15.73:0/450876524 learned_addr learned my addr 172.21.15.73:0/450876524 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b77fe640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58b81f7a30 0x7f58b813a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32185e640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31c200c40 0x7ff31c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a04e78640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a00151e90 0x7f1a00148500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c530 tx=0x7f19f400c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 -- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58b81f7a30 msgr2=0x7f58b813a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58b81f7a30 0x7f58b813a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 -- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58b813aee0 msgr2=0x7f58b815e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58b813aee0 0x7f58b815e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 -- 172.21.15.73:0/450876524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b8142c00 con 0x7f58a00052f0 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 -- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60c4033870 msgr2=0x7f60c40d7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60c4033870 0x7f60c40d7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 -- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 msgr2=0x7f60c4048050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 0x7f60c4048050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 -- 172.21.15.73:0/2074016209 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c40d98e0 con 0x7f60c4039260 2024-09-12T03:34:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca80b5670 con 0x7faca815cfc0 2024-09-12T03:34:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f60d0df9640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c4039260 0x7f60c404c210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60cc02dd60 tx=0x7f60cc0697c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f19fcff9640 1 -- 172.21.15.73:0/2084283631 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4018070 con 0x7f1a00151e90 2024-09-12T03:34:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f19fcff9640 1 -- 172.21.15.73:0/2084283631 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f4007500 con 0x7f1a00151e90 2024-09-12T03:34:56.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f19fcff9640 1 -- 172.21.15.73:0/2084283631 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4004a30 con 0x7f1a00151e90 2024-09-12T03:34:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 -- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31c200c40 msgr2=0x7ff31c15bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31c200c40 0x7ff31c15bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 -- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c0b5390 msgr2=0x7ff31c0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c0b5390 0x7ff31c0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7ff32105d640 1 -- 172.21.15.73:0/363714995 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c0cf790 con 0x7ff31c06ffc0 2024-09-12T03:34:56.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a068db640 1 -- 172.21.15.73:0/2084283631 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a00154b40 con 0x7f1a00151e90 2024-09-12T03:34:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 -- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5554072db0 msgr2=0x7f55541fbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5554072db0 0x7f55541fbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 -- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55540b27f0 msgr2=0x7f55541fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55540b27f0 0x7f55541fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f555901f640 1 -- 172.21.15.73:0/743439224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55540ac0f0 con 0x7f5554072880 2024-09-12T03:34:56.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1a068db640 1 -- 172.21.15.73:0/2084283631 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a001550c0 con 0x7f1a00151e90 2024-09-12T03:34:56.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 Processor -- start 2024-09-12T03:34:56.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f58b7fff640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00052f0 0x7f58b81f74f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58b000f900 tx=0x7f58b000fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7ff32105d640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c06ffc0 0x7ff31c14ffb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff31800b3e0 tx=0x7ff31800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f60c8ff9640 1 -- 172.21.15.73:0/2074016209 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc0741c0 con 0x7f60c4039260 2024-09-12T03:34:56.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13337fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f133c0c7990 0x7f133c0c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1340ce8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f133c0c6060 0x7f133c207ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1340ce8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f133c0c6060 0x7f133c207ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:34020/0 (socket says 172.21.15.73:34020) 2024-09-12T03:34:56.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f1340ce8640 1 -- 172.21.15.73:0/2564891891 learned_addr learned my addr 172.21.15.73:0/2564891891 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.032+0000 7f13337fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f133c0c7990 0x7f133c0c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:47136/0 (socket says 172.21.15.73:47136) 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c40d9bc0 con 0x7f60c4039260 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c404e270 con 0x7f60c4039260 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f1340ce8640 1 -- 172.21.15.73:0/2564891891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f133c0c7990 msgr2=0x7f133c0c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f1340ce8640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f133c0c7990 0x7f133c0c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f1340ce8640 1 -- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f133c2018d0 msgr2=0x7f133c204fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f1340ce8640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f133c2018d0 0x7f133c204fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f1340ce8640 1 -- 172.21.15.73:0/2564891891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c0c8210 con 0x7f133c0c6060 2024-09-12T03:34:56.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f1340ce8640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f133c0c6060 0x7f133c207ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f133c0c5620 tx=0x7f133400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f555881e640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5554072db0 0x7f55541fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:56.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f1a068db640 1 -- 172.21.15.73:0/2084283631 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e00052a0 con 0x7f1a00151e90 2024-09-12T03:34:56.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 -- start start 2024-09-12T03:34:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f555901f640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554072880 0x7f555414b140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f554401f510 tx=0x7f554401ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f7200142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7200141a90 0x7f720015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f720013f8d0 0x7f720013fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f720006c750 con 0x7f7200141a90 2024-09-12T03:34:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f72000b3d80 con 0x7f720013f8d0 2024-09-12T03:34:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f7208301640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f720006c8d0 con 0x7f71f0004810 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f58b4ff9640 1 -- 172.21.15.73:0/450876524 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0018020 con 0x7f58a00052f0 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f58b4ff9640 1 -- 172.21.15.73:0/450876524 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b000da00 con 0x7f58a00052f0 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f58b4ff9640 1 -- 172.21.15.73:0/450876524 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b000ddf0 con 0x7f58a00052f0 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b813b460 con 0x7f58a00052f0 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b813ba20 con 0x7f58a00052f0 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f13397fa640 1 -- 172.21.15.73:0/2564891891 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133400a640 con 0x7f133c0c6060 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f13397fa640 1 -- 172.21.15.73:0/2564891891 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133400a7e0 con 0x7f133c0c6060 2024-09-12T03:34:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f13397fa640 1 -- 172.21.15.73:0/2564891891 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133400abd0 con 0x7f133c0c6060 2024-09-12T03:34:56.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c4006f50 con 0x7f60c4039260 2024-09-12T03:34:56.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c0c84f0 con 0x7f133c0c6060 2024-09-12T03:34:56.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c0c8ab0 con 0x7f133c0c6060 2024-09-12T03:34:56.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7faca57fa640 1 -- 172.21.15.73:0/260435936 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faca001b020 con 0x7faca815cfc0 2024-09-12T03:34:56.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720609d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f7200142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720609d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f7200142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:47146/0 (socket says 172.21.15.73:47146) 2024-09-12T03:34:56.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720609d640 1 -- 172.21.15.73:0/1476236253 learned_addr learned my addr 172.21.15.73:0/1476236253 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720689e640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f720013f8d0 0x7f720013fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7faca57fa640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fac8c0678c0 0x7fac8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7faca57fa640 1 -- 172.21.15.73:0/260435936 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faca00870e0 con 0x7faca815cfc0 2024-09-12T03:34:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7facac9de640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fac8c0678c0 0x7fac8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720689e640 1 -- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 msgr2=0x7f7200142690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720689e640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f7200142690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720689e640 1 -- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7200141a90 msgr2=0x7f720015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720689e640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7200141a90 0x7f720015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f720689e640 1 -- 172.21.15.73:0/1476236253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7200142d90 con 0x7f720013f8d0 2024-09-12T03:34:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f19fcff9640 1 -- 172.21.15.73:0/2084283631 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f19f401b360 con 0x7f1a00151e90 2024-09-12T03:34:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f19fcff9640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f19ec0678c0 0x7f19ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f19fcff9640 1 -- 172.21.15.73:0/2084283631 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f19f4085580 con 0x7f1a00151e90 2024-09-12T03:34:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f19fffff640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f19ec0678c0 0x7f19ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f5549ffb640 1 -- 172.21.15.73:0/743439224 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440b5070 con 0x7f5554072880 2024-09-12T03:34:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f5549ffb640 1 -- 172.21.15.73:0/743439224 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55440bf070 con 0x7f5554072880 2024-09-12T03:34:56.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f5549ffb640 1 -- 172.21.15.73:0/743439224 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440b0e20 con 0x7f5554072880 2024-09-12T03:34:56.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55540ac3d0 con 0x7f5554072880 2024-09-12T03:34:56.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55540ac990 con 0x7f5554072880 2024-09-12T03:34:56.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133c070850 con 0x7f133c0c6060 2024-09-12T03:34:56.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.036+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b8072ac0 con 0x7f58a00052f0 2024-09-12T03:34:56.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.040+0000 7f720689e640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f720013f8d0 0x7f720013fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72000740c0 tx=0x7f71f800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.040+0000 7facac9de640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fac8c0678c0 0x7fac8c069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac9c007fd0 tx=0x7fac9c0079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.040+0000 7f19fffff640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f19ec0678c0 0x7f19ec069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19f8007fd0 tx=0x7f19f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.040+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5554072340 con 0x7f5554072880 2024-09-12T03:34:56.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.048+0000 7f60c8ff9640 1 -- 172.21.15.73:0/2074016209 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60cc06de50 con 0x7f60c4039260 2024-09-12T03:34:56.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.048+0000 7f60c8ff9640 1 -- 172.21.15.73:0/2074016209 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60cc098020 con 0x7f60c4039260 2024-09-12T03:34:56.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.048+0000 7ff311ffb640 1 -- 172.21.15.73:0/363714995 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318015020 con 0x7ff31c06ffc0 2024-09-12T03:34:56.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.048+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31c0cfa70 con 0x7ff31c06ffc0 2024-09-12T03:34:56.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.048+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31c15e3e0 con 0x7ff31c06ffc0 2024-09-12T03:34:56.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.048+0000 7faca57fa640 1 -- 172.21.15.73:0/260435936 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faca0022030 con 0x7faca815cfc0 2024-09-12T03:34:56.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7ff311ffb640 1 -- 172.21.15.73:0/363714995 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff318011830 con 0x7ff31c06ffc0 2024-09-12T03:34:56.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7ff311ffb640 1 -- 172.21.15.73:0/363714995 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318011c20 con 0x7ff31c06ffc0 2024-09-12T03:34:56.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f19fcff9640 1 -- 172.21.15.73:0/2084283631 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1a00144830 con 0x7f1a00151e90 2024-09-12T03:34:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f71feffd640 1 -- 172.21.15.73:0/1476236253 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f8017070 con 0x7f720013f8d0 2024-09-12T03:34:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7200143070 con 0x7f720013f8d0 2024-09-12T03:34:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7200143630 con 0x7f720013f8d0 2024-09-12T03:34:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc0052a0 con 0x7ff31c06ffc0 2024-09-12T03:34:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f60c8ff9640 1 -- 172.21.15.73:0/2074016209 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60cc093400 con 0x7f60c4039260 2024-09-12T03:34:56.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f60c8ff9640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60b00678c0 0x7f60b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f60c8ff9640 1 -- 172.21.15.73:0/2074016209 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f60cc1017e0 con 0x7f60c4039260 2024-09-12T03:34:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f60cbfff640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60b00678c0 0x7f60b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720006db90 con 0x7f720013f8d0 2024-09-12T03:34:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f71feffd640 1 -- 172.21.15.73:0/1476236253 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f80072d0 con 0x7f720013f8d0 2024-09-12T03:34:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f71feffd640 1 -- 172.21.15.73:0/1476236253 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec009460 con 0x7f720013f8d0 2024-09-12T03:34:56.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f60cbfff640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60b00678c0 0x7f60b0069d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f60c40ea700 tx=0x7f60c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7ff311ffb640 1 -- 172.21.15.73:0/363714995 <== mon.2 v2:172.21.15.150:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff318018020 con 0x7ff31c06ffc0 2024-09-12T03:34:56.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f13397fa640 1 -- 172.21.15.73:0/2564891891 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1334007110 con 0x7f133c0c6060 2024-09-12T03:34:56.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f13397fa640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f131c0678f0 0x7f131c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f13397fa640 1 -- 172.21.15.73:0/2564891891 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1334085e40 con 0x7f133c0c6060 2024-09-12T03:34:56.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f133bfff640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f131c0678f0 0x7f131c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f58b4ff9640 1 -- 172.21.15.73:0/450876524 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58b001b020 con 0x7f58a00052f0 2024-09-12T03:34:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7ff311ffb640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3000678c0 0x7ff300069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7ff32085c640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3000678c0 0x7ff300069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f58b4ff9640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58a4067940 0x7f58a4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7ff32085c640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3000678c0 0x7ff300069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3140b1000 tx=0x7ff314004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.052+0000 7f5549ffb640 1 -- 172.21.15.73:0/743439224 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55440a8ae0 con 0x7f5554072880 2024-09-12T03:34:56.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f5549ffb640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5538067910 0x7f5538069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f5549ffb640 1 -- 172.21.15.73:0/743439224 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f55441243e0 con 0x7f5554072880 2024-09-12T03:34:56.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f555881e640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5538067910 0x7f5538069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f555881e640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5538067910 0x7f5538069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55540cf5a0 tx=0x7f5550008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f58b4ff9640 1 -- 172.21.15.73:0/450876524 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f58b0086c00 con 0x7f58a00052f0 2024-09-12T03:34:56.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f58b77fe640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58a4067940 0x7f58a4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f133bfff640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f131c0678f0 0x7f131c069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f133c06a610 tx=0x7f132c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.056+0000 7f58b77fe640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58a4067940 0x7f58a4069e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58b80cf140 tx=0x7f58ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.064+0000 7ff311ffb640 1 -- 172.21.15.73:0/363714995 <== mon.2 v2:172.21.15.150:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff318054550 con 0x7ff31c06ffc0 2024-09-12T03:34:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.064+0000 7f60c8ff9640 1 -- 172.21.15.73:0/2074016209 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f60cc0a2080 con 0x7f60c4039260 2024-09-12T03:34:56.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.068+0000 7f13397fa640 1 -- 172.21.15.73:0/2564891891 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f133401a020 con 0x7f133c0c6060 2024-09-12T03:34:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.072+0000 7f71feffd640 1 -- 172.21.15.73:0/1476236253 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f71f801a070 con 0x7f720013f8d0 2024-09-12T03:34:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.072+0000 7f71feffd640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f71e40678c0 0x7f71e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.072+0000 7f720609d640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f71e40678c0 0x7f71e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.072+0000 7f720609d640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f71e40678c0 0x7f71e4069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71ec004710 tx=0x7f71ec009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.076+0000 7ff311ffb640 1 -- 172.21.15.73:0/363714995 <== mon.2 v2:172.21.15.150:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff31801f020 con 0x7ff31c06ffc0 2024-09-12T03:34:56.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.080+0000 7f5549ffb640 1 -- 172.21.15.73:0/743439224 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55440187d0 con 0x7f5554072880 2024-09-12T03:34:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.092+0000 7f71feffd640 1 -- 172.21.15.73:0/1476236253 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f71f80533e0 con 0x7f720013f8d0 2024-09-12T03:34:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.092+0000 7f58b4ff9640 1 -- 172.21.15.73:0/450876524 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f58b0022020 con 0x7f58a00052f0 2024-09-12T03:34:56.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.104+0000 7f71feffd640 1 -- 172.21.15.73:0/1476236253 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f71f8022020 con 0x7f720013f8d0 2024-09-12T03:34:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.332+0000 7f1a068db640 1 -- 172.21.15.73:0/2084283631 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f19e0005860 con 0x7f1a00151e90 2024-09-12T03:34:56.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.332+0000 7f19fcff9640 1 -- 172.21.15.73:0/2084283631 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19f4055710 con 0x7f1a00151e90 2024-09-12T03:34:56.338 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2024-09-12T03:34:56.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 -- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f19ec0678c0 msgr2=0x7f19ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f19ec0678c0 0x7f19ec069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f19f8007fd0 tx=0x7f19f8009040 comp rx=0 tx=0).stop 2024-09-12T03:34:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 -- 172.21.15.73:0/2084283631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a00151e90 msgr2=0x7f1a00148500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a00151e90 0x7f1a00148500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c530 tx=0x7f19f400c9f0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 -- 172.21.15.73:0/2084283631 shutdown_connections 2024-09-12T03:34:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f19ec0678c0 0x7f19ec069d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0015aeb0 0x7f1a00151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a00151e90 0x7f1a00148500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 --2- 172.21.15.73:0/2084283631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1a00073210 0x7f1a001442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 -- 172.21.15.73:0/2084283631 >> 172.21.15.73:0/2084283631 conn(0x7f1a0006cdd0 msgr2=0x7f1a00159630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 -- 172.21.15.73:0/2084283631 shutdown_connections 2024-09-12T03:34:56.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.340+0000 7f19e67fc640 1 -- 172.21.15.73:0/2084283631 wait complete. 2024-09-12T03:34:56.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-12T03:34:56.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.364+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faca80729f0 con 0x7faca815cfc0 2024-09-12T03:34:56.368 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.364+0000 7faca57fa640 1 -- 172.21.15.73:0/260435936 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faca0010040 con 0x7faca815cfc0 2024-09-12T03:34:56.369 INFO:teuthology.orchestra.run.smithi073.stdout:55834574856 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fac8c0678c0 msgr2=0x7fac8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fac8c0678c0 0x7fac8c069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac9c007fd0 tx=0x7fac9c0079a0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 msgr2=0x7faca8138c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca8138c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faca000eba0 tx=0x7faca000c490 comp rx=0 tx=0).stop 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 shutdown_connections 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fac8c0678c0 0x7fac8c069d80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faca815cfc0 0x7faca8138c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faca8145a00 0x7faca8138740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 --2- 172.21.15.73:0/260435936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faca80b5200 0x7faca8139f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 >> 172.21.15.73:0/260435936 conn(0x7faca80b1bf0 msgr2=0x7faca806d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 shutdown_connections 2024-09-12T03:34:56.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.368+0000 7facad9e0640 1 -- 172.21.15.73:0/260435936 wait complete. 2024-09-12T03:34:56.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.384+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f133c09b9a0 con 0x7f133c0c6060 2024-09-12T03:34:56.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.384+0000 7f13397fa640 1 -- 172.21.15.73:0/2564891891 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f13340565a0 con 0x7f133c0c6060 2024-09-12T03:34:56.389 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-09-12T03:34:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f131c0678f0 msgr2=0x7f131c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f131c0678f0 0x7f131c069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f133c06a610 tx=0x7f132c008040 comp rx=0 tx=0).stop 2024-09-12T03:34:56.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f133c0c6060 msgr2=0x7f133c207ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f133c0c6060 0x7f133c207ab0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f133c0c5620 tx=0x7f133400cc60 comp rx=0 tx=0).stop 2024-09-12T03:34:56.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-09-12T03:34:56.397 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 shutdown_connections 2024-09-12T03:34:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f131c0678f0 0x7f131c069db0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f133c0c6060 0x7f133c207ab0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f133c0c7990 0x7f133c0c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 --2- 172.21.15.73:0/2564891891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f133c2018d0 0x7f133c204fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 >> 172.21.15.73:0/2564891891 conn(0x7f133c0b3ae0 msgr2=0x7f133c0b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 shutdown_connections 2024-09-12T03:34:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f13414e9640 1 -- 172.21.15.73:0/2564891891 wait complete. 2024-09-12T03:34:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.388+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f60c4033030 con 0x7f60c4039260 2024-09-12T03:34:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60c8ff9640 1 -- 172.21.15.73:0/2074016209 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f60cc08f030 con 0x7f60c4039260 2024-09-12T03:34:56.400 INFO:teuthology.orchestra.run.smithi073.stdout:64424509449 2024-09-12T03:34:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60b00678c0 msgr2=0x7f60b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60b00678c0 0x7f60b0069d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f60c40ea700 tx=0x7f60c0009040 comp rx=0 tx=0).stop 2024-09-12T03:34:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c4039260 msgr2=0x7f60c404c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c4039260 0x7f60c404c210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60cc02dd60 tx=0x7f60cc0697c0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 shutdown_connections 2024-09-12T03:34:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60b00678c0 0x7f60b0069d80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60c4036740 0x7f60c4048050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60c4039260 0x7f60c404c210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 --2- 172.21.15.73:0/2074016209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60c4033870 0x7f60c40d7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 >> 172.21.15.73:0/2074016209 conn(0x7f60c401d940 msgr2=0x7f60c40de030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 shutdown_connections 2024-09-12T03:34:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.392+0000 7f60d15fa640 1 -- 172.21.15.73:0/2074016209 wait complete. 2024-09-12T03:34:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.396+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f55540b1330 con 0x7f5554072880 2024-09-12T03:34:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.396+0000 7f5549ffb640 1 -- 172.21.15.73:0/743439224 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f55440f4ce0 con 0x7f5554072880 2024-09-12T03:34:56.404 INFO:teuthology.orchestra.run.smithi073.stdout:64424509450 2024-09-12T03:34:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff2fc005860 con 0x7ff31c06ffc0 2024-09-12T03:34:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5538067910 msgr2=0x7f5538069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5538067910 0x7f5538069dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f55540cf5a0 tx=0x7f5550008040 comp rx=0 tx=0).stop 2024-09-12T03:34:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554072880 msgr2=0x7f555414b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554072880 0x7f555414b140 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f554401f510 tx=0x7f554401ba10 comp rx=0 tx=0).stop 2024-09-12T03:34:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 shutdown_connections 2024-09-12T03:34:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5538067910 0x7f5538069dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55540b27f0 0x7f55541fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5554072db0 0x7f55541fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 --2- 172.21.15.73:0/743439224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5554072880 0x7f555414b140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 >> 172.21.15.73:0/743439224 conn(0x7f55540b1cd0 msgr2=0x7f55540b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f720013d310 con 0x7f720013f8d0 2024-09-12T03:34:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 shutdown_connections 2024-09-12T03:34:56.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f555b283640 1 -- 172.21.15.73:0/743439224 wait complete. 2024-09-12T03:34:56.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7ff311ffb640 1 -- 172.21.15.73:0/363714995 <== mon.2 v2:172.21.15.150:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff318056bb0 con 0x7ff31c06ffc0 2024-09-12T03:34:56.409 INFO:teuthology.orchestra.run.smithi073.stdout:64424509450 2024-09-12T03:34:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f71feffd640 1 -- 172.21.15.73:0/1476236253 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71f8055340 con 0x7f720013f8d0 2024-09-12T03:34:56.410 INFO:teuthology.orchestra.run.smithi073.stdout:64424509450 2024-09-12T03:34:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f71e40678c0 msgr2=0x7f71e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f71e40678c0 0x7f71e4069d80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f71ec004710 tx=0x7f71ec009060 comp rx=0 tx=0).stop 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f720013f8d0 msgr2=0x7f720013fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f720013f8d0 0x7f720013fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72000740c0 tx=0x7f71f800c820 comp rx=0 tx=0).stop 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 shutdown_connections 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f71e40678c0 0x7f71e4069d80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7200141a90 0x7f720015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f720013f8d0 0x7f720013fd60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 --2- 172.21.15.73:0/1476236253 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71f0004810 0x7f7200142690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 >> 172.21.15.73:0/1476236253 conn(0x7f720006f420 msgr2=0x7f72000b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 shutdown_connections 2024-09-12T03:34:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.400+0000 7f7208301640 1 -- 172.21.15.73:0/1476236253 wait complete. 2024-09-12T03:34:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3000678c0 msgr2=0x7ff300069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3000678c0 0x7ff300069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff3140b1000 tx=0x7ff314004ac0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c06ffc0 msgr2=0x7ff31c14ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c06ffc0 0x7ff31c14ffb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff31800b3e0 tx=0x7ff31800b8a0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 shutdown_connections 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3000678c0 0x7ff300069d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff31c0b5390 0x7ff31c0b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff31c200c40 0x7ff31c15bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 --2- 172.21.15.73:0/363714995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff31c06ffc0 0x7ff31c14ffb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 >> 172.21.15.73:0/363714995 conn(0x7ff31c06d960 msgr2=0x7ff31c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 shutdown_connections 2024-09-12T03:34:56.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.404+0000 7ff32205f640 1 -- 172.21.15.73:0/363714995 wait complete. 2024-09-12T03:34:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.416+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f58b806ccd0 con 0x7f58a00052f0 2024-09-12T03:34:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.416+0000 7f58b4ff9640 1 -- 172.21.15.73:0/450876524 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58b0057470 con 0x7f58a00052f0 2024-09-12T03:34:56.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-12T03:34:56.427 INFO:teuthology.orchestra.run.smithi073.stdout:64424509449 2024-09-12T03:34:56.428 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58a4067940 msgr2=0x7f58a4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58a4067940 0x7f58a4069e00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58b80cf140 tx=0x7f58ac008040 comp rx=0 tx=0).stop 2024-09-12T03:34:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00052f0 msgr2=0x7f58b81f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00052f0 0x7f58b81f74f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58b000f900 tx=0x7f58b000fdc0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-09-12T03:34:56.431 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 shutdown_connections 2024-09-12T03:34:56.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58a4067940 0x7f58a4069e00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58b813aee0 0x7f58b815e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58b81f7a30 0x7f58b813a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 --2- 172.21.15.73:0/450876524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58a00052f0 0x7f58b81f74f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 >> 172.21.15.73:0/450876524 conn(0x7f58b80b1bf0 msgr2=0x7f58b80afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 shutdown_connections 2024-09-12T03:34:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.420+0000 7f58bd13c640 1 -- 172.21.15.73:0/450876524 wait complete. 2024-09-12T03:34:56.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-09-12T03:34:56.441 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-09-12T03:34:56.443 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-09-12T03:34:56.444 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.4 2024-09-12T03:34:56.444 DEBUG:teuthology.parallel:result is None 2024-09-12T03:34:56.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:34:56.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:34:56.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.592+0000 7fa76447f640 1 Processor -- start 2024-09-12T03:34:56.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.592+0000 7fa76447f640 1 -- start start 2024-09-12T03:34:56.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa76447f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 0x7fa75c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa76447f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa75c0cf450 0x7fa75c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa76447f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c0d0300 con 0x7fa75c161a60 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa76447f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa75c0b0f60 con 0x7fa75c0cf450 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa76447f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0cfd40 con 0x7fa75c0d3060 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa762a1c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa75c0cf450 0x7fa75c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa76221b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa75c161a60 0x7fa75c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59820/0 (socket says 172.21.15.73:59820) 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa76221b640 1 -- 172.21.15.73:0/1822413587 learned_addr learned my addr 172.21.15.73:0/1822413587 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa761a1a640 1 --2- 172.21.15.73:0/1822413587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 0x7fa75c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa762a1c640 1 -- 172.21.15.73:0/1822413587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 msgr2=0x7fa75c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa762a1c640 1 --2- 172.21.15.73:0/1822413587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 0x7fa75c0cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa762a1c640 1 -- 172.21.15.73:0/1822413587 >> v1:172.21.15.73:6789/0 conn(0x7fa75c161a60 legacy=0x7fa75c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa762a1c640 1 -- 172.21.15.73:0/1822413587 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c0d0020 con 0x7fa75c0cf450 2024-09-12T03:34:56.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa762a1c640 1 --2- 172.21.15.73:0/1822413587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0cf450 0x7fa75c06d6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60942460b97190b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa761219640 1 -- 172.21.15.73:0/1822413587 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7540b2070 con 0x7fa75c0cf450 2024-09-12T03:34:56.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa761219640 1 -- 172.21.15.73:0/1822413587 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540a5740 con 0x7fa75c0cf450 2024-09-12T03:34:56.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.596+0000 7fa761219640 1 -- 172.21.15.73:0/1822413587 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7540a5b10 con 0x7fa75c0cf450 2024-09-12T03:34:56.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/1822413587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0cf450 msgr2=0x7fa75c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 --2- 172.21.15.73:0/1822413587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0cf450 0x7fa75c06d6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa754009d90 tx=0x7fa75401c740 comp rx=0 tx=0).stop 2024-09-12T03:34:56.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/1822413587 shutdown_connections 2024-09-12T03:34:56.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 --2- 172.21.15.73:0/1822413587 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 0x7fa75c0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 --2- 172.21.15.73:0/1822413587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c0cf450 0x7fa75c06d6b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/1822413587 >> 172.21.15.73:0/1822413587 conn(0x7fa75c08bf90 msgr2=0x7fa75c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/1822413587 shutdown_connections 2024-09-12T03:34:56.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/1822413587 wait complete. 2024-09-12T03:34:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 Processor -- start 2024-09-12T03:34:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- start start 2024-09-12T03:34:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cf450 0x7fa75c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 0x7fa75c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c161a60 0x7fa75c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c06e400 con 0x7fa75c161a60 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0cfaf0 con 0x7fa75c0cf450 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c06e580 con 0x7fa75c0d3060 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c161a60 0x7fa75c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c161a60 0x7fa75c0b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37180/0 (socket says 172.21.15.73:37180) 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 -- 172.21.15.73:0/142873318 learned_addr learned my addr 172.21.15.73:0/142873318 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76221b640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cf450 0x7fa75c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 -- 172.21.15.73:0/142873318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 msgr2=0x7fa75c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 0x7fa75c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 -- 172.21.15.73:0/142873318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cf450 msgr2=0x7fa75c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cf450 0x7fa75c0caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 -- 172.21.15.73:0/142873318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c0b98b0 con 0x7fa75c161a60 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa762a1c640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c161a60 0x7fa75c0b23d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa75401cfe0 tx=0x7fa7540194e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa752ffd640 1 -- 172.21.15.73:0/142873318 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7540b2050 con 0x7fa75c161a60 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa752ffd640 1 -- 172.21.15.73:0/142873318 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7540be070 con 0x7fa75c161a60 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa752ffd640 1 -- 172.21.15.73:0/142873318 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7540ad850 con 0x7fa75c161a60 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c0b9b50 con 0x7fa75c161a60 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c0ba110 con 0x7fa75c161a60 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.600+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c06d6b0 con 0x7fa75c161a60 2024-09-12T03:34:56.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.604+0000 7fa752ffd640 1 -- 172.21.15.73:0/142873318 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7540ad9f0 con 0x7fa75c161a60 2024-09-12T03:34:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.604+0000 7fa752ffd640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7400678c0 0x7fa740069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.604+0000 7fa752ffd640 1 -- 172.21.15.73:0/142873318 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa7541211b0 con 0x7fa75c161a60 2024-09-12T03:34:56.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.604+0000 7fa76221b640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7400678c0 0x7fa740069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.604+0000 7fa76221b640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7400678c0 0x7fa740069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa758000f70 tx=0x7fa758009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.608+0000 7fa752ffd640 1 -- 172.21.15.73:0/142873318 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa754016480 con 0x7fa75c161a60 2024-09-12T03:34:56.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.752+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa75c0c7c40 con 0x7fa7400678c0 2024-09-12T03:34:56.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.764+0000 7fa752ffd640 1 -- 172.21.15.73:0/142873318 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fa75c0c7c40 con 0x7fa7400678c0 2024-09-12T03:34:56.770 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:56.776 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:34:56.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7400678c0 msgr2=0x7fa740069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7400678c0 0x7fa740069d80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa758000f70 tx=0x7fa758009040 comp rx=0 tx=0).stop 2024-09-12T03:34:56.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c161a60 msgr2=0x7fa75c0b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c161a60 0x7fa75c0b23d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa75401cfe0 tx=0x7fa7540194e0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 shutdown_connections 2024-09-12T03:34:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7400678c0 0x7fa740069d80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa75c161a60 0x7fa75c0b23d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa75c0d3060 0x7fa75c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 --2- 172.21.15.73:0/142873318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa75c0cf450 0x7fa75c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.768+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 >> 172.21.15.73:0/142873318 conn(0x7fa75c08bf90 msgr2=0x7fa75c160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.772+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 shutdown_connections 2024-09-12T03:34:56.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.772+0000 7fa76447f640 1 -- 172.21.15.73:0/142873318 wait complete. 2024-09-12T03:34:56.792 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-12T03:34:55.792482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2006572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.702719"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012394+0000","last_change":"2024-09-12T03:34:38.010797+0000","last_active":"2024-09-12T03:34:45.012394+0000","last_peered":"2024-09-12T03:34:45.012394+0000","last_clean":"2024-09-12T03:34:45.012394+0000","last_became_active":"2024-09-12T03:34:38.010433+0000","last_became_peered":"2024-09-12T03:34:38.010433+0000","last_unstale":"2024-09-12T03:34:45.012394+0000","last_undegraded":"2024-09-12T03:34:45.012394+0000","last_fullsized":"2024-09-12T03:34:45.012394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009665+0000","last_change":"2024-09-12T03:34:39.074559+0000","last_active":"2024-09-12T03:34:45.009665+0000","last_peered":"2024-09-12T03:34:45.009665+0000","last_clean":"2024-09-12T03:34:45.009665+0000","last_became_active":"2024-09-12T03:34:39.074317+0000","last_became_peered":"2024-09-12T03:34:39.074317+0000","last_unstale":"2024-09-12T03:34:45.009665+0000","last_undegraded":"2024-09-12T03:34:45.009665+0000","last_fullsized":"2024-09-12T03:34:45.009665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007763+0000","last_change":"2024-09-12T03:34:43.218439+0000","last_active":"2024-09-12T03:34:45.007763+0000","last_peered":"2024-09-12T03:34:45.007763+0000","last_clean":"2024-09-12T03:34:45.007763+0000","last_became_active":"2024-09-12T03:34:43.216661+0000","last_became_peered":"2024-09-12T03:34:43.216661+0000","last_unstale":"2024-09-12T03:34:45.007763+0000","last_undegraded":"2024-09-12T03:34:45.007763+0000","last_fullsized":"2024-09-12T03:34:45.007763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:12.169699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010114+0000","last_change":"2024-09-12T03:34:38.014275+0000","last_active":"2024-09-12T03:34:45.010114+0000","last_peered":"2024-09-12T03:34:45.010114+0000","last_clean":"2024-09-12T03:34:45.010114+0000","last_became_active":"2024-09-12T03:34:38.013821+0000","last_became_peered":"2024-09-12T03:34:38.013821+0000","last_unstale":"2024-09-12T03:34:45.010114+0000","last_undegraded":"2024-09-12T03:34:45.010114+0000","last_fullsized":"2024-09-12T03:34:45.010114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012133+0000","last_change":"2024-09-12T03:34:39.088423+0000","last_active":"2024-09-12T03:34:45.012133+0000","last_peered":"2024-09-12T03:34:45.012133+0000","last_clean":"2024-09-12T03:34:45.012133+0000","last_became_active":"2024-09-12T03:34:39.088198+0000","last_became_peered":"2024-09-12T03:34:39.088198+0000","last_unstale":"2024-09-12T03:34:45.012133+0000","last_undegraded":"2024-09-12T03:34:45.012133+0000","last_fullsized":"2024-09-12T03:34:45.012133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097304+0000","last_change":"2024-09-12T03:34:43.134447+0000","last_active":"2024-09-12T03:34:44.097304+0000","last_peered":"2024-09-12T03:34:44.097304+0000","last_clean":"2024-09-12T03:34:44.097304+0000","last_became_active":"2024-09-12T03:34:43.131156+0000","last_became_peered":"2024-09-12T03:34:43.131156+0000","last_unstale":"2024-09-12T03:34:44.097304+0000","last_undegraded":"2024-09-12T03:34:44.097304+0000","last_fullsized":"2024-09-12T03:34:44.097304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010783+0000","last_change":"2024-09-12T03:34:38.029333+0000","last_active":"2024-09-12T03:34:45.010783+0000","last_peered":"2024-09-12T03:34:45.010783+0000","last_clean":"2024-09-12T03:34:45.010783+0000","last_became_active":"2024-09-12T03:34:38.028881+0000","last_became_peered":"2024-09-12T03:34:38.028881+0000","last_unstale":"2024-09-12T03:34:45.010783+0000","last_undegraded":"2024-09-12T03:34:45.010783+0000","last_fullsized":"2024-09-12T03:34:45.010783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097344+0000","last_change":"2024-09-12T03:34:39.099744+0000","last_active":"2024-09-12T03:34:44.097344+0000","last_peered":"2024-09-12T03:34:44.097344+0000","last_clean":"2024-09-12T03:34:44.097344+0000","last_became_active":"2024-09-12T03:34:39.098494+0000","last_became_peered":"2024-09-12T03:34:39.098494+0000","last_unstale":"2024-09-12T03:34:44.097344+0000","last_undegraded":"2024-09-12T03:34:44.097344+0000","last_fullsized":"2024-09-12T03:34:44.097344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096627+0000","last_change":"2024-09-12T03:34:43.136579+0000","last_active":"2024-09-12T03:34:44.096627+0000","last_peered":"2024-09-12T03:34:44.096627+0000","last_clean":"2024-09-12T03:34:44.096627+0000","last_became_active":"2024-09-12T03:34:43.131614+0000","last_became_peered":"2024-09-12T03:34:43.131614+0000","last_unstale":"2024-09-12T03:34:44.096627+0000","last_undegraded":"2024-09-12T03:34:44.096627+0000","last_fullsized":"2024-09-12T03:34:44.096627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:04.948070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010371+0000","last_change":"2024-09-12T03:34:38.031062+0000","last_active":"2024-09-12T03:34:45.010371+0000","last_peered":"2024-09-12T03:34:45.010371+0000","last_clean":"2024-09-12T03:34:45.010371+0000","last_became_active":"2024-09-12T03:34:38.030527+0000","last_became_peered":"2024-09-12T03:34:38.030527+0000","last_unstale":"2024-09-12T03:34:45.010371+0000","last_undegraded":"2024-09-12T03:34:45.010371+0000","last_fullsized":"2024-09-12T03:34:45.010371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098474+0000","last_change":"2024-09-12T03:34:39.101380+0000","last_active":"2024-09-12T03:34:44.098474+0000","last_peered":"2024-09-12T03:34:44.098474+0000","last_clean":"2024-09-12T03:34:44.098474+0000","last_became_active":"2024-09-12T03:34:39.099679+0000","last_became_peered":"2024-09-12T03:34:39.099679+0000","last_unstale":"2024-09-12T03:34:44.098474+0000","last_undegraded":"2024-09-12T03:34:44.098474+0000","last_fullsized":"2024-09-12T03:34:44.098474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095057+0000","last_change":"2024-09-12T03:34:43.128313+0000","last_active":"2024-09-12T03:34:44.095057+0000","last_peered":"2024-09-12T03:34:44.095057+0000","last_clean":"2024-09-12T03:34:44.095057+0000","last_became_active":"2024-09-12T03:34:43.126843+0000","last_became_peered":"2024-09-12T03:34:43.126843+0000","last_unstale":"2024-09-12T03:34:44.095057+0000","last_undegraded":"2024-09-12T03:34:44.095057+0000","last_fullsized":"2024-09-12T03:34:44.095057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:23.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187338+0000","last_change":"2024-09-12T03:34:39.093427+0000","last_active":"2024-09-12T03:34:44.187338+0000","last_peered":"2024-09-12T03:34:44.187338+0000","last_clean":"2024-09-12T03:34:44.187338+0000","last_became_active":"2024-09-12T03:34:39.092380+0000","last_became_peered":"2024-09-12T03:34:39.092380+0000","last_unstale":"2024-09-12T03:34:44.187338+0000","last_undegraded":"2024-09-12T03:34:44.187338+0000","last_fullsized":"2024-09-12T03:34:44.187338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010267+0000","last_change":"2024-09-12T03:34:38.029799+0000","last_active":"2024-09-12T03:34:45.010267+0000","last_peered":"2024-09-12T03:34:45.010267+0000","last_clean":"2024-09-12T03:34:45.010267+0000","last_became_active":"2024-09-12T03:34:38.027974+0000","last_became_peered":"2024-09-12T03:34:38.027974+0000","last_unstale":"2024-09-12T03:34:45.010267+0000","last_undegraded":"2024-09-12T03:34:45.010267+0000","last_fullsized":"2024-09-12T03:34:45.010267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095984+0000","last_change":"2024-09-12T03:34:43.124251+0000","last_active":"2024-09-12T03:34:44.095984+0000","last_peered":"2024-09-12T03:34:44.095984+0000","last_clean":"2024-09-12T03:34:44.095984+0000","last_became_active":"2024-09-12T03:34:43.123246+0000","last_became_peered":"2024-09-12T03:34:43.123246+0000","last_unstale":"2024-09-12T03:34:44.095984+0000","last_undegraded":"2024-09-12T03:34:44.095984+0000","last_fullsized":"2024-09-12T03:34:44.095984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010770+0000","last_change":"2024-09-12T03:34:39.066746+0000","last_active":"2024-09-12T03:34:45.010770+0000","last_peered":"2024-09-12T03:34:45.010770+0000","last_clean":"2024-09-12T03:34:45.010770+0000","last_became_active":"2024-09-12T03:34:39.066399+0000","last_became_peered":"2024-09-12T03:34:39.066399+0000","last_unstale":"2024-09-12T03:34:45.010770+0000","last_undegraded":"2024-09-12T03:34:45.010770+0000","last_fullsized":"2024-09-12T03:34:45.010770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093375+0000","last_change":"2024-09-12T03:34:38.005663+0000","last_active":"2024-09-12T03:34:44.093375+0000","last_peered":"2024-09-12T03:34:44.093375+0000","last_clean":"2024-09-12T03:34:44.093375+0000","last_became_active":"2024-09-12T03:34:38.005160+0000","last_became_peered":"2024-09-12T03:34:38.005160+0000","last_unstale":"2024-09-12T03:34:44.093375+0000","last_undegraded":"2024-09-12T03:34:44.093375+0000","last_fullsized":"2024-09-12T03:34:44.093375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095966+0000","last_change":"2024-09-12T03:34:43.131000+0000","last_active":"2024-09-12T03:34:44.095966+0000","last_peered":"2024-09-12T03:34:44.095966+0000","last_clean":"2024-09-12T03:34:44.095966+0000","last_became_active":"2024-09-12T03:34:43.129785+0000","last_became_peered":"2024-09-12T03:34:43.129785+0000","last_unstale":"2024-09-12T03:34:44.095966+0000","last_undegraded":"2024-09-12T03:34:44.095966+0000","last_fullsized":"2024-09-12T03:34:44.095966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:17.250004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008215+0000","last_change":"2024-09-12T03:34:39.065304+0000","last_active":"2024-09-12T03:34:45.008215+0000","last_peered":"2024-09-12T03:34:45.008215+0000","last_clean":"2024-09-12T03:34:45.008215+0000","last_became_active":"2024-09-12T03:34:39.065027+0000","last_became_peered":"2024-09-12T03:34:39.065027+0000","last_unstale":"2024-09-12T03:34:45.008215+0000","last_undegraded":"2024-09-12T03:34:45.008215+0000","last_fullsized":"2024-09-12T03:34:45.008215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092648+0000","last_change":"2024-09-12T03:34:38.020702+0000","last_active":"2024-09-12T03:34:44.092648+0000","last_peered":"2024-09-12T03:34:44.092648+0000","last_clean":"2024-09-12T03:34:44.092648+0000","last_became_active":"2024-09-12T03:34:38.020279+0000","last_became_peered":"2024-09-12T03:34:38.020279+0000","last_unstale":"2024-09-12T03:34:44.092648+0000","last_undegraded":"2024-09-12T03:34:44.092648+0000","last_fullsized":"2024-09-12T03:34:44.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094739+0000","last_change":"2024-09-12T03:34:43.215466+0000","last_active":"2024-09-12T03:34:44.094739+0000","last_peered":"2024-09-12T03:34:44.094739+0000","last_clean":"2024-09-12T03:34:44.094739+0000","last_became_active":"2024-09-12T03:34:43.214416+0000","last_became_peered":"2024-09-12T03:34:43.214416+0000","last_unstale":"2024-09-12T03:34:44.094739+0000","last_undegraded":"2024-09-12T03:34:44.094739+0000","last_fullsized":"2024-09-12T03:34:44.094739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:09.728873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095570+0000","last_change":"2024-09-12T03:34:39.063489+0000","last_active":"2024-09-12T03:34:44.095570+0000","last_peered":"2024-09-12T03:34:44.095570+0000","last_clean":"2024-09-12T03:34:44.095570+0000","last_became_active":"2024-09-12T03:34:39.062768+0000","last_became_peered":"2024-09-12T03:34:39.062768+0000","last_unstale":"2024-09-12T03:34:44.095570+0000","last_undegraded":"2024-09-12T03:34:44.095570+0000","last_fullsized":"2024-09-12T03:34:44.095570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009376+0000","last_change":"2024-09-12T03:34:38.015940+0000","last_active":"2024-09-12T03:34:45.009376+0000","last_peered":"2024-09-12T03:34:45.009376+0000","last_clean":"2024-09-12T03:34:45.009376+0000","last_became_active":"2024-09-12T03:34:38.015461+0000","last_became_peered":"2024-09-12T03:34:38.015461+0000","last_unstale":"2024-09-12T03:34:45.009376+0000","last_undegraded":"2024-09-12T03:34:45.009376+0000","last_fullsized":"2024-09-12T03:34:45.009376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095326+0000","last_change":"2024-09-12T03:34:43.129118+0000","last_active":"2024-09-12T03:34:44.095326+0000","last_peered":"2024-09-12T03:34:44.095326+0000","last_clean":"2024-09-12T03:34:44.095326+0000","last_became_active":"2024-09-12T03:34:43.127925+0000","last_became_peered":"2024-09-12T03:34:43.127925+0000","last_unstale":"2024-09-12T03:34:44.095326+0000","last_undegraded":"2024-09-12T03:34:44.095326+0000","last_fullsized":"2024-09-12T03:34:44.095326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:47.375563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013122+0000","last_change":"2024-09-12T03:34:39.058932+0000","last_active":"2024-09-12T03:34:45.013122+0000","last_peered":"2024-09-12T03:34:45.013122+0000","last_clean":"2024-09-12T03:34:45.013122+0000","last_became_active":"2024-09-12T03:34:39.058293+0000","last_became_peered":"2024-09-12T03:34:39.058293+0000","last_unstale":"2024-09-12T03:34:45.013122+0000","last_undegraded":"2024-09-12T03:34:45.013122+0000","last_fullsized":"2024-09-12T03:34:45.013122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:38.023773+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:38.023187+0000","last_became_peered":"2024-09-12T03:34:38.023187+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.688103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095125+0000","last_change":"2024-09-12T03:34:43.216377+0000","last_active":"2024-09-12T03:34:44.095125+0000","last_peered":"2024-09-12T03:34:44.095125+0000","last_clean":"2024-09-12T03:34:44.095125+0000","last_became_active":"2024-09-12T03:34:43.215337+0000","last_became_peered":"2024-09-12T03:34:43.215337+0000","last_unstale":"2024-09-12T03:34:44.095125+0000","last_undegraded":"2024-09-12T03:34:44.095125+0000","last_fullsized":"2024-09-12T03:34:44.095125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:38.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010397+0000","last_change":"2024-09-12T03:34:39.084538+0000","last_active":"2024-09-12T03:34:45.010397+0000","last_peered":"2024-09-12T03:34:45.010397+0000","last_clean":"2024-09-12T03:34:45.010397+0000","last_became_active":"2024-09-12T03:34:39.084268+0000","last_became_peered":"2024-09-12T03:34:39.084268+0000","last_unstale":"2024-09-12T03:34:45.010397+0000","last_undegraded":"2024-09-12T03:34:45.010397+0000","last_fullsized":"2024-09-12T03:34:45.010397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094541+0000","last_change":"2024-09-12T03:34:38.019195+0000","last_active":"2024-09-12T03:34:44.094541+0000","last_peered":"2024-09-12T03:34:44.094541+0000","last_clean":"2024-09-12T03:34:44.094541+0000","last_became_active":"2024-09-12T03:34:38.018785+0000","last_became_peered":"2024-09-12T03:34:38.018785+0000","last_unstale":"2024-09-12T03:34:44.094541+0000","last_undegraded":"2024-09-12T03:34:44.094541+0000","last_fullsized":"2024-09-12T03:34:44.094541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007530+0000","last_change":"2024-09-12T03:34:43.214340+0000","last_active":"2024-09-12T03:34:45.007530+0000","last_peered":"2024-09-12T03:34:45.007530+0000","last_clean":"2024-09-12T03:34:45.007530+0000","last_became_active":"2024-09-12T03:34:43.213920+0000","last_became_peered":"2024-09-12T03:34:43.213920+0000","last_unstale":"2024-09-12T03:34:45.007530+0000","last_undegraded":"2024-09-12T03:34:45.007530+0000","last_fullsized":"2024-09-12T03:34:45.007530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:12.709218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094005+0000","last_change":"2024-09-12T03:34:39.060173+0000","last_active":"2024-09-12T03:34:44.094005+0000","last_peered":"2024-09-12T03:34:44.094005+0000","last_clean":"2024-09-12T03:34:44.094005+0000","last_became_active":"2024-09-12T03:34:39.059915+0000","last_became_peered":"2024-09-12T03:34:39.059915+0000","last_unstale":"2024-09-12T03:34:44.094005+0000","last_undegraded":"2024-09-12T03:34:44.094005+0000","last_fullsized":"2024-09-12T03:34:44.094005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011065+0000","last_change":"2024-09-12T03:34:38.021938+0000","last_active":"2024-09-12T03:34:45.011065+0000","last_peered":"2024-09-12T03:34:45.011065+0000","last_clean":"2024-09-12T03:34:45.011065+0000","last_became_active":"2024-09-12T03:34:38.020605+0000","last_became_peered":"2024-09-12T03:34:38.020605+0000","last_unstale":"2024-09-12T03:34:45.011065+0000","last_undegraded":"2024-09-12T03:34:45.011065+0000","last_fullsized":"2024-09-12T03:34:45.011065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013038+0000","last_change":"2024-09-12T03:34:43.217230+0000","last_active":"2024-09-12T03:34:45.013038+0000","last_peered":"2024-09-12T03:34:45.013038+0000","last_clean":"2024-09-12T03:34:45.013038+0000","last_became_active":"2024-09-12T03:34:43.214307+0000","last_became_peered":"2024-09-12T03:34:43.214307+0000","last_unstale":"2024-09-12T03:34:45.013038+0000","last_undegraded":"2024-09-12T03:34:45.013038+0000","last_fullsized":"2024-09-12T03:34:45.013038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:03.198301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098650+0000","last_change":"2024-09-12T03:34:39.100077+0000","last_active":"2024-09-12T03:34:44.098650+0000","last_peered":"2024-09-12T03:34:44.098650+0000","last_clean":"2024-09-12T03:34:44.098650+0000","last_became_active":"2024-09-12T03:34:39.097599+0000","last_became_peered":"2024-09-12T03:34:39.097599+0000","last_unstale":"2024-09-12T03:34:44.098650+0000","last_undegraded":"2024-09-12T03:34:44.098650+0000","last_fullsized":"2024-09-12T03:34:44.098650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094119+0000","last_change":"2024-09-12T03:34:38.013282+0000","last_active":"2024-09-12T03:34:44.094119+0000","last_peered":"2024-09-12T03:34:44.094119+0000","last_clean":"2024-09-12T03:34:44.094119+0000","last_became_active":"2024-09-12T03:34:38.013066+0000","last_became_peered":"2024-09-12T03:34:38.013066+0000","last_unstale":"2024-09-12T03:34:44.094119+0000","last_undegraded":"2024-09-12T03:34:44.094119+0000","last_fullsized":"2024-09-12T03:34:44.094119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092815+0000","last_change":"2024-09-12T03:34:43.124967+0000","last_active":"2024-09-12T03:34:44.092815+0000","last_peered":"2024-09-12T03:34:44.092815+0000","last_clean":"2024-09-12T03:34:44.092815+0000","last_became_active":"2024-09-12T03:34:43.124439+0000","last_became_peered":"2024-09-12T03:34:43.124439+0000","last_unstale":"2024-09-12T03:34:44.092815+0000","last_undegraded":"2024-09-12T03:34:44.092815+0000","last_fullsized":"2024-09-12T03:34:44.092815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097630+0000","last_change":"2024-09-12T03:34:39.069126+0000","last_active":"2024-09-12T03:34:44.097630+0000","last_peered":"2024-09-12T03:34:44.097630+0000","last_clean":"2024-09-12T03:34:44.097630+0000","last_became_active":"2024-09-12T03:34:39.068202+0000","last_became_peered":"2024-09-12T03:34:39.068202+0000","last_unstale":"2024-09-12T03:34:44.097630+0000","last_undegraded":"2024-09-12T03:34:44.097630+0000","last_fullsized":"2024-09-12T03:34:44.097630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097368+0000","last_change":"2024-09-12T03:34:38.025161+0000","last_active":"2024-09-12T03:34:44.097368+0000","last_peered":"2024-09-12T03:34:44.097368+0000","last_clean":"2024-09-12T03:34:44.097368+0000","last_became_active":"2024-09-12T03:34:38.024569+0000","last_became_peered":"2024-09-12T03:34:38.024569+0000","last_unstale":"2024-09-12T03:34:44.097368+0000","last_undegraded":"2024-09-12T03:34:44.097368+0000","last_fullsized":"2024-09-12T03:34:44.097368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093825+0000","last_change":"2024-09-12T03:34:43.119701+0000","last_active":"2024-09-12T03:34:44.093825+0000","last_peered":"2024-09-12T03:34:44.093825+0000","last_clean":"2024-09-12T03:34:44.093825+0000","last_became_active":"2024-09-12T03:34:43.118522+0000","last_became_peered":"2024-09-12T03:34:43.118522+0000","last_unstale":"2024-09-12T03:34:44.093825+0000","last_undegraded":"2024-09-12T03:34:44.093825+0000","last_fullsized":"2024-09-12T03:34:44.093825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:53.891623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092997+0000","last_change":"2024-09-12T03:34:39.060677+0000","last_active":"2024-09-12T03:34:44.092997+0000","last_peered":"2024-09-12T03:34:44.092997+0000","last_clean":"2024-09-12T03:34:44.092997+0000","last_became_active":"2024-09-12T03:34:39.060405+0000","last_became_peered":"2024-09-12T03:34:39.060405+0000","last_unstale":"2024-09-12T03:34:44.092997+0000","last_undegraded":"2024-09-12T03:34:44.092997+0000","last_fullsized":"2024-09-12T03:34:44.092997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009942+0000","last_change":"2024-09-12T03:34:38.004523+0000","last_active":"2024-09-12T03:34:45.009942+0000","last_peered":"2024-09-12T03:34:45.009942+0000","last_clean":"2024-09-12T03:34:45.009942+0000","last_became_active":"2024-09-12T03:34:38.004151+0000","last_became_peered":"2024-09-12T03:34:38.004151+0000","last_unstale":"2024-09-12T03:34:45.009942+0000","last_undegraded":"2024-09-12T03:34:45.009942+0000","last_fullsized":"2024-09-12T03:34:45.009942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095029+0000","last_change":"2024-09-12T03:34:43.123712+0000","last_active":"2024-09-12T03:34:44.095029+0000","last_peered":"2024-09-12T03:34:44.095029+0000","last_clean":"2024-09-12T03:34:44.095029+0000","last_became_active":"2024-09-12T03:34:43.123329+0000","last_became_peered":"2024-09-12T03:34:43.123329+0000","last_unstale":"2024-09-12T03:34:44.095029+0000","last_undegraded":"2024-09-12T03:34:44.095029+0000","last_fullsized":"2024-09-12T03:34:44.095029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:30.312088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011415+0000","last_change":"2024-09-12T03:34:39.053892+0000","last_active":"2024-09-12T03:34:45.011415+0000","last_peered":"2024-09-12T03:34:45.011415+0000","last_clean":"2024-09-12T03:34:45.011415+0000","last_became_active":"2024-09-12T03:34:39.053583+0000","last_became_peered":"2024-09-12T03:34:39.053583+0000","last_unstale":"2024-09-12T03:34:45.011415+0000","last_undegraded":"2024-09-12T03:34:45.011415+0000","last_fullsized":"2024-09-12T03:34:45.011415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:20.973812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009534+0000","last_change":"2024-09-12T03:34:38.019954+0000","last_active":"2024-09-12T03:34:45.009534+0000","last_peered":"2024-09-12T03:34:45.009534+0000","last_clean":"2024-09-12T03:34:45.009534+0000","last_became_active":"2024-09-12T03:34:38.017677+0000","last_became_peered":"2024-09-12T03:34:38.017677+0000","last_unstale":"2024-09-12T03:34:45.009534+0000","last_undegraded":"2024-09-12T03:34:45.009534+0000","last_fullsized":"2024-09-12T03:34:45.009534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012804+0000","last_change":"2024-09-12T03:34:43.211560+0000","last_active":"2024-09-12T03:34:45.012804+0000","last_peered":"2024-09-12T03:34:45.012804+0000","last_clean":"2024-09-12T03:34:45.012804+0000","last_became_active":"2024-09-12T03:34:43.210313+0000","last_became_peered":"2024-09-12T03:34:43.210313+0000","last_unstale":"2024-09-12T03:34:45.012804+0000","last_undegraded":"2024-09-12T03:34:45.012804+0000","last_fullsized":"2024-09-12T03:34:45.012804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008264+0000","last_change":"2024-09-12T03:34:39.099469+0000","last_active":"2024-09-12T03:34:45.008264+0000","last_peered":"2024-09-12T03:34:45.008264+0000","last_clean":"2024-09-12T03:34:45.008264+0000","last_became_active":"2024-09-12T03:34:39.099241+0000","last_became_peered":"2024-09-12T03:34:39.099241+0000","last_unstale":"2024-09-12T03:34:45.008264+0000","last_undegraded":"2024-09-12T03:34:45.008264+0000","last_fullsized":"2024-09-12T03:34:45.008264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096283+0000","last_change":"2024-09-12T03:34:38.012498+0000","last_active":"2024-09-12T03:34:44.096283+0000","last_peered":"2024-09-12T03:34:44.096283+0000","last_clean":"2024-09-12T03:34:44.096283+0000","last_became_active":"2024-09-12T03:34:38.011287+0000","last_became_peered":"2024-09-12T03:34:38.011287+0000","last_unstale":"2024-09-12T03:34:44.096283+0000","last_undegraded":"2024-09-12T03:34:44.096283+0000","last_fullsized":"2024-09-12T03:34:44.096283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009617+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:34:45.009617+0000","last_peered":"2024-09-12T03:34:45.009617+0000","last_clean":"2024-09-12T03:34:45.009617+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:34:45.009617+0000","last_undegraded":"2024-09-12T03:34:45.009617+0000","last_fullsized":"2024-09-12T03:34:45.009617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187899+0000","last_change":"2024-09-12T03:34:43.217542+0000","last_active":"2024-09-12T03:34:44.187899+0000","last_peered":"2024-09-12T03:34:44.187899+0000","last_clean":"2024-09-12T03:34:44.187899+0000","last_became_active":"2024-09-12T03:34:43.216519+0000","last_became_peered":"2024-09-12T03:34:43.216519+0000","last_unstale":"2024-09-12T03:34:44.187899+0000","last_undegraded":"2024-09-12T03:34:44.187899+0000","last_fullsized":"2024-09-12T03:34:44.187899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010497+0000","last_change":"2024-09-12T03:34:39.102583+0000","last_active":"2024-09-12T03:34:45.010497+0000","last_peered":"2024-09-12T03:34:45.010497+0000","last_clean":"2024-09-12T03:34:45.010497+0000","last_became_active":"2024-09-12T03:34:39.102127+0000","last_became_peered":"2024-09-12T03:34:39.102127+0000","last_unstale":"2024-09-12T03:34:45.010497+0000","last_undegraded":"2024-09-12T03:34:45.010497+0000","last_fullsized":"2024-09-12T03:34:45.010497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011031+0000","last_change":"2024-09-12T03:34:38.005330+0000","last_active":"2024-09-12T03:34:45.011031+0000","last_peered":"2024-09-12T03:34:45.011031+0000","last_clean":"2024-09-12T03:34:45.011031+0000","last_became_active":"2024-09-12T03:34:38.004948+0000","last_became_peered":"2024-09-12T03:34:38.004948+0000","last_unstale":"2024-09-12T03:34:45.011031+0000","last_undegraded":"2024-09-12T03:34:45.011031+0000","last_fullsized":"2024-09-12T03:34:45.011031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187730+0000","last_change":"2024-09-12T03:34:43.214134+0000","last_active":"2024-09-12T03:34:44.187730+0000","last_peered":"2024-09-12T03:34:44.187730+0000","last_clean":"2024-09-12T03:34:44.187730+0000","last_became_active":"2024-09-12T03:34:43.212887+0000","last_became_peered":"2024-09-12T03:34:43.212887+0000","last_unstale":"2024-09-12T03:34:44.187730+0000","last_undegraded":"2024-09-12T03:34:44.187730+0000","last_fullsized":"2024-09-12T03:34:44.187730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:50.420633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097609+0000","last_change":"2024-09-12T03:34:39.097188+0000","last_active":"2024-09-12T03:34:44.097609+0000","last_peered":"2024-09-12T03:34:44.097609+0000","last_clean":"2024-09-12T03:34:44.097609+0000","last_became_active":"2024-09-12T03:34:39.088779+0000","last_became_peered":"2024-09-12T03:34:39.088779+0000","last_unstale":"2024-09-12T03:34:44.097609+0000","last_undegraded":"2024-09-12T03:34:44.097609+0000","last_fullsized":"2024-09-12T03:34:44.097609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094237+0000","last_change":"2024-09-12T03:34:38.016976+0000","last_active":"2024-09-12T03:34:44.094237+0000","last_peered":"2024-09-12T03:34:44.094237+0000","last_clean":"2024-09-12T03:34:44.094237+0000","last_became_active":"2024-09-12T03:34:38.016660+0000","last_became_peered":"2024-09-12T03:34:38.016660+0000","last_unstale":"2024-09-12T03:34:44.094237+0000","last_undegraded":"2024-09-12T03:34:44.094237+0000","last_fullsized":"2024-09-12T03:34:44.094237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013574+0000","last_change":"2024-09-12T03:34:43.120906+0000","last_active":"2024-09-12T03:34:45.013574+0000","last_peered":"2024-09-12T03:34:45.013574+0000","last_clean":"2024-09-12T03:34:45.013574+0000","last_became_active":"2024-09-12T03:34:43.120173+0000","last_became_peered":"2024-09-12T03:34:43.120173+0000","last_unstale":"2024-09-12T03:34:45.013574+0000","last_undegraded":"2024-09-12T03:34:45.013574+0000","last_fullsized":"2024-09-12T03:34:45.013574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:47.645139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011129+0000","last_change":"2024-09-12T03:34:39.091419+0000","last_active":"2024-09-12T03:34:45.011129+0000","last_peered":"2024-09-12T03:34:45.011129+0000","last_clean":"2024-09-12T03:34:45.011129+0000","last_became_active":"2024-09-12T03:34:39.090855+0000","last_became_peered":"2024-09-12T03:34:39.090855+0000","last_unstale":"2024-09-12T03:34:45.011129+0000","last_undegraded":"2024-09-12T03:34:45.011129+0000","last_fullsized":"2024-09-12T03:34:45.011129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011991+0000","last_change":"2024-09-12T03:34:38.008658+0000","last_active":"2024-09-12T03:34:45.011991+0000","last_peered":"2024-09-12T03:34:45.011991+0000","last_clean":"2024-09-12T03:34:45.011991+0000","last_became_active":"2024-09-12T03:34:38.007921+0000","last_became_peered":"2024-09-12T03:34:38.007921+0000","last_unstale":"2024-09-12T03:34:45.011991+0000","last_undegraded":"2024-09-12T03:34:45.011991+0000","last_fullsized":"2024-09-12T03:34:45.011991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:55.788731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094885+0000","last_change":"2024-09-12T03:34:43.216644+0000","last_active":"2024-09-12T03:34:44.094885+0000","last_peered":"2024-09-12T03:34:44.094885+0000","last_clean":"2024-09-12T03:34:44.094885+0000","last_became_active":"2024-09-12T03:34:43.215467+0000","last_became_peered":"2024-09-12T03:34:43.215467+0000","last_unstale":"2024-09-12T03:34:44.094885+0000","last_undegraded":"2024-09-12T03:34:44.094885+0000","last_fullsized":"2024-09-12T03:34:44.094885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010860+0000","last_change":"2024-09-12T03:34:39.091357+0000","last_active":"2024-09-12T03:34:45.010860+0000","last_peered":"2024-09-12T03:34:45.010860+0000","last_clean":"2024-09-12T03:34:45.010860+0000","last_became_active":"2024-09-12T03:34:39.090805+0000","last_became_peered":"2024-09-12T03:34:39.090805+0000","last_unstale":"2024-09-12T03:34:45.010860+0000","last_undegraded":"2024-09-12T03:34:45.010860+0000","last_fullsized":"2024-09-12T03:34:45.010860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095561+0000","last_change":"2024-09-12T03:34:38.017119+0000","last_active":"2024-09-12T03:34:44.095561+0000","last_peered":"2024-09-12T03:34:44.095561+0000","last_clean":"2024-09-12T03:34:44.095561+0000","last_became_active":"2024-09-12T03:34:38.016642+0000","last_became_peered":"2024-09-12T03:34:38.016642+0000","last_unstale":"2024-09-12T03:34:44.095561+0000","last_undegraded":"2024-09-12T03:34:44.095561+0000","last_fullsized":"2024-09-12T03:34:44.095561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094658+0000","last_change":"2024-09-12T03:34:43.128636+0000","last_active":"2024-09-12T03:34:44.094658+0000","last_peered":"2024-09-12T03:34:44.094658+0000","last_clean":"2024-09-12T03:34:44.094658+0000","last_became_active":"2024-09-12T03:34:43.127210+0000","last_became_peered":"2024-09-12T03:34:43.127210+0000","last_unstale":"2024-09-12T03:34:44.094658+0000","last_undegraded":"2024-09-12T03:34:44.094658+0000","last_fullsized":"2024-09-12T03:34:44.094658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.156353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010031+0000","last_change":"2024-09-12T03:34:39.091653+0000","last_active":"2024-09-12T03:34:45.010031+0000","last_peered":"2024-09-12T03:34:45.010031+0000","last_clean":"2024-09-12T03:34:45.010031+0000","last_became_active":"2024-09-12T03:34:39.090971+0000","last_became_peered":"2024-09-12T03:34:39.090971+0000","last_unstale":"2024-09-12T03:34:45.010031+0000","last_undegraded":"2024-09-12T03:34:45.010031+0000","last_fullsized":"2024-09-12T03:34:45.010031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009309+0000","last_change":"2024-09-12T03:34:38.007157+0000","last_active":"2024-09-12T03:34:45.009309+0000","last_peered":"2024-09-12T03:34:45.009309+0000","last_clean":"2024-09-12T03:34:45.009309+0000","last_became_active":"2024-09-12T03:34:38.006706+0000","last_became_peered":"2024-09-12T03:34:38.006706+0000","last_unstale":"2024-09-12T03:34:45.009309+0000","last_undegraded":"2024-09-12T03:34:45.009309+0000","last_fullsized":"2024-09-12T03:34:45.009309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012527+0000","last_change":"2024-09-12T03:34:43.126450+0000","last_active":"2024-09-12T03:34:45.012527+0000","last_peered":"2024-09-12T03:34:45.012527+0000","last_clean":"2024-09-12T03:34:45.012527+0000","last_became_active":"2024-09-12T03:34:43.126083+0000","last_became_peered":"2024-09-12T03:34:43.126083+0000","last_unstale":"2024-09-12T03:34:45.012527+0000","last_undegraded":"2024-09-12T03:34:45.012527+0000","last_fullsized":"2024-09-12T03:34:45.012527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187658+0000","last_change":"2024-09-12T03:34:39.073954+0000","last_active":"2024-09-12T03:34:44.187658+0000","last_peered":"2024-09-12T03:34:44.187658+0000","last_clean":"2024-09-12T03:34:44.187658+0000","last_became_active":"2024-09-12T03:34:39.073238+0000","last_became_peered":"2024-09-12T03:34:39.073238+0000","last_unstale":"2024-09-12T03:34:44.187658+0000","last_undegraded":"2024-09-12T03:34:44.187658+0000","last_fullsized":"2024-09-12T03:34:44.187658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187978+0000","last_change":"2024-09-12T03:34:38.023260+0000","last_active":"2024-09-12T03:34:44.187978+0000","last_peered":"2024-09-12T03:34:44.187978+0000","last_clean":"2024-09-12T03:34:44.187978+0000","last_became_active":"2024-09-12T03:34:38.022602+0000","last_became_peered":"2024-09-12T03:34:38.022602+0000","last_unstale":"2024-09-12T03:34:44.187978+0000","last_undegraded":"2024-09-12T03:34:44.187978+0000","last_fullsized":"2024-09-12T03:34:44.187978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:20.254507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010135+0000","last_change":"2024-09-12T03:34:43.216165+0000","last_active":"2024-09-12T03:34:45.010135+0000","last_peered":"2024-09-12T03:34:45.010135+0000","last_clean":"2024-09-12T03:34:45.010135+0000","last_became_active":"2024-09-12T03:34:43.214989+0000","last_became_peered":"2024-09-12T03:34:43.214989+0000","last_unstale":"2024-09-12T03:34:45.010135+0000","last_undegraded":"2024-09-12T03:34:45.010135+0000","last_fullsized":"2024-09-12T03:34:45.010135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.591844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010173+0000","last_change":"2024-09-12T03:34:39.090006+0000","last_active":"2024-09-12T03:34:45.010173+0000","last_peered":"2024-09-12T03:34:45.010173+0000","last_clean":"2024-09-12T03:34:45.010173+0000","last_became_active":"2024-09-12T03:34:39.089165+0000","last_became_peered":"2024-09-12T03:34:39.089165+0000","last_unstale":"2024-09-12T03:34:45.010173+0000","last_undegraded":"2024-09-12T03:34:45.010173+0000","last_fullsized":"2024-09-12T03:34:45.010173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097113+0000","last_change":"2024-09-12T03:34:38.014916+0000","last_active":"2024-09-12T03:34:44.097113+0000","last_peered":"2024-09-12T03:34:44.097113+0000","last_clean":"2024-09-12T03:34:44.097113+0000","last_became_active":"2024-09-12T03:34:38.014447+0000","last_became_peered":"2024-09-12T03:34:38.014447+0000","last_unstale":"2024-09-12T03:34:44.097113+0000","last_undegraded":"2024-09-12T03:34:44.097113+0000","last_fullsized":"2024-09-12T03:34:44.097113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008970+0000","last_change":"2024-09-12T03:34:43.211049+0000","last_active":"2024-09-12T03:34:45.008970+0000","last_peered":"2024-09-12T03:34:45.008970+0000","last_clean":"2024-09-12T03:34:45.008970+0000","last_became_active":"2024-09-12T03:34:43.210561+0000","last_became_peered":"2024-09-12T03:34:43.210561+0000","last_unstale":"2024-09-12T03:34:45.008970+0000","last_undegraded":"2024-09-12T03:34:45.008970+0000","last_fullsized":"2024-09-12T03:34:45.008970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:22.633242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012235+0000","last_change":"2024-09-12T03:34:39.082890+0000","last_active":"2024-09-12T03:34:45.012235+0000","last_peered":"2024-09-12T03:34:45.012235+0000","last_clean":"2024-09-12T03:34:45.012235+0000","last_became_active":"2024-09-12T03:34:39.082674+0000","last_became_peered":"2024-09-12T03:34:39.082674+0000","last_unstale":"2024-09-12T03:34:45.012235+0000","last_undegraded":"2024-09-12T03:34:45.012235+0000","last_fullsized":"2024-09-12T03:34:45.012235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013716+0000","last_change":"2024-09-12T03:34:38.017260+0000","last_active":"2024-09-12T03:34:45.013716+0000","last_peered":"2024-09-12T03:34:45.013716+0000","last_clean":"2024-09-12T03:34:45.013716+0000","last_became_active":"2024-09-12T03:34:38.016781+0000","last_became_peered":"2024-09-12T03:34:38.016781+0000","last_unstale":"2024-09-12T03:34:45.013716+0000","last_undegraded":"2024-09-12T03:34:45.013716+0000","last_fullsized":"2024-09-12T03:34:45.013716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:49.748803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098324+0000","last_change":"2024-09-12T03:34:43.213204+0000","last_active":"2024-09-12T03:34:44.098324+0000","last_peered":"2024-09-12T03:34:44.098324+0000","last_clean":"2024-09-12T03:34:44.098324+0000","last_became_active":"2024-09-12T03:34:43.212190+0000","last_became_peered":"2024-09-12T03:34:43.212190+0000","last_unstale":"2024-09-12T03:34:44.098324+0000","last_undegraded":"2024-09-12T03:34:44.098324+0000","last_fullsized":"2024-09-12T03:34:44.098324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010365+0000","last_change":"2024-09-12T03:34:39.087244+0000","last_active":"2024-09-12T03:34:45.010365+0000","last_peered":"2024-09-12T03:34:45.010365+0000","last_clean":"2024-09-12T03:34:45.010365+0000","last_became_active":"2024-09-12T03:34:39.085708+0000","last_became_peered":"2024-09-12T03:34:39.085708+0000","last_unstale":"2024-09-12T03:34:45.010365+0000","last_undegraded":"2024-09-12T03:34:45.010365+0000","last_fullsized":"2024-09-12T03:34:45.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:49.528251+0000","last_change":"2024-09-12T03:34:38.020300+0000","last_active":"2024-09-12T03:34:49.528251+0000","last_peered":"2024-09-12T03:34:49.528251+0000","last_clean":"2024-09-12T03:34:49.528251+0000","last_became_active":"2024-09-12T03:34:38.019416+0000","last_became_peered":"2024-09-12T03:34:38.019416+0000","last_unstale":"2024-09-12T03:34:49.528251+0000","last_undegraded":"2024-09-12T03:34:49.528251+0000","last_fullsized":"2024-09-12T03:34:49.528251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:57.206207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093034+0000","last_change":"2024-09-12T03:34:43.127205+0000","last_active":"2024-09-12T03:34:44.093034+0000","last_peered":"2024-09-12T03:34:44.093034+0000","last_clean":"2024-09-12T03:34:44.093034+0000","last_became_active":"2024-09-12T03:34:43.126473+0000","last_became_peered":"2024-09-12T03:34:43.126473+0000","last_unstale":"2024-09-12T03:34:44.093034+0000","last_undegraded":"2024-09-12T03:34:44.093034+0000","last_fullsized":"2024-09-12T03:34:44.093034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:08.474524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096722+0000","last_change":"2024-09-12T03:34:39.076678+0000","last_active":"2024-09-12T03:34:44.096722+0000","last_peered":"2024-09-12T03:34:44.096722+0000","last_clean":"2024-09-12T03:34:44.096722+0000","last_became_active":"2024-09-12T03:34:39.076007+0000","last_became_peered":"2024-09-12T03:34:39.076007+0000","last_unstale":"2024-09-12T03:34:44.096722+0000","last_undegraded":"2024-09-12T03:34:44.096722+0000","last_fullsized":"2024-09-12T03:34:44.096722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:29.999907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094072+0000","last_change":"2024-09-12T03:34:38.028753+0000","last_active":"2024-09-12T03:34:44.094072+0000","last_peered":"2024-09-12T03:34:44.094072+0000","last_clean":"2024-09-12T03:34:44.094072+0000","last_became_active":"2024-09-12T03:34:38.028499+0000","last_became_peered":"2024-09-12T03:34:38.028499+0000","last_unstale":"2024-09-12T03:34:44.094072+0000","last_undegraded":"2024-09-12T03:34:44.094072+0000","last_fullsized":"2024-09-12T03:34:44.094072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096751+0000","last_change":"2024-09-12T03:34:43.135662+0000","last_active":"2024-09-12T03:34:44.096751+0000","last_peered":"2024-09-12T03:34:44.096751+0000","last_clean":"2024-09-12T03:34:44.096751+0000","last_became_active":"2024-09-12T03:34:43.128133+0000","last_became_peered":"2024-09-12T03:34:43.128133+0000","last_unstale":"2024-09-12T03:34:44.096751+0000","last_undegraded":"2024-09-12T03:34:44.096751+0000","last_fullsized":"2024-09-12T03:34:44.096751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:41.314336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012301+0000","last_change":"2024-09-12T03:34:39.088237+0000","last_active":"2024-09-12T03:34:45.012301+0000","last_peered":"2024-09-12T03:34:45.012301+0000","last_clean":"2024-09-12T03:34:45.012301+0000","last_became_active":"2024-09-12T03:34:39.087952+0000","last_became_peered":"2024-09-12T03:34:39.087952+0000","last_unstale":"2024-09-12T03:34:45.012301+0000","last_undegraded":"2024-09-12T03:34:45.012301+0000","last_fullsized":"2024-09-12T03:34:45.012301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097921+0000","last_change":"2024-09-12T03:34:38.012565+0000","last_active":"2024-09-12T03:34:44.097921+0000","last_peered":"2024-09-12T03:34:44.097921+0000","last_clean":"2024-09-12T03:34:44.097921+0000","last_became_active":"2024-09-12T03:34:38.012023+0000","last_became_peered":"2024-09-12T03:34:38.012023+0000","last_unstale":"2024-09-12T03:34:44.097921+0000","last_undegraded":"2024-09-12T03:34:44.097921+0000","last_fullsized":"2024-09-12T03:34:44.097921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007983+0000","last_change":"2024-09-12T03:34:43.127550+0000","last_active":"2024-09-12T03:34:45.007983+0000","last_peered":"2024-09-12T03:34:45.007983+0000","last_clean":"2024-09-12T03:34:45.007983+0000","last_became_active":"2024-09-12T03:34:43.118399+0000","last_became_peered":"2024-09-12T03:34:43.118399+0000","last_unstale":"2024-09-12T03:34:45.007983+0000","last_undegraded":"2024-09-12T03:34:45.007983+0000","last_fullsized":"2024-09-12T03:34:45.007983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097682+0000","last_change":"2024-09-12T03:34:39.103021+0000","last_active":"2024-09-12T03:34:44.097682+0000","last_peered":"2024-09-12T03:34:44.097682+0000","last_clean":"2024-09-12T03:34:44.097682+0000","last_became_active":"2024-09-12T03:34:39.102537+0000","last_became_peered":"2024-09-12T03:34:39.102537+0000","last_unstale":"2024-09-12T03:34:44.097682+0000","last_undegraded":"2024-09-12T03:34:44.097682+0000","last_fullsized":"2024-09-12T03:34:44.097682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188469+0000","last_change":"2024-09-12T03:34:38.026833+0000","last_active":"2024-09-12T03:34:44.188469+0000","last_peered":"2024-09-12T03:34:44.188469+0000","last_clean":"2024-09-12T03:34:44.188469+0000","last_became_active":"2024-09-12T03:34:38.026268+0000","last_became_peered":"2024-09-12T03:34:38.026268+0000","last_unstale":"2024-09-12T03:34:44.188469+0000","last_undegraded":"2024-09-12T03:34:44.188469+0000","last_fullsized":"2024-09-12T03:34:44.188469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:52.708505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008838+0000","last_change":"2024-09-12T03:34:43.212792+0000","last_active":"2024-09-12T03:34:45.008838+0000","last_peered":"2024-09-12T03:34:45.008838+0000","last_clean":"2024-09-12T03:34:45.008838+0000","last_became_active":"2024-09-12T03:34:43.211671+0000","last_became_peered":"2024-09-12T03:34:43.211671+0000","last_unstale":"2024-09-12T03:34:45.008838+0000","last_undegraded":"2024-09-12T03:34:45.008838+0000","last_fullsized":"2024-09-12T03:34:45.008838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013459+0000","last_change":"2024-09-12T03:34:43.218438+0000","last_active":"2024-09-12T03:34:45.013459+0000","last_peered":"2024-09-12T03:34:45.013459+0000","last_clean":"2024-09-12T03:34:45.013459+0000","last_became_active":"2024-09-12T03:34:43.217735+0000","last_became_peered":"2024-09-12T03:34:43.217735+0000","last_unstale":"2024-09-12T03:34:45.013459+0000","last_undegraded":"2024-09-12T03:34:45.013459+0000","last_fullsized":"2024-09-12T03:34:45.013459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:19.562019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092348+0000","last_change":"2024-09-12T03:34:39.063362+0000","last_active":"2024-09-12T03:34:44.092348+0000","last_peered":"2024-09-12T03:34:44.092348+0000","last_clean":"2024-09-12T03:34:44.092348+0000","last_became_active":"2024-09-12T03:34:39.063020+0000","last_became_peered":"2024-09-12T03:34:39.063020+0000","last_unstale":"2024-09-12T03:34:44.092348+0000","last_undegraded":"2024-09-12T03:34:44.092348+0000","last_fullsized":"2024-09-12T03:34:44.092348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095747+0000","last_change":"2024-09-12T03:34:38.027195+0000","last_active":"2024-09-12T03:34:44.095747+0000","last_peered":"2024-09-12T03:34:44.095747+0000","last_clean":"2024-09-12T03:34:44.095747+0000","last_became_active":"2024-09-12T03:34:38.026662+0000","last_became_peered":"2024-09-12T03:34:38.026662+0000","last_unstale":"2024-09-12T03:34:44.095747+0000","last_undegraded":"2024-09-12T03:34:44.095747+0000","last_fullsized":"2024-09-12T03:34:44.095747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188079+0000","last_change":"2024-09-12T03:34:43.134866+0000","last_active":"2024-09-12T03:34:44.188079+0000","last_peered":"2024-09-12T03:34:44.188079+0000","last_clean":"2024-09-12T03:34:44.188079+0000","last_became_active":"2024-09-12T03:34:43.133525+0000","last_became_peered":"2024-09-12T03:34:43.133525+0000","last_unstale":"2024-09-12T03:34:44.188079+0000","last_undegraded":"2024-09-12T03:34:44.188079+0000","last_fullsized":"2024-09-12T03:34:44.188079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008011+0000","last_change":"2024-09-12T03:34:39.063056+0000","last_active":"2024-09-12T03:34:45.008011+0000","last_peered":"2024-09-12T03:34:45.008011+0000","last_clean":"2024-09-12T03:34:45.008011+0000","last_became_active":"2024-09-12T03:34:39.062761+0000","last_became_peered":"2024-09-12T03:34:39.062761+0000","last_unstale":"2024-09-12T03:34:45.008011+0000","last_undegraded":"2024-09-12T03:34:45.008011+0000","last_fullsized":"2024-09-12T03:34:45.008011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008537+0000","last_change":"2024-09-12T03:34:38.018201+0000","last_active":"2024-09-12T03:34:45.008537+0000","last_peered":"2024-09-12T03:34:45.008537+0000","last_clean":"2024-09-12T03:34:45.008537+0000","last_became_active":"2024-09-12T03:34:38.017942+0000","last_became_peered":"2024-09-12T03:34:38.017942+0000","last_unstale":"2024-09-12T03:34:45.008537+0000","last_undegraded":"2024-09-12T03:34:45.008537+0000","last_fullsized":"2024-09-12T03:34:45.008537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188411+0000","last_change":"2024-09-12T03:34:38.022415+0000","last_active":"2024-09-12T03:34:44.188411+0000","last_peered":"2024-09-12T03:34:44.188411+0000","last_clean":"2024-09-12T03:34:44.188411+0000","last_became_active":"2024-09-12T03:34:38.019452+0000","last_became_peered":"2024-09-12T03:34:38.019452+0000","last_unstale":"2024-09-12T03:34:44.188411+0000","last_undegraded":"2024-09-12T03:34:44.188411+0000","last_fullsized":"2024-09-12T03:34:44.188411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:48.971400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013639+0000","last_change":"2024-09-12T03:34:39.054095+0000","last_active":"2024-09-12T03:34:45.013639+0000","last_peered":"2024-09-12T03:34:45.013639+0000","last_clean":"2024-09-12T03:34:45.013639+0000","last_became_active":"2024-09-12T03:34:39.053738+0000","last_became_peered":"2024-09-12T03:34:39.053738+0000","last_unstale":"2024-09-12T03:34:45.013639+0000","last_undegraded":"2024-09-12T03:34:45.013639+0000","last_fullsized":"2024-09-12T03:34:45.013639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010585+0000","last_change":"2024-09-12T03:34:43.114138+0000","last_active":"2024-09-12T03:34:45.010585+0000","last_peered":"2024-09-12T03:34:45.010585+0000","last_clean":"2024-09-12T03:34:45.010585+0000","last_became_active":"2024-09-12T03:34:43.113549+0000","last_became_peered":"2024-09-12T03:34:43.113549+0000","last_unstale":"2024-09-12T03:34:45.010585+0000","last_undegraded":"2024-09-12T03:34:45.010585+0000","last_fullsized":"2024-09-12T03:34:45.010585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:38.432588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008571+0000","last_change":"2024-09-12T03:34:38.030379+0000","last_active":"2024-09-12T03:34:45.008571+0000","last_peered":"2024-09-12T03:34:45.008571+0000","last_clean":"2024-09-12T03:34:45.008571+0000","last_became_active":"2024-09-12T03:34:38.030041+0000","last_became_peered":"2024-09-12T03:34:38.030041+0000","last_unstale":"2024-09-12T03:34:45.008571+0000","last_undegraded":"2024-09-12T03:34:45.008571+0000","last_fullsized":"2024-09-12T03:34:45.008571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095998+0000","last_change":"2024-09-12T03:34:39.064296+0000","last_active":"2024-09-12T03:34:44.095998+0000","last_peered":"2024-09-12T03:34:44.095998+0000","last_clean":"2024-09-12T03:34:44.095998+0000","last_became_active":"2024-09-12T03:34:39.063569+0000","last_became_peered":"2024-09-12T03:34:39.063569+0000","last_unstale":"2024-09-12T03:34:44.095998+0000","last_undegraded":"2024-09-12T03:34:44.095998+0000","last_fullsized":"2024-09-12T03:34:44.095998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:42.375906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009228+0000","last_change":"2024-09-12T03:34:43.118123+0000","last_active":"2024-09-12T03:34:45.009228+0000","last_peered":"2024-09-12T03:34:45.009228+0000","last_clean":"2024-09-12T03:34:45.009228+0000","last_became_active":"2024-09-12T03:34:43.117722+0000","last_became_peered":"2024-09-12T03:34:43.117722+0000","last_unstale":"2024-09-12T03:34:45.009228+0000","last_undegraded":"2024-09-12T03:34:45.009228+0000","last_fullsized":"2024-09-12T03:34:45.009228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:08.248672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187424+0000","last_change":"2024-09-12T03:34:39.077386+0000","last_active":"2024-09-12T03:34:44.187424+0000","last_peered":"2024-09-12T03:34:44.187424+0000","last_clean":"2024-09-12T03:34:44.187424+0000","last_became_active":"2024-09-12T03:34:39.076662+0000","last_became_peered":"2024-09-12T03:34:39.076662+0000","last_unstale":"2024-09-12T03:34:44.187424+0000","last_undegraded":"2024-09-12T03:34:44.187424+0000","last_fullsized":"2024-09-12T03:34:44.187424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009701+0000","last_change":"2024-09-12T03:34:39.087463+0000","last_active":"2024-09-12T03:34:45.009701+0000","last_peered":"2024-09-12T03:34:45.009701+0000","last_clean":"2024-09-12T03:34:45.009701+0000","last_became_active":"2024-09-12T03:34:39.087165+0000","last_became_peered":"2024-09-12T03:34:39.087165+0000","last_unstale":"2024-09-12T03:34:45.009701+0000","last_undegraded":"2024-09-12T03:34:45.009701+0000","last_fullsized":"2024-09-12T03:34:45.009701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096888+0000","last_change":"2024-09-12T03:34:39.098154+0000","last_active":"2024-09-12T03:34:44.096888+0000","last_peered":"2024-09-12T03:34:44.096888+0000","last_clean":"2024-09-12T03:34:44.096888+0000","last_became_active":"2024-09-12T03:34:39.097223+0000","last_became_peered":"2024-09-12T03:34:39.097223+0000","last_unstale":"2024-09-12T03:34:44.096888+0000","last_undegraded":"2024-09-12T03:34:44.096888+0000","last_fullsized":"2024-09-12T03:34:44.096888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013401+0000","last_change":"2024-09-12T03:34:39.065566+0000","last_active":"2024-09-12T03:34:45.013401+0000","last_peered":"2024-09-12T03:34:45.013401+0000","last_clean":"2024-09-12T03:34:45.013401+0000","last_became_active":"2024-09-12T03:34:39.065271+0000","last_became_peered":"2024-09-12T03:34:39.065271+0000","last_unstale":"2024-09-12T03:34:45.013401+0000","last_undegraded":"2024-09-12T03:34:45.013401+0000","last_fullsized":"2024-09-12T03:34:45.013401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:21.031062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009257+0000","last_change":"2024-09-12T03:34:39.080421+0000","last_active":"2024-09-12T03:34:45.009257+0000","last_peered":"2024-09-12T03:34:45.009257+0000","last_clean":"2024-09-12T03:34:45.009257+0000","last_became_active":"2024-09-12T03:34:39.080177+0000","last_became_peered":"2024-09-12T03:34:39.080177+0000","last_unstale":"2024-09-12T03:34:45.009257+0000","last_undegraded":"2024-09-12T03:34:45.009257+0000","last_fullsized":"2024-09-12T03:34:45.009257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093781+0000","last_change":"2024-09-12T03:34:39.064463+0000","last_active":"2024-09-12T03:34:44.093781+0000","last_peered":"2024-09-12T03:34:44.093781+0000","last_clean":"2024-09-12T03:34:44.093781+0000","last_became_active":"2024-09-12T03:34:39.064221+0000","last_became_peered":"2024-09-12T03:34:39.064221+0000","last_unstale":"2024-09-12T03:34:44.093781+0000","last_undegraded":"2024-09-12T03:34:44.093781+0000","last_fullsized":"2024-09-12T03:34:44.093781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188514+0000","last_change":"2024-09-12T03:34:39.104917+0000","last_active":"2024-09-12T03:34:44.188514+0000","last_peered":"2024-09-12T03:34:44.188514+0000","last_clean":"2024-09-12T03:34:44.188514+0000","last_became_active":"2024-09-12T03:34:39.104399+0000","last_became_peered":"2024-09-12T03:34:39.104399+0000","last_unstale":"2024-09-12T03:34:44.188514+0000","last_undegraded":"2024-09-12T03:34:44.188514+0000","last_fullsized":"2024-09-12T03:34:44.188514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:03.567787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010275+0000","last_change":"2024-09-12T03:34:39.081674+0000","last_active":"2024-09-12T03:34:45.010275+0000","last_peered":"2024-09-12T03:34:45.010275+0000","last_clean":"2024-09-12T03:34:45.010275+0000","last_became_active":"2024-09-12T03:34:39.081415+0000","last_became_peered":"2024-09-12T03:34:39.081415+0000","last_unstale":"2024-09-12T03:34:45.010275+0000","last_undegraded":"2024-09-12T03:34:45.010275+0000","last_fullsized":"2024-09-12T03:34:45.010275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095516+0000","last_change":"2024-09-12T03:34:39.105000+0000","last_active":"2024-09-12T03:34:44.095516+0000","last_peered":"2024-09-12T03:34:44.095516+0000","last_clean":"2024-09-12T03:34:44.095516+0000","last_became_active":"2024-09-12T03:34:39.104552+0000","last_became_peered":"2024-09-12T03:34:39.104552+0000","last_unstale":"2024-09-12T03:34:44.095516+0000","last_undegraded":"2024-09-12T03:34:44.095516+0000","last_fullsized":"2024-09-12T03:34:44.095516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008305+0000","last_change":"2024-09-12T03:34:39.081413+0000","last_active":"2024-09-12T03:34:45.008305+0000","last_peered":"2024-09-12T03:34:45.008305+0000","last_clean":"2024-09-12T03:34:45.008305+0000","last_became_active":"2024-09-12T03:34:39.081124+0000","last_became_peered":"2024-09-12T03:34:39.081124+0000","last_unstale":"2024-09-12T03:34:45.008305+0000","last_undegraded":"2024-09-12T03:34:45.008305+0000","last_fullsized":"2024-09-12T03:34:45.008305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096657+0000","last_change":"2024-09-12T03:34:39.103486+0000","last_active":"2024-09-12T03:34:44.096657+0000","last_peered":"2024-09-12T03:34:44.096657+0000","last_clean":"2024-09-12T03:34:44.096657+0000","last_became_active":"2024-09-12T03:34:39.102713+0000","last_became_peered":"2024-09-12T03:34:39.102713+0000","last_unstale":"2024-09-12T03:34:44.096657+0000","last_undegraded":"2024-09-12T03:34:44.096657+0000","last_fullsized":"2024-09-12T03:34:44.096657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013159+0000","last_change":"2024-09-12T03:34:39.084516+0000","last_active":"2024-09-12T03:34:45.013159+0000","last_peered":"2024-09-12T03:34:45.013159+0000","last_clean":"2024-09-12T03:34:45.013159+0000","last_became_active":"2024-09-12T03:34:39.084230+0000","last_became_peered":"2024-09-12T03:34:39.084230+0000","last_unstale":"2024-09-12T03:34:45.013159+0000","last_undegraded":"2024-09-12T03:34:45.013159+0000","last_fullsized":"2024-09-12T03:34:45.013159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:35.100430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:39.107212+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:39.106301+0000","last_became_peered":"2024-09-12T03:34:39.106301+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010903+0000","last_change":"2024-09-12T03:34:39.087886+0000","last_active":"2024-09-12T03:34:45.010903+0000","last_peered":"2024-09-12T03:34:45.010903+0000","last_clean":"2024-09-12T03:34:45.010903+0000","last_became_active":"2024-09-12T03:34:39.086540+0000","last_became_peered":"2024-09-12T03:34:39.086540+0000","last_unstale":"2024-09-12T03:34:45.010903+0000","last_undegraded":"2024-09-12T03:34:45.010903+0000","last_fullsized":"2024-09-12T03:34:45.010903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011752+0000","last_change":"2024-09-12T03:34:39.090922+0000","last_active":"2024-09-12T03:34:45.011752+0000","last_peered":"2024-09-12T03:34:45.011752+0000","last_clean":"2024-09-12T03:34:45.011752+0000","last_became_active":"2024-09-12T03:34:39.090678+0000","last_became_peered":"2024-09-12T03:34:39.090678+0000","last_unstale":"2024-09-12T03:34:45.011752+0000","last_undegraded":"2024-09-12T03:34:45.011752+0000","last_fullsized":"2024-09-12T03:34:45.011752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.099310+0000","last_change":"2024-09-12T03:34:39.103626+0000","last_active":"2024-09-12T03:34:44.099310+0000","last_peered":"2024-09-12T03:34:44.099310+0000","last_clean":"2024-09-12T03:34:44.099310+0000","last_became_active":"2024-09-12T03:34:39.102752+0000","last_became_peered":"2024-09-12T03:34:39.102752+0000","last_unstale":"2024-09-12T03:34:44.099310+0000","last_undegraded":"2024-09-12T03:34:44.099310+0000","last_fullsized":"2024-09-12T03:34:44.099310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095270+0000","last_change":"2024-09-12T03:34:39.088569+0000","last_active":"2024-09-12T03:34:44.095270+0000","last_peered":"2024-09-12T03:34:44.095270+0000","last_clean":"2024-09-12T03:34:44.095270+0000","last_became_active":"2024-09-12T03:34:39.088031+0000","last_became_peered":"2024-09-12T03:34:39.088031+0000","last_unstale":"2024-09-12T03:34:44.095270+0000","last_undegraded":"2024-09-12T03:34:44.095270+0000","last_fullsized":"2024-09-12T03:34:44.095270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092516+0000","last_change":"2024-09-12T03:34:39.081983+0000","last_active":"2024-09-12T03:34:44.092516+0000","last_peered":"2024-09-12T03:34:44.092516+0000","last_clean":"2024-09-12T03:34:44.092516+0000","last_became_active":"2024-09-12T03:34:39.081670+0000","last_became_peered":"2024-09-12T03:34:39.081670+0000","last_unstale":"2024-09-12T03:34:44.092516+0000","last_undegraded":"2024-09-12T03:34:44.092516+0000","last_fullsized":"2024-09-12T03:34:44.092516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012007+0000","last_change":"2024-09-12T03:34:39.058851+0000","last_active":"2024-09-12T03:34:45.012007+0000","last_peered":"2024-09-12T03:34:45.012007+0000","last_clean":"2024-09-12T03:34:45.012007+0000","last_became_active":"2024-09-12T03:34:39.058122+0000","last_became_peered":"2024-09-12T03:34:39.058122+0000","last_unstale":"2024-09-12T03:34:45.012007+0000","last_undegraded":"2024-09-12T03:34:45.012007+0000","last_fullsized":"2024-09-12T03:34:45.012007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:12.193080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008220+0000","last_change":"2024-09-12T03:34:39.067672+0000","last_active":"2024-09-12T03:34:45.008220+0000","last_peered":"2024-09-12T03:34:45.008220+0000","last_clean":"2024-09-12T03:34:45.008220+0000","last_became_active":"2024-09-12T03:34:39.067402+0000","last_became_peered":"2024-09-12T03:34:39.067402+0000","last_unstale":"2024-09-12T03:34:45.008220+0000","last_undegraded":"2024-09-12T03:34:45.008220+0000","last_fullsized":"2024-09-12T03:34:45.008220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096493+0000","last_change":"2024-09-12T03:34:39.108544+0000","last_active":"2024-09-12T03:34:44.096493+0000","last_peered":"2024-09-12T03:34:44.096493+0000","last_clean":"2024-09-12T03:34:44.096493+0000","last_became_active":"2024-09-12T03:34:39.108009+0000","last_became_peered":"2024-09-12T03:34:39.108009+0000","last_unstale":"2024-09-12T03:34:44.096493+0000","last_undegraded":"2024-09-12T03:34:44.096493+0000","last_fullsized":"2024-09-12T03:34:44.096493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188461+0000","last_change":"2024-09-12T03:34:39.104075+0000","last_active":"2024-09-12T03:34:44.188461+0000","last_peered":"2024-09-12T03:34:44.188461+0000","last_clean":"2024-09-12T03:34:44.188461+0000","last_became_active":"2024-09-12T03:34:39.094220+0000","last_became_peered":"2024-09-12T03:34:39.094220+0000","last_unstale":"2024-09-12T03:34:44.188461+0000","last_undegraded":"2024-09-12T03:34:44.188461+0000","last_fullsized":"2024-09-12T03:34:44.188461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188458+0000","last_change":"2024-09-12T03:34:39.093290+0000","last_active":"2024-09-12T03:34:44.188458+0000","last_peered":"2024-09-12T03:34:44.188458+0000","last_clean":"2024-09-12T03:34:44.188458+0000","last_became_active":"2024-09-12T03:34:39.092378+0000","last_became_peered":"2024-09-12T03:34:39.092378+0000","last_unstale":"2024-09-12T03:34:44.188458+0000","last_undegraded":"2024-09-12T03:34:44.188458+0000","last_fullsized":"2024-09-12T03:34:44.188458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011121+0000","last_change":"2024-09-12T03:34:39.099671+0000","last_active":"2024-09-12T03:34:45.011121+0000","last_peered":"2024-09-12T03:34:45.011121+0000","last_clean":"2024-09-12T03:34:45.011121+0000","last_became_active":"2024-09-12T03:34:39.099044+0000","last_became_peered":"2024-09-12T03:34:39.099044+0000","last_unstale":"2024-09-12T03:34:45.011121+0000","last_undegraded":"2024-09-12T03:34:45.011121+0000","last_fullsized":"2024-09-12T03:34:45.011121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007754+0000","last_change":"2024-09-12T03:34:39.097597+0000","last_active":"2024-09-12T03:34:45.007754+0000","last_peered":"2024-09-12T03:34:45.007754+0000","last_clean":"2024-09-12T03:34:45.007754+0000","last_became_active":"2024-09-12T03:34:39.097301+0000","last_became_peered":"2024-09-12T03:34:39.097301+0000","last_unstale":"2024-09-12T03:34:45.007754+0000","last_undegraded":"2024-09-12T03:34:45.007754+0000","last_fullsized":"2024-09-12T03:34:45.007754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:24.666071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009891+0000","last_change":"2024-09-12T03:34:39.084776+0000","last_active":"2024-09-12T03:34:45.009891+0000","last_peered":"2024-09-12T03:34:45.009891+0000","last_clean":"2024-09-12T03:34:45.009891+0000","last_became_active":"2024-09-12T03:34:39.083987+0000","last_became_peered":"2024-09-12T03:34:39.083987+0000","last_unstale":"2024-09-12T03:34:45.009891+0000","last_undegraded":"2024-09-12T03:34:45.009891+0000","last_fullsized":"2024-09-12T03:34:45.009891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096430+0000","last_change":"2024-09-12T03:34:39.088318+0000","last_active":"2024-09-12T03:34:44.096430+0000","last_peered":"2024-09-12T03:34:44.096430+0000","last_clean":"2024-09-12T03:34:44.096430+0000","last_became_active":"2024-09-12T03:34:39.087777+0000","last_became_peered":"2024-09-12T03:34:39.087777+0000","last_unstale":"2024-09-12T03:34:44.096430+0000","last_undegraded":"2024-09-12T03:34:44.096430+0000","last_fullsized":"2024-09-12T03:34:44.096430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009971+0000","last_change":"2024-09-12T03:34:39.085197+0000","last_active":"2024-09-12T03:34:45.009971+0000","last_peered":"2024-09-12T03:34:45.009971+0000","last_clean":"2024-09-12T03:34:45.009971+0000","last_became_active":"2024-09-12T03:34:39.084478+0000","last_became_peered":"2024-09-12T03:34:39.084478+0000","last_unstale":"2024-09-12T03:34:45.009971+0000","last_undegraded":"2024-09-12T03:34:45.009971+0000","last_fullsized":"2024-09-12T03:34:45.009971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097330+0000","last_change":"2024-09-12T03:34:39.097105+0000","last_active":"2024-09-12T03:34:44.097330+0000","last_peered":"2024-09-12T03:34:44.097330+0000","last_clean":"2024-09-12T03:34:44.097330+0000","last_became_active":"2024-09-12T03:34:39.088754+0000","last_became_peered":"2024-09-12T03:34:39.088754+0000","last_unstale":"2024-09-12T03:34:44.097330+0000","last_undegraded":"2024-09-12T03:34:44.097330+0000","last_fullsized":"2024-09-12T03:34:44.097330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011922+0000","last_change":"2024-09-12T03:34:39.049548+0000","last_active":"2024-09-12T03:34:45.011922+0000","last_peered":"2024-09-12T03:34:45.011922+0000","last_clean":"2024-09-12T03:34:45.011922+0000","last_became_active":"2024-09-12T03:34:39.049247+0000","last_became_peered":"2024-09-12T03:34:39.049247+0000","last_unstale":"2024-09-12T03:34:45.011922+0000","last_undegraded":"2024-09-12T03:34:45.011922+0000","last_fullsized":"2024-09-12T03:34:45.011922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094491+0000","last_change":"2024-09-12T03:34:39.061225+0000","last_active":"2024-09-12T03:34:44.094491+0000","last_peered":"2024-09-12T03:34:44.094491+0000","last_clean":"2024-09-12T03:34:44.094491+0000","last_became_active":"2024-09-12T03:34:39.060943+0000","last_became_peered":"2024-09-12T03:34:39.060943+0000","last_unstale":"2024-09-12T03:34:44.094491+0000","last_undegraded":"2024-09-12T03:34:44.094491+0000","last_fullsized":"2024-09-12T03:34:44.094491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010849+0000","last_change":"2024-09-12T03:34:39.105481+0000","last_active":"2024-09-12T03:34:45.010849+0000","last_peered":"2024-09-12T03:34:45.010849+0000","last_clean":"2024-09-12T03:34:45.010849+0000","last_became_active":"2024-09-12T03:34:39.105018+0000","last_became_peered":"2024-09-12T03:34:39.105018+0000","last_unstale":"2024-09-12T03:34:45.010849+0000","last_undegraded":"2024-09-12T03:34:45.010849+0000","last_fullsized":"2024-09-12T03:34:45.010849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:34:56.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:34:56.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.944+0000 7f3b07bdc640 1 Processor -- start 2024-09-12T03:34:56.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.944+0000 7f3b07bdc640 1 -- start start 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b07bdc640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b0006f010 0x7f3b00166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b07bdc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b000b3290 con 0x7f3b0015c2a0 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b07bdc640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b000b3570 con 0x7f3b0015bec0 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b07bdc640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3b000b3850 con 0x7f3b0006f010 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3b0015c2a0 0x7f3b000aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59832/0 (socket says 172.21.15.73:59832) 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 -- 172.21.15.73:0/4047924533 learned_addr learned my addr 172.21.15.73:0/4047924533 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b06179640 1 --2- 172.21.15.73:0/4047924533 >> v2:172.21.15.150:3300/0 conn(0x7f3b0006f010 0x7f3b00166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257358347 0 0) 0x7f3b000b3290 con 0x7f3b0015c2a0 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3aec003530 con 0x7f3b0015c2a0 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1687886018 0 0) 0x7f3aec003530 con 0x7f3b0015c2a0 2024-09-12T03:34:56.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 >> v2:172.21.15.150:3300/0 conn(0x7f3b0006f010 msgr2=0x7f3b00166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 --2- 172.21.15.73:0/4047924533 >> v2:172.21.15.150:3300/0 conn(0x7f3b0006f010 0x7f3b00166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 >> v1:172.21.15.150:6789/0 conn(0x7f3b0015bec0 legacy=0x7f3b000ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b000b3b30 con 0x7f3b0015c2a0 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f3af0001680 con 0x7f3b0015c2a0 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 >> v1:172.21.15.73:6789/0 conn(0x7f3b0015c2a0 legacy=0x7f3b000aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3aec0039c0 0x7f3aec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3aec004810 0x7f3aec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec0051d0 0x7f3aec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3b000b3850 con 0x7f3aec004810 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec00c070 con 0x7f3aec0051d0 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3aec00c270 con 0x7f3aec0039c0 2024-09-12T03:34:56.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3aec004810 0x7f3aec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b06179640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec0051d0 0x7f3aec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 -- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3aec0039c0 msgr2=0x7f3aec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05978640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3aec0039c0 0x7f3aec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3aec0039c0 0x7f3aec003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 -- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec0051d0 msgr2=0x7f3aec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec0051d0 0x7f3aec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b05177640 1 -- 172.21.15.73:0/4047924533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec003530 con 0x7f3aec004810 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b06179640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec0051d0 0x7f3aec00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:56.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.948+0000 7f3b06179640 1 -- 172.21.15.73:0/4047924533 reap_dead start 2024-09-12T03:34:56.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3aec004810 0x7f3aec004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c190 tx=0x7f3af001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc3e37e8c0f536 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0007d00 con 0x7f3aec004810 2024-09-12T03:34:56.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af0005b00 con 0x7f3aec004810 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b04976640 1 -- 172.21.15.73:0/4047924533 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0007070 con 0x7f3aec004810 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- 172.21.15.73:0/4047924533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3aec004810 msgr2=0x7f3aec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3aec004810 0x7f3aec004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c190 tx=0x7f3af001f310 comp rx=0 tx=0).stop 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- 172.21.15.73:0/4047924533 shutdown_connections 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/4047924533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3aec004810 0x7f3aec004c90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- 172.21.15.73:0/4047924533 >> 172.21.15.73:0/4047924533 conn(0x7f3b000b1f90 msgr2=0x7f3b000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- 172.21.15.73:0/4047924533 shutdown_connections 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- 172.21.15.73:0/4047924533 wait complete. 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 Processor -- start 2024-09-12T03:34:56.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- start start 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec004810 0x7f3b001f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b0015f060 0x7f3b001e7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000b1140 0x7f3b000b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3b000afc90 con 0x7f3b0015f060 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b000b40f0 con 0x7f3aec004810 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3b000ad200 con 0x7f3b000b1140 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b0015f060 0x7f3b001e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b0015f060 0x7f3b001e7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37194/0 (socket says 172.21.15.73:37194) 2024-09-12T03:34:56.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 -- 172.21.15.73:0/3367869124 learned_addr learned my addr 172.21.15.73:0/3367869124 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b06179640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000b1140 0x7f3b000b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05978640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec004810 0x7f3b001f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 -- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000b1140 msgr2=0x7f3b000b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000b1140 0x7f3b000b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 -- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec004810 msgr2=0x7f3b001f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec004810 0x7f3b001f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 -- 172.21.15.73:0/3367869124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b001f8750 con 0x7f3b0015f060 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b05177640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b0015f060 0x7f3b001e7150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3af001f140 tx=0x7f3aec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3af67fc640 1 -- 172.21.15.73:0/3367869124 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0007d00 con 0x7f3b0015f060 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3af67fc640 1 -- 172.21.15.73:0/3367869124 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af0000ee0 con 0x7f3b0015f060 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b0015dfc0 con 0x7f3b0015f060 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3af67fc640 1 -- 172.21.15.73:0/3367869124 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0001440 con 0x7f3b0015f060 2024-09-12T03:34:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.952+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b0015e580 con 0x7f3b0015f060 2024-09-12T03:34:56.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.956+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b000ad530 con 0x7f3b0015f060 2024-09-12T03:34:56.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.956+0000 7f3af67fc640 1 -- 172.21.15.73:0/3367869124 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3af00047f0 con 0x7f3b0015f060 2024-09-12T03:34:56.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.956+0000 7f3af67fc640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ae40678f0 0x7f3ae4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:56.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.956+0000 7f3af67fc640 1 -- 172.21.15.73:0/3367869124 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3af0123460 con 0x7f3b0015f060 2024-09-12T03:34:56.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.956+0000 7f3b05978640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ae40678f0 0x7f3ae4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:56.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.956+0000 7f3b05978640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ae40678f0 0x7f3ae4069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3afc000c10 tx=0x7f3afc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:56.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:56.960+0000 7f3af67fc640 1 -- 172.21.15.73:0/3367869124 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3af00c1060 con 0x7f3b0015f060 2024-09-12T03:34:57.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.104+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b0006fcd0 con 0x7f3ae40678f0 2024-09-12T03:34:57.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.116+0000 7f3af67fc640 1 -- 172.21.15.73:0/3367869124 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f3b0006fcd0 con 0x7f3ae40678f0 2024-09-12T03:34:57.124 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:57.126 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:34:57.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ae40678f0 msgr2=0x7f3ae4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ae40678f0 0x7f3ae4069db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3afc000c10 tx=0x7f3afc009040 comp rx=0 tx=0).stop 2024-09-12T03:34:57.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b0015f060 msgr2=0x7f3b001e7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b0015f060 0x7f3b001e7150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3af001f140 tx=0x7f3aec005840 comp rx=0 tx=0).stop 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 shutdown_connections 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ae40678f0 0x7f3ae4069db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b0015f060 0x7f3b001e7150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b000b1140 0x7f3b000b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 --2- 172.21.15.73:0/3367869124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aec004810 0x7f3b001f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 >> 172.21.15.73:0/3367869124 conn(0x7f3b000b1f90 msgr2=0x7f3b00157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 shutdown_connections 2024-09-12T03:34:57.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.120+0000 7f3b07bdc640 1 -- 172.21.15.73:0/3367869124 wait complete. 2024-09-12T03:34:57.140 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-12T03:34:55.792482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3240,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3317760,"data_stored":2006572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.702719"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012394+0000","last_change":"2024-09-12T03:34:38.010797+0000","last_active":"2024-09-12T03:34:45.012394+0000","last_peered":"2024-09-12T03:34:45.012394+0000","last_clean":"2024-09-12T03:34:45.012394+0000","last_became_active":"2024-09-12T03:34:38.010433+0000","last_became_peered":"2024-09-12T03:34:38.010433+0000","last_unstale":"2024-09-12T03:34:45.012394+0000","last_undegraded":"2024-09-12T03:34:45.012394+0000","last_fullsized":"2024-09-12T03:34:45.012394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.531455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009665+0000","last_change":"2024-09-12T03:34:39.074559+0000","last_active":"2024-09-12T03:34:45.009665+0000","last_peered":"2024-09-12T03:34:45.009665+0000","last_clean":"2024-09-12T03:34:45.009665+0000","last_became_active":"2024-09-12T03:34:39.074317+0000","last_became_peered":"2024-09-12T03:34:39.074317+0000","last_unstale":"2024-09-12T03:34:45.009665+0000","last_undegraded":"2024-09-12T03:34:45.009665+0000","last_fullsized":"2024-09-12T03:34:45.009665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007763+0000","last_change":"2024-09-12T03:34:43.218439+0000","last_active":"2024-09-12T03:34:45.007763+0000","last_peered":"2024-09-12T03:34:45.007763+0000","last_clean":"2024-09-12T03:34:45.007763+0000","last_became_active":"2024-09-12T03:34:43.216661+0000","last_became_peered":"2024-09-12T03:34:43.216661+0000","last_unstale":"2024-09-12T03:34:45.007763+0000","last_undegraded":"2024-09-12T03:34:45.007763+0000","last_fullsized":"2024-09-12T03:34:45.007763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:12.169699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010114+0000","last_change":"2024-09-12T03:34:38.014275+0000","last_active":"2024-09-12T03:34:45.010114+0000","last_peered":"2024-09-12T03:34:45.010114+0000","last_clean":"2024-09-12T03:34:45.010114+0000","last_became_active":"2024-09-12T03:34:38.013821+0000","last_became_peered":"2024-09-12T03:34:38.013821+0000","last_unstale":"2024-09-12T03:34:45.010114+0000","last_undegraded":"2024-09-12T03:34:45.010114+0000","last_fullsized":"2024-09-12T03:34:45.010114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012133+0000","last_change":"2024-09-12T03:34:39.088423+0000","last_active":"2024-09-12T03:34:45.012133+0000","last_peered":"2024-09-12T03:34:45.012133+0000","last_clean":"2024-09-12T03:34:45.012133+0000","last_became_active":"2024-09-12T03:34:39.088198+0000","last_became_peered":"2024-09-12T03:34:39.088198+0000","last_unstale":"2024-09-12T03:34:45.012133+0000","last_undegraded":"2024-09-12T03:34:45.012133+0000","last_fullsized":"2024-09-12T03:34:45.012133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097304+0000","last_change":"2024-09-12T03:34:43.134447+0000","last_active":"2024-09-12T03:34:44.097304+0000","last_peered":"2024-09-12T03:34:44.097304+0000","last_clean":"2024-09-12T03:34:44.097304+0000","last_became_active":"2024-09-12T03:34:43.131156+0000","last_became_peered":"2024-09-12T03:34:43.131156+0000","last_unstale":"2024-09-12T03:34:44.097304+0000","last_undegraded":"2024-09-12T03:34:44.097304+0000","last_fullsized":"2024-09-12T03:34:44.097304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010783+0000","last_change":"2024-09-12T03:34:38.029333+0000","last_active":"2024-09-12T03:34:45.010783+0000","last_peered":"2024-09-12T03:34:45.010783+0000","last_clean":"2024-09-12T03:34:45.010783+0000","last_became_active":"2024-09-12T03:34:38.028881+0000","last_became_peered":"2024-09-12T03:34:38.028881+0000","last_unstale":"2024-09-12T03:34:45.010783+0000","last_undegraded":"2024-09-12T03:34:45.010783+0000","last_fullsized":"2024-09-12T03:34:45.010783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097344+0000","last_change":"2024-09-12T03:34:39.099744+0000","last_active":"2024-09-12T03:34:44.097344+0000","last_peered":"2024-09-12T03:34:44.097344+0000","last_clean":"2024-09-12T03:34:44.097344+0000","last_became_active":"2024-09-12T03:34:39.098494+0000","last_became_peered":"2024-09-12T03:34:39.098494+0000","last_unstale":"2024-09-12T03:34:44.097344+0000","last_undegraded":"2024-09-12T03:34:44.097344+0000","last_fullsized":"2024-09-12T03:34:44.097344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096627+0000","last_change":"2024-09-12T03:34:43.136579+0000","last_active":"2024-09-12T03:34:44.096627+0000","last_peered":"2024-09-12T03:34:44.096627+0000","last_clean":"2024-09-12T03:34:44.096627+0000","last_became_active":"2024-09-12T03:34:43.131614+0000","last_became_peered":"2024-09-12T03:34:43.131614+0000","last_unstale":"2024-09-12T03:34:44.096627+0000","last_undegraded":"2024-09-12T03:34:44.096627+0000","last_fullsized":"2024-09-12T03:34:44.096627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:04.948070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010371+0000","last_change":"2024-09-12T03:34:38.031062+0000","last_active":"2024-09-12T03:34:45.010371+0000","last_peered":"2024-09-12T03:34:45.010371+0000","last_clean":"2024-09-12T03:34:45.010371+0000","last_became_active":"2024-09-12T03:34:38.030527+0000","last_became_peered":"2024-09-12T03:34:38.030527+0000","last_unstale":"2024-09-12T03:34:45.010371+0000","last_undegraded":"2024-09-12T03:34:45.010371+0000","last_fullsized":"2024-09-12T03:34:45.010371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098474+0000","last_change":"2024-09-12T03:34:39.101380+0000","last_active":"2024-09-12T03:34:44.098474+0000","last_peered":"2024-09-12T03:34:44.098474+0000","last_clean":"2024-09-12T03:34:44.098474+0000","last_became_active":"2024-09-12T03:34:39.099679+0000","last_became_peered":"2024-09-12T03:34:39.099679+0000","last_unstale":"2024-09-12T03:34:44.098474+0000","last_undegraded":"2024-09-12T03:34:44.098474+0000","last_fullsized":"2024-09-12T03:34:44.098474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095057+0000","last_change":"2024-09-12T03:34:43.128313+0000","last_active":"2024-09-12T03:34:44.095057+0000","last_peered":"2024-09-12T03:34:44.095057+0000","last_clean":"2024-09-12T03:34:44.095057+0000","last_became_active":"2024-09-12T03:34:43.126843+0000","last_became_peered":"2024-09-12T03:34:43.126843+0000","last_unstale":"2024-09-12T03:34:44.095057+0000","last_undegraded":"2024-09-12T03:34:44.095057+0000","last_fullsized":"2024-09-12T03:34:44.095057+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:23.563428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187338+0000","last_change":"2024-09-12T03:34:39.093427+0000","last_active":"2024-09-12T03:34:44.187338+0000","last_peered":"2024-09-12T03:34:44.187338+0000","last_clean":"2024-09-12T03:34:44.187338+0000","last_became_active":"2024-09-12T03:34:39.092380+0000","last_became_peered":"2024-09-12T03:34:39.092380+0000","last_unstale":"2024-09-12T03:34:44.187338+0000","last_undegraded":"2024-09-12T03:34:44.187338+0000","last_fullsized":"2024-09-12T03:34:44.187338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010267+0000","last_change":"2024-09-12T03:34:38.029799+0000","last_active":"2024-09-12T03:34:45.010267+0000","last_peered":"2024-09-12T03:34:45.010267+0000","last_clean":"2024-09-12T03:34:45.010267+0000","last_became_active":"2024-09-12T03:34:38.027974+0000","last_became_peered":"2024-09-12T03:34:38.027974+0000","last_unstale":"2024-09-12T03:34:45.010267+0000","last_undegraded":"2024-09-12T03:34:45.010267+0000","last_fullsized":"2024-09-12T03:34:45.010267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095984+0000","last_change":"2024-09-12T03:34:43.124251+0000","last_active":"2024-09-12T03:34:44.095984+0000","last_peered":"2024-09-12T03:34:44.095984+0000","last_clean":"2024-09-12T03:34:44.095984+0000","last_became_active":"2024-09-12T03:34:43.123246+0000","last_became_peered":"2024-09-12T03:34:43.123246+0000","last_unstale":"2024-09-12T03:34:44.095984+0000","last_undegraded":"2024-09-12T03:34:44.095984+0000","last_fullsized":"2024-09-12T03:34:44.095984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.896904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010770+0000","last_change":"2024-09-12T03:34:39.066746+0000","last_active":"2024-09-12T03:34:45.010770+0000","last_peered":"2024-09-12T03:34:45.010770+0000","last_clean":"2024-09-12T03:34:45.010770+0000","last_became_active":"2024-09-12T03:34:39.066399+0000","last_became_peered":"2024-09-12T03:34:39.066399+0000","last_unstale":"2024-09-12T03:34:45.010770+0000","last_undegraded":"2024-09-12T03:34:45.010770+0000","last_fullsized":"2024-09-12T03:34:45.010770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093375+0000","last_change":"2024-09-12T03:34:38.005663+0000","last_active":"2024-09-12T03:34:44.093375+0000","last_peered":"2024-09-12T03:34:44.093375+0000","last_clean":"2024-09-12T03:34:44.093375+0000","last_became_active":"2024-09-12T03:34:38.005160+0000","last_became_peered":"2024-09-12T03:34:38.005160+0000","last_unstale":"2024-09-12T03:34:44.093375+0000","last_undegraded":"2024-09-12T03:34:44.093375+0000","last_fullsized":"2024-09-12T03:34:44.093375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095966+0000","last_change":"2024-09-12T03:34:43.131000+0000","last_active":"2024-09-12T03:34:44.095966+0000","last_peered":"2024-09-12T03:34:44.095966+0000","last_clean":"2024-09-12T03:34:44.095966+0000","last_became_active":"2024-09-12T03:34:43.129785+0000","last_became_peered":"2024-09-12T03:34:43.129785+0000","last_unstale":"2024-09-12T03:34:44.095966+0000","last_undegraded":"2024-09-12T03:34:44.095966+0000","last_fullsized":"2024-09-12T03:34:44.095966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:17.250004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008215+0000","last_change":"2024-09-12T03:34:39.065304+0000","last_active":"2024-09-12T03:34:45.008215+0000","last_peered":"2024-09-12T03:34:45.008215+0000","last_clean":"2024-09-12T03:34:45.008215+0000","last_became_active":"2024-09-12T03:34:39.065027+0000","last_became_peered":"2024-09-12T03:34:39.065027+0000","last_unstale":"2024-09-12T03:34:45.008215+0000","last_undegraded":"2024-09-12T03:34:45.008215+0000","last_fullsized":"2024-09-12T03:34:45.008215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092648+0000","last_change":"2024-09-12T03:34:38.020702+0000","last_active":"2024-09-12T03:34:44.092648+0000","last_peered":"2024-09-12T03:34:44.092648+0000","last_clean":"2024-09-12T03:34:44.092648+0000","last_became_active":"2024-09-12T03:34:38.020279+0000","last_became_peered":"2024-09-12T03:34:38.020279+0000","last_unstale":"2024-09-12T03:34:44.092648+0000","last_undegraded":"2024-09-12T03:34:44.092648+0000","last_fullsized":"2024-09-12T03:34:44.092648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:24.452534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094739+0000","last_change":"2024-09-12T03:34:43.215466+0000","last_active":"2024-09-12T03:34:44.094739+0000","last_peered":"2024-09-12T03:34:44.094739+0000","last_clean":"2024-09-12T03:34:44.094739+0000","last_became_active":"2024-09-12T03:34:43.214416+0000","last_became_peered":"2024-09-12T03:34:43.214416+0000","last_unstale":"2024-09-12T03:34:44.094739+0000","last_undegraded":"2024-09-12T03:34:44.094739+0000","last_fullsized":"2024-09-12T03:34:44.094739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:09.728873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095570+0000","last_change":"2024-09-12T03:34:39.063489+0000","last_active":"2024-09-12T03:34:44.095570+0000","last_peered":"2024-09-12T03:34:44.095570+0000","last_clean":"2024-09-12T03:34:44.095570+0000","last_became_active":"2024-09-12T03:34:39.062768+0000","last_became_peered":"2024-09-12T03:34:39.062768+0000","last_unstale":"2024-09-12T03:34:44.095570+0000","last_undegraded":"2024-09-12T03:34:44.095570+0000","last_fullsized":"2024-09-12T03:34:44.095570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:48.438220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009376+0000","last_change":"2024-09-12T03:34:38.015940+0000","last_active":"2024-09-12T03:34:45.009376+0000","last_peered":"2024-09-12T03:34:45.009376+0000","last_clean":"2024-09-12T03:34:45.009376+0000","last_became_active":"2024-09-12T03:34:38.015461+0000","last_became_peered":"2024-09-12T03:34:38.015461+0000","last_unstale":"2024-09-12T03:34:45.009376+0000","last_undegraded":"2024-09-12T03:34:45.009376+0000","last_fullsized":"2024-09-12T03:34:45.009376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095326+0000","last_change":"2024-09-12T03:34:43.129118+0000","last_active":"2024-09-12T03:34:44.095326+0000","last_peered":"2024-09-12T03:34:44.095326+0000","last_clean":"2024-09-12T03:34:44.095326+0000","last_became_active":"2024-09-12T03:34:43.127925+0000","last_became_peered":"2024-09-12T03:34:43.127925+0000","last_unstale":"2024-09-12T03:34:44.095326+0000","last_undegraded":"2024-09-12T03:34:44.095326+0000","last_fullsized":"2024-09-12T03:34:44.095326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:47.375563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013122+0000","last_change":"2024-09-12T03:34:39.058932+0000","last_active":"2024-09-12T03:34:45.013122+0000","last_peered":"2024-09-12T03:34:45.013122+0000","last_clean":"2024-09-12T03:34:45.013122+0000","last_became_active":"2024-09-12T03:34:39.058293+0000","last_became_peered":"2024-09-12T03:34:39.058293+0000","last_unstale":"2024-09-12T03:34:45.013122+0000","last_undegraded":"2024-09-12T03:34:45.013122+0000","last_fullsized":"2024-09-12T03:34:45.013122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:38.023773+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:38.023187+0000","last_became_peered":"2024-09-12T03:34:38.023187+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.688103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095125+0000","last_change":"2024-09-12T03:34:43.216377+0000","last_active":"2024-09-12T03:34:44.095125+0000","last_peered":"2024-09-12T03:34:44.095125+0000","last_clean":"2024-09-12T03:34:44.095125+0000","last_became_active":"2024-09-12T03:34:43.215337+0000","last_became_peered":"2024-09-12T03:34:43.215337+0000","last_unstale":"2024-09-12T03:34:44.095125+0000","last_undegraded":"2024-09-12T03:34:44.095125+0000","last_fullsized":"2024-09-12T03:34:44.095125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:38.956786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010397+0000","last_change":"2024-09-12T03:34:39.084538+0000","last_active":"2024-09-12T03:34:45.010397+0000","last_peered":"2024-09-12T03:34:45.010397+0000","last_clean":"2024-09-12T03:34:45.010397+0000","last_became_active":"2024-09-12T03:34:39.084268+0000","last_became_peered":"2024-09-12T03:34:39.084268+0000","last_unstale":"2024-09-12T03:34:45.010397+0000","last_undegraded":"2024-09-12T03:34:45.010397+0000","last_fullsized":"2024-09-12T03:34:45.010397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094541+0000","last_change":"2024-09-12T03:34:38.019195+0000","last_active":"2024-09-12T03:34:44.094541+0000","last_peered":"2024-09-12T03:34:44.094541+0000","last_clean":"2024-09-12T03:34:44.094541+0000","last_became_active":"2024-09-12T03:34:38.018785+0000","last_became_peered":"2024-09-12T03:34:38.018785+0000","last_unstale":"2024-09-12T03:34:44.094541+0000","last_undegraded":"2024-09-12T03:34:44.094541+0000","last_fullsized":"2024-09-12T03:34:44.094541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007530+0000","last_change":"2024-09-12T03:34:43.214340+0000","last_active":"2024-09-12T03:34:45.007530+0000","last_peered":"2024-09-12T03:34:45.007530+0000","last_clean":"2024-09-12T03:34:45.007530+0000","last_became_active":"2024-09-12T03:34:43.213920+0000","last_became_peered":"2024-09-12T03:34:43.213920+0000","last_unstale":"2024-09-12T03:34:45.007530+0000","last_undegraded":"2024-09-12T03:34:45.007530+0000","last_fullsized":"2024-09-12T03:34:45.007530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:12.709218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094005+0000","last_change":"2024-09-12T03:34:39.060173+0000","last_active":"2024-09-12T03:34:44.094005+0000","last_peered":"2024-09-12T03:34:44.094005+0000","last_clean":"2024-09-12T03:34:44.094005+0000","last_became_active":"2024-09-12T03:34:39.059915+0000","last_became_peered":"2024-09-12T03:34:39.059915+0000","last_unstale":"2024-09-12T03:34:44.094005+0000","last_undegraded":"2024-09-12T03:34:44.094005+0000","last_fullsized":"2024-09-12T03:34:44.094005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011065+0000","last_change":"2024-09-12T03:34:38.021938+0000","last_active":"2024-09-12T03:34:45.011065+0000","last_peered":"2024-09-12T03:34:45.011065+0000","last_clean":"2024-09-12T03:34:45.011065+0000","last_became_active":"2024-09-12T03:34:38.020605+0000","last_became_peered":"2024-09-12T03:34:38.020605+0000","last_unstale":"2024-09-12T03:34:45.011065+0000","last_undegraded":"2024-09-12T03:34:45.011065+0000","last_fullsized":"2024-09-12T03:34:45.011065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:28.996346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013038+0000","last_change":"2024-09-12T03:34:43.217230+0000","last_active":"2024-09-12T03:34:45.013038+0000","last_peered":"2024-09-12T03:34:45.013038+0000","last_clean":"2024-09-12T03:34:45.013038+0000","last_became_active":"2024-09-12T03:34:43.214307+0000","last_became_peered":"2024-09-12T03:34:43.214307+0000","last_unstale":"2024-09-12T03:34:45.013038+0000","last_undegraded":"2024-09-12T03:34:45.013038+0000","last_fullsized":"2024-09-12T03:34:45.013038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:03.198301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098650+0000","last_change":"2024-09-12T03:34:39.100077+0000","last_active":"2024-09-12T03:34:44.098650+0000","last_peered":"2024-09-12T03:34:44.098650+0000","last_clean":"2024-09-12T03:34:44.098650+0000","last_became_active":"2024-09-12T03:34:39.097599+0000","last_became_peered":"2024-09-12T03:34:39.097599+0000","last_unstale":"2024-09-12T03:34:44.098650+0000","last_undegraded":"2024-09-12T03:34:44.098650+0000","last_fullsized":"2024-09-12T03:34:44.098650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094119+0000","last_change":"2024-09-12T03:34:38.013282+0000","last_active":"2024-09-12T03:34:44.094119+0000","last_peered":"2024-09-12T03:34:44.094119+0000","last_clean":"2024-09-12T03:34:44.094119+0000","last_became_active":"2024-09-12T03:34:38.013066+0000","last_became_peered":"2024-09-12T03:34:38.013066+0000","last_unstale":"2024-09-12T03:34:44.094119+0000","last_undegraded":"2024-09-12T03:34:44.094119+0000","last_fullsized":"2024-09-12T03:34:44.094119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092815+0000","last_change":"2024-09-12T03:34:43.124967+0000","last_active":"2024-09-12T03:34:44.092815+0000","last_peered":"2024-09-12T03:34:44.092815+0000","last_clean":"2024-09-12T03:34:44.092815+0000","last_became_active":"2024-09-12T03:34:43.124439+0000","last_became_peered":"2024-09-12T03:34:43.124439+0000","last_unstale":"2024-09-12T03:34:44.092815+0000","last_undegraded":"2024-09-12T03:34:44.092815+0000","last_fullsized":"2024-09-12T03:34:44.092815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.030580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097630+0000","last_change":"2024-09-12T03:34:39.069126+0000","last_active":"2024-09-12T03:34:44.097630+0000","last_peered":"2024-09-12T03:34:44.097630+0000","last_clean":"2024-09-12T03:34:44.097630+0000","last_became_active":"2024-09-12T03:34:39.068202+0000","last_became_peered":"2024-09-12T03:34:39.068202+0000","last_unstale":"2024-09-12T03:34:44.097630+0000","last_undegraded":"2024-09-12T03:34:44.097630+0000","last_fullsized":"2024-09-12T03:34:44.097630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097368+0000","last_change":"2024-09-12T03:34:38.025161+0000","last_active":"2024-09-12T03:34:44.097368+0000","last_peered":"2024-09-12T03:34:44.097368+0000","last_clean":"2024-09-12T03:34:44.097368+0000","last_became_active":"2024-09-12T03:34:38.024569+0000","last_became_peered":"2024-09-12T03:34:38.024569+0000","last_unstale":"2024-09-12T03:34:44.097368+0000","last_undegraded":"2024-09-12T03:34:44.097368+0000","last_fullsized":"2024-09-12T03:34:44.097368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093825+0000","last_change":"2024-09-12T03:34:43.119701+0000","last_active":"2024-09-12T03:34:44.093825+0000","last_peered":"2024-09-12T03:34:44.093825+0000","last_clean":"2024-09-12T03:34:44.093825+0000","last_became_active":"2024-09-12T03:34:43.118522+0000","last_became_peered":"2024-09-12T03:34:43.118522+0000","last_unstale":"2024-09-12T03:34:44.093825+0000","last_undegraded":"2024-09-12T03:34:44.093825+0000","last_fullsized":"2024-09-12T03:34:44.093825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:53.891623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092997+0000","last_change":"2024-09-12T03:34:39.060677+0000","last_active":"2024-09-12T03:34:44.092997+0000","last_peered":"2024-09-12T03:34:44.092997+0000","last_clean":"2024-09-12T03:34:44.092997+0000","last_became_active":"2024-09-12T03:34:39.060405+0000","last_became_peered":"2024-09-12T03:34:39.060405+0000","last_unstale":"2024-09-12T03:34:44.092997+0000","last_undegraded":"2024-09-12T03:34:44.092997+0000","last_fullsized":"2024-09-12T03:34:44.092997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:22.797562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009942+0000","last_change":"2024-09-12T03:34:38.004523+0000","last_active":"2024-09-12T03:34:45.009942+0000","last_peered":"2024-09-12T03:34:45.009942+0000","last_clean":"2024-09-12T03:34:45.009942+0000","last_became_active":"2024-09-12T03:34:38.004151+0000","last_became_peered":"2024-09-12T03:34:38.004151+0000","last_unstale":"2024-09-12T03:34:45.009942+0000","last_undegraded":"2024-09-12T03:34:45.009942+0000","last_fullsized":"2024-09-12T03:34:45.009942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095029+0000","last_change":"2024-09-12T03:34:43.123712+0000","last_active":"2024-09-12T03:34:44.095029+0000","last_peered":"2024-09-12T03:34:44.095029+0000","last_clean":"2024-09-12T03:34:44.095029+0000","last_became_active":"2024-09-12T03:34:43.123329+0000","last_became_peered":"2024-09-12T03:34:43.123329+0000","last_unstale":"2024-09-12T03:34:44.095029+0000","last_undegraded":"2024-09-12T03:34:44.095029+0000","last_fullsized":"2024-09-12T03:34:44.095029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:30.312088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011415+0000","last_change":"2024-09-12T03:34:39.053892+0000","last_active":"2024-09-12T03:34:45.011415+0000","last_peered":"2024-09-12T03:34:45.011415+0000","last_clean":"2024-09-12T03:34:45.011415+0000","last_became_active":"2024-09-12T03:34:39.053583+0000","last_became_peered":"2024-09-12T03:34:39.053583+0000","last_unstale":"2024-09-12T03:34:45.011415+0000","last_undegraded":"2024-09-12T03:34:45.011415+0000","last_fullsized":"2024-09-12T03:34:45.011415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:20.973812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009534+0000","last_change":"2024-09-12T03:34:38.019954+0000","last_active":"2024-09-12T03:34:45.009534+0000","last_peered":"2024-09-12T03:34:45.009534+0000","last_clean":"2024-09-12T03:34:45.009534+0000","last_became_active":"2024-09-12T03:34:38.017677+0000","last_became_peered":"2024-09-12T03:34:38.017677+0000","last_unstale":"2024-09-12T03:34:45.009534+0000","last_undegraded":"2024-09-12T03:34:45.009534+0000","last_fullsized":"2024-09-12T03:34:45.009534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012804+0000","last_change":"2024-09-12T03:34:43.211560+0000","last_active":"2024-09-12T03:34:45.012804+0000","last_peered":"2024-09-12T03:34:45.012804+0000","last_clean":"2024-09-12T03:34:45.012804+0000","last_became_active":"2024-09-12T03:34:43.210313+0000","last_became_peered":"2024-09-12T03:34:43.210313+0000","last_unstale":"2024-09-12T03:34:45.012804+0000","last_undegraded":"2024-09-12T03:34:45.012804+0000","last_fullsized":"2024-09-12T03:34:45.012804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008264+0000","last_change":"2024-09-12T03:34:39.099469+0000","last_active":"2024-09-12T03:34:45.008264+0000","last_peered":"2024-09-12T03:34:45.008264+0000","last_clean":"2024-09-12T03:34:45.008264+0000","last_became_active":"2024-09-12T03:34:39.099241+0000","last_became_peered":"2024-09-12T03:34:39.099241+0000","last_unstale":"2024-09-12T03:34:45.008264+0000","last_undegraded":"2024-09-12T03:34:45.008264+0000","last_fullsized":"2024-09-12T03:34:45.008264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:50.793491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096283+0000","last_change":"2024-09-12T03:34:38.012498+0000","last_active":"2024-09-12T03:34:44.096283+0000","last_peered":"2024-09-12T03:34:44.096283+0000","last_clean":"2024-09-12T03:34:44.096283+0000","last_became_active":"2024-09-12T03:34:38.011287+0000","last_became_peered":"2024-09-12T03:34:38.011287+0000","last_unstale":"2024-09-12T03:34:44.096283+0000","last_undegraded":"2024-09-12T03:34:44.096283+0000","last_fullsized":"2024-09-12T03:34:44.096283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:39.411942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009617+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:34:45.009617+0000","last_peered":"2024-09-12T03:34:45.009617+0000","last_clean":"2024-09-12T03:34:45.009617+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:34:45.009617+0000","last_undegraded":"2024-09-12T03:34:45.009617+0000","last_fullsized":"2024-09-12T03:34:45.009617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187899+0000","last_change":"2024-09-12T03:34:43.217542+0000","last_active":"2024-09-12T03:34:44.187899+0000","last_peered":"2024-09-12T03:34:44.187899+0000","last_clean":"2024-09-12T03:34:44.187899+0000","last_became_active":"2024-09-12T03:34:43.216519+0000","last_became_peered":"2024-09-12T03:34:43.216519+0000","last_unstale":"2024-09-12T03:34:44.187899+0000","last_undegraded":"2024-09-12T03:34:44.187899+0000","last_fullsized":"2024-09-12T03:34:44.187899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010497+0000","last_change":"2024-09-12T03:34:39.102583+0000","last_active":"2024-09-12T03:34:45.010497+0000","last_peered":"2024-09-12T03:34:45.010497+0000","last_clean":"2024-09-12T03:34:45.010497+0000","last_became_active":"2024-09-12T03:34:39.102127+0000","last_became_peered":"2024-09-12T03:34:39.102127+0000","last_unstale":"2024-09-12T03:34:45.010497+0000","last_undegraded":"2024-09-12T03:34:45.010497+0000","last_fullsized":"2024-09-12T03:34:45.010497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011031+0000","last_change":"2024-09-12T03:34:38.005330+0000","last_active":"2024-09-12T03:34:45.011031+0000","last_peered":"2024-09-12T03:34:45.011031+0000","last_clean":"2024-09-12T03:34:45.011031+0000","last_became_active":"2024-09-12T03:34:38.004948+0000","last_became_peered":"2024-09-12T03:34:38.004948+0000","last_unstale":"2024-09-12T03:34:45.011031+0000","last_undegraded":"2024-09-12T03:34:45.011031+0000","last_fullsized":"2024-09-12T03:34:45.011031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187730+0000","last_change":"2024-09-12T03:34:43.214134+0000","last_active":"2024-09-12T03:34:44.187730+0000","last_peered":"2024-09-12T03:34:44.187730+0000","last_clean":"2024-09-12T03:34:44.187730+0000","last_became_active":"2024-09-12T03:34:43.212887+0000","last_became_peered":"2024-09-12T03:34:43.212887+0000","last_unstale":"2024-09-12T03:34:44.187730+0000","last_undegraded":"2024-09-12T03:34:44.187730+0000","last_fullsized":"2024-09-12T03:34:44.187730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:50.420633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097609+0000","last_change":"2024-09-12T03:34:39.097188+0000","last_active":"2024-09-12T03:34:44.097609+0000","last_peered":"2024-09-12T03:34:44.097609+0000","last_clean":"2024-09-12T03:34:44.097609+0000","last_became_active":"2024-09-12T03:34:39.088779+0000","last_became_peered":"2024-09-12T03:34:39.088779+0000","last_unstale":"2024-09-12T03:34:44.097609+0000","last_undegraded":"2024-09-12T03:34:44.097609+0000","last_fullsized":"2024-09-12T03:34:44.097609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094237+0000","last_change":"2024-09-12T03:34:38.016976+0000","last_active":"2024-09-12T03:34:44.094237+0000","last_peered":"2024-09-12T03:34:44.094237+0000","last_clean":"2024-09-12T03:34:44.094237+0000","last_became_active":"2024-09-12T03:34:38.016660+0000","last_became_peered":"2024-09-12T03:34:38.016660+0000","last_unstale":"2024-09-12T03:34:44.094237+0000","last_undegraded":"2024-09-12T03:34:44.094237+0000","last_fullsized":"2024-09-12T03:34:44.094237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:41.372345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013574+0000","last_change":"2024-09-12T03:34:43.120906+0000","last_active":"2024-09-12T03:34:45.013574+0000","last_peered":"2024-09-12T03:34:45.013574+0000","last_clean":"2024-09-12T03:34:45.013574+0000","last_became_active":"2024-09-12T03:34:43.120173+0000","last_became_peered":"2024-09-12T03:34:43.120173+0000","last_unstale":"2024-09-12T03:34:45.013574+0000","last_undegraded":"2024-09-12T03:34:45.013574+0000","last_fullsized":"2024-09-12T03:34:45.013574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:53:47.645139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011129+0000","last_change":"2024-09-12T03:34:39.091419+0000","last_active":"2024-09-12T03:34:45.011129+0000","last_peered":"2024-09-12T03:34:45.011129+0000","last_clean":"2024-09-12T03:34:45.011129+0000","last_became_active":"2024-09-12T03:34:39.090855+0000","last_became_peered":"2024-09-12T03:34:39.090855+0000","last_unstale":"2024-09-12T03:34:45.011129+0000","last_undegraded":"2024-09-12T03:34:45.011129+0000","last_fullsized":"2024-09-12T03:34:45.011129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011991+0000","last_change":"2024-09-12T03:34:38.008658+0000","last_active":"2024-09-12T03:34:45.011991+0000","last_peered":"2024-09-12T03:34:45.011991+0000","last_clean":"2024-09-12T03:34:45.011991+0000","last_became_active":"2024-09-12T03:34:38.007921+0000","last_became_peered":"2024-09-12T03:34:38.007921+0000","last_unstale":"2024-09-12T03:34:45.011991+0000","last_undegraded":"2024-09-12T03:34:45.011991+0000","last_fullsized":"2024-09-12T03:34:45.011991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:55.788731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094885+0000","last_change":"2024-09-12T03:34:43.216644+0000","last_active":"2024-09-12T03:34:44.094885+0000","last_peered":"2024-09-12T03:34:44.094885+0000","last_clean":"2024-09-12T03:34:44.094885+0000","last_became_active":"2024-09-12T03:34:43.215467+0000","last_became_peered":"2024-09-12T03:34:43.215467+0000","last_unstale":"2024-09-12T03:34:44.094885+0000","last_undegraded":"2024-09-12T03:34:44.094885+0000","last_fullsized":"2024-09-12T03:34:44.094885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010860+0000","last_change":"2024-09-12T03:34:39.091357+0000","last_active":"2024-09-12T03:34:45.010860+0000","last_peered":"2024-09-12T03:34:45.010860+0000","last_clean":"2024-09-12T03:34:45.010860+0000","last_became_active":"2024-09-12T03:34:39.090805+0000","last_became_peered":"2024-09-12T03:34:39.090805+0000","last_unstale":"2024-09-12T03:34:45.010860+0000","last_undegraded":"2024-09-12T03:34:45.010860+0000","last_fullsized":"2024-09-12T03:34:45.010860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.219769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095561+0000","last_change":"2024-09-12T03:34:38.017119+0000","last_active":"2024-09-12T03:34:44.095561+0000","last_peered":"2024-09-12T03:34:44.095561+0000","last_clean":"2024-09-12T03:34:44.095561+0000","last_became_active":"2024-09-12T03:34:38.016642+0000","last_became_peered":"2024-09-12T03:34:38.016642+0000","last_unstale":"2024-09-12T03:34:44.095561+0000","last_undegraded":"2024-09-12T03:34:44.095561+0000","last_fullsized":"2024-09-12T03:34:44.095561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094658+0000","last_change":"2024-09-12T03:34:43.128636+0000","last_active":"2024-09-12T03:34:44.094658+0000","last_peered":"2024-09-12T03:34:44.094658+0000","last_clean":"2024-09-12T03:34:44.094658+0000","last_became_active":"2024-09-12T03:34:43.127210+0000","last_became_peered":"2024-09-12T03:34:43.127210+0000","last_unstale":"2024-09-12T03:34:44.094658+0000","last_undegraded":"2024-09-12T03:34:44.094658+0000","last_fullsized":"2024-09-12T03:34:44.094658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:32.156353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010031+0000","last_change":"2024-09-12T03:34:39.091653+0000","last_active":"2024-09-12T03:34:45.010031+0000","last_peered":"2024-09-12T03:34:45.010031+0000","last_clean":"2024-09-12T03:34:45.010031+0000","last_became_active":"2024-09-12T03:34:39.090971+0000","last_became_peered":"2024-09-12T03:34:39.090971+0000","last_unstale":"2024-09-12T03:34:45.010031+0000","last_undegraded":"2024-09-12T03:34:45.010031+0000","last_fullsized":"2024-09-12T03:34:45.010031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009309+0000","last_change":"2024-09-12T03:34:38.007157+0000","last_active":"2024-09-12T03:34:45.009309+0000","last_peered":"2024-09-12T03:34:45.009309+0000","last_clean":"2024-09-12T03:34:45.009309+0000","last_became_active":"2024-09-12T03:34:38.006706+0000","last_became_peered":"2024-09-12T03:34:38.006706+0000","last_unstale":"2024-09-12T03:34:45.009309+0000","last_undegraded":"2024-09-12T03:34:45.009309+0000","last_fullsized":"2024-09-12T03:34:45.009309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:40:45.669430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012527+0000","last_change":"2024-09-12T03:34:43.126450+0000","last_active":"2024-09-12T03:34:45.012527+0000","last_peered":"2024-09-12T03:34:45.012527+0000","last_clean":"2024-09-12T03:34:45.012527+0000","last_became_active":"2024-09-12T03:34:43.126083+0000","last_became_peered":"2024-09-12T03:34:43.126083+0000","last_unstale":"2024-09-12T03:34:45.012527+0000","last_undegraded":"2024-09-12T03:34:45.012527+0000","last_fullsized":"2024-09-12T03:34:45.012527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:24.001659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187658+0000","last_change":"2024-09-12T03:34:39.073954+0000","last_active":"2024-09-12T03:34:44.187658+0000","last_peered":"2024-09-12T03:34:44.187658+0000","last_clean":"2024-09-12T03:34:44.187658+0000","last_became_active":"2024-09-12T03:34:39.073238+0000","last_became_peered":"2024-09-12T03:34:39.073238+0000","last_unstale":"2024-09-12T03:34:44.187658+0000","last_undegraded":"2024-09-12T03:34:44.187658+0000","last_fullsized":"2024-09-12T03:34:44.187658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:08.187449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187978+0000","last_change":"2024-09-12T03:34:38.023260+0000","last_active":"2024-09-12T03:34:44.187978+0000","last_peered":"2024-09-12T03:34:44.187978+0000","last_clean":"2024-09-12T03:34:44.187978+0000","last_became_active":"2024-09-12T03:34:38.022602+0000","last_became_peered":"2024-09-12T03:34:38.022602+0000","last_unstale":"2024-09-12T03:34:44.187978+0000","last_undegraded":"2024-09-12T03:34:44.187978+0000","last_fullsized":"2024-09-12T03:34:44.187978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:20.254507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010135+0000","last_change":"2024-09-12T03:34:43.216165+0000","last_active":"2024-09-12T03:34:45.010135+0000","last_peered":"2024-09-12T03:34:45.010135+0000","last_clean":"2024-09-12T03:34:45.010135+0000","last_became_active":"2024-09-12T03:34:43.214989+0000","last_became_peered":"2024-09-12T03:34:43.214989+0000","last_unstale":"2024-09-12T03:34:45.010135+0000","last_undegraded":"2024-09-12T03:34:45.010135+0000","last_fullsized":"2024-09-12T03:34:45.010135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:04.591844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010173+0000","last_change":"2024-09-12T03:34:39.090006+0000","last_active":"2024-09-12T03:34:45.010173+0000","last_peered":"2024-09-12T03:34:45.010173+0000","last_clean":"2024-09-12T03:34:45.010173+0000","last_became_active":"2024-09-12T03:34:39.089165+0000","last_became_peered":"2024-09-12T03:34:39.089165+0000","last_unstale":"2024-09-12T03:34:45.010173+0000","last_undegraded":"2024-09-12T03:34:45.010173+0000","last_fullsized":"2024-09-12T03:34:45.010173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097113+0000","last_change":"2024-09-12T03:34:38.014916+0000","last_active":"2024-09-12T03:34:44.097113+0000","last_peered":"2024-09-12T03:34:44.097113+0000","last_clean":"2024-09-12T03:34:44.097113+0000","last_became_active":"2024-09-12T03:34:38.014447+0000","last_became_peered":"2024-09-12T03:34:38.014447+0000","last_unstale":"2024-09-12T03:34:44.097113+0000","last_undegraded":"2024-09-12T03:34:44.097113+0000","last_fullsized":"2024-09-12T03:34:44.097113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:47.434659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008970+0000","last_change":"2024-09-12T03:34:43.211049+0000","last_active":"2024-09-12T03:34:45.008970+0000","last_peered":"2024-09-12T03:34:45.008970+0000","last_clean":"2024-09-12T03:34:45.008970+0000","last_became_active":"2024-09-12T03:34:43.210561+0000","last_became_peered":"2024-09-12T03:34:43.210561+0000","last_unstale":"2024-09-12T03:34:45.008970+0000","last_undegraded":"2024-09-12T03:34:45.008970+0000","last_fullsized":"2024-09-12T03:34:45.008970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:22.633242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012235+0000","last_change":"2024-09-12T03:34:39.082890+0000","last_active":"2024-09-12T03:34:45.012235+0000","last_peered":"2024-09-12T03:34:45.012235+0000","last_clean":"2024-09-12T03:34:45.012235+0000","last_became_active":"2024-09-12T03:34:39.082674+0000","last_became_peered":"2024-09-12T03:34:39.082674+0000","last_unstale":"2024-09-12T03:34:45.012235+0000","last_undegraded":"2024-09-12T03:34:45.012235+0000","last_fullsized":"2024-09-12T03:34:45.012235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:03.509674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013716+0000","last_change":"2024-09-12T03:34:38.017260+0000","last_active":"2024-09-12T03:34:45.013716+0000","last_peered":"2024-09-12T03:34:45.013716+0000","last_clean":"2024-09-12T03:34:45.013716+0000","last_became_active":"2024-09-12T03:34:38.016781+0000","last_became_peered":"2024-09-12T03:34:38.016781+0000","last_unstale":"2024-09-12T03:34:45.013716+0000","last_undegraded":"2024-09-12T03:34:45.013716+0000","last_fullsized":"2024-09-12T03:34:45.013716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:49.748803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.098324+0000","last_change":"2024-09-12T03:34:43.213204+0000","last_active":"2024-09-12T03:34:44.098324+0000","last_peered":"2024-09-12T03:34:44.098324+0000","last_clean":"2024-09-12T03:34:44.098324+0000","last_became_active":"2024-09-12T03:34:43.212190+0000","last_became_peered":"2024-09-12T03:34:43.212190+0000","last_unstale":"2024-09-12T03:34:44.098324+0000","last_undegraded":"2024-09-12T03:34:44.098324+0000","last_fullsized":"2024-09-12T03:34:44.098324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010365+0000","last_change":"2024-09-12T03:34:39.087244+0000","last_active":"2024-09-12T03:34:45.010365+0000","last_peered":"2024-09-12T03:34:45.010365+0000","last_clean":"2024-09-12T03:34:45.010365+0000","last_became_active":"2024-09-12T03:34:39.085708+0000","last_became_peered":"2024-09-12T03:34:39.085708+0000","last_unstale":"2024-09-12T03:34:45.010365+0000","last_undegraded":"2024-09-12T03:34:45.010365+0000","last_fullsized":"2024-09-12T03:34:45.010365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:49.528251+0000","last_change":"2024-09-12T03:34:38.020300+0000","last_active":"2024-09-12T03:34:49.528251+0000","last_peered":"2024-09-12T03:34:49.528251+0000","last_clean":"2024-09-12T03:34:49.528251+0000","last_became_active":"2024-09-12T03:34:38.019416+0000","last_became_peered":"2024-09-12T03:34:38.019416+0000","last_unstale":"2024-09-12T03:34:49.528251+0000","last_undegraded":"2024-09-12T03:34:49.528251+0000","last_fullsized":"2024-09-12T03:34:49.528251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:57.206207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093034+0000","last_change":"2024-09-12T03:34:43.127205+0000","last_active":"2024-09-12T03:34:44.093034+0000","last_peered":"2024-09-12T03:34:44.093034+0000","last_clean":"2024-09-12T03:34:44.093034+0000","last_became_active":"2024-09-12T03:34:43.126473+0000","last_became_peered":"2024-09-12T03:34:43.126473+0000","last_unstale":"2024-09-12T03:34:44.093034+0000","last_undegraded":"2024-09-12T03:34:44.093034+0000","last_fullsized":"2024-09-12T03:34:44.093034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:08.474524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096722+0000","last_change":"2024-09-12T03:34:39.076678+0000","last_active":"2024-09-12T03:34:44.096722+0000","last_peered":"2024-09-12T03:34:44.096722+0000","last_clean":"2024-09-12T03:34:44.096722+0000","last_became_active":"2024-09-12T03:34:39.076007+0000","last_became_peered":"2024-09-12T03:34:39.076007+0000","last_unstale":"2024-09-12T03:34:44.096722+0000","last_undegraded":"2024-09-12T03:34:44.096722+0000","last_fullsized":"2024-09-12T03:34:44.096722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:29.999907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094072+0000","last_change":"2024-09-12T03:34:38.028753+0000","last_active":"2024-09-12T03:34:44.094072+0000","last_peered":"2024-09-12T03:34:44.094072+0000","last_clean":"2024-09-12T03:34:44.094072+0000","last_became_active":"2024-09-12T03:34:38.028499+0000","last_became_peered":"2024-09-12T03:34:38.028499+0000","last_unstale":"2024-09-12T03:34:44.094072+0000","last_undegraded":"2024-09-12T03:34:44.094072+0000","last_fullsized":"2024-09-12T03:34:44.094072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096751+0000","last_change":"2024-09-12T03:34:43.135662+0000","last_active":"2024-09-12T03:34:44.096751+0000","last_peered":"2024-09-12T03:34:44.096751+0000","last_clean":"2024-09-12T03:34:44.096751+0000","last_became_active":"2024-09-12T03:34:43.128133+0000","last_became_peered":"2024-09-12T03:34:43.128133+0000","last_unstale":"2024-09-12T03:34:44.096751+0000","last_undegraded":"2024-09-12T03:34:44.096751+0000","last_fullsized":"2024-09-12T03:34:44.096751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:41.314336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012301+0000","last_change":"2024-09-12T03:34:39.088237+0000","last_active":"2024-09-12T03:34:45.012301+0000","last_peered":"2024-09-12T03:34:45.012301+0000","last_clean":"2024-09-12T03:34:45.012301+0000","last_became_active":"2024-09-12T03:34:39.087952+0000","last_became_peered":"2024-09-12T03:34:39.087952+0000","last_unstale":"2024-09-12T03:34:45.012301+0000","last_undegraded":"2024-09-12T03:34:45.012301+0000","last_fullsized":"2024-09-12T03:34:45.012301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097921+0000","last_change":"2024-09-12T03:34:38.012565+0000","last_active":"2024-09-12T03:34:44.097921+0000","last_peered":"2024-09-12T03:34:44.097921+0000","last_clean":"2024-09-12T03:34:44.097921+0000","last_became_active":"2024-09-12T03:34:38.012023+0000","last_became_peered":"2024-09-12T03:34:38.012023+0000","last_unstale":"2024-09-12T03:34:44.097921+0000","last_undegraded":"2024-09-12T03:34:44.097921+0000","last_fullsized":"2024-09-12T03:34:44.097921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:16.386151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007983+0000","last_change":"2024-09-12T03:34:43.127550+0000","last_active":"2024-09-12T03:34:45.007983+0000","last_peered":"2024-09-12T03:34:45.007983+0000","last_clean":"2024-09-12T03:34:45.007983+0000","last_became_active":"2024-09-12T03:34:43.118399+0000","last_became_peered":"2024-09-12T03:34:43.118399+0000","last_unstale":"2024-09-12T03:34:45.007983+0000","last_undegraded":"2024-09-12T03:34:45.007983+0000","last_fullsized":"2024-09-12T03:34:45.007983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:09.727102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097682+0000","last_change":"2024-09-12T03:34:39.103021+0000","last_active":"2024-09-12T03:34:44.097682+0000","last_peered":"2024-09-12T03:34:44.097682+0000","last_clean":"2024-09-12T03:34:44.097682+0000","last_became_active":"2024-09-12T03:34:39.102537+0000","last_became_peered":"2024-09-12T03:34:39.102537+0000","last_unstale":"2024-09-12T03:34:44.097682+0000","last_undegraded":"2024-09-12T03:34:44.097682+0000","last_fullsized":"2024-09-12T03:34:44.097682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:00.853503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188469+0000","last_change":"2024-09-12T03:34:38.026833+0000","last_active":"2024-09-12T03:34:44.188469+0000","last_peered":"2024-09-12T03:34:44.188469+0000","last_clean":"2024-09-12T03:34:44.188469+0000","last_became_active":"2024-09-12T03:34:38.026268+0000","last_became_peered":"2024-09-12T03:34:38.026268+0000","last_unstale":"2024-09-12T03:34:44.188469+0000","last_undegraded":"2024-09-12T03:34:44.188469+0000","last_fullsized":"2024-09-12T03:34:44.188469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:52.708505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008838+0000","last_change":"2024-09-12T03:34:43.212792+0000","last_active":"2024-09-12T03:34:45.008838+0000","last_peered":"2024-09-12T03:34:45.008838+0000","last_clean":"2024-09-12T03:34:45.008838+0000","last_became_active":"2024-09-12T03:34:43.211671+0000","last_became_peered":"2024-09-12T03:34:43.211671+0000","last_unstale":"2024-09-12T03:34:45.008838+0000","last_undegraded":"2024-09-12T03:34:45.008838+0000","last_fullsized":"2024-09-12T03:34:45.008838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:17.110446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013459+0000","last_change":"2024-09-12T03:34:43.218438+0000","last_active":"2024-09-12T03:34:45.013459+0000","last_peered":"2024-09-12T03:34:45.013459+0000","last_clean":"2024-09-12T03:34:45.013459+0000","last_became_active":"2024-09-12T03:34:43.217735+0000","last_became_peered":"2024-09-12T03:34:43.217735+0000","last_unstale":"2024-09-12T03:34:45.013459+0000","last_undegraded":"2024-09-12T03:34:45.013459+0000","last_fullsized":"2024-09-12T03:34:45.013459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:19.562019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092348+0000","last_change":"2024-09-12T03:34:39.063362+0000","last_active":"2024-09-12T03:34:44.092348+0000","last_peered":"2024-09-12T03:34:44.092348+0000","last_clean":"2024-09-12T03:34:44.092348+0000","last_became_active":"2024-09-12T03:34:39.063020+0000","last_became_peered":"2024-09-12T03:34:39.063020+0000","last_unstale":"2024-09-12T03:34:44.092348+0000","last_undegraded":"2024-09-12T03:34:44.092348+0000","last_fullsized":"2024-09-12T03:34:44.092348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095747+0000","last_change":"2024-09-12T03:34:38.027195+0000","last_active":"2024-09-12T03:34:44.095747+0000","last_peered":"2024-09-12T03:34:44.095747+0000","last_clean":"2024-09-12T03:34:44.095747+0000","last_became_active":"2024-09-12T03:34:38.026662+0000","last_became_peered":"2024-09-12T03:34:38.026662+0000","last_unstale":"2024-09-12T03:34:44.095747+0000","last_undegraded":"2024-09-12T03:34:44.095747+0000","last_fullsized":"2024-09-12T03:34:44.095747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:35.492706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188079+0000","last_change":"2024-09-12T03:34:43.134866+0000","last_active":"2024-09-12T03:34:44.188079+0000","last_peered":"2024-09-12T03:34:44.188079+0000","last_clean":"2024-09-12T03:34:44.188079+0000","last_became_active":"2024-09-12T03:34:43.133525+0000","last_became_peered":"2024-09-12T03:34:43.133525+0000","last_unstale":"2024-09-12T03:34:44.188079+0000","last_undegraded":"2024-09-12T03:34:44.188079+0000","last_fullsized":"2024-09-12T03:34:44.188079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:57:56.256383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008011+0000","last_change":"2024-09-12T03:34:39.063056+0000","last_active":"2024-09-12T03:34:45.008011+0000","last_peered":"2024-09-12T03:34:45.008011+0000","last_clean":"2024-09-12T03:34:45.008011+0000","last_became_active":"2024-09-12T03:34:39.062761+0000","last_became_peered":"2024-09-12T03:34:39.062761+0000","last_unstale":"2024-09-12T03:34:45.008011+0000","last_undegraded":"2024-09-12T03:34:45.008011+0000","last_fullsized":"2024-09-12T03:34:45.008011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:03.389534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008537+0000","last_change":"2024-09-12T03:34:38.018201+0000","last_active":"2024-09-12T03:34:45.008537+0000","last_peered":"2024-09-12T03:34:45.008537+0000","last_clean":"2024-09-12T03:34:45.008537+0000","last_became_active":"2024-09-12T03:34:38.017942+0000","last_became_peered":"2024-09-12T03:34:38.017942+0000","last_unstale":"2024-09-12T03:34:45.008537+0000","last_undegraded":"2024-09-12T03:34:45.008537+0000","last_fullsized":"2024-09-12T03:34:45.008537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:49.548383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188411+0000","last_change":"2024-09-12T03:34:38.022415+0000","last_active":"2024-09-12T03:34:44.188411+0000","last_peered":"2024-09-12T03:34:44.188411+0000","last_clean":"2024-09-12T03:34:44.188411+0000","last_became_active":"2024-09-12T03:34:38.019452+0000","last_became_peered":"2024-09-12T03:34:38.019452+0000","last_unstale":"2024-09-12T03:34:44.188411+0000","last_undegraded":"2024-09-12T03:34:44.188411+0000","last_fullsized":"2024-09-12T03:34:44.188411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:48.971400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013639+0000","last_change":"2024-09-12T03:34:39.054095+0000","last_active":"2024-09-12T03:34:45.013639+0000","last_peered":"2024-09-12T03:34:45.013639+0000","last_clean":"2024-09-12T03:34:45.013639+0000","last_became_active":"2024-09-12T03:34:39.053738+0000","last_became_peered":"2024-09-12T03:34:39.053738+0000","last_unstale":"2024-09-12T03:34:45.013639+0000","last_undegraded":"2024-09-12T03:34:45.013639+0000","last_fullsized":"2024-09-12T03:34:45.013639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010585+0000","last_change":"2024-09-12T03:34:43.114138+0000","last_active":"2024-09-12T03:34:45.010585+0000","last_peered":"2024-09-12T03:34:45.010585+0000","last_clean":"2024-09-12T03:34:45.010585+0000","last_became_active":"2024-09-12T03:34:43.113549+0000","last_became_peered":"2024-09-12T03:34:43.113549+0000","last_unstale":"2024-09-12T03:34:45.010585+0000","last_undegraded":"2024-09-12T03:34:45.010585+0000","last_fullsized":"2024-09-12T03:34:45.010585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:38.432588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008571+0000","last_change":"2024-09-12T03:34:38.030379+0000","last_active":"2024-09-12T03:34:45.008571+0000","last_peered":"2024-09-12T03:34:45.008571+0000","last_clean":"2024-09-12T03:34:45.008571+0000","last_became_active":"2024-09-12T03:34:38.030041+0000","last_became_peered":"2024-09-12T03:34:38.030041+0000","last_unstale":"2024-09-12T03:34:45.008571+0000","last_undegraded":"2024-09-12T03:34:45.008571+0000","last_fullsized":"2024-09-12T03:34:45.008571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:36.971116+0000","last_clean_scrub_stamp":"2024-09-12T03:34:36.971116+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:58.808679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095998+0000","last_change":"2024-09-12T03:34:39.064296+0000","last_active":"2024-09-12T03:34:44.095998+0000","last_peered":"2024-09-12T03:34:44.095998+0000","last_clean":"2024-09-12T03:34:44.095998+0000","last_became_active":"2024-09-12T03:34:39.063569+0000","last_became_peered":"2024-09-12T03:34:39.063569+0000","last_unstale":"2024-09-12T03:34:44.095998+0000","last_undegraded":"2024-09-12T03:34:44.095998+0000","last_fullsized":"2024-09-12T03:34:44.095998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:42.375906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009228+0000","last_change":"2024-09-12T03:34:43.118123+0000","last_active":"2024-09-12T03:34:45.009228+0000","last_peered":"2024-09-12T03:34:45.009228+0000","last_clean":"2024-09-12T03:34:45.009228+0000","last_became_active":"2024-09-12T03:34:43.117722+0000","last_became_peered":"2024-09-12T03:34:43.117722+0000","last_unstale":"2024-09-12T03:34:45.009228+0000","last_undegraded":"2024-09-12T03:34:45.009228+0000","last_fullsized":"2024-09-12T03:34:45.009228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:42.069244+0000","last_clean_scrub_stamp":"2024-09-12T03:34:42.069244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:08.248672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.187424+0000","last_change":"2024-09-12T03:34:39.077386+0000","last_active":"2024-09-12T03:34:44.187424+0000","last_peered":"2024-09-12T03:34:44.187424+0000","last_clean":"2024-09-12T03:34:44.187424+0000","last_became_active":"2024-09-12T03:34:39.076662+0000","last_became_peered":"2024-09-12T03:34:39.076662+0000","last_unstale":"2024-09-12T03:34:44.187424+0000","last_undegraded":"2024-09-12T03:34:44.187424+0000","last_fullsized":"2024-09-12T03:34:44.187424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009701+0000","last_change":"2024-09-12T03:34:39.087463+0000","last_active":"2024-09-12T03:34:45.009701+0000","last_peered":"2024-09-12T03:34:45.009701+0000","last_clean":"2024-09-12T03:34:45.009701+0000","last_became_active":"2024-09-12T03:34:39.087165+0000","last_became_peered":"2024-09-12T03:34:39.087165+0000","last_unstale":"2024-09-12T03:34:45.009701+0000","last_undegraded":"2024-09-12T03:34:45.009701+0000","last_fullsized":"2024-09-12T03:34:45.009701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:01:36.496267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096888+0000","last_change":"2024-09-12T03:34:39.098154+0000","last_active":"2024-09-12T03:34:44.096888+0000","last_peered":"2024-09-12T03:34:44.096888+0000","last_clean":"2024-09-12T03:34:44.096888+0000","last_became_active":"2024-09-12T03:34:39.097223+0000","last_became_peered":"2024-09-12T03:34:39.097223+0000","last_unstale":"2024-09-12T03:34:44.096888+0000","last_undegraded":"2024-09-12T03:34:44.096888+0000","last_fullsized":"2024-09-12T03:34:44.096888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:13.155437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013401+0000","last_change":"2024-09-12T03:34:39.065566+0000","last_active":"2024-09-12T03:34:45.013401+0000","last_peered":"2024-09-12T03:34:45.013401+0000","last_clean":"2024-09-12T03:34:45.013401+0000","last_became_active":"2024-09-12T03:34:39.065271+0000","last_became_peered":"2024-09-12T03:34:39.065271+0000","last_unstale":"2024-09-12T03:34:45.013401+0000","last_undegraded":"2024-09-12T03:34:45.013401+0000","last_fullsized":"2024-09-12T03:34:45.013401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:21.031062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009257+0000","last_change":"2024-09-12T03:34:39.080421+0000","last_active":"2024-09-12T03:34:45.009257+0000","last_peered":"2024-09-12T03:34:45.009257+0000","last_clean":"2024-09-12T03:34:45.009257+0000","last_became_active":"2024-09-12T03:34:39.080177+0000","last_became_peered":"2024-09-12T03:34:39.080177+0000","last_unstale":"2024-09-12T03:34:45.009257+0000","last_undegraded":"2024-09-12T03:34:45.009257+0000","last_fullsized":"2024-09-12T03:34:45.009257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.093781+0000","last_change":"2024-09-12T03:34:39.064463+0000","last_active":"2024-09-12T03:34:44.093781+0000","last_peered":"2024-09-12T03:34:44.093781+0000","last_clean":"2024-09-12T03:34:44.093781+0000","last_became_active":"2024-09-12T03:34:39.064221+0000","last_became_peered":"2024-09-12T03:34:39.064221+0000","last_unstale":"2024-09-12T03:34:44.093781+0000","last_undegraded":"2024-09-12T03:34:44.093781+0000","last_fullsized":"2024-09-12T03:34:44.093781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188514+0000","last_change":"2024-09-12T03:34:39.104917+0000","last_active":"2024-09-12T03:34:44.188514+0000","last_peered":"2024-09-12T03:34:44.188514+0000","last_clean":"2024-09-12T03:34:44.188514+0000","last_became_active":"2024-09-12T03:34:39.104399+0000","last_became_peered":"2024-09-12T03:34:39.104399+0000","last_unstale":"2024-09-12T03:34:44.188514+0000","last_undegraded":"2024-09-12T03:34:44.188514+0000","last_fullsized":"2024-09-12T03:34:44.188514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:03.567787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010275+0000","last_change":"2024-09-12T03:34:39.081674+0000","last_active":"2024-09-12T03:34:45.010275+0000","last_peered":"2024-09-12T03:34:45.010275+0000","last_clean":"2024-09-12T03:34:45.010275+0000","last_became_active":"2024-09-12T03:34:39.081415+0000","last_became_peered":"2024-09-12T03:34:39.081415+0000","last_unstale":"2024-09-12T03:34:45.010275+0000","last_undegraded":"2024-09-12T03:34:45.010275+0000","last_fullsized":"2024-09-12T03:34:45.010275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095516+0000","last_change":"2024-09-12T03:34:39.105000+0000","last_active":"2024-09-12T03:34:44.095516+0000","last_peered":"2024-09-12T03:34:44.095516+0000","last_clean":"2024-09-12T03:34:44.095516+0000","last_became_active":"2024-09-12T03:34:39.104552+0000","last_became_peered":"2024-09-12T03:34:39.104552+0000","last_unstale":"2024-09-12T03:34:44.095516+0000","last_undegraded":"2024-09-12T03:34:44.095516+0000","last_fullsized":"2024-09-12T03:34:44.095516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:28.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008305+0000","last_change":"2024-09-12T03:34:39.081413+0000","last_active":"2024-09-12T03:34:45.008305+0000","last_peered":"2024-09-12T03:34:45.008305+0000","last_clean":"2024-09-12T03:34:45.008305+0000","last_became_active":"2024-09-12T03:34:39.081124+0000","last_became_peered":"2024-09-12T03:34:39.081124+0000","last_unstale":"2024-09-12T03:34:45.008305+0000","last_undegraded":"2024-09-12T03:34:45.008305+0000","last_fullsized":"2024-09-12T03:34:45.008305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:16.066230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096657+0000","last_change":"2024-09-12T03:34:39.103486+0000","last_active":"2024-09-12T03:34:44.096657+0000","last_peered":"2024-09-12T03:34:44.096657+0000","last_clean":"2024-09-12T03:34:44.096657+0000","last_became_active":"2024-09-12T03:34:39.102713+0000","last_became_peered":"2024-09-12T03:34:39.102713+0000","last_unstale":"2024-09-12T03:34:44.096657+0000","last_undegraded":"2024-09-12T03:34:44.096657+0000","last_fullsized":"2024-09-12T03:34:44.096657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.013159+0000","last_change":"2024-09-12T03:34:39.084516+0000","last_active":"2024-09-12T03:34:45.013159+0000","last_peered":"2024-09-12T03:34:45.013159+0000","last_clean":"2024-09-12T03:34:45.013159+0000","last_became_active":"2024-09-12T03:34:39.084230+0000","last_became_peered":"2024-09-12T03:34:39.084230+0000","last_unstale":"2024-09-12T03:34:45.013159+0000","last_undegraded":"2024-09-12T03:34:45.013159+0000","last_fullsized":"2024-09-12T03:34:45.013159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:35.100430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188815+0000","last_change":"2024-09-12T03:34:39.107212+0000","last_active":"2024-09-12T03:34:44.188815+0000","last_peered":"2024-09-12T03:34:44.188815+0000","last_clean":"2024-09-12T03:34:44.188815+0000","last_became_active":"2024-09-12T03:34:39.106301+0000","last_became_peered":"2024-09-12T03:34:39.106301+0000","last_unstale":"2024-09-12T03:34:44.188815+0000","last_undegraded":"2024-09-12T03:34:44.188815+0000","last_fullsized":"2024-09-12T03:34:44.188815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:15:08.554747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010903+0000","last_change":"2024-09-12T03:34:39.087886+0000","last_active":"2024-09-12T03:34:45.010903+0000","last_peered":"2024-09-12T03:34:45.010903+0000","last_clean":"2024-09-12T03:34:45.010903+0000","last_became_active":"2024-09-12T03:34:39.086540+0000","last_became_peered":"2024-09-12T03:34:39.086540+0000","last_unstale":"2024-09-12T03:34:45.010903+0000","last_undegraded":"2024-09-12T03:34:45.010903+0000","last_fullsized":"2024-09-12T03:34:45.010903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:56.936013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011752+0000","last_change":"2024-09-12T03:34:39.090922+0000","last_active":"2024-09-12T03:34:45.011752+0000","last_peered":"2024-09-12T03:34:45.011752+0000","last_clean":"2024-09-12T03:34:45.011752+0000","last_became_active":"2024-09-12T03:34:39.090678+0000","last_became_peered":"2024-09-12T03:34:39.090678+0000","last_unstale":"2024-09-12T03:34:45.011752+0000","last_undegraded":"2024-09-12T03:34:45.011752+0000","last_fullsized":"2024-09-12T03:34:45.011752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.099310+0000","last_change":"2024-09-12T03:34:39.103626+0000","last_active":"2024-09-12T03:34:44.099310+0000","last_peered":"2024-09-12T03:34:44.099310+0000","last_clean":"2024-09-12T03:34:44.099310+0000","last_became_active":"2024-09-12T03:34:39.102752+0000","last_became_peered":"2024-09-12T03:34:39.102752+0000","last_unstale":"2024-09-12T03:34:44.099310+0000","last_undegraded":"2024-09-12T03:34:44.099310+0000","last_fullsized":"2024-09-12T03:34:44.099310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:05.634306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.095270+0000","last_change":"2024-09-12T03:34:39.088569+0000","last_active":"2024-09-12T03:34:44.095270+0000","last_peered":"2024-09-12T03:34:44.095270+0000","last_clean":"2024-09-12T03:34:44.095270+0000","last_became_active":"2024-09-12T03:34:39.088031+0000","last_became_peered":"2024-09-12T03:34:39.088031+0000","last_unstale":"2024-09-12T03:34:44.095270+0000","last_undegraded":"2024-09-12T03:34:44.095270+0000","last_fullsized":"2024-09-12T03:34:44.095270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.092516+0000","last_change":"2024-09-12T03:34:39.081983+0000","last_active":"2024-09-12T03:34:44.092516+0000","last_peered":"2024-09-12T03:34:44.092516+0000","last_clean":"2024-09-12T03:34:44.092516+0000","last_became_active":"2024-09-12T03:34:39.081670+0000","last_became_peered":"2024-09-12T03:34:39.081670+0000","last_unstale":"2024-09-12T03:34:44.092516+0000","last_undegraded":"2024-09-12T03:34:44.092516+0000","last_fullsized":"2024-09-12T03:34:44.092516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.012007+0000","last_change":"2024-09-12T03:34:39.058851+0000","last_active":"2024-09-12T03:34:45.012007+0000","last_peered":"2024-09-12T03:34:45.012007+0000","last_clean":"2024-09-12T03:34:45.012007+0000","last_became_active":"2024-09-12T03:34:39.058122+0000","last_became_peered":"2024-09-12T03:34:39.058122+0000","last_unstale":"2024-09-12T03:34:45.012007+0000","last_undegraded":"2024-09-12T03:34:45.012007+0000","last_fullsized":"2024-09-12T03:34:45.012007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:12.193080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.008220+0000","last_change":"2024-09-12T03:34:39.067672+0000","last_active":"2024-09-12T03:34:45.008220+0000","last_peered":"2024-09-12T03:34:45.008220+0000","last_clean":"2024-09-12T03:34:45.008220+0000","last_became_active":"2024-09-12T03:34:39.067402+0000","last_became_peered":"2024-09-12T03:34:39.067402+0000","last_unstale":"2024-09-12T03:34:45.008220+0000","last_undegraded":"2024-09-12T03:34:45.008220+0000","last_fullsized":"2024-09-12T03:34:45.008220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:58.190739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096493+0000","last_change":"2024-09-12T03:34:39.108544+0000","last_active":"2024-09-12T03:34:44.096493+0000","last_peered":"2024-09-12T03:34:44.096493+0000","last_clean":"2024-09-12T03:34:44.096493+0000","last_became_active":"2024-09-12T03:34:39.108009+0000","last_became_peered":"2024-09-12T03:34:39.108009+0000","last_unstale":"2024-09-12T03:34:44.096493+0000","last_undegraded":"2024-09-12T03:34:44.096493+0000","last_fullsized":"2024-09-12T03:34:44.096493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:25.456095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188461+0000","last_change":"2024-09-12T03:34:39.104075+0000","last_active":"2024-09-12T03:34:44.188461+0000","last_peered":"2024-09-12T03:34:44.188461+0000","last_clean":"2024-09-12T03:34:44.188461+0000","last_became_active":"2024-09-12T03:34:39.094220+0000","last_became_peered":"2024-09-12T03:34:39.094220+0000","last_unstale":"2024-09-12T03:34:44.188461+0000","last_undegraded":"2024-09-12T03:34:44.188461+0000","last_fullsized":"2024-09-12T03:34:44.188461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:54.617082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.188458+0000","last_change":"2024-09-12T03:34:39.093290+0000","last_active":"2024-09-12T03:34:44.188458+0000","last_peered":"2024-09-12T03:34:44.188458+0000","last_clean":"2024-09-12T03:34:44.188458+0000","last_became_active":"2024-09-12T03:34:39.092378+0000","last_became_peered":"2024-09-12T03:34:39.092378+0000","last_unstale":"2024-09-12T03:34:44.188458+0000","last_undegraded":"2024-09-12T03:34:44.188458+0000","last_fullsized":"2024-09-12T03:34:44.188458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.516410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011121+0000","last_change":"2024-09-12T03:34:39.099671+0000","last_active":"2024-09-12T03:34:45.011121+0000","last_peered":"2024-09-12T03:34:45.011121+0000","last_clean":"2024-09-12T03:34:45.011121+0000","last_became_active":"2024-09-12T03:34:39.099044+0000","last_became_peered":"2024-09-12T03:34:39.099044+0000","last_unstale":"2024-09-12T03:34:45.011121+0000","last_undegraded":"2024-09-12T03:34:45.011121+0000","last_fullsized":"2024-09-12T03:34:45.011121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:49.797056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.007754+0000","last_change":"2024-09-12T03:34:39.097597+0000","last_active":"2024-09-12T03:34:45.007754+0000","last_peered":"2024-09-12T03:34:45.007754+0000","last_clean":"2024-09-12T03:34:45.007754+0000","last_became_active":"2024-09-12T03:34:39.097301+0000","last_became_peered":"2024-09-12T03:34:39.097301+0000","last_unstale":"2024-09-12T03:34:45.007754+0000","last_undegraded":"2024-09-12T03:34:45.007754+0000","last_fullsized":"2024-09-12T03:34:45.007754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:24.666071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009891+0000","last_change":"2024-09-12T03:34:39.084776+0000","last_active":"2024-09-12T03:34:45.009891+0000","last_peered":"2024-09-12T03:34:45.009891+0000","last_clean":"2024-09-12T03:34:45.009891+0000","last_became_active":"2024-09-12T03:34:39.083987+0000","last_became_peered":"2024-09-12T03:34:39.083987+0000","last_unstale":"2024-09-12T03:34:45.009891+0000","last_undegraded":"2024-09-12T03:34:45.009891+0000","last_fullsized":"2024-09-12T03:34:45.009891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.096430+0000","last_change":"2024-09-12T03:34:39.088318+0000","last_active":"2024-09-12T03:34:44.096430+0000","last_peered":"2024-09-12T03:34:44.096430+0000","last_clean":"2024-09-12T03:34:44.096430+0000","last_became_active":"2024-09-12T03:34:39.087777+0000","last_became_peered":"2024-09-12T03:34:39.087777+0000","last_unstale":"2024-09-12T03:34:44.096430+0000","last_undegraded":"2024-09-12T03:34:44.096430+0000","last_fullsized":"2024-09-12T03:34:44.096430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:34.862219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.009971+0000","last_change":"2024-09-12T03:34:39.085197+0000","last_active":"2024-09-12T03:34:45.009971+0000","last_peered":"2024-09-12T03:34:45.009971+0000","last_clean":"2024-09-12T03:34:45.009971+0000","last_became_active":"2024-09-12T03:34:39.084478+0000","last_became_peered":"2024-09-12T03:34:39.084478+0000","last_unstale":"2024-09-12T03:34:45.009971+0000","last_undegraded":"2024-09-12T03:34:45.009971+0000","last_fullsized":"2024-09-12T03:34:45.009971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:43.280996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.097330+0000","last_change":"2024-09-12T03:34:39.097105+0000","last_active":"2024-09-12T03:34:44.097330+0000","last_peered":"2024-09-12T03:34:44.097330+0000","last_clean":"2024-09-12T03:34:44.097330+0000","last_became_active":"2024-09-12T03:34:39.088754+0000","last_became_peered":"2024-09-12T03:34:39.088754+0000","last_unstale":"2024-09-12T03:34:44.097330+0000","last_undegraded":"2024-09-12T03:34:44.097330+0000","last_fullsized":"2024-09-12T03:34:44.097330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:26.802337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.011922+0000","last_change":"2024-09-12T03:34:39.049548+0000","last_active":"2024-09-12T03:34:45.011922+0000","last_peered":"2024-09-12T03:34:45.011922+0000","last_clean":"2024-09-12T03:34:45.011922+0000","last_became_active":"2024-09-12T03:34:39.049247+0000","last_became_peered":"2024-09-12T03:34:39.049247+0000","last_unstale":"2024-09-12T03:34:45.011922+0000","last_undegraded":"2024-09-12T03:34:45.011922+0000","last_fullsized":"2024-09-12T03:34:45.011922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:59.476943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:44.094491+0000","last_change":"2024-09-12T03:34:39.061225+0000","last_active":"2024-09-12T03:34:44.094491+0000","last_peered":"2024-09-12T03:34:44.094491+0000","last_clean":"2024-09-12T03:34:44.094491+0000","last_became_active":"2024-09-12T03:34:39.060943+0000","last_became_peered":"2024-09-12T03:34:39.060943+0000","last_unstale":"2024-09-12T03:34:44.094491+0000","last_undegraded":"2024-09-12T03:34:44.094491+0000","last_fullsized":"2024-09-12T03:34:44.094491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:19.468861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-12T03:34:45.010849+0000","last_change":"2024-09-12T03:34:39.105481+0000","last_active":"2024-09-12T03:34:45.010849+0000","last_peered":"2024-09-12T03:34:45.010849+0000","last_clean":"2024-09-12T03:34:45.010849+0000","last_became_active":"2024-09-12T03:34:39.105018+0000","last_became_peered":"2024-09-12T03:34:39.105018+0000","last_unstale":"2024-09-12T03:34:45.010849+0000","last_undegraded":"2024-09-12T03:34:45.010849+0000","last_fullsized":"2024-09-12T03:34:45.010849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:37.974677+0000","last_clean_scrub_stamp":"2024-09-12T03:34:37.974677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:04.379957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":856064,"data_stored":693019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":102159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":102195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":102069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":102229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":693075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:34:57.145 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:34:57.145 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T03:34:57.146 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T03:34:57.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T03:34:57.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f900794c640 1 Processor -- start 2024-09-12T03:34:57.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f900794c640 1 -- start start 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f900794c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f900015bec0 0x7f90000ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f900794c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90000af470 0x7f900006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f900794c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90000b3290 con 0x7f900015c2a0 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f900794c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f90000b3570 con 0x7f900015bec0 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f900794c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f90000b3850 con 0x7f90000af470 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f90056e8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f900015bec0 0x7f90000ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f9004ee7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f900015c2a0 0x7f90000aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59842/0 (socket says 172.21.15.73:59842) 2024-09-12T03:34:57.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f9004ee7640 1 -- 172.21.15.73:0/1570796600 learned_addr learned my addr 172.21.15.73:0/1570796600 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:57.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f90056e8640 1 -- 172.21.15.73:0/1570796600 >> v2:172.21.15.150:3300/0 conn(0x7f90000af470 msgr2=0x7f900006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:57.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f90056e8640 1 --2- 172.21.15.73:0/1570796600 >> v2:172.21.15.150:3300/0 conn(0x7f90000af470 0x7f900006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f90056e8640 1 -- 172.21.15.73:0/1570796600 >> v1:172.21.15.73:6789/0 conn(0x7f900015c2a0 legacy=0x7f90000aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f90056e8640 1 -- 172.21.15.73:0/1570796600 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90000b3b30 con 0x7f900015bec0 2024-09-12T03:34:57.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.288+0000 7f8ffffff640 1 -- 172.21.15.73:0/1570796600 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174810909 0 0) 0x7f90000b3290 con 0x7f900015c2a0 2024-09-12T03:34:57.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f90056e8640 1 --2- 172.21.15.73:0/1570796600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015bec0 0x7f90000ad200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90000b2fb0 tx=0x7f8ff801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea887963a194c3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f8ffffff640 1 -- 172.21.15.73:0/1570796600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80ab650 con 0x7f900015bec0 2024-09-12T03:34:57.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f8ffffff640 1 -- 172.21.15.73:0/1570796600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff80b0070 con 0x7f900015bec0 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f8ffffff640 1 -- 172.21.15.73:0/1570796600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80aba10 con 0x7f900015bec0 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 -- 172.21.15.73:0/1570796600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015bec0 msgr2=0x7f90000ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 --2- 172.21.15.73:0/1570796600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015bec0 0x7f90000ad200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90000b2fb0 tx=0x7f8ff801c450 comp rx=0 tx=0).stop 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 -- 172.21.15.73:0/1570796600 shutdown_connections 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 --2- 172.21.15.73:0/1570796600 >> v2:172.21.15.150:3300/0 conn(0x7f90000af470 0x7f900006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 --2- 172.21.15.73:0/1570796600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015bec0 0x7f90000ad200 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 -- 172.21.15.73:0/1570796600 >> 172.21.15.73:0/1570796600 conn(0x7f90000b1f90 msgr2=0x7f90000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 -- 172.21.15.73:0/1570796600 shutdown_connections 2024-09-12T03:34:57.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.292+0000 7f900794c640 1 -- 172.21.15.73:0/1570796600 wait complete. 2024-09-12T03:34:57.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 Processor -- start 2024-09-12T03:34:57.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 -- start start 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90000af470 0x7f900015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f900015bec0 0x7f90001572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015c2a0 0x7f900014b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f900006ed50 con 0x7f900015c2a0 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f90000ad740 con 0x7f90000af470 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f900006eed0 con 0x7f900015bec0 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015c2a0 0x7f900014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015c2a0 0x7f900014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37220/0 (socket says 172.21.15.73:37220) 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 -- 172.21.15.73:0/3845618877 learned_addr learned my addr 172.21.15.73:0/3845618877 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f90056e8640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90000af470 0x7f900015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9004ee7640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f900015bec0 0x7f90001572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 -- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f900015bec0 msgr2=0x7f90001572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f900015bec0 0x7f90001572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 -- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90000af470 msgr2=0x7f900015cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90000af470 0x7f900015cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 -- 172.21.15.73:0/3845618877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900015f1f0 con 0x7f900015c2a0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f9005ee9640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015c2a0 0x7f900014b330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400b460 tx=0x7f8ff400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f8ffdffb640 1 -- 172.21.15.73:0/3845618877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4015020 con 0x7f900015c2a0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f8ffdffb640 1 -- 172.21.15.73:0/3845618877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4011890 con 0x7f900015c2a0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900015f4d0 con 0x7f900015c2a0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f8ffdffb640 1 -- 172.21.15.73:0/3845618877 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4011c80 con 0x7f900015c2a0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9000156dd0 con 0x7f900015c2a0 2024-09-12T03:34:57.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900006f1f0 con 0x7f900015c2a0 2024-09-12T03:34:57.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f8ffdffb640 1 -- 172.21.15.73:0/3845618877 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ff4018020 con 0x7f900015c2a0 2024-09-12T03:34:57.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f8ffdffb640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fec0678c0 0x7f8fec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f8ffdffb640 1 -- 172.21.15.73:0/3845618877 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ff4086130 con 0x7f900015c2a0 2024-09-12T03:34:57.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.296+0000 7f90056e8640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fec0678c0 0x7f8fec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.300+0000 7f90056e8640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fec0678c0 0x7f8fec069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80af000 tx=0x7f8ff80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.300+0000 7f8ffdffb640 1 -- 172.21.15.73:0/3845618877 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ff401f020 con 0x7f900015c2a0 2024-09-12T03:34:57.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.484+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9000156fa0 con 0x7f900015c2a0 2024-09-12T03:34:57.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.484+0000 7f8ffdffb640 1 -- 172.21.15.73:0/3845618877 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8ff400d040 con 0x7f900015c2a0 2024-09-12T03:34:57.489 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:57.489 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fec0678c0 msgr2=0x7f8fec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fec0678c0 0x7f8fec069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80af000 tx=0x7f8ff80a7000 comp rx=0 tx=0).stop 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015c2a0 msgr2=0x7f900014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015c2a0 0x7f900014b330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400b460 tx=0x7f8ff400b920 comp rx=0 tx=0).stop 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 shutdown_connections 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fec0678c0 0x7f8fec069d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f900015c2a0 0x7f900014b330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f900015bec0 0x7f90001572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 --2- 172.21.15.73:0/3845618877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90000af470 0x7f900015cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 >> 172.21.15.73:0/3845618877 conn(0x7f90000b1f90 msgr2=0x7f90001597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:57.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 shutdown_connections 2024-09-12T03:34:57.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.488+0000 7f900794c640 1 -- 172.21.15.73:0/3845618877 wait complete. 2024-09-12T03:34:57.506 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T03:34:57.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f83a1289640 1 Processor -- start 2024-09-12T03:34:57.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f83a1289640 1 -- start start 2024-09-12T03:34:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f83a1289640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f839c06f010 0x7f839c166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f83a1289640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c0b3290 con 0x7f839c15bec0 2024-09-12T03:34:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f83a1289640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f839c0b3570 con 0x7f839c15c2a0 2024-09-12T03:34:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f83a1289640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f839c0b3850 con 0x7f839c06f010 2024-09-12T03:34:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f839c15bec0 0x7f839c0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59846/0 (socket says 172.21.15.73:59846) 2024-09-12T03:34:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839affd640 1 -- 172.21.15.73:0/1332365117 learned_addr learned my addr 172.21.15.73:0/1332365117 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:57.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981774508 0 0) 0x7f839c0b3290 con 0x7f839c15bec0 2024-09-12T03:34:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8384003530 con 0x7f839c15bec0 2024-09-12T03:34:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839b7fe640 1 --2- 172.21.15.73:0/1332365117 >> v2:172.21.15.150:3300/0 conn(0x7f839c06f010 0x7f839c166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3126558935 0 0) 0x7f8384003530 con 0x7f839c15bec0 2024-09-12T03:34:57.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 >> v2:172.21.15.150:3300/0 conn(0x7f839c06f010 msgr2=0x7f839c166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 --2- 172.21.15.73:0/1332365117 >> v2:172.21.15.150:3300/0 conn(0x7f839c06f010 0x7f839c166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 >> v1:172.21.15.150:6789/0 conn(0x7f839c15c2a0 legacy=0x7f839c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c0b3b30 con 0x7f839c15bec0 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f838c001680 con 0x7f839c15bec0 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 >> v1:172.21.15.73:6789/0 conn(0x7f839c15bec0 legacy=0x7f839c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83840039c0 0x7f8384003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8384004810 0x7f8384004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83840051d0 0x7f838400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0b3850 con 0x7f8384004810 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f838400c120 con 0x7f83840039c0 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f838400c320 con 0x7f83840051d0 2024-09-12T03:34:57.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839a7fc640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8384004810 0x7f8384004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839affd640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83840039c0 0x7f8384003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839b7fe640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83840051d0 0x7f838400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839a7fc640 1 -- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83840051d0 msgr2=0x7f838400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839a7fc640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83840051d0 0x7f838400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839a7fc640 1 -- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83840039c0 msgr2=0x7f8384003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839a7fc640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83840039c0 0x7f8384003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839a7fc640 1 -- 172.21.15.73:0/1332365117 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8384003530 con 0x7f8384004810 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839affd640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f83840039c0 0x7f8384003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839b7fe640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f83840051d0 0x7f838400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:57.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.616+0000 7f839b7fe640 1 -- 172.21.15.73:0/1332365117 reap_dead start 2024-09-12T03:34:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f839a7fc640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8384004810 0x7f8384004c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8390001750 tx=0x7f839001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65f2454e71bce6c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83900013a0 con 0x7f8384004810 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83900052f0 con 0x7f8384004810 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f8399ffb640 1 -- 172.21.15.73:0/1332365117 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390003840 con 0x7f8384004810 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 -- 172.21.15.73:0/1332365117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8384004810 msgr2=0x7f8384004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8384004810 0x7f8384004c90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8390001750 tx=0x7f839001c3c0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 -- 172.21.15.73:0/1332365117 shutdown_connections 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 --2- 172.21.15.73:0/1332365117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8384004810 0x7f8384004c90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 -- 172.21.15.73:0/1332365117 >> 172.21.15.73:0/1332365117 conn(0x7f839c0b1f90 msgr2=0x7f839c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 -- 172.21.15.73:0/1332365117 shutdown_connections 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 -- 172.21.15.73:0/1332365117 wait complete. 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.620+0000 7f83a1289640 1 Processor -- start 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 -- start start 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8384004810 0x7f839c150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0999b0 0x7f839c14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f839c14f6a0 0x7f839c14e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0afc90 con 0x7f839c0999b0 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f839c0b40f0 con 0x7f8384004810 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0ad200 con 0x7f839c14f6a0 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0999b0 0x7f839c14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0999b0 0x7f839c14f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37230/0 (socket says 172.21.15.73:37230) 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 -- 172.21.15.73:0/884394323 learned_addr learned my addr 172.21.15.73:0/884394323 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839affd640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8384004810 0x7f839c150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839b7fe640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f839c14f6a0 0x7f839c14e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 -- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f839c14f6a0 msgr2=0x7f839c14e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f839c14f6a0 0x7f839c14e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 -- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8384004810 msgr2=0x7f839c150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8384004810 0x7f839c150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 -- 172.21.15.73:0/884394323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c14fc20 con 0x7f839c0999b0 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839b7fe640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f839c14f6a0 0x7f839c14e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839a7fc640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0999b0 0x7f839c14f160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f839001c1f0 tx=0x7f8384005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83837fe640 1 -- 172.21.15.73:0/884394323 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390007a40 con 0x7f839c0999b0 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83837fe640 1 -- 172.21.15.73:0/884394323 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83900ba070 con 0x7f839c0999b0 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c14ff00 con 0x7f839c0999b0 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83837fe640 1 -- 172.21.15.73:0/884394323 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390007270 con 0x7f839c0999b0 2024-09-12T03:34:57.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1504c0 con 0x7f839c0999b0 2024-09-12T03:34:57.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c0ad530 con 0x7f839c0999b0 2024-09-12T03:34:57.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83837fe640 1 -- 172.21.15.73:0/884394323 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8390005280 con 0x7f839c0999b0 2024-09-12T03:34:57.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83837fe640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83880678f0 0x7f8388069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f839affd640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83880678f0 0x7f8388069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.624+0000 7f83837fe640 1 -- 172.21.15.73:0/884394323 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8390120030 con 0x7f839c0999b0 2024-09-12T03:34:57.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.628+0000 7f839affd640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83880678f0 0x7f8388069db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f838c004880 tx=0x7f838c0015c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.632+0000 7f83837fe640 1 -- 172.21.15.73:0/884394323 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83900160d0 con 0x7f839c0999b0 2024-09-12T03:34:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.812+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f839c06fcd0 con 0x7f839c0999b0 2024-09-12T03:34:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.812+0000 7f83837fe640 1 -- 172.21.15.73:0/884394323 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f83900f0830 con 0x7f839c0999b0 2024-09-12T03:34:57.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:57.817 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:34:57.818 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:34:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83880678f0 msgr2=0x7f8388069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83880678f0 0x7f8388069db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f838c004880 tx=0x7f838c0015c0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0999b0 msgr2=0x7f839c14f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0999b0 0x7f839c14f160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f839001c1f0 tx=0x7f8384005840 comp rx=0 tx=0).stop 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 shutdown_connections 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83880678f0 0x7f8388069db0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0999b0 0x7f839c14f160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f839c14f6a0 0x7f839c14e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 --2- 172.21.15.73:0/884394323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8384004810 0x7f839c150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 >> 172.21.15.73:0/884394323 conn(0x7f839c0b1f90 msgr2=0x7f839c15a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 shutdown_connections 2024-09-12T03:34:57.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.816+0000 7f83a1289640 1 -- 172.21.15.73:0/884394323 wait complete. 2024-09-12T03:34:57.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818ebf9640 1 Processor -- start 2024-09-12T03:34:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818ebf9640 1 -- start start 2024-09-12T03:34:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818ebf9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f818806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818ebf9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f818806fe50 0x7f818815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818ebf9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8188070250 con 0x7f818815f1d0 2024-09-12T03:34:57.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818ebf9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8188152480 con 0x7f818806fe50 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818ebf9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f81880aede0 con 0x7f81881520a0 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f8187fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f818806fe50 0x7f818815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818d196640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f818815f1d0 0x7f8188071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59854/0 (socket says 172.21.15.73:59854) 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818d196640 1 -- 172.21.15.73:0/186080313 learned_addr learned my addr 172.21.15.73:0/186080313 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818c995640 1 --2- 172.21.15.73:0/186080313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f818806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f8187fff640 1 -- 172.21.15.73:0/186080313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 msgr2=0x7f818806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f8187fff640 1 --2- 172.21.15.73:0/186080313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f818806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f8187fff640 1 -- 172.21.15.73:0/186080313 >> v1:172.21.15.73:6789/0 conn(0x7f818815f1d0 legacy=0x7f8188071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f8187fff640 1 -- 172.21.15.73:0/186080313 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f818815fa10 con 0x7f818806fe50 2024-09-12T03:34:57.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.940+0000 7f818c995640 1 --2- 172.21.15.73:0/186080313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f818806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f8187fff640 1 --2- 172.21.15.73:0/186080313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818806fe50 0x7f818815ec90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81740097c0 tx=0x7f817401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2a1cd144ecf03f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f81877fe640 1 -- 172.21.15.73:0/186080313 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740b1070 con 0x7f818806fe50 2024-09-12T03:34:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f81877fe640 1 -- 172.21.15.73:0/186080313 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81740ac600 con 0x7f818806fe50 2024-09-12T03:34:57.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f81877fe640 1 -- 172.21.15.73:0/186080313 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81740ac9d0 con 0x7f818806fe50 2024-09-12T03:34:57.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- 172.21.15.73:0/186080313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818806fe50 msgr2=0x7f818815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 --2- 172.21.15.73:0/186080313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818806fe50 0x7f818815ec90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f81740097c0 tx=0x7f817401c480 comp rx=0 tx=0).stop 2024-09-12T03:34:57.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- 172.21.15.73:0/186080313 shutdown_connections 2024-09-12T03:34:57.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 --2- 172.21.15.73:0/186080313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818806fe50 0x7f818815ec90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 --2- 172.21.15.73:0/186080313 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f818806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- 172.21.15.73:0/186080313 >> 172.21.15.73:0/186080313 conn(0x7f81880b1f90 msgr2=0x7f81880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:57.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- 172.21.15.73:0/186080313 shutdown_connections 2024-09-12T03:34:57.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- 172.21.15.73:0/186080313 wait complete. 2024-09-12T03:34:57.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 Processor -- start 2024-09-12T03:34:57.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- start start 2024-09-12T03:34:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f818806fe50 0x7f8188097140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f8188145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818815f1d0 0x7f81880cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8188073d30 con 0x7f818815f1d0 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8188073a50 con 0x7f818806fe50 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.944+0000 7f818ebf9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f818815f600 con 0x7f81881520a0 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818815f1d0 0x7f81880cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818815f1d0 0x7f81880cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37242/0 (socket says 172.21.15.73:37242) 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 -- 172.21.15.73:0/601388022 learned_addr learned my addr 172.21.15.73:0/601388022 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818c995640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f818806fe50 0x7f8188097140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f8187fff640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f8188145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 -- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 msgr2=0x7f8188145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f8188145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 -- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f818806fe50 msgr2=0x7f8188097140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:57.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f818806fe50 0x7f8188097140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 -- 172.21.15.73:0/601388022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81880cfc90 con 0x7f818815f1d0 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f8187fff640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f8188145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818d196640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818815f1d0 0x7f81880cec60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f818000cbf0 tx=0x7f818000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f81857fa640 1 -- 172.21.15.73:0/601388022 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180017070 con 0x7f818815f1d0 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f81857fa640 1 -- 172.21.15.73:0/601388022 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818000ad40 con 0x7f818815f1d0 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81880cf3f0 con 0x7f818815f1d0 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f81857fa640 1 -- 172.21.15.73:0/601388022 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180012600 con 0x7f818815f1d0 2024-09-12T03:34:57.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81880cf9b0 con 0x7f818815f1d0 2024-09-12T03:34:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818815ec90 con 0x7f818815f1d0 2024-09-12T03:34:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f81857fa640 1 -- 172.21.15.73:0/601388022 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f818001a070 con 0x7f818815f1d0 2024-09-12T03:34:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f81857fa640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f816c0678c0 0x7f816c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818c995640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f816c0678c0 0x7f816c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f81857fa640 1 -- 172.21.15.73:0/601388022 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8180085ba0 con 0x7f818815f1d0 2024-09-12T03:34:57.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.948+0000 7f818c995640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f816c0678c0 0x7f816c069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f817c00a9a0 tx=0x7f817c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:57.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:57.952+0000 7f81857fa640 1 -- 172.21.15.73:0/601388022 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8180055de0 con 0x7f818815f1d0 2024-09-12T03:34:58.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f818814d980 con 0x7f818815f1d0 2024-09-12T03:34:58.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f81857fa640 1 -- 172.21.15.73:0/601388022 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f8180085070 con 0x7f818815f1d0 2024-09-12T03:34:58.140 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:58.140 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:34:58.140 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:34:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f816c0678c0 msgr2=0x7f816c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f816c0678c0 0x7f816c069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f817c00a9a0 tx=0x7f817c008040 comp rx=0 tx=0).stop 2024-09-12T03:34:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818815f1d0 msgr2=0x7f81880cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818815f1d0 0x7f81880cec60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f818000cbf0 tx=0x7f818000a430 comp rx=0 tx=0).stop 2024-09-12T03:34:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 shutdown_connections 2024-09-12T03:34:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f816c0678c0 0x7f816c069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f818815f1d0 0x7f81880cec60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81881520a0 0x7f8188145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 --2- 172.21.15.73:0/601388022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f818806fe50 0x7f8188097140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 >> 172.21.15.73:0/601388022 conn(0x7f81880b1f90 msgr2=0x7f81880b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 shutdown_connections 2024-09-12T03:34:58.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.136+0000 7f818ebf9640 1 -- 172.21.15.73:0/601388022 wait complete. 2024-09-12T03:34:58.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:34:58.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.268+0000 7f093b7ea640 1 Processor -- start 2024-09-12T03:34:58.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.268+0000 7f093b7ea640 1 -- start start 2024-09-12T03:34:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f093b7ea640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f093b7ea640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f093415f1d0 0x7f09340adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f093b7ea640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09340aede0 con 0x7f09341520a0 2024-09-12T03:34:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f093b7ea640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0934152480 con 0x7f093415f1d0 2024-09-12T03:34:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f093b7ea640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f093415fa10 con 0x7f0934070020 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939586640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f09341520a0 0x7f093406f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59866/0 (socket says 172.21.15.73:59866) 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939586640 1 -- 172.21.15.73:0/31751738 learned_addr learned my addr 172.21.15.73:0/31751738 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939d87640 1 --2- 172.21.15.73:0/31751738 >> v2:172.21.15.73:3300/0 conn(0x7f093415f1d0 0x7f09340adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0938d85640 1 --2- 172.21.15.73:0/31751738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939d87640 1 -- 172.21.15.73:0/31751738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 msgr2=0x7f093415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939d87640 1 --2- 172.21.15.73:0/31751738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939d87640 1 -- 172.21.15.73:0/31751738 >> v1:172.21.15.73:6789/0 conn(0x7f09341520a0 legacy=0x7f093406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939d87640 1 -- 172.21.15.73:0/31751738 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0934074250 con 0x7f093415f1d0 2024-09-12T03:34:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0927fff640 1 -- 172.21.15.73:0/31751738 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022738821 0 0) 0x7f09340aede0 con 0x7f09341520a0 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0939d87640 1 --2- 172.21.15.73:0/31751738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f09340adc80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f092c009dc0 tx=0x7f092c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e13a0edbd08bc7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0927fff640 1 -- 172.21.15.73:0/31751738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0b2070 con 0x7f093415f1d0 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0927fff640 1 -- 172.21.15.73:0/31751738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c0a59e0 con 0x7f093415f1d0 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.272+0000 7f0927fff640 1 -- 172.21.15.73:0/31751738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0a5db0 con 0x7f093415f1d0 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/31751738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 msgr2=0x7f09340adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 --2- 172.21.15.73:0/31751738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f09340adc80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f092c009dc0 tx=0x7f092c01c920 comp rx=0 tx=0).stop 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/31751738 shutdown_connections 2024-09-12T03:34:58.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 --2- 172.21.15.73:0/31751738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 --2- 172.21.15.73:0/31751738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f09340adc80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/31751738 >> 172.21.15.73:0/31751738 conn(0x7f09340b1f90 msgr2=0x7f09340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:58.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/31751738 shutdown_connections 2024-09-12T03:34:58.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/31751738 wait complete. 2024-09-12T03:34:58.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 Processor -- start 2024-09-12T03:34:58.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- start start 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341520a0 0x7f093409cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f0934099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f093415f680 con 0x7f093415f1d0 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0934073d30 con 0x7f09341520a0 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0934167f10 con 0x7f0934070020 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f0934099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f0934099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37268/0 (socket says 172.21.15.73:37268) 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 -- 172.21.15.73:0/199994806 learned_addr learned my addr 172.21.15.73:0/199994806 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0938d85640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341520a0 0x7f093409cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939586640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 -- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 msgr2=0x7f093414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093414eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 -- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341520a0 msgr2=0x7f093409cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341520a0 0x7f093409cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 -- 172.21.15.73:0/199994806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093409d840 con 0x7f093415f1d0 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0938d85640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341520a0 0x7f093409cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0939d87640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f0934099520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f092c01a550 tx=0x7f092c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0925ffb640 1 -- 172.21.15.73:0/199994806 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0b2050 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0925ffb640 1 -- 172.21.15.73:0/199994806 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c0b3040 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093409ae30 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f0925ffb640 1 -- 172.21.15.73:0/199994806 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f092c0ad9b0 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093409b3f0 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.276+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f093406e540 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.280+0000 7f0925ffb640 1 -- 172.21.15.73:0/199994806 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f092c0c0020 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.280+0000 7f0925ffb640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09180678c0 0x7f0918069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.280+0000 7f0925ffb640 1 -- 172.21.15.73:0/199994806 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f092c120c90 con 0x7f093415f1d0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.280+0000 7f0939586640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09180678c0 0x7f0918069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.280+0000 7f0939586640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09180678c0 0x7f0918069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0930000f70 tx=0x7f0930009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:58.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.284+0000 7f0925ffb640 1 -- 172.21.15.73:0/199994806 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f092c0c7020 con 0x7f093415f1d0 2024-09-12T03:34:58.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.432+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f093415ec90 con 0x7f093415f1d0 2024-09-12T03:34:58.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.436+0000 7f0925ffb640 1 -- 172.21.15.73:0/199994806 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f092c016540 con 0x7f093415f1d0 2024-09-12T03:34:58.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:58.441 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09180678c0 msgr2=0x7f0918069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09180678c0 0x7f0918069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0930000f70 tx=0x7f0930009040 comp rx=0 tx=0).stop 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 msgr2=0x7f0934099520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f0934099520 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f092c01a550 tx=0x7f092c0196c0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 shutdown_connections 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f09180678c0 0x7f0918069d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f093415f1d0 0x7f0934099520 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09341520a0 0x7f093409cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 --2- 172.21.15.73:0/199994806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0934070020 0x7f093414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 >> 172.21.15.73:0/199994806 conn(0x7f09340b1f90 msgr2=0x7f093415b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:58.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 shutdown_connections 2024-09-12T03:34:58.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.440+0000 7f093b7ea640 1 -- 172.21.15.73:0/199994806 wait complete. 2024-09-12T03:34:58.459 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:34:58.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.568+0000 7f9660249640 1 Processor -- start 2024-09-12T03:34:58.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.568+0000 7f9660249640 1 -- start start 2024-09-12T03:34:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f9660249640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 0x7f96580aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f9660249640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f96580af2a0 0x7f965806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f9660249640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96580b3290 con 0x7f965815bec0 2024-09-12T03:34:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f9660249640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f96580b3570 con 0x7f96580af2a0 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f9660249640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f96580b3850 con 0x7f965815c2a0 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965dfe5640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f965815bec0 0x7f96580ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59876/0 (socket says 172.21.15.73:59876) 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965dfe5640 1 -- 172.21.15.73:0/3684419656 learned_addr learned my addr 172.21.15.73:0/3684419656 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2170308295 0 0) 0x7f96580b3290 con 0x7f965815bec0 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 --2- 172.21.15.73:0/3684419656 >> v2:172.21.15.150:3300/0 conn(0x7f96580af2a0 0x7f965806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965d7e4640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 0x7f96580aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9644003530 con 0x7f965815bec0 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3661200859 0 0) 0x7f9644003530 con 0x7f965815bec0 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 msgr2=0x7f96580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 0x7f96580aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 >> v2:172.21.15.150:3300/0 conn(0x7f96580af2a0 msgr2=0x7f965806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 --2- 172.21.15.73:0/3684419656 >> v2:172.21.15.150:3300/0 conn(0x7f96580af2a0 0x7f965806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96580b3b30 con 0x7f965815bec0 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f9654001680 con 0x7f965815bec0 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 >> v1:172.21.15.73:6789/0 conn(0x7f965815bec0 legacy=0x7f96580ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 0x7f96440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644003f40 0x7f9644004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9644004d50 0x7f96440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f96580b3570 con 0x7f9644004d50 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f96580b3850 con 0x7f9644003f40 2024-09-12T03:34:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f964400ba20 con 0x7f965815c2a0 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9644004d50 0x7f96440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965dfe5640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 0x7f96440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965d7e4640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644003f40 0x7f9644004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 -- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 msgr2=0x7f96440039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f965815c2a0 0x7f96440039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 -- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644003f40 msgr2=0x7f9644004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644003f40 0x7f9644004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 -- 172.21.15.73:0/3684419656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9644003530 con 0x7f9644004d50 2024-09-12T03:34:58.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965e7e6640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9644004d50 0x7f96440051d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9650009fc0 tx=0x7f965001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca00de5bd60c78a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:58.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96500b2070 con 0x7f9644004d50 2024-09-12T03:34:58.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96500a5cd0 con 0x7f9644004d50 2024-09-12T03:34:58.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.572+0000 7f965cfe3640 1 -- 172.21.15.73:0/3684419656 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650009c10 con 0x7f9644004d50 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- 172.21.15.73:0/3684419656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9644004d50 msgr2=0x7f96440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 --2- 172.21.15.73:0/3684419656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9644004d50 0x7f96440051d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9650009fc0 tx=0x7f965001ccc0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965e7e6640 1 -- 172.21.15.73:0/3684419656 reap_dead start 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- 172.21.15.73:0/3684419656 shutdown_connections 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- 172.21.15.73:0/3684419656 >> 172.21.15.73:0/3684419656 conn(0x7f96580b1f90 msgr2=0x7f96580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- 172.21.15.73:0/3684419656 shutdown_connections 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- 172.21.15.73:0/3684419656 wait complete. 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 Processor -- start 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- start start 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644004d50 0x7f9658153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9658154e80 0x7f9658073980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9658099810 0x7f965815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f96580af730 con 0x7f9658154e80 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f96580b40f0 con 0x7f9644004d50 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f96580afc90 con 0x7f9658099810 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9658154e80 0x7f9658073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9658154e80 0x7f9658073980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37274/0 (socket says 172.21.15.73:37274) 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 -- 172.21.15.73:0/4213223220 learned_addr learned my addr 172.21.15.73:0/4213223220 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 -- 172.21.15.73:0/4213223220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9658099810 msgr2=0x7f965815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9658099810 0x7f965815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 -- 172.21.15.73:0/4213223220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644004d50 msgr2=0x7f9658153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644004d50 0x7f9658153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 -- 172.21.15.73:0/4213223220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658073ec0 con 0x7f9658154e80 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f965d7e4640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9658154e80 0x7f9658073980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f964800f530 tx=0x7f964800f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f964e7fc640 1 -- 172.21.15.73:0/4213223220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648013810 con 0x7f9658154e80 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f964e7fc640 1 -- 172.21.15.73:0/4213223220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964801a070 con 0x7f9658154e80 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9658153de0 con 0x7f9658154e80 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f964e7fc640 1 -- 172.21.15.73:0/4213223220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648013bf0 con 0x7f9658154e80 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.576+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96581543a0 con 0x7f9658154e80 2024-09-12T03:34:58.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.580+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96580aed60 con 0x7f9658154e80 2024-09-12T03:34:58.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.580+0000 7f964e7fc640 1 -- 172.21.15.73:0/4213223220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9648012070 con 0x7f9658154e80 2024-09-12T03:34:58.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.580+0000 7f964e7fc640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f963c0678f0 0x7f963c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:58.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.580+0000 7f965dfe5640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f963c0678f0 0x7f963c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:58.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.580+0000 7f964e7fc640 1 -- 172.21.15.73:0/4213223220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9648085e90 con 0x7f9658154e80 2024-09-12T03:34:58.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.580+0000 7f965dfe5640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f963c0678f0 0x7f963c069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f96540017f0 tx=0x7f9654001500 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:58.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.584+0000 7f964e7fc640 1 -- 172.21.15.73:0/4213223220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f964801c310 con 0x7f9658154e80 2024-09-12T03:34:58.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.764+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96580d0f00 con 0x7f9658154e80 2024-09-12T03:34:58.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.764+0000 7f964e7fc640 1 -- 172.21.15.73:0/4213223220 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f9648056690 con 0x7f9658154e80 2024-09-12T03:34:58.769 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:34:58.769 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:34:58.769 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:34:58.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f963c0678f0 msgr2=0x7f963c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f963c0678f0 0x7f963c069db0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f96540017f0 tx=0x7f9654001500 comp rx=0 tx=0).stop 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9658154e80 msgr2=0x7f9658073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9658154e80 0x7f9658073980 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f964800f530 tx=0x7f964800f9f0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 shutdown_connections 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f963c0678f0 0x7f963c069db0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9658154e80 0x7f9658073980 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9658099810 0x7f965815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 --2- 172.21.15.73:0/4213223220 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9644004d50 0x7f9658153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 >> 172.21.15.73:0/4213223220 conn(0x7f96580b1f90 msgr2=0x7f96580b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 shutdown_connections 2024-09-12T03:34:58.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:58.768+0000 7f9660249640 1 -- 172.21.15.73:0/4213223220 wait complete. 2024-09-12T03:34:59.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:34:38.389239+0000', 'modified': '2024-09-12T03:34:52.481248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4248}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4248': {'gid': 4248, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/2532110988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2532110988}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2532110988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4248, 'qdb_cluster': [4248]} 2024-09-12T03:34:59.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:34:59.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T03:34:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37c3ce640 1 Processor -- start 2024-09-12T03:34:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37c3ce640 1 -- start start 2024-09-12T03:34:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37c3ce640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa37415bec0 0x7fa3740ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37c3ce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415c2a0 0x7fa3740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37c3ce640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3740b3290 con 0x7fa3740af2a0 2024-09-12T03:34:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37c3ce640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa3740b3570 con 0x7fa37415bec0 2024-09-12T03:34:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37c3ce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa3740b3850 con 0x7fa37415c2a0 2024-09-12T03:34:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37a16a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa37415bec0 0x7fa3740ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37a96b640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa3740af2a0 0x7fa37415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44632/0 (socket says 172.21.15.73:44632) 2024-09-12T03:34:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37a96b640 1 -- 172.21.15.73:0/1781638198 learned_addr learned my addr 172.21.15.73:0/1781638198 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa379969640 1 --2- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415c2a0 0x7fa3740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37a16a640 1 -- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415c2a0 msgr2=0x7fa3740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37a16a640 1 --2- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415c2a0 0x7fa3740aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37a16a640 1 -- 172.21.15.73:0/1781638198 >> v1:172.21.15.150:6789/0 conn(0x7fa3740af2a0 legacy=0x7fa37415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.320+0000 7fa37a16a640 1 -- 172.21.15.73:0/1781638198 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3740b3b30 con 0x7fa37415bec0 2024-09-12T03:34:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37a16a640 1 --2- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415bec0 0x7fa3740ad200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa370009d90 tx=0x7fa37001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7279cbaeea712b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa379168640 1 -- 172.21.15.73:0/1781638198 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b2070 con 0x7fa37415bec0 2024-09-12T03:34:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa379168640 1 -- 172.21.15.73:0/1781638198 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700a5a00 con 0x7fa37415bec0 2024-09-12T03:34:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa379168640 1 -- 172.21.15.73:0/1781638198 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700a5dd0 con 0x7fa37415bec0 2024-09-12T03:34:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 -- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415bec0 msgr2=0x7fa3740ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415bec0 0x7fa3740ad200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa370009d90 tx=0x7fa37001c940 comp rx=0 tx=0).stop 2024-09-12T03:34:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 -- 172.21.15.73:0/1781638198 shutdown_connections 2024-09-12T03:34:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415c2a0 0x7fa3740aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/1781638198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415bec0 0x7fa3740ad200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 -- 172.21.15.73:0/1781638198 >> 172.21.15.73:0/1781638198 conn(0x7fa3740b1f90 msgr2=0x7fa3740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 -- 172.21.15.73:0/1781638198 shutdown_connections 2024-09-12T03:34:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.324+0000 7fa37c3ce640 1 -- 172.21.15.73:0/1781638198 wait complete. 2024-09-12T03:34:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 Processor -- start 2024-09-12T03:34:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 -- start start 2024-09-12T03:34:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3740af2a0 0x7fa374152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415bec0 0x7fa37409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415c2a0 0x7fa374154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa3740af6b0 con 0x7fa3740af2a0 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa3740ad740 con 0x7fa37415c2a0 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa374169000 con 0x7fa37415bec0 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3740af2a0 0x7fa374152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3740af2a0 0x7fa374152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37286/0 (socket says 172.21.15.73:37286) 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 -- 172.21.15.73:0/693873153 learned_addr learned my addr 172.21.15.73:0/693873153 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a96b640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415c2a0 0x7fa374154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 -- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415bec0 msgr2=0x7fa37409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa379969640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415bec0 0x7fa37409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415bec0 0x7fa37409adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 -- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415c2a0 msgr2=0x7fa374154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415c2a0 0x7fa374154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 -- 172.21.15.73:0/693873153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37409da30 con 0x7fa3740af2a0 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37a16a640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3740af2a0 0x7fa374152630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3700b0040 tx=0x7fa3700196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa36affd640 1 -- 172.21.15.73:0/693873153 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b2050 con 0x7fa3740af2a0 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa36affd640 1 -- 172.21.15.73:0/693873153 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700be070 con 0x7fa3740af2a0 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37409dd10 con 0x7fa3740af2a0 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa36affd640 1 -- 172.21.15.73:0/693873153 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700adb90 con 0x7fa3740af2a0 2024-09-12T03:34:59.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37415dba0 con 0x7fa3740af2a0 2024-09-12T03:34:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.328+0000 7fa36affd640 1 -- 172.21.15.73:0/693873153 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3700039a0 con 0x7fa3740af2a0 2024-09-12T03:34:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa36affd640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3580678f0 0x7fa358069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa36affd640 1 -- 172.21.15.73:0/693873153 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa370120fc0 con 0x7fa3740af2a0 2024-09-12T03:34:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3580678f0 0x7fa358069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3580678f0 0x7fa358069db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa374143df0 tx=0x7fa364008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 Processor -- start 2024-09-12T03:34:59.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- start start 2024-09-12T03:34:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0cd5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0c8bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c8c290 0x55d7b0c8c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d7b0b73b60 con 0x55d7b0cd6440 2024-09-12T03:34:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d7b0adac70 con 0x55d7b0cd5b20 2024-09-12T03:34:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55d7b0a80ed0 con 0x55d7b0c8c290 2024-09-12T03:34:59.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0c8bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0c8bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37302/0 (socket says 172.21.15.73:37302) 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 -- 172.21.15.73:0/388826069 learned_addr learned my addr 172.21.15.73:0/388826069 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 -- 172.21.15.73:0/388826069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c8c290 msgr2=0x55d7b0c8c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 --2- 172.21.15.73:0/388826069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c8c290 0x55d7b0c8c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 -- 172.21.15.73:0/388826069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 msgr2=0x55d7b0cd5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 --2- 172.21.15.73:0/388826069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0cd5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 -- 172.21.15.73:0/388826069 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b0a92e50 con 0x55d7b0cd6440 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa379969640 1 --2- 172.21.15.73:0/388826069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0c8bd50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3640109d0 tx=0x7fa364013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410714476b6d7ad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa357fff640 1 -- 172.21.15.73:0/388826069 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36401c050 con 0x55d7b0cd6440 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa357fff640 1 -- 172.21.15.73:0/388826069 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa364026070 con 0x55d7b0cd6440 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa357fff640 1 -- 172.21.15.73:0/388826069 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36400f040 con 0x55d7b0cd6440 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- 172.21.15.73:0/388826069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 msgr2=0x55d7b0c8bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 --2- 172.21.15.73:0/388826069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0c8bd50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3640109d0 tx=0x7fa364013000 comp rx=0 tx=0).stop 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- 172.21.15.73:0/388826069 shutdown_connections 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 --2- 172.21.15.73:0/388826069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0c8bd50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 --2- 172.21.15.73:0/388826069 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c8c290 0x55d7b0c8c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 --2- 172.21.15.73:0/388826069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0cd5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- 172.21.15.73:0/388826069 >> 172.21.15.73:0/388826069 conn(0x55d7b0c92600 msgr2=0x55d7b0c8a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- 172.21.15.73:0/388826069 shutdown_connections 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- 172.21.15.73:0/388826069 wait complete. 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 -- start start 2024-09-12T03:34:59.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.332+0000 7fa37f48a000 1 Processor -- start 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd5b20 0x55d7b0c90df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd6440 0x55d7b0c96cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 0x55d7b0c97230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d7b0b3cb00 con 0x55d7b0cd5b20 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d7b0ab5360 con 0x55d7b0cd6440 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55d7b0ab22d0 con 0x55d7b0c91330 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 10 client.0 _ll_register_callbacks cb 0x55d7b0c77820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd5b20 0x55d7b0c90df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd5b20 0x55d7b0c90df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37308/0 (socket says 172.21.15.73:37308) 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 -- 172.21.15.73:0/3411320725 learned_addr learned my addr 172.21.15.73:0/3411320725 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa379969640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd6440 0x55d7b0c96cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a96b640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 0x55d7b0c97230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 -- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 msgr2=0x55d7b0c97230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 0x55d7b0c97230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 -- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd6440 msgr2=0x55d7b0c96cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd6440 0x55d7b0c96cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 -- 172.21.15.73:0/3411320725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b0a81120 con 0x55d7b0cd5b20 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa379969640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd6440 0x55d7b0c96cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37a16a640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd5b20 0x55d7b0c90df0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa370019550 tx=0x7fa3700a5ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a85b84c97f70a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:34:59.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 1 -- 172.21.15.73:0/3411320725 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370109120 con 0x55d7b0cd5b20 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 1 -- 172.21.15.73:0/3411320725 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa3700add30 con 0x55d7b0cd5b20 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa364026070 con 0x55d7b0cd5b20 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 1 -- 172.21.15.73:0/3411320725 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa3700f5480 con 0x55d7b0cd5b20 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 10 client.4620 fetch_fsmap learned FSMap version 8 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d7b0a7a450 con 0x55d7b0cd5b20 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 1 -- 172.21.15.73:0/3411320725 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa364026070 con 0x55d7b0cd5b20 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 1 -- 172.21.15.73:0/3411320725 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fa3700ed740 con 0x55d7b0cd5b20 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 10 client.4620 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 10 client.4620 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 20 client.4620 populate_metadata read hostname 'smithi073' 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0ce4280 0x55d7b0ce6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 4 client.4620 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:34:59.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 --> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7b0a74c00 con 0x55d7b0ce4280 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa379969640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0ce4280 0x55d7b0ce6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa379969640 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0ce4280 0x55d7b0ce6670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f2dd01b74e6aa7 server_cookie=136ae84ed1c7e968 in_seq=0 out_seq=0 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 10 client.4620 ms_handle_connect on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 1 -- 172.21.15.73:0/3411320725 <== mds.0 v2:172.21.15.73:6835/2532110988 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7b0a74c00 con 0x55d7b0ce4280 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 10 client.4620 handle_command_reply: tid=0 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 client.4620 shutdown 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd5b20 msgr2=0x55d7b0c90df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd5b20 0x55d7b0c90df0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa370019550 tx=0x7fa3700a5ac0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 shutdown_connections 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0ce4280 0x55d7b0ce6670 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 0x55d7b0c97230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd6440 0x55d7b0c96cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa3557fa640 0 client.4620 ms_handle_reset on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:59.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 --2- 172.21.15.73:0/3411320725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd5b20 0x55d7b0c90df0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 >> 172.21.15.73:0/3411320725 conn(0x55d7b0c8c290 msgr2=0x55d7b0c8ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:59.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 shutdown_connections 2024-09-12T03:34:59.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 1 -- 172.21.15.73:0/3411320725 wait complete. 2024-09-12T03:34:59.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.336+0000 7fa37f48a000 20 client.4620 trim_cache size 0 max 16384 2024-09-12T03:34:59.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 Processor -- start 2024-09-12T03:34:59.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 -- start start 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 0x55d7b0cd4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0cd5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0ce6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa374201c00 con 0x55d7b0cd6440 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa37415f130 con 0x55d7b0cd5b20 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa3742015b0 con 0x55d7b0c91330 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0ce6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0ce6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37324/0 (socket says 172.21.15.73:37324) 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 -- 172.21.15.73:0/2370755596 learned_addr learned my addr 172.21.15.73:0/2370755596 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:59.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 -- 172.21.15.73:0/2370755596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 msgr2=0x55d7b0cd4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 --2- 172.21.15.73:0/2370755596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 0x55d7b0cd4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 -- 172.21.15.73:0/2370755596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 msgr2=0x55d7b0cd5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 --2- 172.21.15.73:0/2370755596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0cd5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 -- 172.21.15.73:0/2370755596 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7b0a61fd0 con 0x55d7b0cd6440 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37a96b640 1 --2- 172.21.15.73:0/2370755596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0ce6670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0014b0 tx=0x7fa36c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4eff074f5a5540 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa3577fe640 1 -- 172.21.15.73:0/2370755596 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c005cd0 con 0x55d7b0cd6440 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa3577fe640 1 -- 172.21.15.73:0/2370755596 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c0070d0 con 0x55d7b0cd6440 2024-09-12T03:34:59.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa3577fe640 1 -- 172.21.15.73:0/2370755596 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0074c0 con 0x55d7b0cd6440 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 -- 172.21.15.73:0/2370755596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 msgr2=0x55d7b0ce6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.356+0000 7fa37f48a000 1 --2- 172.21.15.73:0/2370755596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0ce6670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0014b0 tx=0x7fa36c001970 comp rx=0 tx=0).stop 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/2370755596 shutdown_connections 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/2370755596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0cd6440 0x55d7b0ce6670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/2370755596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0cd5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/2370755596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0c91330 0x55d7b0cd4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/2370755596 >> 172.21.15.73:0/2370755596 conn(0x55d7b0c8c290 msgr2=0x55d7b0c90840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/2370755596 shutdown_connections 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/2370755596 wait complete. 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- start start 2024-09-12T03:34:59.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 Processor -- start 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0c91330 0x55d7b0ce9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0d04960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0cd6440 0x55d7b0d04ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d7b0ad9f80 con 0x55d7b0c91330 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55d7b0a92ca0 con 0x55d7b0cd5b20 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55d7b0adf2a0 con 0x55d7b0cd6440 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 10 client.0 _ll_register_callbacks cb 0x7fa370009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0c91330 0x55d7b0ce9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0c91330 0x55d7b0ce9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37334/0 (socket says 172.21.15.73:37334) 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 -- 172.21.15.73:0/1491302974 learned_addr learned my addr 172.21.15.73:0/1491302974 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa379969640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0d04960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 -- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0cd6440 msgr2=0x55d7b0d04ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a96b640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0cd6440 0x55d7b0d04ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0cd6440 0x55d7b0d04ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 -- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 msgr2=0x55d7b0d04960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0d04960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 -- 172.21.15.73:0/1491302974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7b0b5d750 con 0x55d7b0c91330 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa379969640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0d04960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37a16a640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0c91330 0x55d7b0ce9aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3700a5530 tx=0x7fa370000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209f2dfae28d6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 1 -- 172.21.15.73:0/1491302974 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700f0c10 con 0x55d7b0c91330 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa36c0070d0 con 0x55d7b0c91330 2024-09-12T03:34:59.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 1 -- 172.21.15.73:0/1491302974 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa3700ef3d0 con 0x55d7b0c91330 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 1 -- 172.21.15.73:0/1491302974 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fa370114050 con 0x55d7b0c91330 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 10 client.4626 fetch_fsmap learned FSMap version 8 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d7b0a68a30 con 0x55d7b0c91330 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 1 -- 172.21.15.73:0/1491302974 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c0070d0 con 0x55d7b0c91330 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 1 -- 172.21.15.73:0/1491302974 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7fa370117020 con 0x55d7b0c91330 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 10 client.4626 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 20 client.4626 populate_metadata read hostname 'smithi073' 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0d053e0 0x55d7b0d49030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 4 client.4626 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 --> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] -- command(tid 0: {"prefix": "status"}) -- 0x55d7b0ae83a0 con 0x55d7b0d053e0 2024-09-12T03:34:59.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa379969640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0d053e0 0x55d7b0d49030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 10 client.4626 ms_handle_connect on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa379969640 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0d053e0 0x55d7b0d49030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc2ecec6195acb39 server_cookie=f934e0a89842fbf7 in_seq=0 out_seq=0 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 1 -- 172.21.15.73:0/1491302974 <== mds.0 v2:172.21.15.73:6835/2532110988 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55d7b0ae83a0 con 0x55d7b0d053e0 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 10 client.4626 handle_command_reply: tid=0 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 client.4626 shutdown 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0c91330 msgr2=0x55d7b0ce9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0c91330 0x55d7b0ce9aa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa3700a5530 tx=0x7fa370000f50 comp rx=0 tx=0).stop 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 shutdown_connections 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:6835/2532110988,v1:172.21.15.73:6837/2532110988] conn(0x55d7b0d053e0 0x55d7b0d49030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55d7b0cd6440 0x55d7b0d04ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d7b0cd5b20 0x55d7b0d04960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa3557fa640 0 client.4626 ms_handle_reset on v2:172.21.15.73:6835/2532110988 2024-09-12T03:34:59.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 --2- 172.21.15.73:0/1491302974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d7b0c91330 0x55d7b0ce9aa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 >> 172.21.15.73:0/1491302974 conn(0x55d7b0c8c290 msgr2=0x55d7b0cd3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 shutdown_connections 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 1 -- 172.21.15.73:0/1491302974 wait complete. 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.360+0000 7fa37f48a000 20 client.4626 trim_cache size 0 max 16384 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4248, 2024-09-12T03:34:59.373 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 20.329089206999999, 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 8, 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 25, 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 25, 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 26.182045588000001 2024-09-12T03:34:59.374 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3580678f0 msgr2=0x7fa358069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3580678f0 0x7fa358069db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa374143df0 tx=0x7fa364008040 comp rx=0 tx=0).stop 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3740af2a0 msgr2=0x7fa374152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3740af2a0 0x7fa374152630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3700b0040 tx=0x7fa3700196e0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 shutdown_connections 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa3580678f0 0x7fa358069db0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa37415c2a0 0x7fa374154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37415bec0 0x7fa37409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 --2- 172.21.15.73:0/693873153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3740af2a0 0x7fa374152630 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 >> 172.21.15.73:0/693873153 conn(0x7fa3740b1f90 msgr2=0x7fa3740b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:59.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 shutdown_connections 2024-09-12T03:34:59.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.364+0000 7fa37c3ce640 1 -- 172.21.15.73:0/693873153 wait complete. 2024-09-12T03:34:59.383 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T03:34:59.392 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T03:34:59.392 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T03:34:59.392 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T03:34:59.393 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-12T03:34:59.402 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-12T03:34:59.402 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-12T03:34:59.403 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-12T03:34:59.403 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T03:34:59.403 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:34:59.403 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-12T03:34:59.403 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T03:34:59.403 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T03:34:59.403 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-12T03:34:59.403 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T03:34:59.403 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:34:59.403 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-12T03:34:59.404 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T03:34:59.404 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T03:34:59.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:59.404 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:34:59.409 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T03:34:59.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:59.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T03:34:59.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:59.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-12T03:34:59.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:59.648 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:34:59.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:34:59.655 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-12T03:34:59.713 INFO:teuthology.orchestra.run.smithi150.stderr:Cannot find device "ceph-brx" 2024-09-12T03:34:59.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:34:59.715 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-12T03:34:59.715 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T03:34:59.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:34:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.840+0000 7fd4f83fd640 1 Processor -- start 2024-09-12T03:34:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.840+0000 7fd4f83fd640 1 -- start start 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f83fd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4f015e3e0 0x7fd4f015f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f83fd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4f0072dd0 0x7fd4f00aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f83fd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f00b04a0 con 0x7fd4f00b3300 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f83fd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f00b0770 con 0x7fd4f015e3e0 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f83fd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f00b0a50 con 0x7fd4f0072dd0 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f699a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd4f00b3300 0x7fd4f0161e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59878/0 (socket says 172.21.15.73:59878) 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f699a640 1 -- 172.21.15.73:0/2399019568 learned_addr learned my addr 172.21.15.73:0/2399019568 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:34:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729748577 0 0) 0x7fd4f00b04a0 con 0x7fd4f00b3300 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4dc003530 con 0x7fd4f00b3300 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5998640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4f0072dd0 0x7fd4f00aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2399019568 >> v2:172.21.15.150:3300/0 conn(0x7fd4f015e3e0 0x7fd4f015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1986270122 0 0) 0x7fd4dc003530 con 0x7fd4f00b3300 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4f0072dd0 msgr2=0x7fd4f00aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4f0072dd0 0x7fd4f00aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 >> v2:172.21.15.150:3300/0 conn(0x7fd4f015e3e0 msgr2=0x7fd4f015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 --2- 172.21.15.73:0/2399019568 >> v2:172.21.15.150:3300/0 conn(0x7fd4f015e3e0 0x7fd4f015f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f015eb10 con 0x7fd4f00b3300 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fd4e8001a00 con 0x7fd4f00b3300 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2399019568 >> v2:172.21.15.150:3300/0 conn(0x7fd4f015e3e0 0x7fd4f015f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 >> v1:172.21.15.73:6789/0 conn(0x7fd4f00b3300 legacy=0x7fd4f0161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4dc0039c0 0x7fd4dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4dc004810 0x7fd4dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4f0072dd0 0x7fd4dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f00b0770 con 0x7fd4dc0039c0 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f00b0a50 con 0x7fd4dc004810 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd4dc00bb30 con 0x7fd4f0072dd0 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4dc0039c0 0x7fd4dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 -- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4f0072dd0 msgr2=0x7fd4dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4f0072dd0 0x7fd4dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 -- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4dc004810 msgr2=0x7fd4dc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4dc004810 0x7fd4dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.844+0000 7fd4f6199640 1 -- 172.21.15.73:0/2399019568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4dc003530 con 0x7fd4dc0039c0 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4dc0039c0 0x7fd4dc003de0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40098a0 tx=0x7fd4e401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cb1ea66b68801b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400f040 con 0x7fd4dc0039c0 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e40a95f0 con 0x7fd4dc0039c0 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5197640 1 -- 172.21.15.73:0/2399019568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40a99a0 con 0x7fd4dc0039c0 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2399019568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4dc0039c0 msgr2=0x7fd4dc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 --2- 172.21.15.73:0/2399019568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4dc0039c0 0x7fd4dc003de0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40098a0 tx=0x7fd4e401c5f0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f699a640 1 -- 172.21.15.73:0/2399019568 reap_dead start 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2399019568 shutdown_connections 2024-09-12T03:34:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2399019568 >> 172.21.15.73:0/2399019568 conn(0x7fd4f00b6870 msgr2=0x7fd4f00b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:34:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2399019568 shutdown_connections 2024-09-12T03:34:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2399019568 wait complete. 2024-09-12T03:34:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 Processor -- start 2024-09-12T03:34:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- start start 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4dc0039c0 0x7fd4f0161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4f015d920 0x7fd4f014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f0163f80 0x7fd4f0164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f01626b0 con 0x7fd4f015d920 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0162530 con 0x7fd4f0163f80 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f0162830 con 0x7fd4dc0039c0 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4f015d920 0x7fd4f014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4f015d920 0x7fd4f014d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37360/0 (socket says 172.21.15.73:37360) 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 -- 172.21.15.73:0/2832897903 learned_addr learned my addr 172.21.15.73:0/2832897903 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4dc0039c0 0x7fd4f0161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f699a640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f0163f80 0x7fd4f0164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 -- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4dc0039c0 msgr2=0x7fd4f0161060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4dc0039c0 0x7fd4f0161060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 -- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f0163f80 msgr2=0x7fd4f0164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f0163f80 0x7fd4f0164430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 -- 172.21.15.73:0/2832897903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f00b2480 con 0x7fd4f015d920 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f699a640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f0163f80 0x7fd4f0164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f5998640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4f015d920 0x7fd4f014d7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00d800 tx=0x7fd4ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4e2ffd640 1 -- 172.21.15.73:0/2832897903 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00b6c0 con 0x7fd4f015d920 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4e2ffd640 1 -- 172.21.15.73:0/2832897903 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec019070 con 0x7fd4f015d920 2024-09-12T03:34:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f00b26f0 con 0x7fd4f015d920 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.848+0000 7fd4e2ffd640 1 -- 172.21.15.73:0/2832897903 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00bac0 con 0x7fd4f015d920 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.852+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f0161740 con 0x7fd4f015d920 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.852+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f00b2c10 con 0x7fd4f015d920 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.852+0000 7fd4e2ffd640 1 -- 172.21.15.73:0/2832897903 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd4ec00bc60 con 0x7fd4f015d920 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.852+0000 7fd4e2ffd640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd4d40678c0 0x7fd4d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.852+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd4d40678c0 0x7fd4d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.852+0000 7fd4e2ffd640 1 -- 172.21.15.73:0/2832897903 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd4ec086470 con 0x7fd4f015d920 2024-09-12T03:34:59.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.852+0000 7fd4f6199640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd4d40678c0 0x7fd4d4069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40ae000 tx=0x7fd4e40b4040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:34:59.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:34:59.856+0000 7fd4e2ffd640 1 -- 172.21.15.73:0/2832897903 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd4ec056c70 con 0x7fd4f015d920 2024-09-12T03:35:00.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.056+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd4f014e1f0 con 0x7fd4f015d920 2024-09-12T03:35:00.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.056+0000 7fd4e2ffd640 1 -- 172.21.15.73:0/2832897903 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fd4ec056570 con 0x7fd4f015d920 2024-09-12T03:35:00.061 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T03:35:00.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd4d40678c0 msgr2=0x7fd4d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:00.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd4d40678c0 0x7fd4d4069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40ae000 tx=0x7fd4e40b4040 comp rx=0 tx=0).stop 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4f015d920 msgr2=0x7fd4f014d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4f015d920 0x7fd4f014d7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00d800 tx=0x7fd4ec00dcc0 comp rx=0 tx=0).stop 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 shutdown_connections 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd4d40678c0 0x7fd4d4069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4f015d920 0x7fd4f014d7d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4f0163f80 0x7fd4f0164430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 --2- 172.21.15.73:0/2832897903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd4dc0039c0 0x7fd4f0161060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 >> 172.21.15.73:0/2832897903 conn(0x7fd4f00b6870 msgr2=0x7fd4f00b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 shutdown_connections 2024-09-12T03:35:00.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00.060+0000 7fd4f83fd640 1 -- 172.21.15.73:0/2832897903 wait complete. 2024-09-12T03:35:00.080 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:35:00.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:35:00.080 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:35:00.080 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T03:35:00.080 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:00.080 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:35:00.081 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:35:00.081 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:35:00.081 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:35:00.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:00.081 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:35:00.086 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:00.086 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:00.086 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:00.086 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:00.086 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:00.086 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-09-12T03:35:00.087 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:35:00.088 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:00.088 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:35:00.088 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:00.088 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:35:00.088 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:00.088 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T03:35:00.088 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:00.088 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:00.088 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-09-12T03:35:00.088 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-09-12T03:35:00.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-09-12T03:35:00.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T03:35:00.089 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:00.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:00.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:00.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:00.205 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:35:00.254 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:35:00.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:00.256 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:00.312 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:00.313 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:00.313 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:35:00.313 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:00.313 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:00.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:35:00.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:35:00.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:35:00.313 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:00.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:00.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:00.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:00.430 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:35:00.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:00.475 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-09-12T03:35:00.523 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:00.523 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:00.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:00.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T03:35:00.523 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:00.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:00.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:00.640 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T03:35:00.640 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:00.640 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:00.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T03:35:00.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T03:35:00.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T03:35:00.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T03:35:00.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T03:35:00.641 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:00.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:00.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:00.733 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:00.733 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:00.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:35:00.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T03:35:00.733 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:00.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:00.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:00.833 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T03:35:00.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:00.833 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:00.884 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:35:00.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:00.885 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:00.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:00.993 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:01.040 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:01.041 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:01.042 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:01.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:01.043 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:01.092 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:35:01.093 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T03:35:01.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:01.150 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:01.203 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:01.204 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:01.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:01.206 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:01.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-09-12T03:35:01.212+0000 7f541ef78580 -1 init, newargv = 0x563ecb621ce0 newargc=15 2024-09-12T03:35:01.216 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[36015]: starting ceph client 2024-09-12T03:35:01.222 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[36015]: starting fuse 2024-09-12T03:35:02.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:02.337 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:02.388 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:02.388 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:02.388 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:02.388 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:02.389 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:02.390 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:02.391 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:02.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:02.392 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:02.439 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:35:02.440 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:35:02.440 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:35:02.441 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:35:02.442 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:02.442 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-09-12T03:35:02.443 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:35:02.562 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.36015.asok 2024-09-12T03:35:02.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:02.574 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36015.asok 2024-09-12T03:35:02.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:02.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36015.asok status 2024-09-12T03:35:02.731 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:35:02.731 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:35:02.731 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:35:02.731 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:35:02.733 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-09-12T03:35:02.733 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:35:02.733 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T03:35:02.734 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "36015", 2024-09-12T03:35:02.734 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:35:02.734 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:02.734 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:35:02.734 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:35:02.735 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4638, 2024-09-12T03:35:02.735 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:35:02.735 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:35:02.735 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:35:02.735 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4638 2024-09-12T03:35:02.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:02.736 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:35:02.736 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:35:02.736 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:02.736 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2853943513 2024-09-12T03:35:02.736 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:02.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:02.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:35:02.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:35:02.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:02.737 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2853943513 2024-09-12T03:35:02.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:02.738 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4638 192.168.0.1:0/2853943513", 2024-09-12T03:35:02.738 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/2853943513", 2024-09-12T03:35:02.738 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:35:02.738 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 8, 2024-09-12T03:35:02.738 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 25, 2024-09-12T03:35:02.739 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:35:02.739 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:35:02.739 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:35:02.739 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:35:02.745 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T03:35:02.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:35:02.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.860+0000 7fc19e8dd640 1 Processor -- start 2024-09-12T03:35:02.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.860+0000 7fc19e8dd640 1 -- start start 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc19e8dd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc19806f010 0x7fc198166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc19e8dd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1980b3290 con 0x7fc19815c2a0 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc19e8dd640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1980b3570 con 0x7fc19815bec0 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc19e8dd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc1980b3850 con 0x7fc19806f010 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc1977fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc19815c2a0 0x7fc1980aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59890/0 (socket says 172.21.15.73:59890) 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc1977fe640 1 -- 172.21.15.73:0/387427102 learned_addr learned my addr 172.21.15.73:0/387427102 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998555951 0 0) 0x7fc1980b3290 con 0x7fc19815c2a0 2024-09-12T03:35:02.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc184003530 con 0x7fc19815c2a0 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc19ce7a640 1 --2- 172.21.15.73:0/387427102 >> v2:172.21.15.150:3300/0 conn(0x7fc19806f010 0x7fc198166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1059339853 0 0) 0x7fc184003530 con 0x7fc19815c2a0 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 >> v2:172.21.15.150:3300/0 conn(0x7fc19806f010 msgr2=0x7fc198166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 --2- 172.21.15.73:0/387427102 >> v2:172.21.15.150:3300/0 conn(0x7fc19806f010 0x7fc198166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 >> v1:172.21.15.150:6789/0 conn(0x7fc19815bec0 legacy=0x7fc1980ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1980b3b30 con 0x7fc19815c2a0 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fc180001680 con 0x7fc19815c2a0 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 >> v1:172.21.15.73:6789/0 conn(0x7fc19815c2a0 legacy=0x7fc1980aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1840039c0 0x7fc184003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc184004810 0x7fc184004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840051d0 0x7fc18400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980b3850 con 0x7fc1840039c0 2024-09-12T03:35:02.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc18400c070 con 0x7fc184004810 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc18400c270 con 0x7fc1840051d0 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc197fff640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1840039c0 0x7fc184003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc1977fe640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc184004810 0x7fc184004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc19ce7a640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840051d0 0x7fc18400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc197fff640 1 -- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840051d0 msgr2=0x7fc18400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc197fff640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840051d0 0x7fc18400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc197fff640 1 -- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc184004810 msgr2=0x7fc184004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc197fff640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc184004810 0x7fc184004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc19ce7a640 1 -- 172.21.15.73:0/387427102 reap_dead start 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc197fff640 1 -- 172.21.15.73:0/387427102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc184003530 con 0x7fc1840039c0 2024-09-12T03:35:02.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.864+0000 7fc1977fe640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc184004810 0x7fc184004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:02.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc197fff640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1840039c0 0x7fc184003de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc188001e70 tx=0x7fc18801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dc5cd9d53a3358 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:02.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc188001a90 con 0x7fc1840039c0 2024-09-12T03:35:02.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188003b80 con 0x7fc1840039c0 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc196ffd640 1 -- 172.21.15.73:0/387427102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880050d0 con 0x7fc1840039c0 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- 172.21.15.73:0/387427102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1840039c0 msgr2=0x7fc184003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1840039c0 0x7fc184003de0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc188001e70 tx=0x7fc18801c730 comp rx=0 tx=0).stop 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- 172.21.15.73:0/387427102 shutdown_connections 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/387427102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1840039c0 0x7fc184003de0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- 172.21.15.73:0/387427102 >> 172.21.15.73:0/387427102 conn(0x7fc1980b1f90 msgr2=0x7fc1980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- 172.21.15.73:0/387427102 shutdown_connections 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- 172.21.15.73:0/387427102 wait complete. 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 Processor -- start 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- start start 2024-09-12T03:35:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840039c0 0x7fc19814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1981f5db0 0x7fc19815f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc19815d730 0x7fc19814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980ad610 con 0x7fc1981f5db0 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc1980afc90 con 0x7fc19815d730 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19e8dd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc1980ad790 con 0x7fc1840039c0 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1981f5db0 0x7fc19815f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1981f5db0 0x7fc19815f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37390/0 (socket says 172.21.15.73:37390) 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 -- 172.21.15.73:0/3554780143 learned_addr learned my addr 172.21.15.73:0/3554780143 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc197fff640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840039c0 0x7fc19814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc19ce7a640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc19815d730 0x7fc19814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 -- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840039c0 msgr2=0x7fc19814a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840039c0 0x7fc19814a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:02.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 -- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc19815d730 msgr2=0x7fc19814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc19815d730 0x7fc19814b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.868+0000 7fc1977fe640 1 -- 172.21.15.73:0/3554780143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19815dc60 con 0x7fc1981f5db0 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc1977fe640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1981f5db0 0x7fc19815f2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc18000d800 tx=0x7fc18000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc194ff9640 1 -- 172.21.15.73:0/3554780143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc180019070 con 0x7fc1981f5db0 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc194ff9640 1 -- 172.21.15.73:0/3554780143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1800074e0 con 0x7fc1981f5db0 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19815df40 con 0x7fc1981f5db0 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc194ff9640 1 -- 172.21.15.73:0/3554780143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc180004a30 con 0x7fc1981f5db0 2024-09-12T03:35:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19815e500 con 0x7fc1981f5db0 2024-09-12T03:35:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1980af4a0 con 0x7fc1981f5db0 2024-09-12T03:35:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc194ff9640 1 -- 172.21.15.73:0/3554780143 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc18001c070 con 0x7fc1981f5db0 2024-09-12T03:35:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc194ff9640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc1780678c0 0x7fc178069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc197fff640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc1780678c0 0x7fc178069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc194ff9640 1 -- 172.21.15.73:0/3554780143 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1800858b0 con 0x7fc1981f5db0 2024-09-12T03:35:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.872+0000 7fc197fff640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc1780678c0 0x7fc178069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ad000 tx=0x7fc1880b2040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:02.876+0000 7fc194ff9640 1 -- 172.21.15.73:0/3554780143 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc180055a60 con 0x7fc1981f5db0 2024-09-12T03:35:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc198151d80 con 0x7fc1981f5db0 2024-09-12T03:35:03.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc194ff9640 1 -- 172.21.15.73:0/3554780143 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc180059d60 con 0x7fc1981f5db0 2024-09-12T03:35:03.083 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc1780678c0 msgr2=0x7fc178069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc1780678c0 0x7fc178069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ad000 tx=0x7fc1880b2040 comp rx=0 tx=0).stop 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1981f5db0 msgr2=0x7fc19815f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1981f5db0 0x7fc19815f2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc18000d800 tx=0x7fc18000dc00 comp rx=0 tx=0).stop 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 shutdown_connections 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc1780678c0 0x7fc178069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1981f5db0 0x7fc19815f2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc19815d730 0x7fc19814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:03.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 --2- 172.21.15.73:0/3554780143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc1840039c0 0x7fc19814a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 >> 172.21.15.73:0/3554780143 conn(0x7fc1980b1f90 msgr2=0x7fc1981603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 shutdown_connections 2024-09-12T03:35:03.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03.080+0000 7fc19e8dd640 1 -- 172.21.15.73:0/3554780143 wait complete. 2024-09-12T03:35:03.103 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:35:03.103 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:35:03.103 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:35:03.103 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-12T03:35:03.104 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:03.104 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:35:03.104 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:35:03.104 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:35:03.104 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-12T03:35:03.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.104 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:03.110 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42465sec preferred_lft 42465sec 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:35:03.111 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.112 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:35:03.113 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:03.113 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:35:03.113 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.113 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:35:03.165 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:35:03.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.167 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:35:03.220 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:35:03.220 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:35:03.220 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:35:03.220 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:35:03.221 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:35:03.221 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:35:03.221 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:35:03.221 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:03.221 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:03.221 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:03.221 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:35:03.221 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:03.222 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:03.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:35:03.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:35:03.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:35:03.222 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:03.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:03.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:03.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.346 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:35:03.351 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:35:03.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.352 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-09-12T03:35:03.399 INFO:teuthology.orchestra.run.smithi073.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-12T03:35:03.400 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:03.400 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:03.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:03.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-12T03:35:03.400 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:03.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:03.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 6e:e9:90:9a:af:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T03:35:03.526 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T03:35:03.527 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.527 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::6ce9:90ff:fe9a:af47/64 scope link 2024-09-12T03:35:03.527 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 6e:e9:90:9a:af:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T03:35:03.582 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T03:35:03.583 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.583 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::6ce9:90ff:fe9a:af47/64 scope link 2024-09-12T03:35:03.583 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:03.584 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-12T03:35:03.584 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:03.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:03.725 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:03.725 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:03.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.1 up 2024-09-12T03:35:03.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T03:35:03.725 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:03.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:03.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:03.783 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-12T03:35:03.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:03.784 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:03.830 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-12T03:35:03.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:03.831 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:03.879 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:03.936 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:03.989 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:03.990 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:03.991 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:03.992 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:03.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:03.993 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:04.039 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:35:04.039 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-12T03:35:04.039 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-12T03:35:04.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:04.098 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:04.147 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:04.148 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:04.149 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:04.150 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:04.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:04.151 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:04.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi073.stderr:2024-09-12T03:35:04.160+0000 7f6e20a78580 -1 init, newargv = 0x5640b4736110 newargc=15 2024-09-12T03:35:04.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi073.stderr:ceph-fuse[36160]: starting ceph client 2024-09-12T03:35:04.170 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:35:04.170 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi073.stderr:ceph-fuse[36160]: starting fuse 2024-09-12T03:35:05.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:05.289 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:05.336 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:05.336 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:05.336 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:05.337 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:05.338 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:05.339 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:05.339 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:05.339 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:05.339 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:05.339 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:05.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:05.340 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:05.391 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:35:05.391 INFO:teuthology.orchestra.run.smithi073.stdout:46 2024-09-12T03:35:05.392 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:35:05.392 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:35:05.393 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:35:05.394 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:05.394 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.2")) 2024-09-12T03:35:05.394 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:35:05.516 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.2.36160.asok 2024-09-12T03:35:05.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:05.529 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.36160.asok 2024-09-12T03:35:05.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:05.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.36160.asok status 2024-09-12T03:35:05.677 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:35:05.677 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:35:05.677 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:35:05.677 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "2", 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "36160", 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4653, 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4653 2024-09-12T03:35:05.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.2:0", 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3453571939 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.2:0", 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3453571939 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4653 192.168.0.2:0/3453571939", 2024-09-12T03:35:05.679 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.2:0/3453571939", 2024-09-12T03:35:05.680 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:35:05.680 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 8, 2024-09-12T03:35:05.680 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 25, 2024-09-12T03:35:05.680 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:35:05.680 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:35:05.680 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:35:05.680 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:35:05.691 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T03:35:05.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:35:05.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.804+0000 7f92fc192640 1 Processor -- start 2024-09-12T03:35:05.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.804+0000 7f92fc192640 1 -- start start 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92f41567e0 0x7f92f40b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f4160460 0x7f92f415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f40b4620 con 0x7f92f40b3c40 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f92f40b4900 con 0x7f92f41567e0 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f92f40b4be0 con 0x7f92f4160460 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92f41567e0 0x7f92f40b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92f41567e0 0x7f92f40b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44716/0 (socket says 172.21.15.73:44716) 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f972d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f92f40b3c40 0x7f92f415fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42234/0 (socket says 172.21.15.73:42234) 2024-09-12T03:35:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 -- 172.21.15.73:0/554123022 learned_addr learned my addr 172.21.15.73:0/554123022 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 -- 172.21.15.73:0/554123022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f4160460 msgr2=0x7f92f415d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 --2- 172.21.15.73:0/554123022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f4160460 0x7f92f415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 -- 172.21.15.73:0/554123022 >> v1:172.21.15.73:6789/0 conn(0x7f92f40b3c40 legacy=0x7f92f415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f8f2c640 1 -- 172.21.15.73:0/554123022 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683070812 0 0) 0x7f92f40b4620 con 0x7f92f40b3c40 2024-09-12T03:35:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 -- 172.21.15.73:0/554123022 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f40b4ec0 con 0x7f92f41567e0 2024-09-12T03:35:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f9f2e640 1 --2- 172.21.15.73:0/554123022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f40b56c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e80 tx=0x7f92ec01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1a7e36e2405a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:05.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f8f2c640 1 -- 172.21.15.73:0/554123022 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0a5830 con 0x7f92f41567e0 2024-09-12T03:35:05.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f8f2c640 1 -- 172.21.15.73:0/554123022 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ec0a59d0 con 0x7f92f41567e0 2024-09-12T03:35:05.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92f8f2c640 1 -- 172.21.15.73:0/554123022 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0a5da0 con 0x7f92f41567e0 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 -- 172.21.15.73:0/554123022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 msgr2=0x7f92f40b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 --2- 172.21.15.73:0/554123022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f40b56c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e80 tx=0x7f92ec01c950 comp rx=0 tx=0).stop 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 -- 172.21.15.73:0/554123022 shutdown_connections 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 --2- 172.21.15.73:0/554123022 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f4160460 0x7f92f415d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.808+0000 7f92fc192640 1 --2- 172.21.15.73:0/554123022 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f40b56c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- 172.21.15.73:0/554123022 >> 172.21.15.73:0/554123022 conn(0x7f92f4073580 msgr2=0x7f92f406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- 172.21.15.73:0/554123022 shutdown_connections 2024-09-12T03:35:05.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- 172.21.15.73:0/554123022 wait complete. 2024-09-12T03:35:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 Processor -- start 2024-09-12T03:35:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- start start 2024-09-12T03:35:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40b3c40 0x7f92f413f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f4160460 0x7f92f40b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4160b50 con 0x7f92f41567e0 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41609d0 con 0x7f92f4160460 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f92f415e270 con 0x7f92f40b3c40 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f406efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44724/0 (socket says 172.21.15.73:44724) 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 -- 172.21.15.73:0/340765597 learned_addr learned my addr 172.21.15.73:0/340765597 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 -- 172.21.15.73:0/340765597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40b3c40 msgr2=0x7f92f413f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40b3c40 0x7f92f413f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 -- 172.21.15.73:0/340765597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f4160460 msgr2=0x7f92f40b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f4160460 0x7f92f40b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 -- 172.21.15.73:0/340765597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f406f910 con 0x7f92f41567e0 2024-09-12T03:35:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92f972d640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f406efa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f92e40011f0 tx=0x7f92e400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92ea7fc640 1 -- 172.21.15.73:0/340765597 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4018070 con 0x7f92f41567e0 2024-09-12T03:35:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92ea7fc640 1 -- 172.21.15.73:0/340765597 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e40074e0 con 0x7f92f41567e0 2024-09-12T03:35:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f406fbf0 con 0x7f92f41567e0 2024-09-12T03:35:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92ea7fc640 1 -- 172.21.15.73:0/340765597 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4004a10 con 0x7f92f41567e0 2024-09-12T03:35:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f40701b0 con 0x7f92f41567e0 2024-09-12T03:35:05.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.812+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f40b56c0 con 0x7f92f41567e0 2024-09-12T03:35:05.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.816+0000 7f92ea7fc640 1 -- 172.21.15.73:0/340765597 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f92e401b070 con 0x7f92f41567e0 2024-09-12T03:35:05.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.816+0000 7f92ea7fc640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92d80678c0 0x7f92d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:05.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.816+0000 7f92ea7fc640 1 -- 172.21.15.73:0/340765597 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f92e4085360 con 0x7f92f41567e0 2024-09-12T03:35:05.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.816+0000 7f92f9f2e640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92d80678c0 0x7f92d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:05.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.816+0000 7f92f9f2e640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92d80678c0 0x7f92d8069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0ae000 tx=0x7f92ec004ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:05.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:05.820+0000 7f92ea7fc640 1 -- 172.21.15.73:0/340765597 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f92e4055b60 con 0x7f92f41567e0 2024-09-12T03:35:06.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.020+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f92f4070e20 con 0x7f92f41567e0 2024-09-12T03:35:06.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.020+0000 7f92ea7fc640 1 -- 172.21.15.73:0/340765597 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f92e4055460 con 0x7f92f41567e0 2024-09-12T03:35:06.026 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T03:35:06.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92d80678c0 msgr2=0x7f92d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:06.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92d80678c0 0x7f92d8069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0ae000 tx=0x7f92ec004ac0 comp rx=0 tx=0).stop 2024-09-12T03:35:06.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 msgr2=0x7f92f406efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:06.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f406efa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f92e40011f0 tx=0x7f92e400c9b0 comp rx=0 tx=0).stop 2024-09-12T03:35:06.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 shutdown_connections 2024-09-12T03:35:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92d80678c0 0x7f92d8069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92f41567e0 0x7f92f406efa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92f4160460 0x7f92f40b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 --2- 172.21.15.73:0/340765597 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92f40b3c40 0x7f92f413f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 >> 172.21.15.73:0/340765597 conn(0x7f92f4073580 msgr2=0x7f92f415ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 shutdown_connections 2024-09-12T03:35:06.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:06.024+0000 7f92fc192640 1 -- 172.21.15.73:0/340765597 wait complete. 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:35:06.044 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:35:06.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:06.045 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:06.052 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42474sec preferred_lft 42474sec 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:06.053 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:35:06.054 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:06.054 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T03:35:06.054 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:06.054 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:06.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2024-09-12T03:35:06.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2024-09-12T03:35:06.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2024-09-12T03:35:06.054 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T03:35:06.054 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:06.143 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:06.176 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:06.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:06.183 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:35:06.192 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:35:06.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:06.194 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:06.266 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:06.267 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:35:06.267 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:06.267 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:06.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:35:06.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:35:06.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:35:06.267 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:06.357 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:06.385 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:06.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:06.392 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:35:06.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:06.398 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-09-12T03:35:06.445 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:06.446 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:06.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:06.446 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T03:35:06.446 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:06.534 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:06.557 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:06.564 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T03:35:06.564 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:06.564 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:06.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T03:35:06.564 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T03:35:06.565 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T03:35:06.565 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T03:35:06.565 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T03:35:06.565 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:06.606 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:06.660 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:06.667 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:06.667 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:06.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:35:06.667 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T03:35:06.667 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:06.746 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:06.764 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:06.770 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:35:06.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:06.770 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:06.817 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:35:06.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:06.817 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:06.865 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:06.921 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:06.970 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:06.970 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:06.970 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:06.970 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:06.971 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:06.972 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:06.973 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:06.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:06.974 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:07.022 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:35:07.022 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T03:35:07.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:07.084 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:07.131 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:07.132 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:07.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:07.133 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:07.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:35:07.145+0000 7f95b2262580 -1 init, newargv = 0x55d9930e91c0 newargc=15 2024-09-12T03:35:07.151 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34473]: starting ceph client 2024-09-12T03:35:07.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34473]: starting fuse 2024-09-12T03:35:07.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:35:07.352 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:35:08.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:08.272 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:08.324 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:08.324 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:08.324 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:08.324 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:08.325 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:08.326 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:08.327 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:08.327 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:08.327 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:08.327 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:08.327 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:08.327 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:08.327 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:08.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:08.328 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:08.375 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:35:08.375 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:35:08.375 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:35:08.375 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:35:08.375 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:35:08.376 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:35:08.377 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:08.378 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:35:08.378 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:35:08.499 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.34473.asok 2024-09-12T03:35:08.502 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:08.510 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34473.asok 2024-09-12T03:35:08.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:08.511 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34473.asok status 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "34473", 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:35:08.659 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4385, 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4385 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2202450119 2024-09-12T03:35:08.660 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2202450119 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4385 192.168.0.1:0/2202450119", 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/2202450119", 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 8, 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 25, 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:35:08.661 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:35:08.662 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:35:08.662 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:35:08.673 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-12T03:35:08.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:35:08.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f8901fcc640 1 Processor -- start 2024-09-12T03:35:08.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f8901fcc640 1 -- start start 2024-09-12T03:35:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f8901fcc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 0x7f88fc0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f8901fcc640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f88fc0b4340 0x7f88fc0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f8901fcc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88fc0d27a0 con 0x7f88fc1457a0 2024-09-12T03:35:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f8901fcc640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f88fc0b47b0 con 0x7f88fc0b4340 2024-09-12T03:35:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f8901fcc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc0d2a80 con 0x7f88fc0cf800 2024-09-12T03:35:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88fb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f88fc1457a0 0x7f88fc0d1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42246/0 (socket says 172.21.15.73:42246) 2024-09-12T03:35:08.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88fb7fe640 1 -- 172.21.15.73:0/1844406614 learned_addr learned my addr 172.21.15.73:0/1844406614 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377783523 0 0) 0x7f88fc0d27a0 con 0x7f88fc1457a0 2024-09-12T03:35:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88fbfff640 1 --2- 172.21.15.73:0/1844406614 >> v2:172.21.15.150:3300/0 conn(0x7f88fc0b4340 0x7f88fc0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88e8003530 con 0x7f88fc1457a0 2024-09-12T03:35:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 0x7f88fc0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2080959198 0 0) 0x7f88e8003530 con 0x7f88fc1457a0 2024-09-12T03:35:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 msgr2=0x7f88fc0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:08.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 0x7f88fc0b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 >> v2:172.21.15.150:3300/0 conn(0x7f88fc0b4340 msgr2=0x7f88fc0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 --2- 172.21.15.73:0/1844406614 >> v2:172.21.15.150:3300/0 conn(0x7f88fc0b4340 0x7f88fc0d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc0d2d60 con 0x7f88fc1457a0 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f88ec001680 con 0x7f88fc1457a0 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 0x7f88fc0b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 >> v1:172.21.15.73:6789/0 conn(0x7f88fc1457a0 legacy=0x7f88fc0d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e80039c0 0x7f88e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8004810 0x7f88e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 0x7f88e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0b47b0 con 0x7f88e8004810 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0d2a80 con 0x7f88e80039c0 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f88e800bab0 con 0x7f88fc0cf800 2024-09-12T03:35:08.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8004810 0x7f88e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88fb7fe640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e80039c0 0x7f88e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88fbfff640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 0x7f88e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 -- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 msgr2=0x7f88e80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:08.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88fc0cf800 0x7f88e80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:08.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 -- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e80039c0 msgr2=0x7f88e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:08.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88e80039c0 0x7f88e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:08.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.804+0000 7f88f3fff640 1 -- 172.21.15.73:0/1844406614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e8003530 con 0x7f88e8004810 2024-09-12T03:35:08.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f88f3fff640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8004810 0x7f88e8004c90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88e40098a0 tx=0x7f88e401c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e48f5ab56ce8943 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e40b1070 con 0x7f88e8004810 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e40ac600 con 0x7f88e8004810 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f88faffd640 1 -- 172.21.15.73:0/1844406614 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e400f040 con 0x7f88e8004810 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- 172.21.15.73:0/1844406614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8004810 msgr2=0x7f88e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 --2- 172.21.15.73:0/1844406614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88e8004810 0x7f88e8004c90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88e40098a0 tx=0x7f88e401c570 comp rx=0 tx=0).stop 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f88fbfff640 1 -- 172.21.15.73:0/1844406614 reap_dead start 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- 172.21.15.73:0/1844406614 shutdown_connections 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- 172.21.15.73:0/1844406614 >> 172.21.15.73:0/1844406614 conn(0x7f88fc06bcc0 msgr2=0x7f88fc06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- 172.21.15.73:0/1844406614 shutdown_connections 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- 172.21.15.73:0/1844406614 wait complete. 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 Processor -- start 2024-09-12T03:35:08.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- start start 2024-09-12T03:35:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88e8004810 0x7f88fc1f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc0c73f0 0x7f88fc1fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88fc0cc2d0 0x7f88fc1fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0d1670 con 0x7f88fc0c73f0 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc0b8260 con 0x7f88fc0cc2d0 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f8901fcc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc1670a0 con 0x7f88e8004810 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.808+0000 7f88f3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc0c73f0 0x7f88fc1fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc0c73f0 0x7f88fc1fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44736/0 (socket says 172.21.15.73:44736) 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 -- 172.21.15.73:0/2832336894 learned_addr learned my addr 172.21.15.73:0/2832336894 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88fbfff640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88fc0cc2d0 0x7f88fc1fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88fb7fe640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88e8004810 0x7f88fc1f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 -- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88e8004810 msgr2=0x7f88fc1f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88e8004810 0x7f88fc1f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:08.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 -- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88fc0cc2d0 msgr2=0x7f88fc1fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88fc0cc2d0 0x7f88fc1fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 -- 172.21.15.73:0/2832336894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc1f8930 con 0x7f88fc0c73f0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f3fff640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc0c73f0 0x7f88fc1fad80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af040 tx=0x7f88e8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f8ff9640 1 -- 172.21.15.73:0/2832336894 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e40b1040 con 0x7f88fc0c73f0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f8ff9640 1 -- 172.21.15.73:0/2832336894 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e400f000 con 0x7f88fc0c73f0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc1f8c10 con 0x7f88fc0c73f0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f8ff9640 1 -- 172.21.15.73:0/2832336894 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4004020 con 0x7f88fc0c73f0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1f94b0 con 0x7f88fc0c73f0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88fc1f8de0 con 0x7f88fc0c73f0 2024-09-12T03:35:08.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f8ff9640 1 -- 172.21.15.73:0/2832336894 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88e40c0020 con 0x7f88fc0c73f0 2024-09-12T03:35:08.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f8ff9640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88dc0678c0 0x7f88dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:08.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88f8ff9640 1 -- 172.21.15.73:0/2832336894 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88e411fc90 con 0x7f88fc0c73f0 2024-09-12T03:35:08.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88fb7fe640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88dc0678c0 0x7f88dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:08.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.812+0000 7f88fb7fe640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88dc0678c0 0x7f88dc069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88ec001060 tx=0x7f88ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:08.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:08.816+0000 7f88f8ff9640 1 -- 172.21.15.73:0/2832336894 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f88e4016280 con 0x7f88fc0c73f0 2024-09-12T03:35:09.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.016+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f88fc0d0710 con 0x7f88fc0c73f0 2024-09-12T03:35:09.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.016+0000 7f88f8ff9640 1 -- 172.21.15.73:0/2832336894 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f88e40f0490 con 0x7f88fc0c73f0 2024-09-12T03:35:09.021 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T03:35:09.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88dc0678c0 msgr2=0x7f88dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:09.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88dc0678c0 0x7f88dc069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88ec001060 tx=0x7f88ec009040 comp rx=0 tx=0).stop 2024-09-12T03:35:09.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc0c73f0 msgr2=0x7f88fc1fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:09.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc0c73f0 0x7f88fc1fad80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88e40af040 tx=0x7f88e8005840 comp rx=0 tx=0).stop 2024-09-12T03:35:09.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 shutdown_connections 2024-09-12T03:35:09.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88dc0678c0 0x7f88dc069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:09.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88fc0c73f0 0x7f88fc1fad80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:09.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88fc0cc2d0 0x7f88fc1fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:09.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 --2- 172.21.15.73:0/2832336894 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f88e8004810 0x7f88fc1f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:09.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 >> 172.21.15.73:0/2832336894 conn(0x7f88fc06bcc0 msgr2=0x7f88fc165090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:09.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 shutdown_connections 2024-09-12T03:35:09.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:09.020+0000 7f8901fcc640 1 -- 172.21.15.73:0/2832336894 wait complete. 2024-09-12T03:35:09.040 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:35:09.040 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:35:09.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:35:09.040 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-12T03:35:09.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:09.041 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:35:09.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:35:09.041 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:35:09.041 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-12T03:35:09.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.041 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:35:09.048 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:09.048 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:09.048 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:09.048 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.048 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:09.049 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42471sec preferred_lft 42471sec 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:35:09.050 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.051 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:35:09.051 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:09.051 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:35:09.051 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.051 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:35:09.106 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:35:09.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.108 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:09.159 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:09.160 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:09.160 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:35:09.160 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:09.160 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:09.160 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:35:09.160 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:35:09.160 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:35:09.161 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:09.247 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:09.275 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:09.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.285 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:35:09.290 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:35:09.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.291 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2024-09-12T03:35:09.338 INFO:teuthology.orchestra.run.smithi150.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-12T03:35:09.338 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:09.338 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:09.338 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:09.338 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-12T03:35:09.338 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:09.431 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:09.451 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:09.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T03:35:09.471 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 12:e2:20:c6:6f:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::10e2:20ff:fec6:6f91/64 scope link 2024-09-12T03:35:09.472 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.474 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T03:35:09.530 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:09.530 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:09.530 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:09.530 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.530 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:09.531 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.531 INFO:teuthology.orchestra.run.smithi150.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:09.531 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 12:e2:20:c6:6f:91 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T03:35:09.531 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T03:35:09.531 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.531 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::10e2:20ff:fec6:6f91/64 scope link 2024-09-12T03:35:09.531 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:09.532 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-12T03:35:09.532 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:09.532 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:09.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-12T03:35:09.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T03:35:09.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-12T03:35:09.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-12T03:35:09.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-12T03:35:09.533 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:09.618 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:09.664 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:09.670 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:09.670 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:09.670 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.1 up 2024-09-12T03:35:09.670 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T03:35:09.671 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:09.709 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:09.723 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:09.729 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-12T03:35:09.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:09.730 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:09.777 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-12T03:35:09.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:09.777 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:09.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:09.881 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:09.932 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:09.932 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:09.933 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:09.933 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:09.933 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:09.933 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:09.933 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:09.933 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:09.933 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:09.934 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:09.934 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:09.934 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:09.934 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:09.934 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:09.934 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:09.935 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:09.935 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:09.935 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:09.935 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:09.935 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:09.935 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:09.936 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:09.937 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:09.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:09.938 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:09.985 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:35:09.986 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-12T03:35:09.986 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-12T03:35:10.030 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:10.044 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:10.090 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:10.091 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:10.092 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:10.093 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:10.093 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:10.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:10.094 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:10.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:2024-09-12T03:35:10.105+0000 7f8ca9773580 -1 init, newargv = 0x5570876b2f30 newargc=15 2024-09-12T03:35:10.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[34594]: starting ceph client 2024-09-12T03:35:10.115 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:35:10.117 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi150.stderr:ceph-fuse[34594]: starting fuse 2024-09-12T03:35:11.217 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:11.234 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:11.282 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:11.283 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:11.284 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:11.285 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:11.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.286 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:11.334 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:35:11.335 INFO:teuthology.orchestra.run.smithi150.stdout:46 2024-09-12T03:35:11.335 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-12T03:35:11.335 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:35:11.335 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:35:11.336 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:35:11.336 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:35:11.336 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:35:11.336 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:11.336 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:35:11.336 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-12T03:35:11.337 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:35:11.337 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-12T03:35:11.337 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:11.337 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:35:11.337 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:35:11.338 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:35:11.338 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:35:11.338 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:11.338 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:35:11.338 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:35:11.338 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:35:11.339 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:35:11.339 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:35:11.339 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:35:11.339 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:35:11.339 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:35:11.339 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:11.340 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.3")) 2024-09-12T03:35:11.340 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:35:11.458 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.3.34594.asok 2024-09-12T03:35:11.462 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:11.471 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.34594.asok 2024-09-12T03:35:11.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.34594.asok status 2024-09-12T03:35:11.626 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:35:11.627 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:35:11.627 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:35:11.627 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:35:11.627 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "3", 2024-09-12T03:35:11.627 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:35:11.628 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-12T03:35:11.628 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "34594", 2024-09-12T03:35:11.628 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:35:11.628 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:11.628 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:35:11.628 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:35:11.629 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4540, 2024-09-12T03:35:11.629 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:35:11.629 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:35:11.629 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:35:11.629 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4540 2024-09-12T03:35:11.630 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:11.630 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:35:11.630 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:35:11.630 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2024-09-12T03:35:11.630 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3192078953 2024-09-12T03:35:11.630 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:35:11.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:11.631 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:35:11.631 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:35:11.631 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.2:0", 2024-09-12T03:35:11.631 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3192078953 2024-09-12T03:35:11.631 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:11.632 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4540 192.168.0.2:0/3192078953", 2024-09-12T03:35:11.632 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.2:0/3192078953", 2024-09-12T03:35:11.632 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:35:11.632 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 8, 2024-09-12T03:35:11.632 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 25, 2024-09-12T03:35:11.633 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:35:11.633 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:35:11.633 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:35:11.633 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:35:11.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.640 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:35:11.640 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:11.647 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:35:11.648 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:11.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:11.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.709 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:35:11.709 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:11.761 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:35:11.761 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:11.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.762 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:11.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.816 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:35:11.816 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:11.823 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:35:11.824 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:11.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.824 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:11.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.879 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:35:11.879 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:11.930 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:35:11.931 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:11.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:11.931 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:11.986 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-12T03:35:12.028 INFO:tasks.cephfs_test_runner:Starting test: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test: 2024-09-12T03:35:12.028 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2024-09-12T03:35:12.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:12.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.156+0000 7f58e3917640 1 Processor -- start 2024-09-12T03:35:12.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e3917640 1 -- start start 2024-09-12T03:35:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e3917640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f58dc1520a0 0x7f58dc06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e3917640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58dc06fe50 0x7f58dc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e3917640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58dc070250 con 0x7f58dc15f1d0 2024-09-12T03:35:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e3917640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f58dc152480 con 0x7f58dc06fe50 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e3917640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f58dc0aede0 con 0x7f58dc1520a0 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58dc06fe50 0x7f58dc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58dc06fe50 0x7f58dc15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44744/0 (socket says 172.21.15.73:44744) 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 -- 172.21.15.73:0/2485384008 learned_addr learned my addr 172.21.15.73:0/2485384008 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e16b3640 1 --2- 172.21.15.73:0/2485384008 >> v2:172.21.15.150:3300/0 conn(0x7f58dc1520a0 0x7f58dc06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 -- 172.21.15.73:0/2485384008 >> v2:172.21.15.150:3300/0 conn(0x7f58dc1520a0 msgr2=0x7f58dc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 --2- 172.21.15.73:0/2485384008 >> v2:172.21.15.150:3300/0 conn(0x7f58dc1520a0 0x7f58dc06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 -- 172.21.15.73:0/2485384008 >> v1:172.21.15.150:6789/0 conn(0x7f58dc15f1d0 legacy=0x7f58dc071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 -- 172.21.15.73:0/2485384008 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58dc15fa10 con 0x7f58dc06fe50 2024-09-12T03:35:12.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e16b3640 1 --2- 172.21.15.73:0/2485384008 >> v2:172.21.15.150:3300/0 conn(0x7f58dc1520a0 0x7f58dc06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58e0eb2640 1 --2- 172.21.15.73:0/2485384008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc06fe50 0x7f58dc15ec90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f58dc071710 tx=0x7f58d801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438ea0d9038ad59f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58d3fff640 1 -- 172.21.15.73:0/2485384008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80b1070 con 0x7f58dc06fe50 2024-09-12T03:35:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58d3fff640 1 -- 172.21.15.73:0/2485384008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d80a8050 con 0x7f58dc06fe50 2024-09-12T03:35:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.160+0000 7f58d3fff640 1 -- 172.21.15.73:0/2485384008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80ac860 con 0x7f58dc06fe50 2024-09-12T03:35:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- 172.21.15.73:0/2485384008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc06fe50 msgr2=0x7f58dc15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 --2- 172.21.15.73:0/2485384008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc06fe50 0x7f58dc15ec90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f58dc071710 tx=0x7f58d801c4c0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- 172.21.15.73:0/2485384008 shutdown_connections 2024-09-12T03:35:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 --2- 172.21.15.73:0/2485384008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc06fe50 0x7f58dc15ec90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 --2- 172.21.15.73:0/2485384008 >> v2:172.21.15.150:3300/0 conn(0x7f58dc1520a0 0x7f58dc06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- 172.21.15.73:0/2485384008 >> 172.21.15.73:0/2485384008 conn(0x7f58dc0b1f90 msgr2=0x7f58dc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- 172.21.15.73:0/2485384008 shutdown_connections 2024-09-12T03:35:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- 172.21.15.73:0/2485384008 wait complete. 2024-09-12T03:35:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 Processor -- start 2024-09-12T03:35:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- start start 2024-09-12T03:35:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58dc06fe50 0x7f58dc146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58dc1520a0 0x7f58dc159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc15f1d0 0x7f58dc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc073d30 con 0x7f58dc15f1d0 2024-09-12T03:35:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc073a50 con 0x7f58dc06fe50 2024-09-12T03:35:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f58dc15f660 con 0x7f58dc1520a0 2024-09-12T03:35:12.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc15f1d0 0x7f58dc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc15f1d0 0x7f58dc15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44756/0 (socket says 172.21.15.73:44756) 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 -- 172.21.15.73:0/2126234457 learned_addr learned my addr 172.21.15.73:0/2126234457 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e16b3640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58dc06fe50 0x7f58dc146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e0eb2640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58dc1520a0 0x7f58dc159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 -- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58dc1520a0 msgr2=0x7f58dc159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58dc1520a0 0x7f58dc159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 -- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58dc06fe50 msgr2=0x7f58dc146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58dc06fe50 0x7f58dc146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 -- 172.21.15.73:0/2126234457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58dc0cdda0 con 0x7f58dc15f1d0 2024-09-12T03:35:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e1eb4640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc15f1d0 0x7f58dc15a4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c780 tx=0x7f58d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58d1ffb640 1 -- 172.21.15.73:0/2126234457 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4004b70 con 0x7f58dc15f1d0 2024-09-12T03:35:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58d1ffb640 1 -- 172.21.15.73:0/2126234457 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d4004d10 con 0x7f58dc15f1d0 2024-09-12T03:35:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58dc0ce080 con 0x7f58dc15f1d0 2024-09-12T03:35:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58d1ffb640 1 -- 172.21.15.73:0/2126234457 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d400aa90 con 0x7f58dc15f1d0 2024-09-12T03:35:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.164+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58dc0ce640 con 0x7f58dc15f1d0 2024-09-12T03:35:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.168+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58dc15ec90 con 0x7f58dc15f1d0 2024-09-12T03:35:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.168+0000 7f58d1ffb640 1 -- 172.21.15.73:0/2126234457 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58d400ac30 con 0x7f58dc15f1d0 2024-09-12T03:35:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.168+0000 7f58d1ffb640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58c00678c0 0x7f58c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.168+0000 7f58d1ffb640 1 -- 172.21.15.73:0/2126234457 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f58d4086200 con 0x7f58dc15f1d0 2024-09-12T03:35:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.168+0000 7f58e16b3640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58c00678c0 0x7f58c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.168+0000 7f58e16b3640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58c00678c0 0x7f58c0069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58cc006fd0 tx=0x7f58cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.172+0000 7f58d1ffb640 1 -- 172.21.15.73:0/2126234457 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f58d4020070 con 0x7f58dc15f1d0 2024-09-12T03:35:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.336+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58dc06e540 con 0x7f58dc15f1d0 2024-09-12T03:35:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58d1ffb640 1 -- 172.21.15.73:0/2126234457 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7f58d4056a90 con 0x7f58dc15f1d0 2024-09-12T03:35:12.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:12.344 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58c00678c0 msgr2=0x7f58c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58c00678c0 0x7f58c0069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58cc006fd0 tx=0x7f58cc008040 comp rx=0 tx=0).stop 2024-09-12T03:35:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc15f1d0 msgr2=0x7f58dc15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc15f1d0 0x7f58dc15a4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c780 tx=0x7f58d400cc40 comp rx=0 tx=0).stop 2024-09-12T03:35:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 shutdown_connections 2024-09-12T03:35:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58c00678c0 0x7f58c0069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58dc15f1d0 0x7f58dc15a4c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58dc1520a0 0x7f58dc159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 --2- 172.21.15.73:0/2126234457 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58dc06fe50 0x7f58dc146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 >> 172.21.15.73:0/2126234457 conn(0x7f58dc0b1f90 msgr2=0x7f58dc15d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:12.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 shutdown_connections 2024-09-12T03:35:12.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.340+0000 7f58e3917640 1 -- 172.21.15.73:0/2126234457 wait complete. 2024-09-12T03:35:12.364 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T03:34:25.956292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T03:34:36.451955+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T03:34:37.332778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T03:34:41.111459+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T03:35:12.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T03:35:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.480+0000 7ff3f5762640 1 Processor -- start 2024-09-12T03:35:12.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.480+0000 7ff3f5762640 1 -- start start 2024-09-12T03:35:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3f5762640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff3f006df70 0x7ff3f01634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3f5762640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3f00b3290 0x7ff3f00b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3f5762640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f006e470 con 0x7ff3f01630c0 2024-09-12T03:35:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3f5762640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f006fc20 con 0x7ff3f00b3290 2024-09-12T03:35:12.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3f5762640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f006e750 con 0x7ff3f006df70 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ef7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3f00b3290 0x7ff3f00b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ef7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3f00b3290 0x7ff3f00b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44758/0 (socket says 172.21.15.73:44758) 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/3963604674 learned_addr learned my addr 172.21.15.73:0/3963604674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ee7fc640 1 --2- 172.21.15.73:0/3963604674 >> v2:172.21.15.150:3300/0 conn(0x7ff3f006df70 0x7ff3f01634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/3963604674 >> v2:172.21.15.150:3300/0 conn(0x7ff3f006df70 msgr2=0x7ff3f01634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ef7fe640 1 --2- 172.21.15.73:0/3963604674 >> v2:172.21.15.150:3300/0 conn(0x7ff3f006df70 0x7ff3f01634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/3963604674 >> v1:172.21.15.150:6789/0 conn(0x7ff3f01630c0 legacy=0x7ff3f006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.484+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/3963604674 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f006ea30 con 0x7ff3f00b3290 2024-09-12T03:35:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3ef7fe640 1 --2- 172.21.15.73:0/3963604674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f00b3290 0x7ff3f00b3720 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00cc950 tx=0x7ff3e801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf3d066b82005a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3edffb640 1 -- 172.21.15.73:0/3963604674 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80a56c0 con 0x7ff3f00b3290 2024-09-12T03:35:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3edffb640 1 -- 172.21.15.73:0/3963604674 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e80a5860 con 0x7ff3f00b3290 2024-09-12T03:35:12.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3edffb640 1 -- 172.21.15.73:0/3963604674 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80a5c30 con 0x7ff3f00b3290 2024-09-12T03:35:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- 172.21.15.73:0/3963604674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f00b3290 msgr2=0x7ff3f00b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 --2- 172.21.15.73:0/3963604674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f00b3290 0x7ff3f00b3720 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00cc950 tx=0x7ff3e801c9f0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- 172.21.15.73:0/3963604674 shutdown_connections 2024-09-12T03:35:12.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 --2- 172.21.15.73:0/3963604674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f00b3290 0x7ff3f00b3720 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 --2- 172.21.15.73:0/3963604674 >> v2:172.21.15.150:3300/0 conn(0x7ff3f006df70 0x7ff3f01634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- 172.21.15.73:0/3963604674 >> 172.21.15.73:0/3963604674 conn(0x7ff3f00b1f90 msgr2=0x7ff3f00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- 172.21.15.73:0/3963604674 shutdown_connections 2024-09-12T03:35:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- 172.21.15.73:0/3963604674 wait complete. 2024-09-12T03:35:12.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 Processor -- start 2024-09-12T03:35:12.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- start start 2024-09-12T03:35:12.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f006df70 0x7ff3f0158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00b3290 0x7ff3f0156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f01630c0 0x7ff3f015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f016f5f0 con 0x7ff3f01630c0 2024-09-12T03:35:12.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f016f770 con 0x7ff3f00b3290 2024-09-12T03:35:12.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.488+0000 7ff3f5762640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f016f8f0 con 0x7ff3f006df70 2024-09-12T03:35:12.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f01630c0 0x7ff3f015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f01630c0 0x7ff3f015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44766/0 (socket says 172.21.15.73:44766) 2024-09-12T03:35:12.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/2469043558 learned_addr learned my addr 172.21.15.73:0/2469043558 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:12.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ee7fc640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00b3290 0x7ff3f0156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3eeffd640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f006df70 0x7ff3f0158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f006df70 msgr2=0x7ff3f0158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f006df70 0x7ff3f0158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00b3290 msgr2=0x7ff3f0156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00b3290 0x7ff3f0156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 -- 172.21.15.73:0/2469043558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f0159f70 con 0x7ff3f01630c0 2024-09-12T03:35:12.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3ef7fe640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f01630c0 0x7ff3f015c180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8019600 tx=0x7ff3e8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3d77fe640 1 -- 172.21.15.73:0/2469043558 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80bc020 con 0x7ff3f01630c0 2024-09-12T03:35:12.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3d77fe640 1 -- 172.21.15.73:0/2469043558 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e80b8670 con 0x7ff3f01630c0 2024-09-12T03:35:12.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f009a3b0 con 0x7ff3f01630c0 2024-09-12T03:35:12.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3d77fe640 1 -- 172.21.15.73:0/2469043558 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80b8a40 con 0x7ff3f01630c0 2024-09-12T03:35:12.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f0159c90 con 0x7ff3f01630c0 2024-09-12T03:35:12.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f01634a0 con 0x7ff3f01630c0 2024-09-12T03:35:12.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3d77fe640 1 -- 172.21.15.73:0/2469043558 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3e80bf020 con 0x7ff3f01630c0 2024-09-12T03:35:12.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3d77fe640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3dc0678c0 0x7ff3dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3eeffd640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3dc0678c0 0x7ff3dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3d77fe640 1 -- 172.21.15.73:0/2469043558 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff3e8120f50 con 0x7ff3f01630c0 2024-09-12T03:35:12.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.492+0000 7ff3eeffd640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3dc0678c0 0x7ff3dc069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0099c80 tx=0x7ff3e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.496+0000 7ff3d77fe640 1 -- 172.21.15.73:0/2469043558 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3e80c6030 con 0x7ff3f01630c0 2024-09-12T03:35:12.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.660+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3f0070080 con 0x7ff3f01630c0 2024-09-12T03:35:12.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.660+0000 7ff3d77fe640 1 -- 172.21.15.73:0/2469043558 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff3e80165e0 con 0x7ff3f01630c0 2024-09-12T03:35:12.664 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.660+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3dc0678c0 msgr2=0x7ff3dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3dc0678c0 0x7ff3dc069d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0099c80 tx=0x7ff3e4009040 comp rx=0 tx=0).stop 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f01630c0 msgr2=0x7ff3f015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f01630c0 0x7ff3f015c180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8019600 tx=0x7ff3e8019790 comp rx=0 tx=0).stop 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 shutdown_connections 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3dc0678c0 0x7ff3dc069d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f01630c0 0x7ff3f015c180 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f00b3290 0x7ff3f0156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 --2- 172.21.15.73:0/2469043558 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f006df70 0x7ff3f0158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 >> 172.21.15.73:0/2469043558 conn(0x7ff3f00b1f90 msgr2=0x7ff3f006f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 shutdown_connections 2024-09-12T03:35:12.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.664+0000 7ff3f5762640 1 -- 172.21.15.73:0/2469043558 wait complete. 2024-09-12T03:35:12.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T03:35:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f44775ce640 1 Processor -- start 2024-09-12T03:35:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f44775ce640 1 -- start start 2024-09-12T03:35:12.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f44775ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4470161a60 0x7f44700d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f44775ce640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f44700d2e90 0x7f44700cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f44775ce640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44700d32b0 con 0x7f44700cf450 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f44775ce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f44700d0300 con 0x7f4470161a60 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f44775ce640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f447006e6c0 con 0x7f44700d2e90 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f447536a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4470161a60 0x7f44700d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f447536a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4470161a60 0x7f44700d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44774/0 (socket says 172.21.15.73:44774) 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f447536a640 1 -- 172.21.15.73:0/1643556859 learned_addr learned my addr 172.21.15.73:0/1643556859 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f4474b69640 1 --2- 172.21.15.73:0/1643556859 >> v2:172.21.15.150:3300/0 conn(0x7f44700d2e90 0x7f44700cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f447536a640 1 -- 172.21.15.73:0/1643556859 >> v2:172.21.15.150:3300/0 conn(0x7f44700d2e90 msgr2=0x7f44700cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f447536a640 1 --2- 172.21.15.73:0/1643556859 >> v2:172.21.15.150:3300/0 conn(0x7f44700d2e90 0x7f44700cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f447536a640 1 -- 172.21.15.73:0/1643556859 >> v1:172.21.15.150:6789/0 conn(0x7f44700cf450 legacy=0x7f44700d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:12.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.796+0000 7f447536a640 1 -- 172.21.15.73:0/1643556859 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44700b0f60 con 0x7f4470161a60 2024-09-12T03:35:12.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f447536a640 1 --2- 172.21.15.73:0/1643556859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700d2950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f447008d850 tx=0x7f446c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c87fc8075856f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f4467fff640 1 -- 172.21.15.73:0/1643556859 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44700d1930 con 0x7f4470161a60 2024-09-12T03:35:12.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f4467fff640 1 -- 172.21.15.73:0/1643556859 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446c0b0070 con 0x7f4470161a60 2024-09-12T03:35:12.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f4467fff640 1 -- 172.21.15.73:0/1643556859 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c0ab840 con 0x7f4470161a60 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 -- 172.21.15.73:0/1643556859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 msgr2=0x7f44700d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 --2- 172.21.15.73:0/1643556859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700d2950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f447008d850 tx=0x7f446c01c420 comp rx=0 tx=0).stop 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 -- 172.21.15.73:0/1643556859 shutdown_connections 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 --2- 172.21.15.73:0/1643556859 >> v2:172.21.15.150:3300/0 conn(0x7f44700d2e90 0x7f44700cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 --2- 172.21.15.73:0/1643556859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700d2950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 -- 172.21.15.73:0/1643556859 >> 172.21.15.73:0/1643556859 conn(0x7f447008bf90 msgr2=0x7f447009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 -- 172.21.15.73:0/1643556859 shutdown_connections 2024-09-12T03:35:12.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 -- 172.21.15.73:0/1643556859 wait complete. 2024-09-12T03:35:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 Processor -- start 2024-09-12T03:35:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.800+0000 7f44775ce640 1 -- start start 2024-09-12T03:35:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44700cf450 0x7f4470154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44700d2e90 0x7f44700cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f44700cf8c0 con 0x7f4470161a60 2024-09-12T03:35:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f447006d190 con 0x7f44700d2e90 2024-09-12T03:35:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f44700cfa40 con 0x7f44700cf450 2024-09-12T03:35:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44786/0 (socket says 172.21.15.73:44786) 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 -- 172.21.15.73:0/3512029014 learned_addr learned my addr 172.21.15.73:0/3512029014 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4474b69640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44700d2e90 0x7f44700cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f447536a640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44700cf450 0x7f4470154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 -- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44700cf450 msgr2=0x7f4470154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44700cf450 0x7f4470154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 -- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44700d2e90 msgr2=0x7f44700cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44700d2e90 0x7f44700cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 -- 172.21.15.73:0/3512029014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4470154db0 con 0x7f4470161a60 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4475b6b640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700cb980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f446800b970 tx=0x7f446800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4465ffb640 1 -- 172.21.15.73:0/3512029014 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468019070 con 0x7f4470161a60 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4465ffb640 1 -- 172.21.15.73:0/3512029014 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446800cb40 con 0x7f4470161a60 2024-09-12T03:35:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44701599f0 con 0x7f4470161a60 2024-09-12T03:35:12.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4465ffb640 1 -- 172.21.15.73:0/3512029014 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468014440 con 0x7f4470161a60 2024-09-12T03:35:12.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4470159c90 con 0x7f4470161a60 2024-09-12T03:35:12.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44700cef10 con 0x7f4470161a60 2024-09-12T03:35:12.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4465ffb640 1 -- 172.21.15.73:0/3512029014 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f446801c070 con 0x7f4470161a60 2024-09-12T03:35:12.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4465ffb640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44540678f0 0x7f4454069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:12.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f447536a640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44540678f0 0x7f4454069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:12.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.804+0000 7f4465ffb640 1 -- 172.21.15.73:0/3512029014 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4468085af0 con 0x7f4470161a60 2024-09-12T03:35:12.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.808+0000 7f447536a640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44540678f0 0x7f4454069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f446c0af000 tx=0x7f446c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:12.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.808+0000 7f4465ffb640 1 -- 172.21.15.73:0/3512029014 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4468056380 con 0x7f4470161a60 2024-09-12T03:35:12.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.960+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f447006d800 con 0x7f4470161a60 2024-09-12T03:35:12.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.960+0000 7f4465ffb640 1 -- 172.21.15.73:0/3512029014 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f4468055c80 con 0x7f4470161a60 2024-09-12T03:35:12.966 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-09-12T03:35:12.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44540678f0 msgr2=0x7f4454069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44540678f0 0x7f4454069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f446c0af000 tx=0x7f446c0a7000 comp rx=0 tx=0).stop 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 msgr2=0x7f44700cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700cb980 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f446800b970 tx=0x7f446800be30 comp rx=0 tx=0).stop 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 shutdown_connections 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44540678f0 0x7f4454069db0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4470161a60 0x7f44700cb980 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f44700d2e90 0x7f44700cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 --2- 172.21.15.73:0/3512029014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f44700cf450 0x7f4470154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 >> 172.21.15.73:0/3512029014 conn(0x7f447008bf90 msgr2=0x7f447006dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 shutdown_connections 2024-09-12T03:35:12.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:12.964+0000 7f44775ce640 1 -- 172.21.15.73:0/3512029014 wait complete. 2024-09-12T03:35:12.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T03:35:13.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4932bf4640 1 Processor -- start 2024-09-12T03:35:13.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4932bf4640 1 -- start start 2024-09-12T03:35:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4932bf4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c1520a0 0x7f492c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4932bf4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f492c15f3a0 0x7f492c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4932bf4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c070250 con 0x7f492c06fe50 2024-09-12T03:35:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4932bf4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f492c152480 con 0x7f492c15f3a0 2024-09-12T03:35:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4932bf4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f492c0aede0 con 0x7f492c1520a0 2024-09-12T03:35:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4931191640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f492c15f3a0 0x7f492c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f492bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f492c06fe50 0x7f492c15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42252/0 (socket says 172.21.15.73:42252) 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f492bfff640 1 -- 172.21.15.73:0/3961505484 learned_addr learned my addr 172.21.15.73:0/3961505484 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4931191640 1 -- 172.21.15.73:0/3961505484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c1520a0 msgr2=0x7f492c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4930990640 1 --2- 172.21.15.73:0/3961505484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c1520a0 0x7f492c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f492b7fe640 1 -- 172.21.15.73:0/3961505484 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834961997 0 0) 0x7f492c070250 con 0x7f492c06fe50 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4931191640 1 --2- 172.21.15.73:0/3961505484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c1520a0 0x7f492c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4931191640 1 -- 172.21.15.73:0/3961505484 >> v1:172.21.15.73:6789/0 conn(0x7f492c06fe50 legacy=0x7f492c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4931191640 1 -- 172.21.15.73:0/3961505484 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c15fa10 con 0x7f492c15f3a0 2024-09-12T03:35:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.092+0000 7f4930990640 1 --2- 172.21.15.73:0/3961505484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c1520a0 0x7f492c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4931191640 1 --2- 172.21.15.73:0/3961505484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c15f3a0 0x7f492c0adc80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f492401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4455ab279794b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492b7fe640 1 -- 172.21.15.73:0/3961505484 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49240b2070 con 0x7f492c15f3a0 2024-09-12T03:35:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492b7fe640 1 -- 172.21.15.73:0/3961505484 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49240a5a30 con 0x7f492c15f3a0 2024-09-12T03:35:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492b7fe640 1 -- 172.21.15.73:0/3961505484 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49240a5e00 con 0x7f492c15f3a0 2024-09-12T03:35:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- 172.21.15.73:0/3961505484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c15f3a0 msgr2=0x7f492c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 --2- 172.21.15.73:0/3961505484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c15f3a0 0x7f492c0adc80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f492401c970 comp rx=0 tx=0).stop 2024-09-12T03:35:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- 172.21.15.73:0/3961505484 shutdown_connections 2024-09-12T03:35:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 --2- 172.21.15.73:0/3961505484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c15f3a0 0x7f492c0adc80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 --2- 172.21.15.73:0/3961505484 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c1520a0 0x7f492c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- 172.21.15.73:0/3961505484 >> 172.21.15.73:0/3961505484 conn(0x7f492c0b1f90 msgr2=0x7f492c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- 172.21.15.73:0/3961505484 shutdown_connections 2024-09-12T03:35:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- 172.21.15.73:0/3961505484 wait complete. 2024-09-12T03:35:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 Processor -- start 2024-09-12T03:35:13.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- start start 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c06fe50 0x7f492c099060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c1520a0 0x7f492c1fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f492c15f3a0 0x7f492c1683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f492c073d30 con 0x7f492c1520a0 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f492c073a50 con 0x7f492c15f3a0 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4932bf4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f492c06e800 con 0x7f492c06fe50 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c1520a0 0x7f492c1fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c1520a0 0x7f492c1fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44814/0 (socket says 172.21.15.73:44814) 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 -- 172.21.15.73:0/807810257 learned_addr learned my addr 172.21.15.73:0/807810257 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4931191640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f492c15f3a0 0x7f492c1683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f4930990640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c06fe50 0x7f492c099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 -- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c06fe50 msgr2=0x7f492c099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c06fe50 0x7f492c099060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 -- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f492c15f3a0 msgr2=0x7f492c1683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f492c15f3a0 0x7f492c1683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.096+0000 7f492bfff640 1 -- 172.21.15.73:0/807810257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c1fb7f0 con 0x7f492c1520a0 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f492bfff640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c1520a0 0x7f492c1fb2b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c480 tx=0x7f491c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f49297fa640 1 -- 172.21.15.73:0/807810257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c018070 con 0x7f492c1520a0 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f49297fa640 1 -- 172.21.15.73:0/807810257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491c0074e0 con 0x7f492c1520a0 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c14abe0 con 0x7f492c1520a0 2024-09-12T03:35:13.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f49297fa640 1 -- 172.21.15.73:0/807810257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0049f0 con 0x7f492c1520a0 2024-09-12T03:35:13.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c14b1a0 con 0x7f492c1520a0 2024-09-12T03:35:13.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c0adc80 con 0x7f492c1520a0 2024-09-12T03:35:13.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f49297fa640 1 -- 172.21.15.73:0/807810257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f491c01b070 con 0x7f492c1520a0 2024-09-12T03:35:13.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f49297fa640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f49180678c0 0x7f4918069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f49297fa640 1 -- 172.21.15.73:0/807810257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f491c085390 con 0x7f492c1520a0 2024-09-12T03:35:13.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f4930990640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f49180678c0 0x7f4918069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.100+0000 7f4930990640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f49180678c0 0x7f4918069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4920006fd0 tx=0x7f4920008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.104+0000 7f49297fa640 1 -- 172.21.15.73:0/807810257 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f491c055c20 con 0x7f492c1520a0 2024-09-12T03:35:13.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.252+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f492c164380 con 0x7f492c1520a0 2024-09-12T03:35:13.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f49297fa640 1 -- 172.21.15.73:0/807810257 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f491c055520 con 0x7f492c1520a0 2024-09-12T03:35:13.259 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-09-12T03:35:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f49180678c0 msgr2=0x7f4918069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f49180678c0 0x7f4918069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4920006fd0 tx=0x7f4920008040 comp rx=0 tx=0).stop 2024-09-12T03:35:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c1520a0 msgr2=0x7f492c1fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c1520a0 0x7f492c1fb2b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f491c00c480 tx=0x7f491c00c940 comp rx=0 tx=0).stop 2024-09-12T03:35:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 shutdown_connections 2024-09-12T03:35:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f49180678c0 0x7f4918069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492c1520a0 0x7f492c1fb2b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f492c15f3a0 0x7f492c1683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 --2- 172.21.15.73:0/807810257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f492c06fe50 0x7f492c099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 >> 172.21.15.73:0/807810257 conn(0x7f492c0b1f90 msgr2=0x7f492c14e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 shutdown_connections 2024-09-12T03:35:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.256+0000 7f4932bf4640 1 -- 172.21.15.73:0/807810257 wait complete. 2024-09-12T03:35:13.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T03:35:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.392+0000 7f1334733640 1 Processor -- start 2024-09-12T03:35:13.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.392+0000 7f1334733640 1 -- start start 2024-09-12T03:35:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1334733640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15bec0 0x7f132c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1334733640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f132c15c2a0 0x7f132c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1334733640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132c0b3290 con 0x7f132c0af2a0 2024-09-12T03:35:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1334733640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f132c0b3570 con 0x7f132c15c2a0 2024-09-12T03:35:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1334733640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f132c0b3850 con 0x7f132c15bec0 2024-09-12T03:35:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1331cce640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f132c15c2a0 0x7f132c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f13324cf640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15bec0 0x7f132c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1331cce640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f132c15c2a0 0x7f132c0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:46136/0 (socket says 172.21.15.73:46136) 2024-09-12T03:35:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1331cce640 1 -- 172.21.15.73:0/327698688 learned_addr learned my addr 172.21.15.73:0/327698688 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1332cd0640 1 --1- 172.21.15.73:0/327698688 >> v1:172.21.15.150:6789/0 conn(0x7f132c0af2a0 0x7f132c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:41142/0 (socket says 172.21.15.73:41142) 2024-09-12T03:35:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1331cce640 1 -- 172.21.15.73:0/327698688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15bec0 msgr2=0x7f132c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1331cce640 1 --2- 172.21.15.73:0/327698688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15bec0 0x7f132c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1331cce640 1 -- 172.21.15.73:0/327698688 >> v1:172.21.15.150:6789/0 conn(0x7f132c0af2a0 legacy=0x7f132c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.396+0000 7f1331cce640 1 -- 172.21.15.73:0/327698688 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c0b3b30 con 0x7f132c15c2a0 2024-09-12T03:35:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 --2- 172.21.15.73:0/327698688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c15c2a0 0x7f132c0aed60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f131c009870 tx=0x7f131c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd464a88ee791a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f13314cd640 1 -- 172.21.15.73:0/327698688 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0a95f0 con 0x7f132c15c2a0 2024-09-12T03:35:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f13314cd640 1 -- 172.21.15.73:0/327698688 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131c0a9790 con 0x7f132c15c2a0 2024-09-12T03:35:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f13314cd640 1 -- 172.21.15.73:0/327698688 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0a9b60 con 0x7f132c15c2a0 2024-09-12T03:35:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- 172.21.15.73:0/327698688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c15c2a0 msgr2=0x7f132c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 --2- 172.21.15.73:0/327698688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c15c2a0 0x7f132c0aed60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f131c009870 tx=0x7f131c01c530 comp rx=0 tx=0).stop 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- 172.21.15.73:0/327698688 shutdown_connections 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 --2- 172.21.15.73:0/327698688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c15c2a0 0x7f132c0aed60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 --2- 172.21.15.73:0/327698688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15bec0 0x7f132c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- 172.21.15.73:0/327698688 >> 172.21.15.73:0/327698688 conn(0x7f132c0b1f90 msgr2=0x7f132c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- 172.21.15.73:0/327698688 shutdown_connections 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- 172.21.15.73:0/327698688 wait complete. 2024-09-12T03:35:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 Processor -- start 2024-09-12T03:35:13.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- start start 2024-09-12T03:35:13.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c0af2a0 0x7f132c1fc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132c15bec0 0x7f132c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15c2a0 0x7f132c0cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f132c0af6b0 con 0x7f132c15bec0 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f132c0ad740 con 0x7f132c0af2a0 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f132c169000 con 0x7f132c15c2a0 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132c15bec0 0x7f132c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132c15bec0 0x7f132c155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44824/0 (socket says 172.21.15.73:44824) 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 -- 172.21.15.73:0/4141812570 learned_addr learned my addr 172.21.15.73:0/4141812570 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1332cd0640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15c2a0 0x7f132c0cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f13324cf640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c0af2a0 0x7f132c1fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 -- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15c2a0 msgr2=0x7f132c0cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15c2a0 0x7f132c0cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 -- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c0af2a0 msgr2=0x7f132c1fc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c0af2a0 0x7f132c1fc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 -- 172.21.15.73:0/4141812570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c15c780 con 0x7f132c15bec0 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1332cd0640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15c2a0 0x7f132c0cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1331cce640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132c15bec0 0x7f132c155f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f131c01abe0 tx=0x7f131c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1322ffd640 1 -- 172.21.15.73:0/4141812570 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0bf070 con 0x7f132c15bec0 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1322ffd640 1 -- 172.21.15.73:0/4141812570 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131c0ba410 con 0x7f132c15bec0 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c156690 con 0x7f132c15bec0 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1322ffd640 1 -- 172.21.15.73:0/4141812570 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c0ba7e0 con 0x7f132c15bec0 2024-09-12T03:35:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.400+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c156c50 con 0x7f132c15bec0 2024-09-12T03:35:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.404+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c0ad200 con 0x7f132c15bec0 2024-09-12T03:35:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.404+0000 7f1322ffd640 1 -- 172.21.15.73:0/4141812570 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f131c0c2070 con 0x7f132c15bec0 2024-09-12T03:35:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.404+0000 7f1322ffd640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f13100678f0 0x7f1310069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.404+0000 7f13324cf640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f13100678f0 0x7f1310069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.404+0000 7f1322ffd640 1 -- 172.21.15.73:0/4141812570 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f131c11ff60 con 0x7f132c15bec0 2024-09-12T03:35:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.404+0000 7f13324cf640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f13100678f0 0x7f1310069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1328009af0 tx=0x7f1328008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.408+0000 7f1322ffd640 1 -- 172.21.15.73:0/4141812570 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f131c0ad020 con 0x7f132c15bec0 2024-09-12T03:35:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f132c0cf8f0 con 0x7f132c15bec0 2024-09-12T03:35:13.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1322ffd640 1 -- 172.21.15.73:0/4141812570 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f131c016150 con 0x7f132c15bec0 2024-09-12T03:35:13.572 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-09-12T03:35:13.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f13100678f0 msgr2=0x7f1310069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f13100678f0 0x7f1310069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1328009af0 tx=0x7f1328008040 comp rx=0 tx=0).stop 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132c15bec0 msgr2=0x7f132c155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132c15bec0 0x7f132c155f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f131c01abe0 tx=0x7f131c0192d0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 shutdown_connections 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f13100678f0 0x7f1310069db0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132c15bec0 0x7f132c155f40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f132c15c2a0 0x7f132c0cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 --2- 172.21.15.73:0/4141812570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f132c0af2a0 0x7f132c1fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 >> 172.21.15.73:0/4141812570 conn(0x7f132c0b1f90 msgr2=0x7f132c15ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 shutdown_connections 2024-09-12T03:35:13.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.568+0000 7f1334733640 1 -- 172.21.15.73:0/4141812570 wait complete. 2024-09-12T03:35:13.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2024-09-12T03:35:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 Processor -- start 2024-09-12T03:35:13.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 -- start start 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2de406fef0 0x7f2de415b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2de40b3d50 0x7f2de40b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2de40b46a0 con 0x7f2de40b3d50 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f2de415bda0 con 0x7f2de406fef0 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de95e7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2de406ee50 con 0x7f2de4073e60 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2de40b3d50 0x7f2de40b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2de40b3d50 0x7f2de40b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44830/0 (socket says 172.21.15.73:44830) 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 -- 172.21.15.73:0/64968384 learned_addr learned my addr 172.21.15.73:0/64968384 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de2ffd640 1 --2- 172.21.15.73:0/64968384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de27fc640 1 --2- 172.21.15.73:0/64968384 >> v2:172.21.15.150:3300/0 conn(0x7f2de406fef0 0x7f2de415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 -- 172.21.15.73:0/64968384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 msgr2=0x7f2de406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 --2- 172.21.15.73:0/64968384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de406e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 -- 172.21.15.73:0/64968384 >> v2:172.21.15.150:3300/0 conn(0x7f2de406fef0 msgr2=0x7f2de415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 --2- 172.21.15.73:0/64968384 >> v2:172.21.15.150:3300/0 conn(0x7f2de406fef0 0x7f2de415b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de37fe640 1 -- 172.21.15.73:0/64968384 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de406f130 con 0x7f2de40b3d50 2024-09-12T03:35:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.700+0000 7f2de27fc640 1 --2- 172.21.15.73:0/64968384 >> v2:172.21.15.150:3300/0 conn(0x7f2de406fef0 0x7f2de415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 --2- 172.21.15.73:0/64968384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de40b4160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2de406dd30 tx=0x7f2ddc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1164bd2d9424b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de1ffb640 1 -- 172.21.15.73:0/64968384 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0a5650 con 0x7f2de40b3d50 2024-09-12T03:35:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de1ffb640 1 -- 172.21.15.73:0/64968384 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc0a57f0 con 0x7f2de40b3d50 2024-09-12T03:35:13.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de1ffb640 1 -- 172.21.15.73:0/64968384 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0a5bc0 con 0x7f2de40b3d50 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- 172.21.15.73:0/64968384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 msgr2=0x7f2de40b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 --2- 172.21.15.73:0/64968384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de40b4160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2de406dd30 tx=0x7f2ddc01c960 comp rx=0 tx=0).stop 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- 172.21.15.73:0/64968384 shutdown_connections 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 --2- 172.21.15.73:0/64968384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de40b4160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 --2- 172.21.15.73:0/64968384 >> v2:172.21.15.150:3300/0 conn(0x7f2de406fef0 0x7f2de415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 --2- 172.21.15.73:0/64968384 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de406e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- 172.21.15.73:0/64968384 >> 172.21.15.73:0/64968384 conn(0x7f2de40b1f90 msgr2=0x7f2de40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- 172.21.15.73:0/64968384 shutdown_connections 2024-09-12T03:35:13.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- 172.21.15.73:0/64968384 wait complete. 2024-09-12T03:35:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 Processor -- start 2024-09-12T03:35:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- start start 2024-09-12T03:35:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de406fef0 0x7f2de4155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de413e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de4153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2de415e580 con 0x7f2de40b3d50 2024-09-12T03:35:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2de415e400 con 0x7f2de406fef0 2024-09-12T03:35:13.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2de415e700 con 0x7f2de4073e60 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de4153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de4153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44844/0 (socket says 172.21.15.73:44844) 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 -- 172.21.15.73:0/4084388175 learned_addr learned my addr 172.21.15.73:0/4084388175 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de2ffd640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de406fef0 0x7f2de4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de27fc640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de413e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 -- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 msgr2=0x7f2de413e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de413e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 -- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de406fef0 msgr2=0x7f2de4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de406fef0 0x7f2de4155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 -- 172.21.15.73:0/4084388175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de415dbb0 con 0x7f2de40b3d50 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de27fc640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de413e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:13.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de37fe640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de4153080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc01b010 tx=0x7f2ddc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2dcb7fe640 1 -- 172.21.15.73:0/4084388175 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0bc020 con 0x7f2de40b3d50 2024-09-12T03:35:13.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2dcb7fe640 1 -- 172.21.15.73:0/4084388175 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ddc0b8670 con 0x7f2de40b3d50 2024-09-12T03:35:13.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de413eae0 con 0x7f2de40b3d50 2024-09-12T03:35:13.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2dcb7fe640 1 -- 172.21.15.73:0/4084388175 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc009510 con 0x7f2de40b3d50 2024-09-12T03:35:13.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.704+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de41522c0 con 0x7f2de40b3d50 2024-09-12T03:35:13.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.708+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de415b860 con 0x7f2de40b3d50 2024-09-12T03:35:13.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.708+0000 7f2dcb7fe640 1 -- 172.21.15.73:0/4084388175 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ddc0bf020 con 0x7f2de40b3d50 2024-09-12T03:35:13.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.708+0000 7f2dcb7fe640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2dd00678c0 0x7f2dd0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:13.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.708+0000 7f2dcb7fe640 1 -- 172.21.15.73:0/4084388175 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2ddc120f70 con 0x7f2de40b3d50 2024-09-12T03:35:13.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.708+0000 7f2de2ffd640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2dd00678c0 0x7f2dd0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:13.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.708+0000 7f2de2ffd640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2dd00678c0 0x7f2dd0069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2de4154ee0 tx=0x7f2dd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:13.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.712+0000 7f2dcb7fe640 1 -- 172.21.15.73:0/4084388175 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ddc0c6030 con 0x7f2de40b3d50 2024-09-12T03:35:13.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:13.924+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) -- 0x7f2de40723f0 con 0x7f2de40b3d50 2024-09-12T03:35:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.892+0000 7f2dcb7fe640 1 -- 172.21.15.73:0/4084388175 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v54) ==== 163+0+0 (secure 0 0 0) 0x7f2ddc0165e0 con 0x7f2de40b3d50 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2dd00678c0 msgr2=0x7f2dd0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2dd00678c0 0x7f2dd0069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2de4154ee0 tx=0x7f2dd4008040 comp rx=0 tx=0).stop 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 msgr2=0x7f2de4153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de4153080 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc01b010 tx=0x7f2ddc019700 comp rx=0 tx=0).stop 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 shutdown_connections 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2dd00678c0 0x7f2dd0069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2de40b3d50 0x7f2de4153080 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2de4073e60 0x7f2de413e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 --2- 172.21.15.73:0/4084388175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2de406fef0 0x7f2de4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 >> 172.21.15.73:0/4084388175 conn(0x7f2de40b1f90 msgr2=0x7f2de40b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 shutdown_connections 2024-09-12T03:35:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:14.896+0000 7f2de95e7640 1 -- 172.21.15.73:0/4084388175 wait complete. 2024-09-12T03:35:14.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T03:35:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f8372b640 1 Processor -- start 2024-09-12T03:35:15.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f8372b640 1 -- start start 2024-09-12T03:35:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f8372b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f7c070020 0x7f3f7c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f8372b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 0x7f3f7c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f8372b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7c0aede0 con 0x7f3f7c1520a0 2024-09-12T03:35:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f8372b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3f7c152480 con 0x7f3f7c070020 2024-09-12T03:35:15.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f8372b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c15fa10 con 0x7f3f7c15f1d0 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f80cc6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f7c070020 0x7f3f7c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f814c7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f7c1520a0 0x7f3f7c06f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54462/0 (socket says 172.21.15.73:54462) 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f814c7640 1 -- 172.21.15.73:0/1449495561 learned_addr learned my addr 172.21.15.73:0/1449495561 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f80cc6640 1 -- 172.21.15.73:0/1449495561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 msgr2=0x7f3f7c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f80cc6640 1 --2- 172.21.15.73:0/1449495561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 0x7f3f7c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f80cc6640 1 -- 172.21.15.73:0/1449495561 >> v1:172.21.15.73:6789/0 conn(0x7f3f7c1520a0 legacy=0x7f3f7c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f80cc6640 1 -- 172.21.15.73:0/1449495561 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c074250 con 0x7f3f7c070020 2024-09-12T03:35:15.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f73fff640 1 -- 172.21.15.73:0/1449495561 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110018677 0 0) 0x7f3f7c0aede0 con 0x7f3f7c1520a0 2024-09-12T03:35:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f80cc6640 1 --2- 172.21.15.73:0/1449495561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c15ec90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0097c0 tx=0x7f3f6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795d13acb5fafbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.056+0000 7f3f73fff640 1 -- 172.21.15.73:0/1449495561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a7070 con 0x7f3f7c070020 2024-09-12T03:35:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f73fff640 1 -- 172.21.15.73:0/1449495561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6c0b0070 con 0x7f3f7c070020 2024-09-12T03:35:15.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f73fff640 1 -- 172.21.15.73:0/1449495561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0ab890 con 0x7f3f7c070020 2024-09-12T03:35:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- 172.21.15.73:0/1449495561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 msgr2=0x7f3f7c15ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 --2- 172.21.15.73:0/1449495561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c15ec90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0097c0 tx=0x7f3f6c01c470 comp rx=0 tx=0).stop 2024-09-12T03:35:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- 172.21.15.73:0/1449495561 shutdown_connections 2024-09-12T03:35:15.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 --2- 172.21.15.73:0/1449495561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 0x7f3f7c0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 --2- 172.21.15.73:0/1449495561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c15ec90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- 172.21.15.73:0/1449495561 >> 172.21.15.73:0/1449495561 conn(0x7f3f7c0b1f90 msgr2=0x7f3f7c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- 172.21.15.73:0/1449495561 shutdown_connections 2024-09-12T03:35:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- 172.21.15.73:0/1449495561 wait complete. 2024-09-12T03:35:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 Processor -- start 2024-09-12T03:35:15.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- start start 2024-09-12T03:35:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c1467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1520a0 0x7f3f7c15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 0x7f3f7c15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c15f660 con 0x7f3f7c070020 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c073d30 con 0x7f3f7c1520a0 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7c1652b0 con 0x7f3f7c15f1d0 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c1467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c1467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58988/0 (socket says 172.21.15.73:58988) 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 -- 172.21.15.73:0/2612265883 learned_addr learned my addr 172.21.15.73:0/2612265883 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 -- 172.21.15.73:0/2612265883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 msgr2=0x7f3f7c15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 0x7f3f7c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 -- 172.21.15.73:0/2612265883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1520a0 msgr2=0x7f3f7c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1520a0 0x7f3f7c15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 -- 172.21.15.73:0/2612265883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c165b00 con 0x7f3f7c070020 2024-09-12T03:35:15.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f814c7640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c1467c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c890 tx=0x7f3f7800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f71ffb640 1 -- 172.21.15.73:0/2612265883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78018070 con 0x7f3f7c070020 2024-09-12T03:35:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f71ffb640 1 -- 172.21.15.73:0/2612265883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7800a5e0 con 0x7f3f7c070020 2024-09-12T03:35:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c164c60 con 0x7f3f7c070020 2024-09-12T03:35:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f71ffb640 1 -- 172.21.15.73:0/2612265883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800a9d0 con 0x7f3f7c070020 2024-09-12T03:35:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.060+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c15ac50 con 0x7f3f7c070020 2024-09-12T03:35:15.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.064+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7c15ec90 con 0x7f3f7c070020 2024-09-12T03:35:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.064+0000 7f3f71ffb640 1 -- 172.21.15.73:0/2612265883 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f7801b070 con 0x7f3f7c070020 2024-09-12T03:35:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.064+0000 7f3f71ffb640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f600678f0 0x7f3f60069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.064+0000 7f3f80cc6640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f600678f0 0x7f3f60069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.064+0000 7f3f71ffb640 1 -- 172.21.15.73:0/2612265883 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3f78085720 con 0x7f3f7c070020 2024-09-12T03:35:15.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.064+0000 7f3f80cc6640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f600678f0 0x7f3f60069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0af000 tx=0x7f3f6c004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.068+0000 7f3f71ffb640 1 -- 172.21.15.73:0/2612265883 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3f78055e80 con 0x7f3f7c070020 2024-09-12T03:35:15.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.236+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3f7c0d0ac0 con 0x7f3f7c070020 2024-09-12T03:35:15.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.244+0000 7f3f71ffb640 1 -- 172.21.15.73:0/2612265883 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f3f78055780 con 0x7f3f7c070020 2024-09-12T03:35:15.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f600678f0 msgr2=0x7f3f60069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f600678f0 0x7f3f60069db0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0af000 tx=0x7f3f6c004740 comp rx=0 tx=0).stop 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 msgr2=0x7f3f7c1467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c1467c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c890 tx=0x7f3f7800cd50 comp rx=0 tx=0).stop 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 shutdown_connections 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f600678f0 0x7f3f60069db0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f7c15f1d0 0x7f3f7c15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f7c1520a0 0x7f3f7c15d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 --2- 172.21.15.73:0/2612265883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f7c070020 0x7f3f7c1467c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 >> 172.21.15.73:0/2612265883 conn(0x7f3f7c0b1f90 msgr2=0x7f3f7c151400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 shutdown_connections 2024-09-12T03:35:15.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.248+0000 7f3f8372b640 1 -- 172.21.15.73:0/2612265883 wait complete. 2024-09-12T03:35:15.268 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:35:15.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:35:15.320 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:35:15.379 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:35:15.379 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:15.379 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:15.384 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:15.384 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:15.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:15.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a6d835640 1 Processor -- start 2024-09-12T03:35:15.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a6d835640 1 -- start start 2024-09-12T03:35:15.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a6d835640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8a68073e60 0x7f8a6806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a6d835640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6806ee50 con 0x7f8a680b3d50 2024-09-12T03:35:15.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a6d835640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6806f130 con 0x7f8a6806fef0 2024-09-12T03:35:15.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a6d835640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6806f410 con 0x7f8a68073e60 2024-09-12T03:35:15.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8a680b3d50 0x7f8a680b4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54472/0 (socket says 172.21.15.73:54472) 2024-09-12T03:35:15.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 -- 172.21.15.73:0/1385654526 learned_addr learned my addr 172.21.15.73:0/1385654526 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:15.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a66ffd640 1 --2- 172.21.15.73:0/1385654526 >> v2:172.21.15.150:3300/0 conn(0x7f8a68073e60 0x7f8a6806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128348679 0 0) 0x7f8a6806ee50 con 0x7f8a680b3d50 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a50003530 con 0x7f8a680b3d50 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1622647176 0 0) 0x7f8a50003530 con 0x7f8a680b3d50 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 >> v2:172.21.15.150:3300/0 conn(0x7f8a68073e60 msgr2=0x7f8a6806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 --2- 172.21.15.73:0/1385654526 >> v2:172.21.15.150:3300/0 conn(0x7f8a68073e60 0x7f8a6806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 >> v1:172.21.15.150:6789/0 conn(0x7f8a6806fef0 legacy=0x7f8a6815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6806f6f0 con 0x7f8a680b3d50 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f8a60001a00 con 0x7f8a680b3d50 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a66ffd640 1 --2- 172.21.15.73:0/1385654526 >> v2:172.21.15.150:3300/0 conn(0x7f8a68073e60 0x7f8a6806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 >> v1:172.21.15.73:6789/0 conn(0x7f8a680b3d50 legacy=0x7f8a680b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a500039c0 0x7f8a50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50004810 0x7f8a50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a500052f0 0x7f8a5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6806f410 con 0x7f8a500052f0 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5000c1c0 con 0x7f8a500039c0 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5000c3c0 con 0x7f8a50004810 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a500052f0 0x7f8a5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a66ffd640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a500039c0 0x7f8a50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a667fc640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50004810 0x7f8a50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 -- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50004810 msgr2=0x7f8a50004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a50004810 0x7f8a50004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 -- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a500039c0 msgr2=0x7f8a50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a500039c0 0x7f8a50003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a677fe640 1 -- 172.21.15.73:0/1385654526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a50003530 con 0x7f8a500052f0 2024-09-12T03:35:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.600+0000 7f8a66ffd640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a500039c0 0x7f8a50003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a677fe640 1 -- 172.21.15.73:0/1385654526 reap_dead start 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a677fe640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a500052f0 0x7f8a5000b9d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000a830 tx=0x7f8a6001fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10355af67cf8c108 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000a480 con 0x7f8a500052f0 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a600aa4f0 con 0x7f8a500052f0 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a65ffb640 1 -- 172.21.15.73:0/1385654526 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a600aa8c0 con 0x7f8a500052f0 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 -- 172.21.15.73:0/1385654526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a500052f0 msgr2=0x7f8a5000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a500052f0 0x7f8a5000b9d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000a830 tx=0x7f8a6001fac0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 -- 172.21.15.73:0/1385654526 shutdown_connections 2024-09-12T03:35:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 --2- 172.21.15.73:0/1385654526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a500052f0 0x7f8a5000b9d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 -- 172.21.15.73:0/1385654526 >> 172.21.15.73:0/1385654526 conn(0x7f8a680b1f90 msgr2=0x7f8a680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 -- 172.21.15.73:0/1385654526 shutdown_connections 2024-09-12T03:35:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 -- 172.21.15.73:0/1385654526 wait complete. 2024-09-12T03:35:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 Processor -- start 2024-09-12T03:35:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.604+0000 7f8a6d835640 1 -- start start 2024-09-12T03:35:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a500052f0 0x7f8a68159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a68148040 0x7f8a6814bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a681440b0 0x7f8a6814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6815b9e0 con 0x7f8a68148040 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6815b860 con 0x7f8a681440b0 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6815bb60 con 0x7f8a500052f0 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a68148040 0x7f8a6814bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a68148040 0x7f8a6814bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59014/0 (socket says 172.21.15.73:59014) 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 -- 172.21.15.73:0/3496286745 learned_addr learned my addr 172.21.15.73:0/3496286745 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a677fe640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a681440b0 0x7f8a6814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a66ffd640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a500052f0 0x7f8a68159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 -- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a500052f0 msgr2=0x7f8a68159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a500052f0 0x7f8a68159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 -- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a681440b0 msgr2=0x7f8a6814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a681440b0 0x7f8a6814c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 -- 172.21.15.73:0/3496286745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a68154fb0 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a677fe640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a681440b0 0x7f8a6814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a667fc640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a68148040 0x7f8a6814bdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00e510 tx=0x7f8a5c00e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a4ffff640 1 -- 172.21.15.73:0/3496286745 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0052e0 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a4ffff640 1 -- 172.21.15.73:0/3496286745 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5c018070 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a68154cd0 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a4ffff640 1 -- 172.21.15.73:0/3496286745 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c003820 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6814daf0 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6806edb0 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a4ffff640 1 -- 172.21.15.73:0/3496286745 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a5c0039c0 con 0x7f8a68148040 2024-09-12T03:35:15.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a4ffff640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8a540678f0 0x7f8a54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a4ffff640 1 -- 172.21.15.73:0/3496286745 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a5c085920 con 0x7f8a68148040 2024-09-12T03:35:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a66ffd640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8a540678f0 0x7f8a54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.608+0000 7f8a66ffd640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8a540678f0 0x7f8a54069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a58010820 tx=0x7f8a58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.612+0000 7f8a4ffff640 1 -- 172.21.15.73:0/3496286745 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8a5c005480 con 0x7f8a68148040 2024-09-12T03:35:15.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8a68073570 con 0x7f8a68148040 2024-09-12T03:35:15.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a4ffff640 1 -- 172.21.15.73:0/3496286745 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f8a5c056120 con 0x7f8a68148040 2024-09-12T03:35:15.792 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8a540678f0 msgr2=0x7f8a54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8a540678f0 0x7f8a54069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a58010820 tx=0x7f8a58008040 comp rx=0 tx=0).stop 2024-09-12T03:35:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a68148040 msgr2=0x7f8a6814bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a68148040 0x7f8a6814bdd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c00e510 tx=0x7f8a5c00e9d0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 shutdown_connections 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8a540678f0 0x7f8a54069db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a68148040 0x7f8a6814bdd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a681440b0 0x7f8a6814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 --2- 172.21.15.73:0/3496286745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8a500052f0 0x7f8a68159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 >> 172.21.15.73:0/3496286745 conn(0x7f8a680b1f90 msgr2=0x7f8a6815c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 shutdown_connections 2024-09-12T03:35:15.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.788+0000 7f8a6d835640 1 -- 172.21.15.73:0/3496286745 wait complete. 2024-09-12T03:35:15.812 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:15.812 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:15.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:15.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a84c4640 1 Processor -- start 2024-09-12T03:35:15.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a84c4640 1 -- start start 2024-09-12T03:35:15.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a84c4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3a015bec0 0x7ff3a00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a84c4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a84c4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a00b3290 con 0x7ff3a00af2a0 2024-09-12T03:35:15.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a84c4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a00b3570 con 0x7ff3a015bec0 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a84c4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a00b3850 con 0x7ff3a015c2a0 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a6260640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3a015bec0 0x7ff3a00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a6260640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3a015bec0 0x7ff3a00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59026/0 (socket says 172.21.15.73:59026) 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a6260640 1 -- 172.21.15.73:0/879849314 learned_addr learned my addr 172.21.15.73:0/879849314 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a5a5f640 1 --2- 172.21.15.73:0/879849314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a6260640 1 -- 172.21.15.73:0/879849314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 msgr2=0x7ff3a00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a6260640 1 --2- 172.21.15.73:0/879849314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a6260640 1 -- 172.21.15.73:0/879849314 >> v1:172.21.15.150:6789/0 conn(0x7ff3a00af2a0 legacy=0x7ff3a015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a6260640 1 -- 172.21.15.73:0/879849314 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a00b3b30 con 0x7ff3a015bec0 2024-09-12T03:35:15.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.980+0000 7ff3a5a5f640 1 --2- 172.21.15.73:0/879849314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:15.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a6260640 1 --2- 172.21.15.73:0/879849314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a00ad200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009870 tx=0x7ff39c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cf8c47f6cac242 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a525e640 1 -- 172.21.15.73:0/879849314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0a95f0 con 0x7ff3a015bec0 2024-09-12T03:35:15.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a525e640 1 -- 172.21.15.73:0/879849314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39c0a9790 con 0x7ff3a015bec0 2024-09-12T03:35:15.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a525e640 1 -- 172.21.15.73:0/879849314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0a9b60 con 0x7ff3a015bec0 2024-09-12T03:35:15.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 -- 172.21.15.73:0/879849314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 msgr2=0x7ff3a00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/879849314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a00ad200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff39c009870 tx=0x7ff39c01c530 comp rx=0 tx=0).stop 2024-09-12T03:35:15.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 -- 172.21.15.73:0/879849314 shutdown_connections 2024-09-12T03:35:15.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/879849314 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/879849314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a00ad200 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 -- 172.21.15.73:0/879849314 >> 172.21.15.73:0/879849314 conn(0x7ff3a00b1f90 msgr2=0x7ff3a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:15.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 -- 172.21.15.73:0/879849314 shutdown_connections 2024-09-12T03:35:15.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.984+0000 7ff3a84c4640 1 -- 172.21.15.73:0/879849314 wait complete. 2024-09-12T03:35:15.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 Processor -- start 2024-09-12T03:35:15.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 -- start start 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a00af2a0 0x7ff3a0152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a01553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a0155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00af6b0 con 0x7ff3a015bec0 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a00ad740 con 0x7ff3a00af2a0 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a0169000 con 0x7ff3a015c2a0 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a01553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a01553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59040/0 (socket says 172.21.15.73:59040) 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 -- 172.21.15.73:0/4030479600 learned_addr learned my addr 172.21.15.73:0/4030479600 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a6260640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a00af2a0 0x7ff3a0152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a6a61640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a0155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 -- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 msgr2=0x7ff3a0155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a0155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 -- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a00af2a0 msgr2=0x7ff3a0152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a00af2a0 0x7ff3a0152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 -- 172.21.15.73:0/4030479600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a0166170 con 0x7ff3a015bec0 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a6260640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a00af2a0 0x7ff3a0152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a5a5f640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a01553c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c7f0 tx=0x7ff39000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff396ffd640 1 -- 172.21.15.73:0/4030479600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390015070 con 0x7ff3a015bec0 2024-09-12T03:35:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff396ffd640 1 -- 172.21.15.73:0/4030479600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff390007820 con 0x7ff3a015bec0 2024-09-12T03:35:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a0072160 con 0x7ff3a015bec0 2024-09-12T03:35:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff396ffd640 1 -- 172.21.15.73:0/4030479600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390007c10 con 0x7ff3a015bec0 2024-09-12T03:35:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a01f7710 con 0x7ff3a015bec0 2024-09-12T03:35:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a00ad200 con 0x7ff3a015bec0 2024-09-12T03:35:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff396ffd640 1 -- 172.21.15.73:0/4030479600 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff390018070 con 0x7ff3a015bec0 2024-09-12T03:35:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.988+0000 7ff396ffd640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3840678c0 0x7ff384069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:15.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.992+0000 7ff3a6260640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3840678c0 0x7ff384069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:15.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.992+0000 7ff396ffd640 1 -- 172.21.15.73:0/4030479600 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff390085f50 con 0x7ff3a015bec0 2024-09-12T03:35:15.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.992+0000 7ff3a6260640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3840678c0 0x7ff384069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0ae000 tx=0x7ff39c0b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:15.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:15.996+0000 7ff396ffd640 1 -- 172.21.15.73:0/4030479600 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff390056750 con 0x7ff3a015bec0 2024-09-12T03:35:16.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.168+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff3a006fcd0 con 0x7ff3a015bec0 2024-09-12T03:35:16.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff396ffd640 1 -- 172.21.15.73:0/4030479600 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff390056050 con 0x7ff3a015bec0 2024-09-12T03:35:16.175 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:16.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3840678c0 msgr2=0x7ff384069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3840678c0 0x7ff384069d80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0ae000 tx=0x7ff39c0b3040 comp rx=0 tx=0).stop 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 msgr2=0x7ff3a01553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a01553c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff39000c7f0 tx=0x7ff39000ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 shutdown_connections 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3840678c0 0x7ff384069d80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3a015bec0 0x7ff3a01553c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3a015c2a0 0x7ff3a0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 --2- 172.21.15.73:0/4030479600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3a00af2a0 0x7ff3a0152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 >> 172.21.15.73:0/4030479600 conn(0x7ff3a00b1f90 msgr2=0x7ff3a00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 shutdown_connections 2024-09-12T03:35:16.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.172+0000 7ff3a84c4640 1 -- 172.21.15.73:0/4030479600 wait complete. 2024-09-12T03:35:16.194 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:35:16.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:16.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:16.208 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:16.208 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:35:16.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:16.209 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:35:16.257 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:16.257 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:16.264 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:16.264 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:16.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb315de640 1 Processor -- start 2024-09-12T03:35:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb315de640 1 -- start start 2024-09-12T03:35:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb315de640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb315de640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffb2c0b0d30 0x7ffb2c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb315de640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb2c09ae60 con 0x7ffb2c15b170 2024-09-12T03:35:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb315de640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ffb2c0b11e0 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb315de640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2c0ae8b0 con 0x7ffb2c09aa00 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffb2c0b0d30 0x7ffb2c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffb2c0b0d30 0x7ffb2c15ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59042/0 (socket says 172.21.15.73:59042) 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2b7fe640 1 -- 172.21.15.73:0/3274036831 learned_addr learned my addr 172.21.15.73:0/3274036831 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2b7fe640 1 -- 172.21.15.73:0/3274036831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 msgr2=0x7ffb2c0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2a7fc640 1 --2- 172.21.15.73:0/3274036831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2b7fe640 1 --2- 172.21.15.73:0/3274036831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c0b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2b7fe640 1 -- 172.21.15.73:0/3274036831 >> v1:172.21.15.150:6789/0 conn(0x7ffb2c15b170 legacy=0x7ffb2c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.432+0000 7ffb2b7fe640 1 -- 172.21.15.73:0/3274036831 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c0aeb90 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2b7fe640 1 --2- 172.21.15.73:0/3274036831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c15ee20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00bb10 tx=0x7ffb1c01ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24124c3eca4eaddd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb29ffb640 1 -- 172.21.15.73:0/3274036831 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0b4070 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb29ffb640 1 -- 172.21.15.73:0/3274036831 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1c0a7c50 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb29ffb640 1 -- 172.21.15.73:0/3274036831 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0af440 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- 172.21.15.73:0/3274036831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 msgr2=0x7ffb2c15ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 --2- 172.21.15.73:0/3274036831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c15ee20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c00bb10 tx=0x7ffb1c01ebc0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- 172.21.15.73:0/3274036831 shutdown_connections 2024-09-12T03:35:16.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 --2- 172.21.15.73:0/3274036831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c15ee20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 --2- 172.21.15.73:0/3274036831 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c0b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- 172.21.15.73:0/3274036831 >> 172.21.15.73:0/3274036831 conn(0x7ffb2c0b6800 msgr2=0x7ffb2c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:16.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- 172.21.15.73:0/3274036831 shutdown_connections 2024-09-12T03:35:16.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- 172.21.15.73:0/3274036831 wait complete. 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 Processor -- start 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- start start 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb2c15b170 0x7ffb2c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c15b550 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c0b0060 con 0x7ffb2c15b170 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb315de640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2c15b6d0 con 0x7ffb2c09aa00 2024-09-12T03:35:16.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c14f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59052/0 (socket says 172.21.15.73:59052) 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 -- 172.21.15.73:0/642837602 learned_addr learned my addr 172.21.15.73:0/642837602 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 -- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 msgr2=0x7ffb2c148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2b7fe640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb2c15b170 0x7ffb2c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2affd640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 -- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb2c15b170 msgr2=0x7ffb2c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb2c15b170 0x7ffb2c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2a7fc640 1 -- 172.21.15.73:0/642837602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c1557d0 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.436+0000 7ffb2b7fe640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb2c15b170 0x7ffb2c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb2a7fc640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c14f2b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c7f0 tx=0x7ffb1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb237fe640 1 -- 172.21.15.73:0/642837602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14004230 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb237fe640 1 -- 172.21.15.73:0/642837602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140043d0 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2c155ab0 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb237fe640 1 -- 172.21.15.73:0/642837602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb14003860 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2c156070 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2c0b07f0 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb237fe640 1 -- 172.21.15.73:0/642837602 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffb14003c10 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb237fe640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffb100678f0 0x7ffb10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb237fe640 1 -- 172.21.15.73:0/642837602 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffb14086180 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb2affd640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffb100678f0 0x7ffb10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.440+0000 7ffb2affd640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffb100678f0 0x7ffb10069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffb24004450 tx=0x7ffb24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:16.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.444+0000 7ffb237fe640 1 -- 172.21.15.73:0/642837602 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffb14015020 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffb2c06cbb0 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb237fe640 1 -- 172.21.15.73:0/642837602 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ffb14056980 con 0x7ffb2c0b0d30 2024-09-12T03:35:16.616 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:16.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffb100678f0 msgr2=0x7ffb10069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffb100678f0 0x7ffb10069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffb24004450 tx=0x7ffb24009040 comp rx=0 tx=0).stop 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 msgr2=0x7ffb2c14f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c14f2b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ffb1400c7f0 tx=0x7ffb1400ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 shutdown_connections 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffb100678f0 0x7ffb10069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb2c0b0d30 0x7ffb2c14f2b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb2c15b170 0x7ffb2c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 --2- 172.21.15.73:0/642837602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffb2c09aa00 0x7ffb2c148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.612+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 >> 172.21.15.73:0/642837602 conn(0x7ffb2c0b6800 msgr2=0x7ffb2c0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.616+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 shutdown_connections 2024-09-12T03:35:16.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.616+0000 7ffb315de640 1 -- 172.21.15.73:0/642837602 wait complete. 2024-09-12T03:35:16.634 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:16.634 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:16.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:16.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9269c92640 1 Processor -- start 2024-09-12T03:35:16.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9269c92640 1 -- start start 2024-09-12T03:35:16.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9269c92640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f926415bec0 0x7f92640ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9269c92640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92640af470 0x7f926406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9269c92640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92640b3290 con 0x7f926415c2a0 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9269c92640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f92640b3570 con 0x7f92640af470 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9269c92640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f92640b3850 con 0x7f926415bec0 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9263fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92640af470 0x7f926406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9263fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92640af470 0x7f926406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59062/0 (socket says 172.21.15.73:59062) 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9263fff640 1 -- 172.21.15.73:0/1402256928 learned_addr learned my addr 172.21.15.73:0/1402256928 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f92637fe640 1 --2- 172.21.15.73:0/1402256928 >> v2:172.21.15.150:3300/0 conn(0x7f926415bec0 0x7f92640ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9263fff640 1 -- 172.21.15.73:0/1402256928 >> v2:172.21.15.150:3300/0 conn(0x7f926415bec0 msgr2=0x7f92640ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9263fff640 1 --2- 172.21.15.73:0/1402256928 >> v2:172.21.15.150:3300/0 conn(0x7f926415bec0 0x7f92640ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9263fff640 1 -- 172.21.15.73:0/1402256928 >> v1:172.21.15.150:6789/0 conn(0x7f926415c2a0 legacy=0x7f92640aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f9263fff640 1 -- 172.21.15.73:0/1402256928 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92640b3b30 con 0x7f92640af470 2024-09-12T03:35:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.760+0000 7f92637fe640 1 --2- 172.21.15.73:0/1402256928 >> v2:172.21.15.150:3300/0 conn(0x7f926415bec0 0x7f92640ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:16.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9263fff640 1 --2- 172.21.15.73:0/1402256928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92640af470 0x7f926406e000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9264071710 tx=0x7f925c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a12f94e3f109f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:16.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9262ffd640 1 -- 172.21.15.73:0/1402256928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0a5840 con 0x7f92640af470 2024-09-12T03:35:16.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9262ffd640 1 -- 172.21.15.73:0/1402256928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c0a59e0 con 0x7f92640af470 2024-09-12T03:35:16.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9262ffd640 1 -- 172.21.15.73:0/1402256928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0a5db0 con 0x7f92640af470 2024-09-12T03:35:16.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 -- 172.21.15.73:0/1402256928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92640af470 msgr2=0x7f926406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 --2- 172.21.15.73:0/1402256928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92640af470 0x7f926406e000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9264071710 tx=0x7f925c01c980 comp rx=0 tx=0).stop 2024-09-12T03:35:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 -- 172.21.15.73:0/1402256928 shutdown_connections 2024-09-12T03:35:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 --2- 172.21.15.73:0/1402256928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92640af470 0x7f926406e000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 --2- 172.21.15.73:0/1402256928 >> v2:172.21.15.150:3300/0 conn(0x7f926415bec0 0x7f92640ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 -- 172.21.15.73:0/1402256928 >> 172.21.15.73:0/1402256928 conn(0x7f92640b1f90 msgr2=0x7f92640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 -- 172.21.15.73:0/1402256928 shutdown_connections 2024-09-12T03:35:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.764+0000 7f9269c92640 1 -- 172.21.15.73:0/1402256928 wait complete. 2024-09-12T03:35:16.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 Processor -- start 2024-09-12T03:35:16.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 -- start start 2024-09-12T03:35:16.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92640af470 0x7f9264156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f926415bec0 0x7f926414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926415c2a0 0x7f926414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f926406ed50 con 0x7f926415c2a0 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f92640ad740 con 0x7f92640af470 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f926406eed0 con 0x7f926415bec0 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926415c2a0 0x7f926414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926415c2a0 0x7f926414c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59064/0 (socket says 172.21.15.73:59064) 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 -- 172.21.15.73:0/2418178669 learned_addr learned my addr 172.21.15.73:0/2418178669 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f92637fe640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92640af470 0x7f9264156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f925affd640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f926415bec0 0x7f926414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 -- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f926415bec0 msgr2=0x7f926414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f926415bec0 0x7f926414a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 -- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92640af470 msgr2=0x7f9264156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92640af470 0x7f9264156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 -- 172.21.15.73:0/2418178669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264155660 con 0x7f926415c2a0 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9263fff640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926415c2a0 0x7f926414c570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f925c01a5b0 tx=0x7f925c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9260ff9640 1 -- 172.21.15.73:0/2418178669 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0bc020 con 0x7f926415c2a0 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9260ff9640 1 -- 172.21.15.73:0/2418178669 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925c0b8880 con 0x7f926415c2a0 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92641569d0 con 0x7f926415c2a0 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9260ff9640 1 -- 172.21.15.73:0/2418178669 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925c0b8c70 con 0x7f926415c2a0 2024-09-12T03:35:16.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9264154e60 con 0x7f926415c2a0 2024-09-12T03:35:16.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9264156ef0 con 0x7f926415c2a0 2024-09-12T03:35:16.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.768+0000 7f9260ff9640 1 -- 172.21.15.73:0/2418178669 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f925c0bf020 con 0x7f926415c2a0 2024-09-12T03:35:16.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.772+0000 7f9260ff9640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92440678c0 0x7f9244069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:16.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.772+0000 7f9260ff9640 1 -- 172.21.15.73:0/2418178669 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f925c1212a0 con 0x7f926415c2a0 2024-09-12T03:35:16.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.772+0000 7f92637fe640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92440678c0 0x7f9244069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:16.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.772+0000 7f92637fe640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92440678c0 0x7f9244069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f925400a9a0 tx=0x7f9254008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:16.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.776+0000 7f9260ff9640 1 -- 172.21.15.73:0/2418178669 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9264156ef0 con 0x7f926415c2a0 2024-09-12T03:35:16.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f926406f260 con 0x7f926415c2a0 2024-09-12T03:35:16.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9260ff9640 1 -- 172.21.15.73:0/2418178669 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f925c0c6030 con 0x7f926415c2a0 2024-09-12T03:35:16.960 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:16.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92440678c0 msgr2=0x7f9244069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92440678c0 0x7f9244069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f925400a9a0 tx=0x7f9254008040 comp rx=0 tx=0).stop 2024-09-12T03:35:16.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926415c2a0 msgr2=0x7f926414c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:16.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926415c2a0 0x7f926414c570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f925c01a5b0 tx=0x7f925c019720 comp rx=0 tx=0).stop 2024-09-12T03:35:16.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 shutdown_connections 2024-09-12T03:35:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92440678c0 0x7f9244069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f926415c2a0 0x7f926414c570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f926415bec0 0x7f926414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 --2- 172.21.15.73:0/2418178669 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92640af470 0x7f9264156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 >> 172.21.15.73:0/2418178669 conn(0x7f92640b1f90 msgr2=0x7f926414fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 shutdown_connections 2024-09-12T03:35:16.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:16.956+0000 7f9269c92640 1 -- 172.21.15.73:0/2418178669 wait complete. 2024-09-12T03:35:16.979 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:35:16.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:16.979 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:17.007 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:17.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:35:17.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:17.008 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:35:17.062 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:17.063 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:17.070 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:17.070 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:17.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:17.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.280+0000 7f91b4a12640 1 Processor -- start 2024-09-12T03:35:17.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.280+0000 7f91b4a12640 1 -- start start 2024-09-12T03:35:17.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91b4a12640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015bec0 0x7f91b00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91b4a12640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91b015c2a0 0x7f91b00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91b4a12640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f91b00af2a0 0x7f91b015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91b4a12640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f91b00b3290 con 0x7f91b015c2a0 2024-09-12T03:35:17.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91b4a12640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f91b00b3570 con 0x7f91b00af2a0 2024-09-12T03:35:17.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91b4a12640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f91b00b3850 con 0x7f91b015bec0 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91b015c2a0 0x7f91b00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91b015c2a0 0x7f91b00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59072/0 (socket says 172.21.15.73:59072) 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 -- 172.21.15.73:0/821200827 learned_addr learned my addr 172.21.15.73:0/821200827 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91aed9d640 1 --2- 172.21.15.73:0/821200827 >> v2:172.21.15.150:3300/0 conn(0x7f91b00af2a0 0x7f91b015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 -- 172.21.15.73:0/821200827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015bec0 msgr2=0x7f91b00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91ae59c640 1 --2- 172.21.15.73:0/821200827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015bec0 0x7f91b00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 --2- 172.21.15.73:0/821200827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015bec0 0x7f91b00ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 -- 172.21.15.73:0/821200827 >> v2:172.21.15.150:3300/0 conn(0x7f91b00af2a0 msgr2=0x7f91b015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 --2- 172.21.15.73:0/821200827 >> v2:172.21.15.150:3300/0 conn(0x7f91b00af2a0 0x7f91b015fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 -- 172.21.15.73:0/821200827 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b00b3b30 con 0x7f91b015c2a0 2024-09-12T03:35:17.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91aed9d640 1 --2- 172.21.15.73:0/821200827 >> v2:172.21.15.150:3300/0 conn(0x7f91b00af2a0 0x7f91b015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:17.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91add9b640 1 --2- 172.21.15.73:0/821200827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b015c2a0 0x7f91b00aed60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f91b00ada40 tx=0x7f91a401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8b9e82d0799f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:17.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91ad59a640 1 -- 172.21.15.73:0/821200827 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40b0070 con 0x7f91b015c2a0 2024-09-12T03:35:17.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91ad59a640 1 -- 172.21.15.73:0/821200827 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a40ab600 con 0x7f91b015c2a0 2024-09-12T03:35:17.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.284+0000 7f91ad59a640 1 -- 172.21.15.73:0/821200827 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a40ab9d0 con 0x7f91b015c2a0 2024-09-12T03:35:17.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- 172.21.15.73:0/821200827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b015c2a0 msgr2=0x7f91b00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 --2- 172.21.15.73:0/821200827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b015c2a0 0x7f91b00aed60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f91b00ada40 tx=0x7f91a401c230 comp rx=0 tx=0).stop 2024-09-12T03:35:17.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- 172.21.15.73:0/821200827 shutdown_connections 2024-09-12T03:35:17.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 --2- 172.21.15.73:0/821200827 >> v2:172.21.15.150:3300/0 conn(0x7f91b00af2a0 0x7f91b015fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 --2- 172.21.15.73:0/821200827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b015c2a0 0x7f91b00aed60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 --2- 172.21.15.73:0/821200827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015bec0 0x7f91b00ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- 172.21.15.73:0/821200827 >> 172.21.15.73:0/821200827 conn(0x7f91b00b1f90 msgr2=0x7f91b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:17.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- 172.21.15.73:0/821200827 shutdown_connections 2024-09-12T03:35:17.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- 172.21.15.73:0/821200827 wait complete. 2024-09-12T03:35:17.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 Processor -- start 2024-09-12T03:35:17.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- start start 2024-09-12T03:35:17.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b00af2a0 0x7f91b0145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91b015bec0 0x7f91b015e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015c2a0 0x7f91b0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91b00af6b0 con 0x7f91b00af2a0 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91b00ad740 con 0x7f91b015bec0 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f91b006e000 con 0x7f91b015c2a0 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b00af2a0 0x7f91b0145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b00af2a0 0x7f91b0145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59088/0 (socket says 172.21.15.73:59088) 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 -- 172.21.15.73:0/2540313140 learned_addr learned my addr 172.21.15.73:0/2540313140 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91add9b640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91b015bec0 0x7f91b015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91aed9d640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015c2a0 0x7f91b0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 -- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015c2a0 msgr2=0x7f91b0154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015c2a0 0x7f91b0154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 -- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91b015bec0 msgr2=0x7f91b015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91b015bec0 0x7f91b015e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 -- 172.21.15.73:0/2540313140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b015f140 con 0x7f91b00af2a0 2024-09-12T03:35:17.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91ae59c640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b00af2a0 0x7f91b0145610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c7f0 tx=0x7f91a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f919effd640 1 -- 172.21.15.73:0/2540313140 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0015070 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b015f420 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f919effd640 1 -- 172.21.15.73:0/2540313140 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0004240 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f919effd640 1 -- 172.21.15.73:0/2540313140 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0003620 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.288+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b0145b50 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.292+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b00ad200 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.292+0000 7f919effd640 1 -- 172.21.15.73:0/2540313140 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91a00039d0 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.292+0000 7f919effd640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91900678c0 0x7f9190069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.292+0000 7f919effd640 1 -- 172.21.15.73:0/2540313140 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f91a0086020 con 0x7f91b00af2a0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.292+0000 7f91add9b640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91900678c0 0x7f9190069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.292+0000 7f91add9b640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91900678c0 0x7f9190069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91a40ad000 tx=0x7f91a40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:17.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.296+0000 7f919effd640 1 -- 172.21.15.73:0/2540313140 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91a0056830 con 0x7f91b00af2a0 2024-09-12T03:35:17.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.464+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91b006fcd0 con 0x7f91b00af2a0 2024-09-12T03:35:17.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.464+0000 7f919effd640 1 -- 172.21.15.73:0/2540313140 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f91a0056130 con 0x7f91b00af2a0 2024-09-12T03:35:17.470 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:17.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91900678c0 msgr2=0x7f9190069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91900678c0 0x7f9190069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f91a40ad000 tx=0x7f91a40a6000 comp rx=0 tx=0).stop 2024-09-12T03:35:17.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b00af2a0 msgr2=0x7f91b0145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b00af2a0 0x7f91b0145610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c7f0 tx=0x7f91a000ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 shutdown_connections 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91900678c0 0x7f9190069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91b015c2a0 0x7f91b0154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91b015bec0 0x7f91b015e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 --2- 172.21.15.73:0/2540313140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91b00af2a0 0x7f91b0145610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 >> 172.21.15.73:0/2540313140 conn(0x7f91b00b1f90 msgr2=0x7f91b00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 shutdown_connections 2024-09-12T03:35:17.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.468+0000 7f91b4a12640 1 -- 172.21.15.73:0/2540313140 wait complete. 2024-09-12T03:35:17.488 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:17.488 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:17.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:17.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68b7045640 1 Processor -- start 2024-09-12T03:35:17.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68b7045640 1 -- start start 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68b7045640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 0x7f68b006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68b7045640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f68b015f3a0 0x7f68b00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68b7045640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b0070250 con 0x7f68b006fe50 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68b7045640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f68b0152480 con 0x7f68b015f3a0 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68b7045640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f68b00aede0 con 0x7f68b01520a0 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68affff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f68b006fe50 0x7f68b015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54474/0 (socket says 172.21.15.73:54474) 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.652+0000 7f68affff640 1 -- 172.21.15.73:0/3577707432 learned_addr learned my addr 172.21.15.73:0/3577707432 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:17.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b55e2640 1 --2- 172.21.15.73:0/3577707432 >> v2:172.21.15.150:3300/0 conn(0x7f68b015f3a0 0x7f68b00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 0x7f68b006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608021024 0 0) 0x7f68b0070250 con 0x7f68b006fe50 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6898005740 con 0x7f68b006fe50 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3992468136 0 0) 0x7f6898005740 con 0x7f68b006fe50 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 msgr2=0x7f68b006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 0x7f68b006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 >> v2:172.21.15.150:3300/0 conn(0x7f68b015f3a0 msgr2=0x7f68b00adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 --2- 172.21.15.73:0/3577707432 >> v2:172.21.15.150:3300/0 conn(0x7f68b015f3a0 0x7f68b00adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b015fa10 con 0x7f68b006fe50 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f68a4001680 con 0x7f68b006fe50 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 >> v1:172.21.15.73:6789/0 conn(0x7f68b006fe50 legacy=0x7f68b015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6898005bd0 0x7f6898005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6898006a20 0x7f6898006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 0x7f68980073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68b00aede0 con 0x7f6898005bd0 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f689800dbe0 con 0x7f6898006a20 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f689800dd60 con 0x7f68b01520a0 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6898005bd0 0x7f6898005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68affff640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6898006a20 0x7f6898006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b55e2640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 0x7f68980073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b4de1640 1 -- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 msgr2=0x7f68980073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b01520a0 0x7f68980073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b4de1640 1 -- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6898006a20 msgr2=0x7f6898006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6898006a20 0x7f6898006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68b4de1640 1 -- 172.21.15.73:0/3577707432 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6898005740 con 0x7f6898005bd0 2024-09-12T03:35:17.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.656+0000 7f68affff640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6898006a20 0x7f6898006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6898005bd0 0x7f6898005ff0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009ac0 tx=0x7f68a001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beea398a0b29528f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a00b2070 con 0x7f6898005bd0 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a00a5540 con 0x7f6898005bd0 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68af7fe640 1 -- 172.21.15.73:0/3577707432 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0009690 con 0x7f6898005bd0 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- 172.21.15.73:0/3577707432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6898005bd0 msgr2=0x7f6898005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 --2- 172.21.15.73:0/3577707432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6898005bd0 0x7f6898005ff0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68a0009ac0 tx=0x7f68a001ca50 comp rx=0 tx=0).stop 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 -- 172.21.15.73:0/3577707432 reap_dead start 2024-09-12T03:35:17.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- 172.21.15.73:0/3577707432 shutdown_connections 2024-09-12T03:35:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- 172.21.15.73:0/3577707432 >> 172.21.15.73:0/3577707432 conn(0x7f68b00b1f90 msgr2=0x7f68b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- 172.21.15.73:0/3577707432 shutdown_connections 2024-09-12T03:35:17.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- 172.21.15.73:0/3577707432 wait complete. 2024-09-12T03:35:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 Processor -- start 2024-09-12T03:35:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- start start 2024-09-12T03:35:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6898005bd0 0x7f68b014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b01414b0 0x7f68b0141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b00b0810 0x7f68b00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0073d30 con 0x7f68b00b0810 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0073a50 con 0x7f68b01414b0 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f68b006e800 con 0x7f6898005bd0 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b00b0810 0x7f68b00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b00b0810 0x7f68b00b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59114/0 (socket says 172.21.15.73:59114) 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 -- 172.21.15.73:0/3195356664 learned_addr learned my addr 172.21.15.73:0/3195356664 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68affff640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b01414b0 0x7f68b0141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6898005bd0 0x7f68b014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 -- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6898005bd0 msgr2=0x7f68b014f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6898005bd0 0x7f68b014f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 -- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b01414b0 msgr2=0x7f68b0141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b01414b0 0x7f68b0141930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 -- 172.21.15.73:0/3195356664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b0151e50 con 0x7f68b00b0810 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6898005bd0 0x7f68b014f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b55e2640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b00b0810 0x7f68b00b0c90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68b015f780 tx=0x7f68a80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68ad7fa640 1 -- 172.21.15.73:0/3195356664 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8011db0 con 0x7f68b00b0810 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68ad7fa640 1 -- 172.21.15.73:0/3195356664 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a801b070 con 0x7f68b00b0810 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68ad7fa640 1 -- 172.21.15.73:0/3195356664 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a80039a0 con 0x7f68b00b0810 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b00b1420 con 0x7f68b00b0810 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.660+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b013f7a0 con 0x7f68b00b0810 2024-09-12T03:35:17.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.664+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b0142320 con 0x7f68b00b0810 2024-09-12T03:35:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.664+0000 7f68ad7fa640 1 -- 172.21.15.73:0/3195356664 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68a8003b40 con 0x7f68b00b0810 2024-09-12T03:35:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.664+0000 7f68ad7fa640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f689c0678f0 0x7f689c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.664+0000 7f68ad7fa640 1 -- 172.21.15.73:0/3195356664 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f68a8086550 con 0x7f68b00b0810 2024-09-12T03:35:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.664+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f689c0678f0 0x7f689c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:17.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.664+0000 7f68b4de1640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f689c0678f0 0x7f689c069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68a00af000 tx=0x7f68a00046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:17.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.668+0000 7f68ad7fa640 1 -- 172.21.15.73:0/3195356664 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f68a8056de0 con 0x7f68b00b0810 2024-09-12T03:35:17.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.828+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f68b00adc80 con 0x7f68b00b0810 2024-09-12T03:35:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68ad7fa640 1 -- 172.21.15.73:0/3195356664 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f68a80566e0 con 0x7f68b00b0810 2024-09-12T03:35:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f689c0678f0 msgr2=0x7f689c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f689c0678f0 0x7f689c069db0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68a00af000 tx=0x7f68a00046d0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b00b0810 msgr2=0x7f68b00b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b00b0810 0x7f68b00b0c90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f68b015f780 tx=0x7f68a80115a0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 shutdown_connections 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f689c0678f0 0x7f689c069db0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b00b0810 0x7f68b00b0c90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b01414b0 0x7f68b0141930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 --2- 172.21.15.73:0/3195356664 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6898005bd0 0x7f68b014f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 >> 172.21.15.73:0/3195356664 conn(0x7f68b00b1f90 msgr2=0x7f68b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 shutdown_connections 2024-09-12T03:35:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:17.832+0000 7f68b7045640 1 -- 172.21.15.73:0/3195356664 wait complete. 2024-09-12T03:35:17.853 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:35:17.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:17.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-12T03:35:17.865 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:17.866 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:35:17.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:17.866 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T03:35:17.911 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:17.911 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:17.918 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:17.918 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:17.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:18.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d5b448640 1 Processor -- start 2024-09-12T03:35:18.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d5b448640 1 -- start start 2024-09-12T03:35:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d5b448640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 0x7f4d540cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d5b448640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4d540cf450 0x7f4d5406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d5b448640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d540d0300 con 0x7f4d54161a60 2024-09-12T03:35:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d5b448640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f4d540b0f60 con 0x7f4d540cf450 2024-09-12T03:35:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d5b448640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540cfd40 con 0x7f4d540d3060 2024-09-12T03:35:18.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d591e4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4d54161a60 0x7f4d540d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54482/0 (socket says 172.21.15.73:54482) 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.084+0000 7f4d591e4640 1 -- 172.21.15.73:0/992947739 learned_addr learned my addr 172.21.15.73:0/992947739 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d589e3640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 0x7f4d540cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d599e5640 1 --2- 172.21.15.73:0/992947739 >> v2:172.21.15.150:3300/0 conn(0x7f4d540cf450 0x7f4d5406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508654321 0 0) 0x7f4d4c0014a0 con 0x7f4d54161a60 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d40003530 con 0x7f4d54161a60 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 306964538 0 0) 0x7f4d40003530 con 0x7f4d54161a60 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 msgr2=0x7f4d540cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 0x7f4d540cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 >> v2:172.21.15.150:3300/0 conn(0x7f4d540cf450 msgr2=0x7f4d5406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 --2- 172.21.15.73:0/992947739 >> v2:172.21.15.150:3300/0 conn(0x7f4d540cf450 0x7f4d5406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d540d0020 con 0x7f4d54161a60 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f4d4c001bd0 con 0x7f4d54161a60 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 >> v1:172.21.15.73:6789/0 conn(0x7f4d54161a60 legacy=0x7f4d540d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d40004810 0x7f4d40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 0x7f4d400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540b0f60 con 0x7f4d400039c0 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540cfd40 con 0x7f4d40004810 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4000b9d0 con 0x7f4d540d3060 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d591e4640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d589e3640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d40004810 0x7f4d40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d599e5640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 0x7f4d400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d591e4640 1 -- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 msgr2=0x7f4d400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d591e4640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540d3060 0x7f4d400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d591e4640 1 -- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d40004810 msgr2=0x7f4d40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d591e4640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d40004810 0x7f4d40004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d591e4640 1 -- 172.21.15.73:0/992947739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d40003530 con 0x7f4d400039c0 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d589e3640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d40004810 0x7f4d40004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d591e4640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d40003de0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00aaa0 tx=0x7f4d4c01d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4461b49543a7becf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00a690 con 0x7f4d400039c0 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c0072d0 con 0x7f4d400039c0 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d4bfff640 1 -- 172.21.15.73:0/992947739 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c007700 con 0x7f4d400039c0 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d5b448640 1 -- 172.21.15.73:0/992947739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 msgr2=0x7f4d40003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d5b448640 1 --2- 172.21.15.73:0/992947739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d40003de0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00aaa0 tx=0x7f4d4c01d370 comp rx=0 tx=0).stop 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.088+0000 7f4d599e5640 1 -- 172.21.15.73:0/992947739 reap_dead start 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- 172.21.15.73:0/992947739 shutdown_connections 2024-09-12T03:35:18.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- 172.21.15.73:0/992947739 >> 172.21.15.73:0/992947739 conn(0x7f4d5408bf90 msgr2=0x7f4d5409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:18.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- 172.21.15.73:0/992947739 shutdown_connections 2024-09-12T03:35:18.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- 172.21.15.73:0/992947739 wait complete. 2024-09-12T03:35:18.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 Processor -- start 2024-09-12T03:35:18.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- start start 2024-09-12T03:35:18.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d54160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540b71a0 0x7f4d54167f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d540b7620 0x7f4d54168450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54168f10 con 0x7f4d400039c0 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5406e610 con 0x7f4d540b7620 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4d54169090 con 0x7f4d540b71a0 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d54160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d54160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59122/0 (socket says 172.21.15.73:59122) 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 -- 172.21.15.73:0/1666749637 learned_addr learned my addr 172.21.15.73:0/1666749637 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d599e5640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d540b7620 0x7f4d54168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d589e3640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540b71a0 0x7f4d54167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 -- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540b71a0 msgr2=0x7f4d54167f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540b71a0 0x7f4d54167f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 -- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d540b7620 msgr2=0x7f4d54168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d540b7620 0x7f4d54168450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 -- 172.21.15.73:0/1666749637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d540d2e60 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d591e4640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d54160730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00aaa0 tx=0x7f4d40005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d49ffb640 1 -- 172.21.15.73:0/1666749637 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0014a0 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d49ffb640 1 -- 172.21.15.73:0/1666749637 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c0bc070 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d540b9040 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d49ffb640 1 -- 172.21.15.73:0/1666749637 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c001bb0 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.092+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d540b9600 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.096+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5406d6b0 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.096+0000 7f4d49ffb640 1 -- 172.21.15.73:0/1666749637 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d4c0b5070 con 0x7f4d400039c0 2024-09-12T03:35:18.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.096+0000 7f4d49ffb640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4d380678f0 0x7f4d38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.096+0000 7f4d49ffb640 1 -- 172.21.15.73:0/1666749637 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4d4c1206c0 con 0x7f4d400039c0 2024-09-12T03:35:18.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.096+0000 7f4d589e3640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4d380678f0 0x7f4d38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.096+0000 7f4d589e3640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4d380678f0 0x7f4d38069db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d54168ad0 tx=0x7f4d44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.100+0000 7f4d49ffb640 1 -- 172.21.15.73:0/1666749637 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4d540d0300 con 0x7f4d400039c0 2024-09-12T03:35:18.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.272+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4d5406bcc0 con 0x7f4d400039c0 2024-09-12T03:35:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.272+0000 7f4d49ffb640 1 -- 172.21.15.73:0/1666749637 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f4d4c0f0ff0 con 0x7f4d400039c0 2024-09-12T03:35:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4d380678f0 msgr2=0x7f4d38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4d380678f0 0x7f4d38069db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4d54168ad0 tx=0x7f4d44008040 comp rx=0 tx=0).stop 2024-09-12T03:35:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 msgr2=0x7f4d54160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d54160730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00aaa0 tx=0x7f4d40005840 comp rx=0 tx=0).stop 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 shutdown_connections 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4d380678f0 0x7f4d38069db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d540b7620 0x7f4d54168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4d540b71a0 0x7f4d54167f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 --2- 172.21.15.73:0/1666749637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d400039c0 0x7f4d54160730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 >> 172.21.15.73:0/1666749637 conn(0x7f4d5408bf90 msgr2=0x7f4d540d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 shutdown_connections 2024-09-12T03:35:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.276+0000 7f4d5b448640 1 -- 172.21.15.73:0/1666749637 wait complete. 2024-09-12T03:35:18.297 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:18.297 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:18.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:18.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff00e1ae640 1 Processor -- start 2024-09-12T03:35:18.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff00e1ae640 1 -- start start 2024-09-12T03:35:18.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff00e1ae640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0080d3060 0x7ff0080cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff00e1ae640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff0080cf450 0x7ff00806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff00e1ae640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0080d0300 con 0x7ff008161a60 2024-09-12T03:35:18.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff00e1ae640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff0080b0f60 con 0x7ff0080d3060 2024-09-12T03:35:18.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff00e1ae640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff0080cfd40 con 0x7ff0080cf450 2024-09-12T03:35:18.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff006ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0080d3060 0x7ff0080cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff006ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0080d3060 0x7ff0080cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59134/0 (socket says 172.21.15.73:59134) 2024-09-12T03:35:18.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff006ffd640 1 -- 172.21.15.73:0/93727994 learned_addr learned my addr 172.21.15.73:0/93727994 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:18.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff007fff640 1 --2- 172.21.15.73:0/93727994 >> v2:172.21.15.150:3300/0 conn(0x7ff0080cf450 0x7ff00806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff006ffd640 1 -- 172.21.15.73:0/93727994 >> v2:172.21.15.150:3300/0 conn(0x7ff0080cf450 msgr2=0x7ff00806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff006ffd640 1 --2- 172.21.15.73:0/93727994 >> v2:172.21.15.150:3300/0 conn(0x7ff0080cf450 0x7ff00806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff006ffd640 1 -- 172.21.15.73:0/93727994 >> v1:172.21.15.150:6789/0 conn(0x7ff008161a60 legacy=0x7ff0080d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.424+0000 7ff006ffd640 1 -- 172.21.15.73:0/93727994 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0080d0020 con 0x7ff0080d3060 2024-09-12T03:35:18.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff006ffd640 1 --2- 172.21.15.73:0/93727994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080cef10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0080ce950 tx=0x7feffc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2767a66dee211184 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff0067fc640 1 -- 172.21.15.73:0/93727994 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0b0070 con 0x7ff0080d3060 2024-09-12T03:35:18.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff0067fc640 1 -- 172.21.15.73:0/93727994 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc0ab600 con 0x7ff0080d3060 2024-09-12T03:35:18.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff0067fc640 1 -- 172.21.15.73:0/93727994 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0ab9d0 con 0x7ff0080d3060 2024-09-12T03:35:18.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 -- 172.21.15.73:0/93727994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 msgr2=0x7ff0080cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/93727994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080cef10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff0080ce950 tx=0x7feffc01c240 comp rx=0 tx=0).stop 2024-09-12T03:35:18.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 -- 172.21.15.73:0/93727994 shutdown_connections 2024-09-12T03:35:18.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/93727994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080cef10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/93727994 >> v2:172.21.15.150:3300/0 conn(0x7ff0080cf450 0x7ff00806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 -- 172.21.15.73:0/93727994 >> 172.21.15.73:0/93727994 conn(0x7ff00808bf90 msgr2=0x7ff00809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:18.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 -- 172.21.15.73:0/93727994 shutdown_connections 2024-09-12T03:35:18.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 -- 172.21.15.73:0/93727994 wait complete. 2024-09-12T03:35:18.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 Processor -- start 2024-09-12T03:35:18.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.428+0000 7ff00e1ae640 1 -- start start 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0080cf450 0x7ff0080cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff008161a60 0x7ff0080b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff00816af20 con 0x7ff0080d3060 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff00806e650 con 0x7ff008161a60 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff00816b0a0 con 0x7ff0080cf450 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59138/0 (socket says 172.21.15.73:59138) 2024-09-12T03:35:18.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 -- 172.21.15.73:0/2801642058 learned_addr learned my addr 172.21.15.73:0/2801642058 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff007fff640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff008161a60 0x7ff0080b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff0077fe640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0080cf450 0x7ff0080cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 -- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0080cf450 msgr2=0x7ff0080cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0080cf450 0x7ff0080cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 -- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff008161a60 msgr2=0x7ff0080b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff008161a60 0x7ff0080b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 -- 172.21.15.73:0/2801642058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0080b9c00 con 0x7ff0080d3060 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff006ffd640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080b7bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feffc0ae040 tx=0x7feffc01aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7fefeffff640 1 -- 172.21.15.73:0/2801642058 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0ba020 con 0x7ff0080d3060 2024-09-12T03:35:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7fefeffff640 1 -- 172.21.15.73:0/2801642058 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc0b6640 con 0x7ff0080d3060 2024-09-12T03:35:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0080b9ee0 con 0x7ff0080d3060 2024-09-12T03:35:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7fefeffff640 1 -- 172.21.15.73:0/2801642058 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0b0040 con 0x7ff0080d3060 2024-09-12T03:35:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0080cb4e0 con 0x7ff0080d3060 2024-09-12T03:35:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00806d6b0 con 0x7ff0080d3060 2024-09-12T03:35:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7fefeffff640 1 -- 172.21.15.73:0/2801642058 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feffc0bd020 con 0x7ff0080d3060 2024-09-12T03:35:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7fefeffff640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feff40678c0 0x7feff4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff0077fe640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feff40678c0 0x7feff4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7fefeffff640 1 -- 172.21.15.73:0/2801642058 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feffc120110 con 0x7ff0080d3060 2024-09-12T03:35:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.432+0000 7ff0077fe640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feff40678c0 0x7feff4069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feff8004e30 tx=0x7feff8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.436+0000 7fefeffff640 1 -- 172.21.15.73:0/2801642058 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feffc0c4030 con 0x7ff0080d3060 2024-09-12T03:35:18.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.612+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0080c77f0 con 0x7ff0080d3060 2024-09-12T03:35:18.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.612+0000 7fefeffff640 1 -- 172.21.15.73:0/2801642058 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7ff0080d0300 con 0x7ff0080d3060 2024-09-12T03:35:18.618 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feff40678c0 msgr2=0x7feff4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feff40678c0 0x7feff4069d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feff8004e30 tx=0x7feff8009040 comp rx=0 tx=0).stop 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 msgr2=0x7ff0080b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080b7bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feffc0ae040 tx=0x7feffc01aa80 comp rx=0 tx=0).stop 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 shutdown_connections 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feff40678c0 0x7feff4069d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0080d3060 0x7ff0080b7bb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff008161a60 0x7ff0080b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 --2- 172.21.15.73:0/2801642058 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff0080cf450 0x7ff0080cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 >> 172.21.15.73:0/2801642058 conn(0x7ff00808bf90 msgr2=0x7ff008159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:18.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 shutdown_connections 2024-09-12T03:35:18.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.616+0000 7ff00e1ae640 1 -- 172.21.15.73:0/2801642058 wait complete. 2024-09-12T03:35:18.637 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:35:18.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:18.637 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-12T03:35:18.651 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:18.651 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:35:18.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:18.652 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T03:35:18.699 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T03:35:18.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f207d4aa640 1 Processor -- start 2024-09-12T03:35:18.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f207d4aa640 1 -- start start 2024-09-12T03:35:18.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f207d4aa640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f207815c2a0 0x7f20780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f207d4aa640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20780b3290 con 0x7f207815bec0 2024-09-12T03:35:18.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f207d4aa640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20780b3570 con 0x7f20780af2a0 2024-09-12T03:35:18.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f207d4aa640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f20780b3850 con 0x7f207815c2a0 2024-09-12T03:35:18.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f207815bec0 0x7f20780ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54484/0 (socket says 172.21.15.73:54484) 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 -- 172.21.15.73:0/2384461304 learned_addr learned my addr 172.21.15.73:0/2384461304 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f206e7fc640 1 --2- 172.21.15.73:0/2384461304 >> v2:172.21.15.150:3300/0 conn(0x7f207815c2a0 0x7f20780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579213614 0 0) 0x7f20780b3290 con 0x7f207815bec0 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2064003530 con 0x7f207815bec0 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 118087002 0 0) 0x7f2064003530 con 0x7f207815bec0 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 >> v2:172.21.15.150:3300/0 conn(0x7f207815c2a0 msgr2=0x7f20780aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 --2- 172.21.15.73:0/2384461304 >> v2:172.21.15.150:3300/0 conn(0x7f207815c2a0 0x7f20780aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 >> v1:172.21.15.150:6789/0 conn(0x7f20780af2a0 legacy=0x7f207806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20780b3b30 con 0x7f207815bec0 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f2068001680 con 0x7f207815bec0 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 >> v1:172.21.15.73:6789/0 conn(0x7f207815bec0 legacy=0x7f20780ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20640039c0 0x7f2064003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2064004810 0x7f2064004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20640051d0 0x7f206400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f20780b3850 con 0x7f20640039c0 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f206400c070 con 0x7f2064004810 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f206400c270 con 0x7f20640051d0 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20640039c0 0x7f2064003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 -- 172.21.15.73:0/2384461304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20640051d0 msgr2=0x7f206400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20640051d0 0x7f206400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 -- 172.21.15.73:0/2384461304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2064004810 msgr2=0x7f2064004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:18.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2064004810 0x7f2064004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f2076ffd640 1 -- 172.21.15.73:0/2384461304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2064003530 con 0x7f20640039c0 2024-09-12T03:35:18.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.820+0000 7f20777fe640 1 -- 172.21.15.73:0/2384461304 reap_dead start 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f2076ffd640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20640039c0 0x7f2064003de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f206800c1c0 tx=0x7f206801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2890f3bbe6a05541 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068007d00 con 0x7f20640039c0 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20680a9020 con 0x7f20640039c0 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f20767fc640 1 -- 172.21.15.73:0/2384461304 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2068005b20 con 0x7f20640039c0 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- 172.21.15.73:0/2384461304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20640039c0 msgr2=0x7f2064003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20640039c0 0x7f2064003de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f206800c1c0 tx=0x7f206801cc30 comp rx=0 tx=0).stop 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- 172.21.15.73:0/2384461304 shutdown_connections 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 --2- 172.21.15.73:0/2384461304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20640039c0 0x7f2064003de0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- 172.21.15.73:0/2384461304 >> 172.21.15.73:0/2384461304 conn(0x7f20780b1f90 msgr2=0x7f20780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:18.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- 172.21.15.73:0/2384461304 shutdown_connections 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- 172.21.15.73:0/2384461304 wait complete. 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 Processor -- start 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- start start 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20640039c0 0x7f20781f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f207809cd20 0x7f207815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2078149a00 0x7f207815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f20780af680 con 0x7f207809cd20 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f20780ad610 con 0x7f20640039c0 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f207d4aa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f207809e2e0 con 0x7f2078149a00 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f207809cd20 0x7f207815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f207809cd20 0x7f207815a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59150/0 (socket says 172.21.15.73:59150) 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 -- 172.21.15.73:0/1200122382 learned_addr learned my addr 172.21.15.73:0/1200122382 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f2076ffd640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20640039c0 0x7f20781f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f20777fe640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2078149a00 0x7f207815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 -- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2078149a00 msgr2=0x7f207815a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2078149a00 0x7f207815a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 -- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20640039c0 msgr2=0x7f20781f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20640039c0 0x7f20781f87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.824+0000 7f206e7fc640 1 -- 172.21.15.73:0/1200122382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207809d240 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f206e7fc640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f207809cd20 0x7f207815a3d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f206000e7f0 tx=0x7f206000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f206ffff640 1 -- 172.21.15.73:0/1200122382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2060017070 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f206ffff640 1 -- 172.21.15.73:0/1200122382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206000c8e0 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207809d520 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f206ffff640 1 -- 172.21.15.73:0/1200122382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206000ccb0 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f207809dae0 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2078160470 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f206ffff640 1 -- 172.21.15.73:0/1200122382 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f206001a070 con 0x7f207809cd20 2024-09-12T03:35:18.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f206ffff640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20580678f0 0x7f2058069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f2076ffd640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20580678f0 0x7f2058069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f206ffff640 1 -- 172.21.15.73:0/1200122382 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f20600860f0 con 0x7f207809cd20 2024-09-12T03:35:18.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.828+0000 7f2076ffd640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20580678f0 0x7f2058069db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20680aa000 tx=0x7f20780b3460 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:18.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:18.832+0000 7f206ffff640 1 -- 172.21.15.73:0/1200122382 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2060056980 con 0x7f207809cd20 2024-09-12T03:35:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.032+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f207806fcd0 con 0x7f207809cd20 2024-09-12T03:35:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.032+0000 7f206ffff640 1 -- 172.21.15.73:0/1200122382 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f2060056280 con 0x7f207809cd20 2024-09-12T03:35:19.036 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:19.037 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:35:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.032+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20580678f0 msgr2=0x7f2058069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.032+0000 7f207d4aa640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20580678f0 0x7f2058069db0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20680aa000 tx=0x7f20780b3460 comp rx=0 tx=0).stop 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.032+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f207809cd20 msgr2=0x7f207815a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.032+0000 7f207d4aa640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f207809cd20 0x7f207815a3d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f206000e7f0 tx=0x7f206000ecb0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.032+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 shutdown_connections 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.036+0000 7f207d4aa640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20580678f0 0x7f2058069db0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f20680aa000 tx=0x7f20780b3460 comp rx=0 tx=0).stop 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.036+0000 7f207d4aa640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f207809cd20 0x7f207815a3d0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f206000e7f0 tx=0x7f206000ecb0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.036+0000 7f207d4aa640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2078149a00 0x7f207815a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.036+0000 7f207d4aa640 1 --2- 172.21.15.73:0/1200122382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20640039c0 0x7f20781f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.036+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 >> 172.21.15.73:0/1200122382 conn(0x7f20780b1f90 msgr2=0x7f20780b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.036+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 shutdown_connections 2024-09-12T03:35:19.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.036+0000 7f207d4aa640 1 -- 172.21.15.73:0/1200122382 wait complete. 2024-09-12T03:35:19.056 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.172+0000 7f4230d84640 1 Processor -- start 2024-09-12T03:35:19.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.172+0000 7f4230d84640 1 -- start start 2024-09-12T03:35:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f4230d84640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f422c15bec0 0x7f422c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f4230d84640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f422c0af470 0x7f422c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f4230d84640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f422c0b3290 con 0x7f422c15c2a0 2024-09-12T03:35:19.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f4230d84640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f422c0b3570 con 0x7f422c15bec0 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f4230d84640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f422c0b3850 con 0x7f422c0af470 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f422c15bec0 0x7f422c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f422c15bec0 0x7f422c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59160/0 (socket says 172.21.15.73:59160) 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422a59c640 1 -- 172.21.15.73:0/2122701818 learned_addr learned my addr 172.21.15.73:0/2122701818 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422ad9d640 1 --2- 172.21.15.73:0/2122701818 >> v2:172.21.15.150:3300/0 conn(0x7f422c0af470 0x7f422c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422a59c640 1 -- 172.21.15.73:0/2122701818 >> v2:172.21.15.150:3300/0 conn(0x7f422c0af470 msgr2=0x7f422c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422a59c640 1 --2- 172.21.15.73:0/2122701818 >> v2:172.21.15.150:3300/0 conn(0x7f422c0af470 0x7f422c06e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422a59c640 1 -- 172.21.15.73:0/2122701818 >> v1:172.21.15.150:6789/0 conn(0x7f422c15c2a0 legacy=0x7f422c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:19.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.176+0000 7f422a59c640 1 -- 172.21.15.73:0/2122701818 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422c0b3b30 con 0x7f422c15bec0 2024-09-12T03:35:19.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422a59c640 1 --2- 172.21.15.73:0/2122701818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15bec0 0x7f422c0ad200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f422c0b2fb0 tx=0x7f421c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ec82323f01456a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422959a640 1 -- 172.21.15.73:0/2122701818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c0b1070 con 0x7f422c15bec0 2024-09-12T03:35:19.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422959a640 1 -- 172.21.15.73:0/2122701818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c0ac620 con 0x7f422c15bec0 2024-09-12T03:35:19.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422959a640 1 -- 172.21.15.73:0/2122701818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c0ac9f0 con 0x7f422c15bec0 2024-09-12T03:35:19.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- 172.21.15.73:0/2122701818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15bec0 msgr2=0x7f422c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 --2- 172.21.15.73:0/2122701818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15bec0 0x7f422c0ad200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f422c0b2fb0 tx=0x7f421c01c4b0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- 172.21.15.73:0/2122701818 shutdown_connections 2024-09-12T03:35:19.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 --2- 172.21.15.73:0/2122701818 >> v2:172.21.15.150:3300/0 conn(0x7f422c0af470 0x7f422c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 --2- 172.21.15.73:0/2122701818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15bec0 0x7f422c0ad200 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- 172.21.15.73:0/2122701818 >> 172.21.15.73:0/2122701818 conn(0x7f422c0b1f90 msgr2=0x7f422c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:19.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- 172.21.15.73:0/2122701818 shutdown_connections 2024-09-12T03:35:19.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- 172.21.15.73:0/2122701818 wait complete. 2024-09-12T03:35:19.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 Processor -- start 2024-09-12T03:35:19.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- start start 2024-09-12T03:35:19.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f422c0af470 0x7f422c1496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f422c15bec0 0x7f422c09ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15c2a0 0x7f422c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f422c06ed50 con 0x7f422c15c2a0 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f422c0ad740 con 0x7f422c15bec0 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4230d84640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f422c06eed0 con 0x7f422c0af470 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15c2a0 0x7f422c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15c2a0 0x7f422c157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59174/0 (socket says 172.21.15.73:59174) 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422ad9d640 1 -- 172.21.15.73:0/3822076269 learned_addr learned my addr 172.21.15.73:0/3822076269 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422a59c640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f422c0af470 0x7f422c1496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f4229d9b640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f422c15bec0 0x7f422c09ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.180+0000 7f422ad9d640 1 -- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f422c0af470 msgr2=0x7f422c1496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f422ad9d640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f422c0af470 0x7f422c1496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f422ad9d640 1 -- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f422c15bec0 msgr2=0x7f422c09ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f422ad9d640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f422c15bec0 0x7f422c09ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f422ad9d640 1 -- 172.21.15.73:0/3822076269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422c09d330 con 0x7f422c15c2a0 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4229d9b640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f422c15bec0 0x7f422c09ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f422ad9d640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15c2a0 0x7f422c157380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f422400cda0 tx=0x7f422400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4222ffd640 1 -- 172.21.15.73:0/3822076269 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224003ba0 con 0x7f422c15c2a0 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4222ffd640 1 -- 172.21.15.73:0/3822076269 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4224003d40 con 0x7f422c15c2a0 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4222ffd640 1 -- 172.21.15.73:0/3822076269 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224004240 con 0x7f422c15c2a0 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422c09d5a0 con 0x7f422c15c2a0 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f422c09db60 con 0x7f422c15c2a0 2024-09-12T03:35:19.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f422c06e000 con 0x7f422c15c2a0 2024-09-12T03:35:19.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4222ffd640 1 -- 172.21.15.73:0/3822076269 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42240043e0 con 0x7f422c15c2a0 2024-09-12T03:35:19.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4222ffd640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f420c0678f0 0x7f420c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f4222ffd640 1 -- 172.21.15.73:0/3822076269 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4224086b30 con 0x7f422c15c2a0 2024-09-12T03:35:19.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f422a59c640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f420c0678f0 0x7f420c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.184+0000 7f422a59c640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f420c0678f0 0x7f420c069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f421c0ae000 tx=0x7f421c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.188+0000 7f4222ffd640 1 -- 172.21.15.73:0/3822076269 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42240572a0 con 0x7f422c15c2a0 2024-09-12T03:35:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.368+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f422c06fcd0 con 0x7f422c15c2a0 2024-09-12T03:35:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.368+0000 7f4222ffd640 1 -- 172.21.15.73:0/3822076269 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f4224056ba0 con 0x7f422c15c2a0 2024-09-12T03:35:19.374 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:19.375 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:35:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f420c0678f0 msgr2=0x7f420c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f420c0678f0 0x7f420c069db0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f421c0ae000 tx=0x7f421c008040 comp rx=0 tx=0).stop 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15c2a0 msgr2=0x7f422c157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15c2a0 0x7f422c157380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f422400cda0 tx=0x7f422400a660 comp rx=0 tx=0).stop 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 shutdown_connections 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f420c0678f0 0x7f420c069db0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f422c15c2a0 0x7f422c157380 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f422c15bec0 0x7f422c09ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 --2- 172.21.15.73:0/3822076269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f422c0af470 0x7f422c1496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 >> 172.21.15.73:0/3822076269 conn(0x7f422c0b1f90 msgr2=0x7f422c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 shutdown_connections 2024-09-12T03:35:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.372+0000 7f4230d84640 1 -- 172.21.15.73:0/3822076269 wait complete. 2024-09-12T03:35:19.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.500+0000 7fa175959640 1 Processor -- start 2024-09-12T03:35:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa175959640 1 -- start start 2024-09-12T03:35:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa175959640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa1701520a0 0x7fa17006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa175959640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa17015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa175959640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa17015f1d0 0x7fa170071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa175959640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa170152480 con 0x7fa17015f1d0 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa175959640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa170070250 con 0x7fa1701520a0 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa175959640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa1700aede0 con 0x7fa17006fe50 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa17015f1d0 0x7fa170071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa17015f1d0 0x7fa170071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59188/0 (socket says 172.21.15.73:59188) 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 -- 172.21.15.73:0/2931264629 learned_addr learned my addr 172.21.15.73:0/2931264629 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16effd640 1 --2- 172.21.15.73:0/2931264629 >> v2:172.21.15.150:3300/0 conn(0x7fa1701520a0 0x7fa17006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16e7fc640 1 --2- 172.21.15.73:0/2931264629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa17015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 -- 172.21.15.73:0/2931264629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 msgr2=0x7fa17015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 --2- 172.21.15.73:0/2931264629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa17015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 -- 172.21.15.73:0/2931264629 >> v2:172.21.15.150:3300/0 conn(0x7fa1701520a0 msgr2=0x7fa17006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 --2- 172.21.15.73:0/2931264629 >> v2:172.21.15.150:3300/0 conn(0x7fa1701520a0 0x7fa17006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.504+0000 7fa16f7fe640 1 -- 172.21.15.73:0/2931264629 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17015fa10 con 0x7fa17015f1d0 2024-09-12T03:35:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16f7fe640 1 --2- 172.21.15.73:0/2931264629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17015f1d0 0x7fa170071f10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa170071710 tx=0x7fa16801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79803584ba744c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16dffb640 1 -- 172.21.15.73:0/2931264629 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1680a5590 con 0x7fa17015f1d0 2024-09-12T03:35:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16dffb640 1 -- 172.21.15.73:0/2931264629 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1680a5730 con 0x7fa17015f1d0 2024-09-12T03:35:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16dffb640 1 -- 172.21.15.73:0/2931264629 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1680a5b00 con 0x7fa17015f1d0 2024-09-12T03:35:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- 172.21.15.73:0/2931264629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17015f1d0 msgr2=0x7fa170071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 --2- 172.21.15.73:0/2931264629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17015f1d0 0x7fa170071f10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa170071710 tx=0x7fa16801c710 comp rx=0 tx=0).stop 2024-09-12T03:35:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- 172.21.15.73:0/2931264629 shutdown_connections 2024-09-12T03:35:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 --2- 172.21.15.73:0/2931264629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa17015f1d0 0x7fa170071f10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 --2- 172.21.15.73:0/2931264629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa17015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 --2- 172.21.15.73:0/2931264629 >> v2:172.21.15.150:3300/0 conn(0x7fa1701520a0 0x7fa17006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- 172.21.15.73:0/2931264629 >> 172.21.15.73:0/2931264629 conn(0x7fa1700b1f90 msgr2=0x7fa1700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- 172.21.15.73:0/2931264629 shutdown_connections 2024-09-12T03:35:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- 172.21.15.73:0/2931264629 wait complete. 2024-09-12T03:35:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 Processor -- start 2024-09-12T03:35:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- start start 2024-09-12T03:35:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa1701464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1701520a0 0x7fa170149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa17015f1d0 0x7fa1701486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa170073d30 con 0x7fa1701520a0 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa170073a50 con 0x7fa17015f1d0 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa175959640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa17015f680 con 0x7fa17006fe50 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1701520a0 0x7fa170149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1701520a0 0x7fa170149900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59194/0 (socket says 172.21.15.73:59194) 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16e7fc640 1 -- 172.21.15.73:0/405154485 learned_addr learned my addr 172.21.15.73:0/405154485 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16effd640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa1701464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16f7fe640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa17015f1d0 0x7fa1701486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16e7fc640 1 -- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 msgr2=0x7fa1701464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16e7fc640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa1701464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16e7fc640 1 -- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa17015f1d0 msgr2=0x7fa1701486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.508+0000 7fa16e7fc640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa17015f1d0 0x7fa1701486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa16e7fc640 1 -- 172.21.15.73:0/405154485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17014a070 con 0x7fa1701520a0 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa16effd640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa1701464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa16e7fc640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1701520a0 0x7fa170149900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa16400d5f0 tx=0x7fa16400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa157fff640 1 -- 172.21.15.73:0/405154485 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164018020 con 0x7fa1701520a0 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa157fff640 1 -- 172.21.15.73:0/405154485 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa164014620 con 0x7fa1701520a0 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17014a350 con 0x7fa1701520a0 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa157fff640 1 -- 172.21.15.73:0/405154485 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164014a10 con 0x7fa1701520a0 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17014a910 con 0x7fa1701520a0 2024-09-12T03:35:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17006e540 con 0x7fa1701520a0 2024-09-12T03:35:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa157fff640 1 -- 172.21.15.73:0/405154485 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa16401b020 con 0x7fa1701520a0 2024-09-12T03:35:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa157fff640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa15c0678c0 0x7fa15c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa157fff640 1 -- 172.21.15.73:0/405154485 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa164086180 con 0x7fa1701520a0 2024-09-12T03:35:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa16effd640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa15c0678c0 0x7fa15c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.512+0000 7fa16effd640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa15c0678c0 0x7fa15c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1701495e0 tx=0x7fa160008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.516+0000 7fa157fff640 1 -- 172.21.15.73:0/405154485 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa164022030 con 0x7fa1701520a0 2024-09-12T03:35:19.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.676+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1700b3330 con 0x7fa1701520a0 2024-09-12T03:35:19.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa157fff640 1 -- 172.21.15.73:0/405154485 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18610 (secure 0 0 0) 0x7fa164024300 con 0x7fa1701520a0 2024-09-12T03:35:19.683 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:19.683 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:34:43.468704+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa15c0678c0 msgr2=0x7fa15c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa15c0678c0 0x7fa15c069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa1701495e0 tx=0x7fa160008040 comp rx=0 tx=0).stop 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1701520a0 msgr2=0x7fa170149900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1701520a0 0x7fa170149900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa16400d5f0 tx=0x7fa16400dab0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 shutdown_connections 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa15c0678c0 0x7fa15c069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1701520a0 0x7fa170149900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa17015f1d0 0x7fa1701486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 --2- 172.21.15.73:0/405154485 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa17006fe50 0x7fa1701464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 >> 172.21.15.73:0/405154485 conn(0x7fa1700b1f90 msgr2=0x7fa17015c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 shutdown_connections 2024-09-12T03:35:19.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.680+0000 7fa175959640 1 -- 172.21.15.73:0/405154485 wait complete. 2024-09-12T03:35:19.701 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:35:19.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe26383640 1 Processor -- start 2024-09-12T03:35:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe26383640 1 -- start start 2024-09-12T03:35:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe26383640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 0x7fbe200cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe26383640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe200cdca0 con 0x7fbe200d0080 2024-09-12T03:35:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe26383640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe200cdf80 con 0x7fbe200cd640 2024-09-12T03:35:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe26383640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200b01c0 con 0x7fbe200cf760 2024-09-12T03:35:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe17fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbe200d0080 0x7fbe200ccf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54490/0 (socket says 172.21.15.73:54490) 2024-09-12T03:35:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe17fff640 1 -- 172.21.15.73:0/841738228 learned_addr learned my addr 172.21.15.73:0/841738228 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 0x7fbe200cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506745274 0 0) 0x7fbe200cdca0 con 0x7fbe200d0080 2024-09-12T03:35:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe0c003530 con 0x7fbe200d0080 2024-09-12T03:35:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4252540662 0 0) 0x7fbe0c003530 con 0x7fbe200d0080 2024-09-12T03:35:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 msgr2=0x7fbe200cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 0x7fbe200cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 >> v1:172.21.15.150:6789/0 conn(0x7fbe200cd640 legacy=0x7fbe20164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2006bf10 con 0x7fbe200d0080 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fbe08001680 con 0x7fbe200d0080 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 >> v1:172.21.15.73:6789/0 conn(0x7fbe200d0080 legacy=0x7fbe200ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004810 0x7fbe0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 0x7fbe0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200b01c0 con 0x7fbe0c0039f0 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c00ba80 con 0x7fbe0c004810 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c00bc80 con 0x7fbe200cf760 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe17fff640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004810 0x7fbe0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe24920640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 0x7fbe0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1ffff640 1 -- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 msgr2=0x7fbe0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe200cf760 0x7fbe0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1ffff640 1 -- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004810 msgr2=0x7fbe0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004810 0x7fbe0c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe1ffff640 1 -- 172.21.15.73:0/841738228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c003530 con 0x7fbe0c0039f0 2024-09-12T03:35:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.820+0000 7fbe17fff640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe0c004810 0x7fbe0c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe0c003e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000bd50 tx=0x7fbe1001f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f826b2b589d577 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b3070 con 0x7fbe0c0039f0 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe100ae600 con 0x7fbe0c0039f0 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe1f7fe640 1 -- 172.21.15.73:0/841738228 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000b950 con 0x7fbe0c0039f0 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 -- 172.21.15.73:0/841738228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 msgr2=0x7fbe0c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 --2- 172.21.15.73:0/841738228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe0c003e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000bd50 tx=0x7fbe1001f360 comp rx=0 tx=0).stop 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe24920640 1 -- 172.21.15.73:0/841738228 reap_dead start 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 -- 172.21.15.73:0/841738228 shutdown_connections 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 -- 172.21.15.73:0/841738228 >> 172.21.15.73:0/841738228 conn(0x7fbe200b2ba0 msgr2=0x7fbe200b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 -- 172.21.15.73:0/841738228 shutdown_connections 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 -- 172.21.15.73:0/841738228 wait complete. 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 Processor -- start 2024-09-12T03:35:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.824+0000 7fbe26383640 1 -- start start 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe2013a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe20140940 0x7fbe20140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2015c8d0 0x7fbe2015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2006bcc0 con 0x7fbe0c0039f0 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200ce260 con 0x7fbe20140940 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2006f010 con 0x7fbe2015c8d0 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe2013a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe2013a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59224/0 (socket says 172.21.15.73:59224) 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 -- 172.21.15.73:0/2992178802 learned_addr learned my addr 172.21.15.73:0/2992178802 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe17fff640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe20140940 0x7fbe20140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 -- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2015c8d0 msgr2=0x7fbe2015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2015c8d0 0x7fbe2015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 -- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe20140940 msgr2=0x7fbe20140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe20140940 0x7fbe20140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 -- 172.21.15.73:0/2992178802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2015bca0 con 0x7fbe0c0039f0 2024-09-12T03:35:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe17fff640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe20140940 0x7fbe20140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1ffff640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe2013a890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe1001f190 tx=0x7fbe0c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1d7fa640 1 -- 172.21.15.73:0/2992178802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100bd020 con 0x7fbe0c0039f0 2024-09-12T03:35:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1d7fa640 1 -- 172.21.15.73:0/2992178802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe100aee50 con 0x7fbe0c0039f0 2024-09-12T03:35:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2015bf40 con 0x7fbe0c0039f0 2024-09-12T03:35:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1d7fa640 1 -- 172.21.15.73:0/2992178802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b3040 con 0x7fbe0c0039f0 2024-09-12T03:35:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2015c500 con 0x7fbe0c0039f0 2024-09-12T03:35:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2006f3f0 con 0x7fbe0c0039f0 2024-09-12T03:35:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1d7fa640 1 -- 172.21.15.73:0/2992178802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbe100c0020 con 0x7fbe0c0039f0 2024-09-12T03:35:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1d7fa640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbe000678c0 0x7fbe00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe1d7fa640 1 -- 172.21.15.73:0/2992178802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbe10123160 con 0x7fbe0c0039f0 2024-09-12T03:35:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe17fff640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbe000678c0 0x7fbe00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.828+0000 7fbe17fff640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbe000678c0 0x7fbe00069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe20141300 tx=0x7fbe08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:19.832+0000 7fbe1d7fa640 1 -- 172.21.15.73:0/2992178802 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbe100c7030 con 0x7fbe0c0039f0 2024-09-12T03:35:20.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.028+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe200b09b0 con 0x7fbe0c0039f0 2024-09-12T03:35:20.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.028+0000 7fbe1d7fa640 1 -- 172.21.15.73:0/2992178802 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7fbe10019070 con 0x7fbe0c0039f0 2024-09-12T03:35:20.033 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:20.033 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:35:20.033 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:35:20.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbe000678c0 msgr2=0x7fbe00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbe000678c0 0x7fbe00069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe20141300 tx=0x7fbe08009040 comp rx=0 tx=0).stop 2024-09-12T03:35:20.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 msgr2=0x7fbe2013a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe2013a890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe1001f190 tx=0x7fbe0c005840 comp rx=0 tx=0).stop 2024-09-12T03:35:20.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 shutdown_connections 2024-09-12T03:35:20.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbe000678c0 0x7fbe00069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbe2015c8d0 0x7fbe2015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe20140940 0x7fbe20140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 --2- 172.21.15.73:0/2992178802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe0c0039f0 0x7fbe2013a890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 >> 172.21.15.73:0/2992178802 conn(0x7fbe200b2ba0 msgr2=0x7fbe200b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:20.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 shutdown_connections 2024-09-12T03:35:20.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.032+0000 7fbe26383640 1 -- 172.21.15.73:0/2992178802 wait complete. 2024-09-12T03:35:20.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b8aa4640 1 Processor -- start 2024-09-12T03:35:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b8aa4640 1 -- start start 2024-09-12T03:35:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b8aa4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 0x7f60b4168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b8aa4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b40d0300 con 0x7f60b40d3060 2024-09-12T03:35:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b8aa4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b40cfab0 con 0x7f60b4161a60 2024-09-12T03:35:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b8aa4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f60b406e6c0 con 0x7f60b40cf620 2024-09-12T03:35:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60abfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f60b40d3060 0x7f60b40cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54506/0 (socket says 172.21.15.73:54506) 2024-09-12T03:35:20.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60abfff640 1 -- 172.21.15.73:0/3994915606 learned_addr learned my addr 172.21.15.73:0/3994915606 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114560447 0 0) 0x7f609c001120 con 0x7f60b40d3060 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b2d9d640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 0x7f60b4168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60a0003530 con 0x7f60b40d3060 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2265321178 0 0) 0x7f60a0003530 con 0x7f60b40d3060 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 msgr2=0x7f60b4168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 0x7f60b4168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 >> v1:172.21.15.150:6789/0 conn(0x7f60b4161a60 legacy=0x7f60b40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b40b0f60 con 0x7f60b40d3060 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f609c001850 con 0x7f60b40d3060 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 >> v1:172.21.15.73:6789/0 conn(0x7f60b40d3060 legacy=0x7f60b40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a00039f0 0x7f60a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 0x7f60a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60a0004d50 0x7f60a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f60b406e6c0 con 0x7f60a00039f0 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f60a000bb00 con 0x7f60a0004d50 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f60a000bd00 con 0x7f60b40cf620 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b259c640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a00039f0 0x7f60a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60abfff640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 0x7f60a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b2d9d640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60a0004d50 0x7f60a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b259c640 1 -- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 msgr2=0x7f60a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:20.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b259c640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60b40cf620 0x7f60a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b259c640 1 -- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60a0004d50 msgr2=0x7f60a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b259c640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60a0004d50 0x7f60a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b259c640 1 -- 172.21.15.73:0/3994915606 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a0003530 con 0x7f60a00039f0 2024-09-12T03:35:20.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.160+0000 7f60b2d9d640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60a0004d50 0x7f60a00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b259c640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a00039f0 0x7f60a0003e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60a4001780 tx=0x7f60a401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89d0f593c450d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40013a0 con 0x7f60a00039f0 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a40052f0 con 0x7f60a00039f0 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b1d9b640 1 -- 172.21.15.73:0/3994915606 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4003840 con 0x7f60a00039f0 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 -- 172.21.15.73:0/3994915606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a00039f0 msgr2=0x7f60a0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 --2- 172.21.15.73:0/3994915606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60a00039f0 0x7f60a0003e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f60a4001780 tx=0x7f60a401c330 comp rx=0 tx=0).stop 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b2d9d640 1 -- 172.21.15.73:0/3994915606 reap_dead start 2024-09-12T03:35:20.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 -- 172.21.15.73:0/3994915606 shutdown_connections 2024-09-12T03:35:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 -- 172.21.15.73:0/3994915606 >> 172.21.15.73:0/3994915606 conn(0x7f60b408bf90 msgr2=0x7f60b409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 -- 172.21.15.73:0/3994915606 shutdown_connections 2024-09-12T03:35:20.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 -- 172.21.15.73:0/3994915606 wait complete. 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 Processor -- start 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.164+0000 7f60b8aa4640 1 -- start start 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60a00039f0 0x7f60b415b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60b40ccab0 0x7f60b406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40b5060 0x7f60b406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4169720 con 0x7f60b40b5060 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f60b406d190 con 0x7f60b40ccab0 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f60b41698a0 con 0x7f60a00039f0 2024-09-12T03:35:20.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40b5060 0x7f60b406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40b5060 0x7f60b406daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59242/0 (socket says 172.21.15.73:59242) 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 -- 172.21.15.73:0/1221389575 learned_addr learned my addr 172.21.15.73:0/1221389575 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 -- 172.21.15.73:0/1221389575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60a00039f0 msgr2=0x7f60b415b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60a00039f0 0x7f60b415b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 -- 172.21.15.73:0/1221389575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60b40ccab0 msgr2=0x7f60b406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60b40ccab0 0x7f60b406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 -- 172.21.15.73:0/1221389575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b40ca0b0 con 0x7f60b40b5060 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b2d9d640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40b5060 0x7f60b406daf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f60b40b6f60 tx=0x7f60ac00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60aaffd640 1 -- 172.21.15.73:0/1221389575 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0039a0 con 0x7f60b40b5060 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60aaffd640 1 -- 172.21.15.73:0/1221389575 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac003b40 con 0x7f60b40b5060 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b40ca350 con 0x7f60b40b5060 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60aaffd640 1 -- 172.21.15.73:0/1221389575 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac004020 con 0x7f60b40b5060 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b40ca910 con 0x7f60b40b5060 2024-09-12T03:35:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b40cef10 con 0x7f60b40b5060 2024-09-12T03:35:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60aaffd640 1 -- 172.21.15.73:0/1221389575 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f60ac01e020 con 0x7f60b40b5060 2024-09-12T03:35:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60aaffd640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60940678f0 0x7f6094069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b259c640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60940678f0 0x7f6094069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60aaffd640 1 -- 172.21.15.73:0/1221389575 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f60ac086340 con 0x7f60b40b5060 2024-09-12T03:35:20.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.168+0000 7f60b259c640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60940678f0 0x7f6094069db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60a4001750 tx=0x7f60a4001130 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.172+0000 7f60aaffd640 1 -- 172.21.15.73:0/1221389575 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f60ac012070 con 0x7f60b40b5060 2024-09-12T03:35:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60b406e390 con 0x7f60b40b5060 2024-09-12T03:35:20.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60aaffd640 1 -- 172.21.15.73:0/1221389575 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5225 (secure 0 0 0) 0x7f60ac056b10 con 0x7f60b40b5060 2024-09-12T03:35:20.360 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:20.360 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"btime":"2024-09-12T03:34:53:134230+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4248316239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4248316239},{"type":"v1","addr":"172.21.15.150:6833","nonce":4248316239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/1500154732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":1500154732},{"type":"v1","addr":"172.21.15.150:6835","nonce":1500154732}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1275534101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1275534101},{"type":"v1","addr":"172.21.15.73:6836","nonce":1275534101}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:34:38.389239+0000","modified":"2024-09-12T03:34:52.481248+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2532110988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2532110988},{"type":"v1","addr":"172.21.15.73:6837","nonce":2532110988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4248,"qdb_cluster":[4248]},"id":1}]} 2024-09-12T03:35:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2024-09-12T03:35:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60940678f0 msgr2=0x7f6094069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60940678f0 0x7f6094069db0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60a4001750 tx=0x7f60a4001130 comp rx=0 tx=0).stop 2024-09-12T03:35:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40b5060 msgr2=0x7f60b406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40b5060 0x7f60b406daf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f60b40b6f60 tx=0x7f60ac00f4a0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 shutdown_connections 2024-09-12T03:35:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f60940678f0 0x7f6094069db0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40b5060 0x7f60b406daf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f60b40ccab0 0x7f60b406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 --2- 172.21.15.73:0/1221389575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f60a00039f0 0x7f60b415b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 >> 172.21.15.73:0/1221389575 conn(0x7f60b408bf90 msgr2=0x7f60b415cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 shutdown_connections 2024-09-12T03:35:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.356+0000 7f60b8aa4640 1 -- 172.21.15.73:0/1221389575 wait complete. 2024-09-12T03:35:20.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.480+0000 7fdfe3914640 1 Processor -- start 2024-09-12T03:35:20.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.480+0000 7fdfe3914640 1 -- start start 2024-09-12T03:35:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe3914640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe3914640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdfdc15c2a0 0x7fdfdc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe3914640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0af2a0 0x7fdfdc15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe3914640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fdfdc0b3290 con 0x7fdfdc15c2a0 2024-09-12T03:35:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe3914640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fdfdc0b3570 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe3914640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdfdc0b3850 con 0x7fdfdc15bec0 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdfdc15c2a0 0x7fdfdc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdfdc15c2a0 0x7fdfdc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59250/0 (socket says 172.21.15.73:59250) 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 -- 172.21.15.73:0/2529650991 learned_addr learned my addr 172.21.15.73:0/2529650991 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe16b0640 1 --2- 172.21.15.73:0/2529650991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe1eb1640 1 --2- 172.21.15.73:0/2529650991 >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0af2a0 0x7fdfdc15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 -- 172.21.15.73:0/2529650991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 msgr2=0x7fdfdc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 --2- 172.21.15.73:0/2529650991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 -- 172.21.15.73:0/2529650991 >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0af2a0 msgr2=0x7fdfdc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 --2- 172.21.15.73:0/2529650991 >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0af2a0 0x7fdfdc15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe0eaf640 1 -- 172.21.15.73:0/2529650991 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc0b3b30 con 0x7fdfdc15c2a0 2024-09-12T03:35:20.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.484+0000 7fdfe1eb1640 1 --2- 172.21.15.73:0/2529650991 >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0af2a0 0x7fdfdc15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:20.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe0eaf640 1 --2- 172.21.15.73:0/2529650991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc0aed60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0ada40 tx=0x7fdfcc01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b4b4e8a8d0f64d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfd3fff640 1 -- 172.21.15.73:0/2529650991 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0b0070 con 0x7fdfdc15c2a0 2024-09-12T03:35:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfd3fff640 1 -- 172.21.15.73:0/2529650991 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfcc0ab600 con 0x7fdfdc15c2a0 2024-09-12T03:35:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfd3fff640 1 -- 172.21.15.73:0/2529650991 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0ab9d0 con 0x7fdfdc15c2a0 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- 172.21.15.73:0/2529650991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc15c2a0 msgr2=0x7fdfdc0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 --2- 172.21.15.73:0/2529650991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc0aed60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0ada40 tx=0x7fdfcc01c230 comp rx=0 tx=0).stop 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- 172.21.15.73:0/2529650991 shutdown_connections 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 --2- 172.21.15.73:0/2529650991 >> v2:172.21.15.150:3300/0 conn(0x7fdfdc0af2a0 0x7fdfdc15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 --2- 172.21.15.73:0/2529650991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc0aed60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 --2- 172.21.15.73:0/2529650991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- 172.21.15.73:0/2529650991 >> 172.21.15.73:0/2529650991 conn(0x7fdfdc0b1f90 msgr2=0x7fdfdc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- 172.21.15.73:0/2529650991 shutdown_connections 2024-09-12T03:35:20.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- 172.21.15.73:0/2529650991 wait complete. 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 Processor -- start 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- start start 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc0af2a0 0x7fdfdc153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc15ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc0af6b0 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc0ad740 con 0x7fdfdc15c2a0 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdfdc06e000 con 0x7fdfdc15bec0 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc0af2a0 0x7fdfdc153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc0af2a0 0x7fdfdc153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59266/0 (socket says 172.21.15.73:59266) 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 -- 172.21.15.73:0/3927155184 learned_addr learned my addr 172.21.15.73:0/3927155184 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:20.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe1eb1640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc15ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe0eaf640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 -- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 msgr2=0x7fdfdc15f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc15f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 -- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc15c2a0 msgr2=0x7fdfdc15ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc15ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 -- 172.21.15.73:0/3927155184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc09ba40 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe1eb1640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe16b0640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc0af2a0 0x7fdfdc153490 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800c820 tx=0x7fdfd800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfd1ffb640 1 -- 172.21.15.73:0/3927155184 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8015070 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfd1ffb640 1 -- 172.21.15.73:0/3927155184 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfd8007a30 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfdc09bd20 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfd1ffb640 1 -- 172.21.15.73:0/3927155184 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8007e20 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.488+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc09c2e0 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.492+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfdc0ad200 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.492+0000 7fdfd1ffb640 1 -- 172.21.15.73:0/3927155184 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdfd8018070 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.492+0000 7fdfd1ffb640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfc00678c0 0x7fdfc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.492+0000 7fdfd1ffb640 1 -- 172.21.15.73:0/3927155184 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fdfd8085f40 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.492+0000 7fdfe0eaf640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfc00678c0 0x7fdfc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.492+0000 7fdfe0eaf640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfc00678c0 0x7fdfc0069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ad000 tx=0x7fdfcc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.496+0000 7fdfd1ffb640 1 -- 172.21.15.73:0/3927155184 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdfd8056680 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.644+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfdc06fcd0 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfd1ffb640 1 -- 172.21.15.73:0/3927155184 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18999 (secure 0 0 0) 0x7fdfd8055f80 con 0x7fdfdc0af2a0 2024-09-12T03:35:20.651 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:20.651 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":26,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:35:19.913521+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:34:36.451955+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T03:34:37.332778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T03:34:41.111459+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:20.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfc00678c0 msgr2=0x7fdfc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfc00678c0 0x7fdfc0069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ad000 tx=0x7fdfcc0a6000 comp rx=0 tx=0).stop 2024-09-12T03:35:20.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc0af2a0 msgr2=0x7fdfdc153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc0af2a0 0x7fdfdc153490 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800c820 tx=0x7fdfd800cce0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 shutdown_connections 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfc00678c0 0x7fdfc0069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdfdc15c2a0 0x7fdfdc15ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdfdc15bec0 0x7fdfdc15f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 --2- 172.21.15.73:0/3927155184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfdc0af2a0 0x7fdfdc153490 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 >> 172.21.15.73:0/3927155184 conn(0x7fdfdc0b1f90 msgr2=0x7fdfdc159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 shutdown_connections 2024-09-12T03:35:20.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.648+0000 7fdfe3914640 1 -- 172.21.15.73:0/3927155184 wait complete. 2024-09-12T03:35:20.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:35:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58f01f9640 1 Processor -- start 2024-09-12T03:35:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58f01f9640 1 -- start start 2024-09-12T03:35:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58f01f9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58e81609f0 0x7f58e80d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58f01f9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80cd8e0 0x7f58e80d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58f01f9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e80ce030 con 0x7f58e8145960 2024-09-12T03:35:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58f01f9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f58e80ce310 con 0x7f58e81609f0 2024-09-12T03:35:20.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58f01f9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f58e80ce5f0 con 0x7f58e80cd8e0 2024-09-12T03:35:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58edf95640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58e81609f0 0x7f58e80d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58ee796640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f58e8145960 0x7f58e80cf240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54516/0 (socket says 172.21.15.73:54516) 2024-09-12T03:35:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58ee796640 1 -- 172.21.15.73:0/3222926386 learned_addr learned my addr 172.21.15.73:0/3222926386 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58ecf93640 1 -- 172.21.15.73:0/3222926386 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784877148 0 0) 0x7f58e80ce030 con 0x7f58e8145960 2024-09-12T03:35:20.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58ed794640 1 --2- 172.21.15.73:0/3222926386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80cd8e0 0x7f58e80d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58ecf93640 1 -- 172.21.15.73:0/3222926386 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58d4003530 con 0x7f58e8145960 2024-09-12T03:35:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58edf95640 1 -- 172.21.15.73:0/3222926386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80cd8e0 msgr2=0x7f58e80d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58edf95640 1 --2- 172.21.15.73:0/3222926386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80cd8e0 0x7f58e80d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58edf95640 1 -- 172.21.15.73:0/3222926386 >> v1:172.21.15.73:6789/0 conn(0x7f58e8145960 legacy=0x7f58e80cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58edf95640 1 -- 172.21.15.73:0/3222926386 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e80cdd20 con 0x7f58e81609f0 2024-09-12T03:35:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.788+0000 7f58edf95640 1 --2- 172.21.15.73:0/3222926386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e81609f0 0x7f58e80d0460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58e40097c0 tx=0x7f58e401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd58d7b73215178d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ecf93640 1 -- 172.21.15.73:0/3222926386 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40ab430 con 0x7f58e81609f0 2024-09-12T03:35:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ecf93640 1 -- 172.21.15.73:0/3222926386 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e40b0070 con 0x7f58e81609f0 2024-09-12T03:35:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ecf93640 1 -- 172.21.15.73:0/3222926386 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40ab7d0 con 0x7f58e81609f0 2024-09-12T03:35:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- 172.21.15.73:0/3222926386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e81609f0 msgr2=0x7f58e80d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 --2- 172.21.15.73:0/3222926386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e81609f0 0x7f58e80d0460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f58e40097c0 tx=0x7f58e401c410 comp rx=0 tx=0).stop 2024-09-12T03:35:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- 172.21.15.73:0/3222926386 shutdown_connections 2024-09-12T03:35:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 --2- 172.21.15.73:0/3222926386 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e80cd8e0 0x7f58e80d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 --2- 172.21.15.73:0/3222926386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e81609f0 0x7f58e80d0460 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- 172.21.15.73:0/3222926386 >> 172.21.15.73:0/3222926386 conn(0x7f58e809aa00 msgr2=0x7f58e80b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- 172.21.15.73:0/3222926386 shutdown_connections 2024-09-12T03:35:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- 172.21.15.73:0/3222926386 wait complete. 2024-09-12T03:35:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 Processor -- start 2024-09-12T03:35:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- start start 2024-09-12T03:35:20.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80cd8e0 0x7f58e80b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e8145960 0x7f58e81f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e81609f0 0x7f58e815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8169450 con 0x7f58e8145960 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f58e81692d0 con 0x7f58e80cd8e0 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f58e81695d0 con 0x7f58e81609f0 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e8145960 0x7f58e81f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e8145960 0x7f58e81f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59278/0 (socket says 172.21.15.73:59278) 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 -- 172.21.15.73:0/2228203401 learned_addr learned my addr 172.21.15.73:0/2228203401 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ee796640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e81609f0 0x7f58e815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58edf95640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80cd8e0 0x7f58e80b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 -- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e81609f0 msgr2=0x7f58e815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e81609f0 0x7f58e815f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 -- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80cd8e0 msgr2=0x7f58e80b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80cd8e0 0x7f58e80b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 -- 172.21.15.73:0/2228203401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e81f7820 con 0x7f58e8145960 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58edf95640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80cd8e0 0x7f58e80b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58ed794640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e8145960 0x7f58e81f71a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d5f0 tx=0x7f58d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58de7fc640 1 -- 172.21.15.73:0/2228203401 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80125f0 con 0x7f58e8145960 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58de7fc640 1 -- 172.21.15.73:0/2228203401 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d8019070 con 0x7f58e8145960 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58de7fc640 1 -- 172.21.15.73:0/2228203401 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80129b0 con 0x7f58e8145960 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e81f7b00 con 0x7f58e8145960 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.792+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e81f80c0 con 0x7f58e8145960 2024-09-12T03:35:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.796+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e80cf240 con 0x7f58e8145960 2024-09-12T03:35:20.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.796+0000 7f58de7fc640 1 -- 172.21.15.73:0/2228203401 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f58d8012b50 con 0x7f58e8145960 2024-09-12T03:35:20.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.796+0000 7f58de7fc640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58cc0678c0 0x7f58cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:20.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.796+0000 7f58de7fc640 1 -- 172.21.15.73:0/2228203401 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f58d8086580 con 0x7f58e8145960 2024-09-12T03:35:20.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.796+0000 7f58edf95640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58cc0678c0 0x7f58cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:20.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.796+0000 7f58edf95640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58cc0678c0 0x7f58cc069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58e40af000 tx=0x7f58e40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:20.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:20.800+0000 7f58de7fc640 1 -- 172.21.15.73:0/2228203401 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f58d8056c40 con 0x7f58e8145960 2024-09-12T03:35:21.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.008+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f58e80cd560 con 0x7f58e8145960 2024-09-12T03:35:21.015 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T03:35:21.012+0000 7fe1c1027640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:35:21.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.012+0000 7f58de7fc640 1 -- 172.21.15.73:0/2228203401 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f58d8056540 con 0x7f58e8145960 2024-09-12T03:35:21.017 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:35:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58cc0678c0 msgr2=0x7f58cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58cc0678c0 0x7f58cc069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58e40af000 tx=0x7f58e40a7000 comp rx=0 tx=0).stop 2024-09-12T03:35:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e8145960 msgr2=0x7f58e81f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e8145960 0x7f58e81f71a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f58d800d5f0 tx=0x7f58d800dab0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 shutdown_connections 2024-09-12T03:35:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f58cc0678c0 0x7f58cc069d80 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f58e40af000 tx=0x7f58e40a7000 comp rx=0 tx=0).stop 2024-09-12T03:35:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58e8145960 0x7f58e81f71a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f58e81609f0 0x7f58e815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 --2- 172.21.15.73:0/2228203401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58e80cd8e0 0x7f58e80b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.016+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 >> 172.21.15.73:0/2228203401 conn(0x7f58e809aa00 msgr2=0x7f58e809b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:21.022 INFO:tasks.ceph.mds.c.smithi073.stderr: -3348> 2024-09-12T03:34:43.193+0000 7f3c759f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:35:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.020+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 shutdown_connections 2024-09-12T03:35:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.020+0000 7f58f01f9640 1 -- 172.21.15.73:0/2228203401 wait complete. 2024-09-12T03:35:21.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:35:21.067 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:35:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a77439640 1 Processor -- start 2024-09-12T03:35:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a77439640 1 -- start start 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a77439640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a7015e5f0 0x7f9a7006d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a77439640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9a700ce9d0 0x7f9a700cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a77439640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7006d9c0 con 0x7f9a700cf920 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a77439640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9a700cfd90 con 0x7f9a7015e5f0 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a77439640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7006dca0 con 0x7f9a700ce9d0 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a759d6640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9a700cf920 0x7f9a700d0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54524/0 (socket says 172.21.15.73:54524) 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a759d6640 1 -- 172.21.15.73:0/147000349 learned_addr learned my addr 172.21.15.73:0/147000349 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a751d5640 1 --2- 172.21.15.73:0/147000349 >> v2:172.21.15.73:3300/0 conn(0x7f9a7015e5f0 0x7f9a7006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a67fff640 1 -- 172.21.15.73:0/147000349 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458579001 0 0) 0x7f9a7006d9c0 con 0x7f9a700cf920 2024-09-12T03:35:21.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a749d4640 1 --2- 172.21.15.73:0/147000349 >> v2:172.21.15.150:3300/0 conn(0x7f9a700ce9d0 0x7f9a700cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a67fff640 1 -- 172.21.15.73:0/147000349 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a5c003530 con 0x7f9a700cf920 2024-09-12T03:35:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a67fff640 1 -- 172.21.15.73:0/147000349 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1049060043 0 0) 0x7f9a5c003530 con 0x7f9a700cf920 2024-09-12T03:35:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a751d5640 1 -- 172.21.15.73:0/147000349 >> v2:172.21.15.150:3300/0 conn(0x7f9a700ce9d0 msgr2=0x7f9a700cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a751d5640 1 --2- 172.21.15.73:0/147000349 >> v2:172.21.15.150:3300/0 conn(0x7f9a700ce9d0 0x7f9a700cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a751d5640 1 -- 172.21.15.73:0/147000349 >> v1:172.21.15.73:6789/0 conn(0x7f9a700cf920 legacy=0x7f9a700d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.152+0000 7f9a751d5640 1 -- 172.21.15.73:0/147000349 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7006df80 con 0x7f9a7015e5f0 2024-09-12T03:35:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a751d5640 1 --2- 172.21.15.73:0/147000349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7015e5f0 0x7f9a7006d090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a700ce980 tx=0x7f9a6c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7c382976a6ce93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a67fff640 1 -- 172.21.15.73:0/147000349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0b0070 con 0x7f9a7015e5f0 2024-09-12T03:35:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a67fff640 1 -- 172.21.15.73:0/147000349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c0ab400 con 0x7f9a7015e5f0 2024-09-12T03:35:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a67fff640 1 -- 172.21.15.73:0/147000349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68001a00 con 0x7f9a7015e5f0 2024-09-12T03:35:21.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 -- 172.21.15.73:0/147000349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7015e5f0 msgr2=0x7f9a7006d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:21.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 --2- 172.21.15.73:0/147000349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7015e5f0 0x7f9a7006d090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a700ce980 tx=0x7f9a6c01c3a0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 -- 172.21.15.73:0/147000349 shutdown_connections 2024-09-12T03:35:21.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 --2- 172.21.15.73:0/147000349 >> v2:172.21.15.150:3300/0 conn(0x7f9a700ce9d0 0x7f9a700cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 --2- 172.21.15.73:0/147000349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7015e5f0 0x7f9a7006d090 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 -- 172.21.15.73:0/147000349 >> 172.21.15.73:0/147000349 conn(0x7f9a70074030 msgr2=0x7f9a7009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:21.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 -- 172.21.15.73:0/147000349 shutdown_connections 2024-09-12T03:35:21.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 -- 172.21.15.73:0/147000349 wait complete. 2024-09-12T03:35:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 Processor -- start 2024-09-12T03:35:21.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.156+0000 7f9a77439640 1 -- start start 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700cf920 0x7f9a70157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7009e1a0 0x7f9a700cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7009e620 0x7f9a700ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7016b120 con 0x7f9a700cf920 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7016afa0 con 0x7f9a7009e1a0 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7016b2a0 con 0x7f9a7009e620 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700cf920 0x7f9a70157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:21.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700cf920 0x7f9a70157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59310/0 (socket says 172.21.15.73:59310) 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 -- 172.21.15.73:0/2820337550 learned_addr learned my addr 172.21.15.73:0/2820337550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 -- 172.21.15.73:0/2820337550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7009e620 msgr2=0x7f9a700ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7009e620 0x7f9a700ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 -- 172.21.15.73:0/2820337550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7009e1a0 msgr2=0x7f9a700cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7009e1a0 0x7f9a700cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 -- 172.21.15.73:0/2820337550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a700b8360 con 0x7f9a700cf920 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a751d5640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700cf920 0x7f9a70157b40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c000c10 tx=0x7f9a6c01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a65ffb640 1 -- 172.21.15.73:0/2820337550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0b0050 con 0x7f9a700cf920 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a65ffb640 1 -- 172.21.15.73:0/2820337550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c0bc070 con 0x7f9a700cf920 2024-09-12T03:35:21.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a700b8640 con 0x7f9a700cf920 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a65ffb640 1 -- 172.21.15.73:0/2820337550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0b7850 con 0x7f9a700cf920 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a700b8c00 con 0x7f9a700cf920 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7015afe0 con 0x7f9a700cf920 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a65ffb640 1 -- 172.21.15.73:0/2820337550 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a6c0b79f0 con 0x7f9a700cf920 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a65ffb640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9a540678c0 0x7f9a54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a749d4640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9a540678c0 0x7f9a54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a65ffb640 1 -- 172.21.15.73:0/2820337550 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f9a6c120680 con 0x7f9a700cf920 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.160+0000 7f9a749d4640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9a540678c0 0x7f9a54069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a60006aa0 tx=0x7f9a60006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:21.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.164+0000 7f9a65ffb640 1 -- 172.21.15.73:0/2820337550 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a6c015f90 con 0x7f9a700cf920 2024-09-12T03:35:21.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:21.364+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9a7015ad00 con 0x7f9a700cf920 2024-09-12T03:35:22.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.016+0000 7f9a65ffb640 1 -- 172.21.15.73:0/2820337550 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f9a6c0f0df0 con 0x7f9a700cf920 2024-09-12T03:35:22.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9a540678c0 msgr2=0x7f9a54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:22.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9a540678c0 0x7f9a54069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a60006aa0 tx=0x7f9a60006a30 comp rx=0 tx=0).stop 2024-09-12T03:35:22.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700cf920 msgr2=0x7f9a70157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:22.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700cf920 0x7f9a70157b40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c000c10 tx=0x7f9a6c01abe0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 shutdown_connections 2024-09-12T03:35:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9a540678c0 0x7f9a54069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9a7009e620 0x7f9a700ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9a7009e1a0 0x7f9a700cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 --2- 172.21.15.73:0/2820337550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a700cf920 0x7f9a70157b40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 >> 172.21.15.73:0/2820337550 conn(0x7f9a700ce9d0 msgr2=0x7f9a700d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 shutdown_connections 2024-09-12T03:35:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.020+0000 7f9a77439640 1 -- 172.21.15.73:0/2820337550 wait complete. 2024-09-12T03:35:22.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:35:22.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a0330b640 1 Processor -- start 2024-09-12T03:35:22.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a0330b640 1 -- start start 2024-09-12T03:35:22.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a0330b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99fc06f010 0x7f99fc166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a0330b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99fc0b3290 con 0x7f99fc15bec0 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a0330b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99fc0b3570 con 0x7f99fc15c2a0 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a0330b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f99fc0b3850 con 0x7f99fc06f010 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a018a8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99fc06f010 0x7f99fc166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a010a7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f99fc15bec0 0x7f99fc0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54530/0 (socket says 172.21.15.73:54530) 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a010a7640 1 -- 172.21.15.73:0/1686764997 learned_addr learned my addr 172.21.15.73:0/1686764997 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a018a8640 1 -- 172.21.15.73:0/1686764997 >> v1:172.21.15.150:6789/0 conn(0x7f99fc15c2a0 legacy=0x7f99fc0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a018a8640 1 -- 172.21.15.73:0/1686764997 >> v1:172.21.15.73:6789/0 conn(0x7f99fc15bec0 legacy=0x7f99fc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f99fbfff640 1 -- 172.21.15.73:0/1686764997 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148694695 0 0) 0x7f99fc0b3290 con 0x7f99fc15bec0 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.208+0000 7f9a018a8640 1 -- 172.21.15.73:0/1686764997 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc0b3b30 con 0x7f99fc06f010 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a018a8640 1 --2- 172.21.15.73:0/1686764997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc06f010 0x7f99fc166ff0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0097c0 tx=0x7f99ec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcf8f7e606eece6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f99fbfff640 1 -- 172.21.15.73:0/1686764997 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0b2070 con 0x7f99fc06f010 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f99fbfff640 1 -- 172.21.15.73:0/1686764997 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99ec0ad680 con 0x7f99fc06f010 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f99fbfff640 1 -- 172.21.15.73:0/1686764997 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0ada50 con 0x7f99fc06f010 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a0330b640 1 -- 172.21.15.73:0/1686764997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc06f010 msgr2=0x7f99fc166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a0330b640 1 --2- 172.21.15.73:0/1686764997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc06f010 0x7f99fc166ff0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0097c0 tx=0x7f99ec01c470 comp rx=0 tx=0).stop 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a0330b640 1 -- 172.21.15.73:0/1686764997 shutdown_connections 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a0330b640 1 --2- 172.21.15.73:0/1686764997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc06f010 0x7f99fc166ff0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a0330b640 1 -- 172.21.15.73:0/1686764997 >> 172.21.15.73:0/1686764997 conn(0x7f99fc0b1f90 msgr2=0x7f99fc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a0330b640 1 -- 172.21.15.73:0/1686764997 shutdown_connections 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.212+0000 7f9a0330b640 1 -- 172.21.15.73:0/1686764997 wait complete. 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 Processor -- start 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 -- start start 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc06f010 0x7f99fc1660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc15bec0 0x7f99fc155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc15c2a0 0x7f99fc072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc169ed0 con 0x7f99fc15bec0 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc169d50 con 0x7f99fc06f010 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f99fc16a050 con 0x7f99fc15c2a0 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc15bec0 0x7f99fc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc15bec0 0x7f99fc155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59326/0 (socket says 172.21.15.73:59326) 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 -- 172.21.15.73:0/3155589862 learned_addr learned my addr 172.21.15.73:0/3155589862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a010a7640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc06f010 0x7f99fc1660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a018a8640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc15c2a0 0x7f99fc072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 -- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc15c2a0 msgr2=0x7f99fc072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc15c2a0 0x7f99fc072a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 -- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc06f010 msgr2=0x7f99fc1660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc06f010 0x7f99fc1660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 -- 172.21.15.73:0/3155589862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc0ae050 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a008a6640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc15bec0 0x7f99fc155780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c390 tx=0x7f99f000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f99f9ffb640 1 -- 172.21.15.73:0/3155589862 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0017070 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f99f9ffb640 1 -- 172.21.15.73:0/3155589862 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f00052d0 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc09e330 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f99f9ffb640 1 -- 172.21.15.73:0/3155589862 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f0003820 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc072250 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99fc072060 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.216+0000 7f99f9ffb640 1 -- 172.21.15.73:0/3155589862 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f99f001a070 con 0x7f99fc15bec0 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.220+0000 7f99f9ffb640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99e80678c0 0x7f99e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:22.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.220+0000 7f99f9ffb640 1 -- 172.21.15.73:0/3155589862 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f99f00853d0 con 0x7f99fc15bec0 2024-09-12T03:35:22.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.220+0000 7f9a010a7640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99e80678c0 0x7f99e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:22.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.220+0000 7f9a010a7640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99e80678c0 0x7f99e8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99f40012f0 tx=0x7f99f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:22.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.224+0000 7f99f9ffb640 1 -- 172.21.15.73:0/3155589862 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f99f0005480 con 0x7f99fc15bec0 2024-09-12T03:35:22.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:22.384+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99fc0b3290 con 0x7f99fc15bec0 2024-09-12T03:35:23.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.024+0000 7f99f9ffb640 1 -- 172.21.15.73:0/3155589862 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f99f0055b40 con 0x7f99fc15bec0 2024-09-12T03:35:23.028 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:35:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99e80678c0 msgr2=0x7f99e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99e80678c0 0x7f99e8069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99f40012f0 tx=0x7f99f4009040 comp rx=0 tx=0).stop 2024-09-12T03:35:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc15bec0 msgr2=0x7f99fc155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:23.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc15bec0 0x7f99fc155780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c390 tx=0x7f99f000c850 comp rx=0 tx=0).stop 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 shutdown_connections 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99e80678c0 0x7f99e8069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99fc15bec0 0x7f99fc155780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99fc15c2a0 0x7f99fc072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 --2- 172.21.15.73:0/3155589862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99fc06f010 0x7f99fc1660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 >> 172.21.15.73:0/3155589862 conn(0x7f99fc0b1f90 msgr2=0x7f99fc15ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 shutdown_connections 2024-09-12T03:35:23.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.032+0000 7f9a0330b640 1 -- 172.21.15.73:0/3155589862 wait complete. 2024-09-12T03:35:23.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:35:23.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840ed57640 1 Processor -- start 2024-09-12T03:35:23.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840ed57640 1 -- start start 2024-09-12T03:35:23.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840ed57640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f840806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:23.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840ed57640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84080d1050 0x7f84080d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840ed57640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84080d1d80 con 0x7f8408145d90 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840ed57640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f840806c640 con 0x7f84080d1050 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840ed57640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f84080afa20 con 0x7f840806bcc0 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840d2f4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84080d1050 0x7f84080d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840d2f4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84080d1050 0x7f84080d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59338/0 (socket says 172.21.15.73:59338) 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.180+0000 7f840d2f4640 1 -- 172.21.15.73:0/461902526 learned_addr learned my addr 172.21.15.73:0/461902526 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f83fffff640 1 --2- 172.21.15.73:0/461902526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f840806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840d2f4640 1 -- 172.21.15.73:0/461902526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 msgr2=0x7f840806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840d2f4640 1 --2- 172.21.15.73:0/461902526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f840806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840d2f4640 1 -- 172.21.15.73:0/461902526 >> v1:172.21.15.150:6789/0 conn(0x7f8408145d90 legacy=0x7f84080b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:23.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840d2f4640 1 -- 172.21.15.73:0/461902526 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080afd00 con 0x7f84080d1050 2024-09-12T03:35:23.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840d2f4640 1 --2- 172.21.15.73:0/461902526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f84080d14e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8400009e50 tx=0x7f840001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39afc2599d42fa7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:23.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f83ff7fe640 1 -- 172.21.15.73:0/461902526 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84000a5720 con 0x7f84080d1050 2024-09-12T03:35:23.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f83ff7fe640 1 -- 172.21.15.73:0/461902526 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84000a58c0 con 0x7f84080d1050 2024-09-12T03:35:23.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f83ff7fe640 1 -- 172.21.15.73:0/461902526 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84000a5c90 con 0x7f84080d1050 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 -- 172.21.15.73:0/461902526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 msgr2=0x7f84080d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 --2- 172.21.15.73:0/461902526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f84080d14e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8400009e50 tx=0x7f840001c9f0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 -- 172.21.15.73:0/461902526 shutdown_connections 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 --2- 172.21.15.73:0/461902526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f84080d14e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 --2- 172.21.15.73:0/461902526 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f840806c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 -- 172.21.15.73:0/461902526 >> 172.21.15.73:0/461902526 conn(0x7f840809aa00 msgr2=0x7f84080b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 -- 172.21.15.73:0/461902526 shutdown_connections 2024-09-12T03:35:23.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.184+0000 7f840ed57640 1 -- 172.21.15.73:0/461902526 wait complete. 2024-09-12T03:35:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 Processor -- start 2024-09-12T03:35:23.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 -- start start 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f84080cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f8408154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8408145d90 0x7f8408142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f84080b4a20 con 0x7f84080d1050 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f84080b48a0 con 0x7f8408145d90 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f84080b4ba0 con 0x7f840806bcc0 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f8408154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f8408154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59350/0 (socket says 172.21.15.73:59350) 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 -- 172.21.15.73:0/3059898965 learned_addr learned my addr 172.21.15.73:0/3059898965 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:23.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840caf3640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f84080cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840d2f4640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8408145d90 0x7f8408142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 -- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 msgr2=0x7f84080cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f84080cf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 -- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8408145d90 msgr2=0x7f8408142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8408145d90 0x7f8408142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 -- 172.21.15.73:0/3059898965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080ce350 con 0x7f84080d1050 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840d2f4640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8408145d90 0x7f8408142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fffff640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f8408154d30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f83f800c7f0 tx=0x7f83f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fd7fa640 1 -- 172.21.15.73:0/3059898965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8015070 con 0x7f84080d1050 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fd7fa640 1 -- 172.21.15.73:0/3059898965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f8004240 con 0x7f84080d1050 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84080ce630 con 0x7f84080d1050 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f83fd7fa640 1 -- 172.21.15.73:0/3059898965 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8003620 con 0x7f84080d1050 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84080cebf0 con 0x7f84080d1050 2024-09-12T03:35:23.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.188+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f840806c100 con 0x7f84080d1050 2024-09-12T03:35:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.192+0000 7f83fd7fa640 1 -- 172.21.15.73:0/3059898965 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83f80039d0 con 0x7f84080d1050 2024-09-12T03:35:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.192+0000 7f83fd7fa640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83f40678f0 0x7f83f4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.192+0000 7f83fd7fa640 1 -- 172.21.15.73:0/3059898965 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7f83f8085f30 con 0x7f84080d1050 2024-09-12T03:35:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.192+0000 7f840caf3640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83f40678f0 0x7f83f4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.192+0000 7f840caf3640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83f40678f0 0x7f83f4069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8404004e30 tx=0x7f8404009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.196+0000 7f83fd7fa640 1 -- 172.21.15.73:0/3059898965 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f83f8056860 con 0x7f84080d1050 2024-09-12T03:35:23.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:23.360+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f840806df00 con 0x7f84080d1050 2024-09-12T03:35:24.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.028+0000 7f83fd7fa640 1 -- 172.21.15.73:0/3059898965 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f83f8056160 con 0x7f84080d1050 2024-09-12T03:35:24.031 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T03:35:24.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83f40678f0 msgr2=0x7f83f4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:24.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83f40678f0 0x7f83f4069db0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8404004e30 tx=0x7f8404009040 comp rx=0 tx=0).stop 2024-09-12T03:35:24.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 msgr2=0x7f8408154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:24.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f8408154d30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f83f800c7f0 tx=0x7f83f800ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 shutdown_connections 2024-09-12T03:35:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83f40678f0 0x7f83f4069db0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080d1050 0x7f8408154d30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8408145d90 0x7f8408142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 --2- 172.21.15.73:0/3059898965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f840806bcc0 0x7f84080cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.036+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 >> 172.21.15.73:0/3059898965 conn(0x7f840809aa00 msgr2=0x7f8408144e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:24.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.040+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 shutdown_connections 2024-09-12T03:35:24.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.040+0000 7f840ed57640 1 -- 172.21.15.73:0/3059898965 wait complete. 2024-09-12T03:35:24.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T03:35:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.192+0000 7fb1e56dd640 1 Processor -- start 2024-09-12T03:35:24.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.192+0000 7fb1e56dd640 1 -- start start 2024-09-12T03:35:24.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.192+0000 7fb1e56dd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 0x7fb1e00b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.192+0000 7fb1e56dd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb1e009aa00 0x7fb1e015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.192+0000 7fb1e56dd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e015d3d0 con 0x7fb1e015b2c0 2024-09-12T03:35:24.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.192+0000 7fb1e56dd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e00cda60 con 0x7fb1e009aa00 2024-09-12T03:35:24.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.192+0000 7fb1e56dd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e00b5580 con 0x7fb1e00b35a0 2024-09-12T03:35:24.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1deffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb1e015b2c0 0x7fb1e00b4800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54542/0 (socket says 172.21.15.73:54542) 2024-09-12T03:35:24.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1deffd640 1 -- 172.21.15.73:0/1511090655 learned_addr learned my addr 172.21.15.73:0/1511090655 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1df7fe640 1 --2- 172.21.15.73:0/1511090655 >> v2:172.21.15.150:3300/0 conn(0x7fb1e009aa00 0x7fb1e015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 0x7fb1e00b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567596295 0 0) 0x7fb1e015d3d0 con 0x7fb1e015b2c0 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c8003530 con 0x7fb1e015b2c0 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3973795416 0 0) 0x7fb1c8003530 con 0x7fb1e015b2c0 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 msgr2=0x7fb1e00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 0x7fb1e00b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 >> v2:172.21.15.150:3300/0 conn(0x7fb1e009aa00 msgr2=0x7fb1e015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 --2- 172.21.15.73:0/1511090655 >> v2:172.21.15.150:3300/0 conn(0x7fb1e009aa00 0x7fb1e015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e00b5860 con 0x7fb1e015b2c0 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fb1d0001680 con 0x7fb1e015b2c0 2024-09-12T03:35:24.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 >> v1:172.21.15.73:6789/0 conn(0x7fb1e015b2c0 legacy=0x7fb1e00b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 0x7fb1c80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8003f60 0x7fb1c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c8004d50 0x7fb1c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00cda60 con 0x7fb1c8003f60 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e00b5580 con 0x7fb1c8004d50 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c800ba50 con 0x7fb1e00b35a0 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8003f60 0x7fb1c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1deffd640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 0x7fb1c80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1df7fe640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c8004d50 0x7fb1c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 -- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 msgr2=0x7fb1c80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 0x7fb1c80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 -- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c8004d50 msgr2=0x7fb1c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1c8004d50 0x7fb1c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 -- 172.21.15.73:0/1511090655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c8003530 con 0x7fb1c8003f60 2024-09-12T03:35:24.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1deffd640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e00b35a0 0x7fb1c80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:24.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1de7fc640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8003f60 0x7fb1c8004810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00b2c70 tx=0x7fb1d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f10ef23e56dd4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:24.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40096b0 con 0x7fb1c8003f60 2024-09-12T03:35:24.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40a6450 con 0x7fb1c8003f60 2024-09-12T03:35:24.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.196+0000 7fb1ddffb640 1 -- 172.21.15.73:0/1511090655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d40a6840 con 0x7fb1c8003f60 2024-09-12T03:35:24.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- 172.21.15.73:0/1511090655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8003f60 msgr2=0x7fb1c8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:24.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 --2- 172.21.15.73:0/1511090655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1c8003f60 0x7fb1c8004810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00b2c70 tx=0x7fb1d401c9f0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1df7fe640 1 -- 172.21.15.73:0/1511090655 reap_dead start 2024-09-12T03:35:24.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- 172.21.15.73:0/1511090655 shutdown_connections 2024-09-12T03:35:24.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- 172.21.15.73:0/1511090655 >> 172.21.15.73:0/1511090655 conn(0x7fb1e0073360 msgr2=0x7fb1e00b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:24.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- 172.21.15.73:0/1511090655 shutdown_connections 2024-09-12T03:35:24.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- 172.21.15.73:0/1511090655 wait complete. 2024-09-12T03:35:24.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 Processor -- start 2024-09-12T03:35:24.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- start start 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e01fa570 0x7fb1e013a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e013a840 0x7fb1e013acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e0138490 0x7fb1e0138920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e015c780 con 0x7fb1e0138490 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e015c600 con 0x7fb1e013a840 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1e56dd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e0165f40 con 0x7fb1e01fa570 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1df7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e0138490 0x7fb1e0138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:24.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1df7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e0138490 0x7fb1e0138920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59380/0 (socket says 172.21.15.73:59380) 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.200+0000 7fb1df7fe640 1 -- 172.21.15.73:0/2759417647 learned_addr learned my addr 172.21.15.73:0/2759417647 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1df7fe640 1 -- 172.21.15.73:0/2759417647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e01fa570 msgr2=0x7fb1e013a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1df7fe640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e01fa570 0x7fb1e013a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1df7fe640 1 -- 172.21.15.73:0/2759417647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e013a840 msgr2=0x7fb1e013acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1df7fe640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e013a840 0x7fb1e013acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1df7fe640 1 -- 172.21.15.73:0/2759417647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e014d030 con 0x7fb1e0138490 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1df7fe640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e0138490 0x7fb1e0138920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb1e009ae10 tx=0x7fb1d80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1c77fe640 1 -- 172.21.15.73:0/2759417647 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011e40 con 0x7fb1e0138490 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1c77fe640 1 -- 172.21.15.73:0/2759417647 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d801b070 con 0x7fb1e0138490 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e014d310 con 0x7fb1e0138490 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1c77fe640 1 -- 172.21.15.73:0/2759417647 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d80039a0 con 0x7fb1e0138490 2024-09-12T03:35:24.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e014d8d0 con 0x7fb1e0138490 2024-09-12T03:35:24.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e015b6a0 con 0x7fb1e0138490 2024-09-12T03:35:24.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1c77fe640 1 -- 172.21.15.73:0/2759417647 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1d8003b40 con 0x7fb1e0138490 2024-09-12T03:35:24.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1c77fe640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1cc0678f0 0x7fb1cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:24.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1c77fe640 1 -- 172.21.15.73:0/2759417647 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7fb1d8086450 con 0x7fb1e0138490 2024-09-12T03:35:24.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1deffd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1cc0678f0 0x7fb1cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:24.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.204+0000 7fb1deffd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1cc0678f0 0x7fb1cc069db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000c10 tx=0x7fb1d0001e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:24.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.208+0000 7fb1c77fe640 1 -- 172.21.15.73:0/2759417647 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1d8025020 con 0x7fb1e0138490 2024-09-12T03:35:24.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:24.376+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb1e0153120 con 0x7fb1e0138490 2024-09-12T03:35:25.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.048+0000 7fb1c77fe640 1 -- 172.21.15.73:0/2759417647 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fb1d8056f90 con 0x7fb1e0138490 2024-09-12T03:35:25.054 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data_ec' removed 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1cc0678f0 msgr2=0x7fb1cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1cc0678f0 0x7fb1cc069db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0000c10 tx=0x7fb1d0001e30 comp rx=0 tx=0).stop 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e0138490 msgr2=0x7fb1e0138920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e0138490 0x7fb1e0138920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb1e009ae10 tx=0x7fb1d80115a0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 shutdown_connections 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1cc0678f0 0x7fb1cc069db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1e0138490 0x7fb1e0138920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1e013a840 0x7fb1e013acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 --2- 172.21.15.73:0/2759417647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb1e01fa570 0x7fb1e013a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 >> 172.21.15.73:0/2759417647 conn(0x7fb1e0073360 msgr2=0x7fb1e0164bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:25.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 shutdown_connections 2024-09-12T03:35:25.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.056+0000 7fb1e56dd640 1 -- 172.21.15.73:0/2759417647 wait complete. 2024-09-12T03:35:25.089 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T03:35:25.089 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T03:35:25.090 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:35:25.090 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:25.090 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T03:35:25.090 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T03:35:25.090 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:35:25.090 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:25.090 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T03:35:25.090 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T03:35:25.091 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:35:25.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:25.091 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T03:35:25.091 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T03:35:25.091 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:35:25.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:25.101 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:35:25.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T03:35:25.105 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:35:25.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T03:35:25.106 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:35:25.107 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T03:35:25.108 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:35:25.109 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T03:35:25.147 INFO:tasks.ceph.mds.c:Started 2024-09-12T03:35:25.148 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:25.148 INFO:tasks.ceph.mds.a:Started 2024-09-12T03:35:25.149 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:25.150 INFO:tasks.ceph.mds.d:Started 2024-09-12T03:35:25.150 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:25.151 INFO:tasks.ceph.mds.b:Started 2024-09-12T03:35:25.152 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:25.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T03:35:25.212 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:35:25.213 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:35:25.222 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:35:25.223 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-12T03:35:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe88af9640 1 Processor -- start 2024-09-12T03:35:25.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe88af9640 1 -- start start 2024-09-12T03:35:25.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe88af9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efe84147d00 0x7efe840b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:25.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe88af9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe840b1c60 0x7efe840ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:25.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe88af9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe840b25b0 con 0x7efe840b44d0 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe88af9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7efe840b6500 con 0x7efe840b1c60 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe88af9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7efe840b2890 con 0x7efe84147d00 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe840b1c60 0x7efe840ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe840b1c60 0x7efe840ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41180/0 (socket says 172.21.15.73:41180) 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 -- 172.21.15.73:0/3397542537 learned_addr learned my addr 172.21.15.73:0/3397542537 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe8259c640 1 --2- 172.21.15.73:0/3397542537 >> v2:172.21.15.150:3300/0 conn(0x7efe84147d00 0x7efe840b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 -- 172.21.15.73:0/3397542537 >> v2:172.21.15.150:3300/0 conn(0x7efe84147d00 msgr2=0x7efe840b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 --2- 172.21.15.73:0/3397542537 >> v2:172.21.15.150:3300/0 conn(0x7efe84147d00 0x7efe840b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 -- 172.21.15.73:0/3397542537 >> v1:172.21.15.150:6789/0 conn(0x7efe840b44d0 legacy=0x7efe8406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:25.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 -- 172.21.15.73:0/3397542537 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe840b2b70 con 0x7efe840b1c60 2024-09-12T03:35:25.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe82d9d640 1 --2- 172.21.15.73:0/3397542537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe840b1c60 0x7efe840ae110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe840d2200 tx=0x7efe7c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eee9a28e9dde902 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:25.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.268+0000 7efe81d9b640 1 -- 172.21.15.73:0/3397542537 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0a5860 con 0x7efe840b1c60 2024-09-12T03:35:25.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe81d9b640 1 -- 172.21.15.73:0/3397542537 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c0a5a00 con 0x7efe840b1c60 2024-09-12T03:35:25.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe81d9b640 1 -- 172.21.15.73:0/3397542537 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0a5dd0 con 0x7efe840b1c60 2024-09-12T03:35:25.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- 172.21.15.73:0/3397542537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe840b1c60 msgr2=0x7efe840ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:25.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 --2- 172.21.15.73:0/3397542537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe840b1c60 0x7efe840ae110 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe840d2200 tx=0x7efe7c01c980 comp rx=0 tx=0).stop 2024-09-12T03:35:25.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- 172.21.15.73:0/3397542537 shutdown_connections 2024-09-12T03:35:25.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 --2- 172.21.15.73:0/3397542537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe840b1c60 0x7efe840ae110 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 --2- 172.21.15.73:0/3397542537 >> v2:172.21.15.150:3300/0 conn(0x7efe84147d00 0x7efe840b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- 172.21.15.73:0/3397542537 >> 172.21.15.73:0/3397542537 conn(0x7efe8409aa00 msgr2=0x7efe840b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:25.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- 172.21.15.73:0/3397542537 shutdown_connections 2024-09-12T03:35:25.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- 172.21.15.73:0/3397542537 wait complete. 2024-09-12T03:35:25.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 Processor -- start 2024-09-12T03:35:25.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- start start 2024-09-12T03:35:25.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe840b44d0 0x7efe8413def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe84147d00 0x7efe84146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe8415e110 0x7efe8415e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efe8406c550 con 0x7efe84147d00 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efe8406c3d0 con 0x7efe840b44d0 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efe840aee60 con 0x7efe8415e110 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe84147d00 0x7efe84146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe84147d00 0x7efe84146950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41188/0 (socket says 172.21.15.73:41188) 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 -- 172.21.15.73:0/2162807604 learned_addr learned my addr 172.21.15.73:0/2162807604 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe8259c640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe840b44d0 0x7efe8413def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe82d9d640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe8415e110 0x7efe8415e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:25.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 -- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe8415e110 msgr2=0x7efe8415e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe8415e110 0x7efe8415e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 -- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe840b44d0 msgr2=0x7efe8413def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe840b44d0 0x7efe8413def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 -- 172.21.15.73:0/2162807604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe84160770 con 0x7efe84147d00 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7bfff640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe84147d00 0x7efe84146950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c480 tx=0x7efe6c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7affd640 1 -- 172.21.15.73:0/2162807604 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c012830 con 0x7efe84147d00 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7affd640 1 -- 172.21.15.73:0/2162807604 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe6c017070 con 0x7efe84147d00 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe84160a50 con 0x7efe84147d00 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe7affd640 1 -- 172.21.15.73:0/2162807604 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c012c30 con 0x7efe84147d00 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.272+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe84146430 con 0x7efe84147d00 2024-09-12T03:35:25.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.276+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe840ae110 con 0x7efe84147d00 2024-09-12T03:35:25.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.276+0000 7efe7affd640 1 -- 172.21.15.73:0/2162807604 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe6c01c460 con 0x7efe84147d00 2024-09-12T03:35:25.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.276+0000 7efe7affd640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe640678c0 0x7efe64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:25.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.276+0000 7efe7affd640 1 -- 172.21.15.73:0/2162807604 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7efe6c085830 con 0x7efe84147d00 2024-09-12T03:35:25.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.276+0000 7efe8259c640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe640678c0 0x7efe64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:25.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.276+0000 7efe8259c640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe640678c0 0x7efe64069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe740079c0 tx=0x7efe74008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:25.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.280+0000 7efe7affd640 1 -- 172.21.15.73:0/2162807604 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe6c056570 con 0x7efe84147d00 2024-09-12T03:35:25.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:25.452+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efe840af3d0 con 0x7efe84147d00 2024-09-12T03:35:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.076+0000 7efe7affd640 1 -- 172.21.15.73:0/2162807604 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7efe6c055e70 con 0x7efe84147d00 2024-09-12T03:35:26.081 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-09-12T03:35:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe640678c0 msgr2=0x7efe64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe640678c0 0x7efe64069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe740079c0 tx=0x7efe74008040 comp rx=0 tx=0).stop 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe84147d00 msgr2=0x7efe84146950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe84147d00 0x7efe84146950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00c480 tx=0x7efe6c00c940 comp rx=0 tx=0).stop 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 shutdown_connections 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe640678c0 0x7efe64069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe84147d00 0x7efe84146950 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe8415e110 0x7efe8415e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 --2- 172.21.15.73:0/2162807604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe840b44d0 0x7efe8413def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 >> 172.21.15.73:0/2162807604 conn(0x7efe8409aa00 msgr2=0x7efe8406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 shutdown_connections 2024-09-12T03:35:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.080+0000 7efe88af9640 1 -- 172.21.15.73:0/2162807604 wait complete. 2024-09-12T03:35:26.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T03:35:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.220+0000 7fa74e4a9640 1 Processor -- start 2024-09-12T03:35:26.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.220+0000 7fa74e4a9640 1 -- start start 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa74e4a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa748161a60 0x7fa7480d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa74e4a9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa7480cf620 0x7fa74806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa74e4a9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7480d32b0 con 0x7fa7480d2e90 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa74e4a9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa7480d0300 con 0x7fa748161a60 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa74e4a9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa7480cfa90 con 0x7fa7480cf620 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa748161a60 0x7fa7480d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa748161a60 0x7fa7480d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41202/0 (socket says 172.21.15.73:41202) 2024-09-12T03:35:26.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 -- 172.21.15.73:0/3158378009 learned_addr learned my addr 172.21.15.73:0/3158378009 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:26.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 -- 172.21.15.73:0/3158378009 >> v2:172.21.15.150:3300/0 conn(0x7fa7480cf620 msgr2=0x7fa74806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:26.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 --2- 172.21.15.73:0/3158378009 >> v2:172.21.15.150:3300/0 conn(0x7fa7480cf620 0x7fa74806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 -- 172.21.15.73:0/3158378009 >> v1:172.21.15.150:6789/0 conn(0x7fa7480d2e90 legacy=0x7fa7480cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:26.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 -- 172.21.15.73:0/3158378009 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7480b0f60 con 0x7fa748161a60 2024-09-12T03:35:26.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa747fff640 1 --2- 172.21.15.73:0/3158378009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7480d2950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7480ce950 tx=0x7fa73c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129fb3b51b212e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:26.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa746ffd640 1 -- 172.21.15.73:0/3158378009 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ab620 con 0x7fa748161a60 2024-09-12T03:35:26.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa746ffd640 1 -- 172.21.15.73:0/3158378009 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c0b0070 con 0x7fa748161a60 2024-09-12T03:35:26.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.224+0000 7fa746ffd640 1 -- 172.21.15.73:0/3158378009 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ab9e0 con 0x7fa748161a60 2024-09-12T03:35:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- 172.21.15.73:0/3158378009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 msgr2=0x7fa7480d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/3158378009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7480d2950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa7480ce950 tx=0x7fa73c01c420 comp rx=0 tx=0).stop 2024-09-12T03:35:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- 172.21.15.73:0/3158378009 shutdown_connections 2024-09-12T03:35:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/3158378009 >> v2:172.21.15.150:3300/0 conn(0x7fa7480cf620 0x7fa74806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/3158378009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7480d2950 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- 172.21.15.73:0/3158378009 >> 172.21.15.73:0/3158378009 conn(0x7fa74808bf90 msgr2=0x7fa74809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:26.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- 172.21.15.73:0/3158378009 shutdown_connections 2024-09-12T03:35:26.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- 172.21.15.73:0/3158378009 wait complete. 2024-09-12T03:35:26.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 Processor -- start 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- start start 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7480cf620 0x7fa74815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7480d2e90 0x7fa74814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7481605e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa74806e400 con 0x7fa748161a60 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa74806d190 con 0x7fa7480d2e90 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa74806e580 con 0x7fa7480cf620 2024-09-12T03:35:26.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7481605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7481605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41218/0 (socket says 172.21.15.73:41218) 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 -- 172.21.15.73:0/2226701507 learned_addr learned my addr 172.21.15.73:0/2226701507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa747fff640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7480cf620 0x7fa74815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa7477fe640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7480d2e90 0x7fa74814ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 -- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7480cf620 msgr2=0x7fa74815be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7480cf620 0x7fa74815be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 -- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7480d2e90 msgr2=0x7fa74814ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7480d2e90 0x7fa74814ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 -- 172.21.15.73:0/2226701507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7480b93b0 con 0x7fa748161a60 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74ca46640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7481605e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b390 tx=0x7fa74000b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa744ff9640 1 -- 172.21.15.73:0/2226701507 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740015020 con 0x7fa748161a60 2024-09-12T03:35:26.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa744ff9640 1 -- 172.21.15.73:0/2226701507 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740011830 con 0x7fa748161a60 2024-09-12T03:35:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7480b9690 con 0x7fa748161a60 2024-09-12T03:35:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.228+0000 7fa744ff9640 1 -- 172.21.15.73:0/2226701507 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740011c20 con 0x7fa748161a60 2024-09-12T03:35:26.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.232+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7480cb4e0 con 0x7fa748161a60 2024-09-12T03:35:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.232+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74806d6b0 con 0x7fa748161a60 2024-09-12T03:35:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.232+0000 7fa744ff9640 1 -- 172.21.15.73:0/2226701507 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa740018020 con 0x7fa748161a60 2024-09-12T03:35:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.232+0000 7fa744ff9640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7340678c0 0x7fa734069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.232+0000 7fa744ff9640 1 -- 172.21.15.73:0/2226701507 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fa7400859f0 con 0x7fa748161a60 2024-09-12T03:35:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.232+0000 7fa747fff640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7340678c0 0x7fa734069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.232+0000 7fa747fff640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7340678c0 0x7fa734069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0af000 tx=0x7fa73c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.236+0000 7fa744ff9640 1 -- 172.21.15.73:0/2226701507 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa74001f020 con 0x7fa748161a60 2024-09-12T03:35:26.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.460+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa74806bcc0 con 0x7fa748161a60 2024-09-12T03:35:26.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.460+0000 7fa744ff9640 1 -- 172.21.15.73:0/2226701507 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fa7400172c0 con 0x7fa748161a60 2024-09-12T03:35:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:26.465 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:35:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-09-12T03:35:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.465 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ==", 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.466 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw==", 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-09-12T03:35:26.467 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA==", 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ==", 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg==", 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.470 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw==", 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-09-12T03:35:26.471 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig==", 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ==", 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.472 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A==", 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.473 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg==", 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.474 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ==", 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g==", 2024-09-12T03:35:26.475 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg==", 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.476 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA==", 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:35:26.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw==", 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ==", 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:35:26.479 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQASYeJmw4+ENRAAkTAy3UFY3keAJJFJvyQaAA==", 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:35:26.480 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mds", 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA3YeJmeXPVBhAAiLUGjm/YJSrHpQJIM1zWzg==", 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mds" 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.481 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mgr", 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA3YeJmqI3VBhAAgD9WXQrKuv7wpe/+tnNcqg==", 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-osd", 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA3YeJmzqPVBhAAKfHNKkwlk+39DAVWDDnPQQ==", 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-osd" 2024-09-12T03:35:26.482 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd", 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA3YeJmwbjVBhAAKUHJuSs4FKE/x25fRhL70Q==", 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-12T03:35:26.483 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA3YeJmJs7VBhAAMULCPGlAS9wk3dBC0jru+Q==", 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rgw", 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQA3YeJmhOTVBhAA20NZ9prHH2+UY13jRDmq9A==", 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.485 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-09-12T03:35:26.485 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw==", 2024-09-12T03:35:26.485 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:35:26.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA==", 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:35:26.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:35:26.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:35:26.490 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:35:26.490 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.490 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:26.490 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T03:35:26.490 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7340678c0 msgr2=0x7fa734069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7340678c0 0x7fa734069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0af000 tx=0x7fa73c0a7000 comp rx=0 tx=0).stop 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 msgr2=0x7fa7481605e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7481605e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa74000b390 tx=0x7fa74000b850 comp rx=0 tx=0).stop 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 shutdown_connections 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7340678c0 0x7fa734069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa748161a60 0x7fa7481605e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa7480d2e90 0x7fa74814ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 --2- 172.21.15.73:0/2226701507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa7480cf620 0x7fa74815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 >> 172.21.15.73:0/2226701507 conn(0x7fa74808bf90 msgr2=0x7fa7480b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:26.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 shutdown_connections 2024-09-12T03:35:26.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.464+0000 7fa74e4a9640 1 -- 172.21.15.73:0/2226701507 wait complete. 2024-09-12T03:35:26.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-12T03:35:26.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 Processor -- start 2024-09-12T03:35:26.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 -- start start 2024-09-12T03:35:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa9415e5f0 0x7ffa9406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffa940ce9d0 0x7ffa940cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa940d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ffa9406d9c0 con 0x7ffa9415e5f0 2024-09-12T03:35:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ffa9406dca0 con 0x7ffa940ce9d0 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa99681640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9406df80 con 0x7ffa940cf920 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa9415e5f0 0x7ffa9406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa9415e5f0 0x7ffa9406d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41222/0 (socket says 172.21.15.73:41222) 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 -- 172.21.15.73:0/365695790 learned_addr learned my addr 172.21.15.73:0/365695790 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa927fc640 1 --2- 172.21.15.73:0/365695790 >> v2:172.21.15.150:3300/0 conn(0x7ffa940ce9d0 0x7ffa940cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa937fe640 1 --2- 172.21.15.73:0/365695790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa940d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 -- 172.21.15.73:0/365695790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 msgr2=0x7ffa940d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 --2- 172.21.15.73:0/365695790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa940d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 -- 172.21.15.73:0/365695790 >> v2:172.21.15.150:3300/0 conn(0x7ffa940ce9d0 msgr2=0x7ffa940cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 --2- 172.21.15.73:0/365695790 >> v2:172.21.15.150:3300/0 conn(0x7ffa940ce9d0 0x7ffa940cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa92ffd640 1 -- 172.21.15.73:0/365695790 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9406e260 con 0x7ffa9415e5f0 2024-09-12T03:35:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.612+0000 7ffa937fe640 1 --2- 172.21.15.73:0/365695790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa940d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:26.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa92ffd640 1 --2- 172.21.15.73:0/365695790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa9415e5f0 0x7ffa9406d090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffa940ce980 tx=0x7ffa8401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30cce5a4f4eba83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa91ffb640 1 -- 172.21.15.73:0/365695790 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa840b0070 con 0x7ffa9415e5f0 2024-09-12T03:35:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa91ffb640 1 -- 172.21.15.73:0/365695790 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa840ab600 con 0x7ffa9415e5f0 2024-09-12T03:35:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa91ffb640 1 -- 172.21.15.73:0/365695790 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa840ab9d0 con 0x7ffa9415e5f0 2024-09-12T03:35:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 -- 172.21.15.73:0/365695790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa9415e5f0 msgr2=0x7ffa9406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 --2- 172.21.15.73:0/365695790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa9415e5f0 0x7ffa9406d090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ffa940ce980 tx=0x7ffa8401c260 comp rx=0 tx=0).stop 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 -- 172.21.15.73:0/365695790 shutdown_connections 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 --2- 172.21.15.73:0/365695790 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa940d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 --2- 172.21.15.73:0/365695790 >> v2:172.21.15.150:3300/0 conn(0x7ffa940ce9d0 0x7ffa940cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 --2- 172.21.15.73:0/365695790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa9415e5f0 0x7ffa9406d090 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 -- 172.21.15.73:0/365695790 >> 172.21.15.73:0/365695790 conn(0x7ffa94074030 msgr2=0x7ffa9409d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 -- 172.21.15.73:0/365695790 shutdown_connections 2024-09-12T03:35:26.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.616+0000 7ffa99681640 1 -- 172.21.15.73:0/365695790 wait complete. 2024-09-12T03:35:26.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 Processor -- start 2024-09-12T03:35:26.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 -- start start 2024-09-12T03:35:26.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa94151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa940c9720 0x7ffa940ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa94150180 0x7ffa94150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffa940d3740 con 0x7ffa94150180 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffa940d35c0 con 0x7ffa940c9720 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffa940d38c0 con 0x7ffa940cf920 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa94150180 0x7ffa94150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa94150180 0x7ffa94150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41234/0 (socket says 172.21.15.73:41234) 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 -- 172.21.15.73:0/870692998 learned_addr learned my addr 172.21.15.73:0/870692998 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa927fc640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa940c9720 0x7ffa940ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa92ffd640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa94151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 -- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 msgr2=0x7ffa94151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa94151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 -- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa940c9720 msgr2=0x7ffa940ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa940c9720 0x7ffa940ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 -- 172.21.15.73:0/870692998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa940caed0 con 0x7ffa94150180 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa937fe640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa94150180 0x7ffa94150600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00cea0 tx=0x7ffa8c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa7b7fe640 1 -- 172.21.15.73:0/870692998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c01a070 con 0x7ffa94150180 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa7b7fe640 1 -- 172.21.15.73:0/870692998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c00d840 con 0x7ffa94150180 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9414f3c0 con 0x7ffa94150180 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa7b7fe640 1 -- 172.21.15.73:0/870692998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00dc30 con 0x7ffa94150180 2024-09-12T03:35:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9414f980 con 0x7ffa94150180 2024-09-12T03:35:26.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa940d3c80 con 0x7ffa94150180 2024-09-12T03:35:26.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.620+0000 7ffa7b7fe640 1 -- 172.21.15.73:0/870692998 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa8c01d070 con 0x7ffa94150180 2024-09-12T03:35:26.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.624+0000 7ffa7b7fe640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffa800678f0 0x7ffa80069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.624+0000 7ffa7b7fe640 1 -- 172.21.15.73:0/870692998 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ffa8c0862f0 con 0x7ffa94150180 2024-09-12T03:35:26.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.624+0000 7ffa92ffd640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffa800678f0 0x7ffa80069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.624+0000 7ffa92ffd640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffa800678f0 0x7ffa80069db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa840ad000 tx=0x7ffa84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:26.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.628+0000 7ffa7b7fe640 1 -- 172.21.15.73:0/870692998 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa8c056f60 con 0x7ffa94150180 2024-09-12T03:35:26.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.844+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7ffa94158a30 con 0x7ffa94150180 2024-09-12T03:35:26.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.848+0000 7ffa7b7fe640 1 -- 172.21.15.73:0/870692998 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7ffa8c056860 con 0x7ffa94150180 2024-09-12T03:35:26.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffa800678f0 msgr2=0x7ffa80069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffa800678f0 0x7ffa80069db0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa840ad000 tx=0x7ffa84008040 comp rx=0 tx=0).stop 2024-09-12T03:35:26.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa94150180 msgr2=0x7ffa94150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa94150180 0x7ffa94150600 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00cea0 tx=0x7ffa8c00cf90 comp rx=0 tx=0).stop 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 shutdown_connections 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffa800678f0 0x7ffa80069db0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa94150180 0x7ffa94150600 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa940c9720 0x7ffa940ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 --2- 172.21.15.73:0/870692998 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffa940cf920 0x7ffa94151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 >> 172.21.15.73:0/870692998 conn(0x7ffa940ce9d0 msgr2=0x7ffa940d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 shutdown_connections 2024-09-12T03:35:26.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.852+0000 7ffa99681640 1 -- 172.21.15.73:0/870692998 wait complete. 2024-09-12T03:35:26.871 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-12T03:35:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c69d8640 1 Processor -- start 2024-09-12T03:35:26.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c69d8640 1 -- start start 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c69d8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77c015c2a0 0x7f77c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c69d8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f77c00af2a0 0x7f77c006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c69d8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c00b3290 con 0x7f77c015bec0 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c69d8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f77c00b3570 con 0x7f77c015c2a0 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c69d8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f77c00b3850 con 0x7f77c00af2a0 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77bf7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77c015c2a0 0x7f77c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77bffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f77c015bec0 0x7f77c00ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38982/0 (socket says 172.21.15.73:38982) 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77bffff640 1 -- 172.21.15.73:0/3478799141 learned_addr learned my addr 172.21.15.73:0/3478799141 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:26.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c4f75640 1 --2- 172.21.15.73:0/3478799141 >> v2:172.21.15.150:3300/0 conn(0x7f77c00af2a0 0x7f77c006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77bf7fe640 1 -- 172.21.15.73:0/3478799141 >> v2:172.21.15.150:3300/0 conn(0x7f77c00af2a0 msgr2=0x7f77c006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77bf7fe640 1 --2- 172.21.15.73:0/3478799141 >> v2:172.21.15.150:3300/0 conn(0x7f77c00af2a0 0x7f77c006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77bf7fe640 1 -- 172.21.15.73:0/3478799141 >> v1:172.21.15.73:6789/0 conn(0x7f77c015bec0 legacy=0x7f77c00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77bf7fe640 1 -- 172.21.15.73:0/3478799141 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c00b3b30 con 0x7f77c015c2a0 2024-09-12T03:35:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77beffd640 1 -- 172.21.15.73:0/3478799141 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992225862 0 0) 0x7f77c00b3290 con 0x7f77c015bec0 2024-09-12T03:35:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.992+0000 7f77c4f75640 1 --2- 172.21.15.73:0/3478799141 >> v2:172.21.15.150:3300/0 conn(0x7f77c00af2a0 0x7f77c006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77bf7fe640 1 --2- 172.21.15.73:0/3478799141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015c2a0 0x7f77c00aed60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f77c00b2fb0 tx=0x7f77b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b97814180f24c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77beffd640 1 -- 172.21.15.73:0/3478799141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40ab650 con 0x7f77c015c2a0 2024-09-12T03:35:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77beffd640 1 -- 172.21.15.73:0/3478799141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40b0070 con 0x7f77c015c2a0 2024-09-12T03:35:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77beffd640 1 -- 172.21.15.73:0/3478799141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40aba10 con 0x7f77c015c2a0 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- 172.21.15.73:0/3478799141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015c2a0 msgr2=0x7f77c00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 --2- 172.21.15.73:0/3478799141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015c2a0 0x7f77c00aed60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f77c00b2fb0 tx=0x7f77b401c450 comp rx=0 tx=0).stop 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- 172.21.15.73:0/3478799141 shutdown_connections 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 --2- 172.21.15.73:0/3478799141 >> v2:172.21.15.150:3300/0 conn(0x7f77c00af2a0 0x7f77c006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 --2- 172.21.15.73:0/3478799141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015c2a0 0x7f77c00aed60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- 172.21.15.73:0/3478799141 >> 172.21.15.73:0/3478799141 conn(0x7f77c00b1f90 msgr2=0x7f77c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- 172.21.15.73:0/3478799141 shutdown_connections 2024-09-12T03:35:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- 172.21.15.73:0/3478799141 wait complete. 2024-09-12T03:35:27.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 Processor -- start 2024-09-12T03:35:27.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- start start 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c00af2a0 0x7f77c015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015bec0 0x7f77c0155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c015c2a0 0x7f77c014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f77c006ed50 con 0x7f77c015bec0 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f77c00af6b0 con 0x7f77c00af2a0 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77c69d8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f77c006eed0 con 0x7f77c015c2a0 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015bec0 0x7f77c0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015bec0 0x7f77c0155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41258/0 (socket says 172.21.15.73:41258) 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:26.996+0000 7f77bf7fe640 1 -- 172.21.15.73:0/1711249990 learned_addr learned my addr 172.21.15.73:0/1711249990 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:27.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bffff640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c00af2a0 0x7f77c015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77c4f75640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c015c2a0 0x7f77c014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bf7fe640 1 -- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c015c2a0 msgr2=0x7f77c014bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bf7fe640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c015c2a0 0x7f77c014bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bf7fe640 1 -- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c00af2a0 msgr2=0x7f77c015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bf7fe640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c00af2a0 0x7f77c015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bf7fe640 1 -- 172.21.15.73:0/1711249990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c014b200 con 0x7f77c015bec0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bffff640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c00af2a0 0x7f77c015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bf7fe640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015bec0 0x7f77c0155570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77b401a080 tx=0x7f77b40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bcff9640 1 -- 172.21.15.73:0/1711249990 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40abde0 con 0x7f77c015bec0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bcff9640 1 -- 172.21.15.73:0/1711249990 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40bf450 con 0x7f77c015bec0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c0155c00 con 0x7f77c015bec0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bcff9640 1 -- 172.21.15.73:0/1711249990 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b40bf840 con 0x7f77c015bec0 2024-09-12T03:35:27.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c014b780 con 0x7f77c015bec0 2024-09-12T03:35:27.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c014bab0 con 0x7f77c015bec0 2024-09-12T03:35:27.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bcff9640 1 -- 172.21.15.73:0/1711249990 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77b40b43f0 con 0x7f77c015bec0 2024-09-12T03:35:27.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bcff9640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f77ac0678c0 0x7f77ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bcff9640 1 -- 172.21.15.73:0/1711249990 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f77b4120780 con 0x7f77c015bec0 2024-09-12T03:35:27.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bffff640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f77ac0678c0 0x7f77ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.000+0000 7f77bffff640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f77ac0678c0 0x7f77ac069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77b0000f70 tx=0x7f77b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.004+0000 7f77bcff9640 1 -- 172.21.15.73:0/1711249990 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f77b4016070 con 0x7f77c015bec0 2024-09-12T03:35:27.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.224+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f77c006f1d0 con 0x7f77c015bec0 2024-09-12T03:35:27.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.228+0000 7f77bcff9640 1 -- 172.21.15.73:0/1711249990 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f77b40f1470 con 0x7f77c015bec0 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f77ac0678c0 msgr2=0x7f77ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f77ac0678c0 0x7f77ac069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f77b0000f70 tx=0x7f77b0009040 comp rx=0 tx=0).stop 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015bec0 msgr2=0x7f77c0155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015bec0 0x7f77c0155570 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77b401a080 tx=0x7f77b40191f0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 shutdown_connections 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f77ac0678c0 0x7f77ac069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c015bec0 0x7f77c0155570 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f77c015c2a0 0x7f77c014bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 --2- 172.21.15.73:0/1711249990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77c00af2a0 0x7f77c015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 >> 172.21.15.73:0/1711249990 conn(0x7f77c00b1f90 msgr2=0x7f77c00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 shutdown_connections 2024-09-12T03:35:27.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.232+0000 7f77c69d8640 1 -- 172.21.15.73:0/1711249990 wait complete. 2024-09-12T03:35:27.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-12T03:35:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48f45a640 1 Processor -- start 2024-09-12T03:35:27.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48f45a640 1 -- start start 2024-09-12T03:35:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48f45a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4880b39a0 0x7ff48806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48f45a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff48806e4b0 0x7ff488072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48f45a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48806ec60 con 0x7ff4881587a0 2024-09-12T03:35:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48f45a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806f870 con 0x7ff4880b39a0 2024-09-12T03:35:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48f45a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff48806ef40 con 0x7ff48806e4b0 2024-09-12T03:35:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48c9f5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4880b39a0 0x7ff48806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48c9f5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4880b39a0 0x7ff48806df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41262/0 (socket says 172.21.15.73:41262) 2024-09-12T03:35:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48c9f5640 1 -- 172.21.15.73:0/3076749697 learned_addr learned my addr 172.21.15.73:0/3076749697 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:27.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48d9f7640 1 --2- 172.21.15.73:0/3076749697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff48806e4b0 0x7ff488072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48c9f5640 1 -- 172.21.15.73:0/3076749697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff48806e4b0 msgr2=0x7ff488072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48c9f5640 1 --2- 172.21.15.73:0/3076749697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff48806e4b0 0x7ff488072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48c9f5640 1 -- 172.21.15.73:0/3076749697 >> v1:172.21.15.150:6789/0 conn(0x7ff4881587a0 legacy=0x7ff4880b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:27.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.356+0000 7ff48c9f5640 1 -- 172.21.15.73:0/3076749697 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48806f220 con 0x7ff4880b39a0 2024-09-12T03:35:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 --2- 172.21.15.73:0/3076749697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff48806df70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff484009870 tx=0x7ff48401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d76e7c45cfaf95d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff47ffff640 1 -- 172.21.15.73:0/3076749697 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840b1070 con 0x7ff4880b39a0 2024-09-12T03:35:27.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff47ffff640 1 -- 172.21.15.73:0/3076749697 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840ac630 con 0x7ff4880b39a0 2024-09-12T03:35:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff47ffff640 1 -- 172.21.15.73:0/3076749697 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840a8050 con 0x7ff4880b39a0 2024-09-12T03:35:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- 172.21.15.73:0/3076749697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 msgr2=0x7ff48806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 --2- 172.21.15.73:0/3076749697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff48806df70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff484009870 tx=0x7ff48401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- 172.21.15.73:0/3076749697 shutdown_connections 2024-09-12T03:35:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 --2- 172.21.15.73:0/3076749697 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff48806e4b0 0x7ff488072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 --2- 172.21.15.73:0/3076749697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff48806df70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- 172.21.15.73:0/3076749697 >> 172.21.15.73:0/3076749697 conn(0x7ff4880b1f90 msgr2=0x7ff4880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- 172.21.15.73:0/3076749697 shutdown_connections 2024-09-12T03:35:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- 172.21.15.73:0/3076749697 wait complete. 2024-09-12T03:35:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 Processor -- start 2024-09-12T03:35:27.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- start start 2024-09-12T03:35:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff48806e4b0 0x7ff488150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff488150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4881587a0 0x7ff48814c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff488073030 con 0x7ff4880b39a0 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff488072eb0 con 0x7ff48806e4b0 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff4880731b0 con 0x7ff4881587a0 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff488150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff488150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41268/0 (socket says 172.21.15.73:41268) 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 -- 172.21.15.73:0/2298480266 learned_addr learned my addr 172.21.15.73:0/2298480266 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 -- 172.21.15.73:0/2298480266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4881587a0 msgr2=0x7ff48814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4881587a0 0x7ff48814c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 -- 172.21.15.73:0/2298480266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff48806e4b0 msgr2=0x7ff488150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff48806e4b0 0x7ff488150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 -- 172.21.15.73:0/2298480266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4881f7390 con 0x7ff4880b39a0 2024-09-12T03:35:27.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48c9f5640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff488150d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff48401aba0 tx=0x7ff484019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff47dffb640 1 -- 172.21.15.73:0/2298480266 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840b9020 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff47dffb640 1 -- 172.21.15.73:0/2298480266 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4840b5410 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4881f7670 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff47dffb640 1 -- 172.21.15.73:0/2298480266 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4840b1040 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.360+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4881f7c30 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.364+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff488072160 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.364+0000 7ff47dffb640 1 -- 172.21.15.73:0/2298480266 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4840bc020 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.364+0000 7ff47dffb640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff46c0678c0 0x7ff46c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.364+0000 7ff47dffb640 1 -- 172.21.15.73:0/2298480266 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ff48411fba0 con 0x7ff4880b39a0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.364+0000 7ff48d1f6640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff46c0678c0 0x7ff46c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.364+0000 7ff48d1f6640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff46c0678c0 0x7ff46c069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff478009670 tx=0x7ff478006bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.368+0000 7ff47dffb640 1 -- 172.21.15.73:0/2298480266 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff4840c3030 con 0x7ff4880b39a0 2024-09-12T03:35:27.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.584+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7ff488070080 con 0x7ff4880b39a0 2024-09-12T03:35:27.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.588+0000 7ff47dffb640 1 -- 172.21.15.73:0/2298480266 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7ff484016110 con 0x7ff4880b39a0 2024-09-12T03:35:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff46c0678c0 msgr2=0x7ff46c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff46c0678c0 0x7ff46c069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff478009670 tx=0x7ff478006bd0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 msgr2=0x7ff488150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff488150d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff48401aba0 tx=0x7ff484019290 comp rx=0 tx=0).stop 2024-09-12T03:35:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 shutdown_connections 2024-09-12T03:35:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff46c0678c0 0x7ff46c069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4880b39a0 0x7ff488150d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff4881587a0 0x7ff48814c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 --2- 172.21.15.73:0/2298480266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff48806e4b0 0x7ff488150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 >> 172.21.15.73:0/2298480266 conn(0x7ff4880b1f90 msgr2=0x7ff488151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:27.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 shutdown_connections 2024-09-12T03:35:27.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.592+0000 7ff48f45a640 1 -- 172.21.15.73:0/2298480266 wait complete. 2024-09-12T03:35:27.611 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-12T03:35:27.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a9784d640 1 Processor -- start 2024-09-12T03:35:27.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a9784d640 1 -- start start 2024-09-12T03:35:27.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a9784d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a9006bcc0 0x7f0a9006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a9784d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a900d1050 0x7f0a900d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a9784d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a900d1d80 con 0x7f0a90145d90 2024-09-12T03:35:27.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a9784d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9006c640 con 0x7f0a900d1050 2024-09-12T03:35:27.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a9784d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0a900afa20 con 0x7f0a9006bcc0 2024-09-12T03:35:27.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a955e9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0a90145d90 0x7f0a900b0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38994/0 (socket says 172.21.15.73:38994) 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a955e9640 1 -- 172.21.15.73:0/2773368867 learned_addr learned my addr 172.21.15.73:0/2773368867 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a95dea640 1 --2- 172.21.15.73:0/2773368867 >> v2:172.21.15.73:3300/0 conn(0x7f0a900d1050 0x7f0a900d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a83fff640 1 -- 172.21.15.73:0/2773368867 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198436506 0 0) 0x7f0a900d1d80 con 0x7f0a90145d90 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a83fff640 1 -- 172.21.15.73:0/2773368867 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a7c003530 con 0x7f0a90145d90 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a94de8640 1 --2- 172.21.15.73:0/2773368867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a9006bcc0 0x7f0a9006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a95dea640 1 -- 172.21.15.73:0/2773368867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a9006bcc0 msgr2=0x7f0a9006c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a95dea640 1 --2- 172.21.15.73:0/2773368867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a9006bcc0 0x7f0a9006c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a95dea640 1 -- 172.21.15.73:0/2773368867 >> v1:172.21.15.73:6789/0 conn(0x7f0a90145d90 legacy=0x7f0a900b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.716+0000 7f0a95dea640 1 -- 172.21.15.73:0/2773368867 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a900afd00 con 0x7f0a900d1050 2024-09-12T03:35:27.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a95dea640 1 --2- 172.21.15.73:0/2773368867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a900d14e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0097c0 tx=0x7f0a8c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea7a0b883b53cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a83fff640 1 -- 172.21.15.73:0/2773368867 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0b0070 con 0x7f0a900d1050 2024-09-12T03:35:27.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a83fff640 1 -- 172.21.15.73:0/2773368867 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c004230 con 0x7f0a900d1050 2024-09-12T03:35:27.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a83fff640 1 -- 172.21.15.73:0/2773368867 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c003620 con 0x7f0a900d1050 2024-09-12T03:35:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- 172.21.15.73:0/2773368867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 msgr2=0x7f0a900d14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2773368867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a900d14e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0097c0 tx=0x7f0a8c01c4a0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- 172.21.15.73:0/2773368867 shutdown_connections 2024-09-12T03:35:27.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2773368867 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a9006bcc0 0x7f0a9006c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2773368867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a900d14e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- 172.21.15.73:0/2773368867 >> 172.21.15.73:0/2773368867 conn(0x7f0a9009aa00 msgr2=0x7f0a900b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- 172.21.15.73:0/2773368867 shutdown_connections 2024-09-12T03:35:27.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- 172.21.15.73:0/2773368867 wait complete. 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 Processor -- start 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- start start 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a9006bcc0 0x7f0a901355f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a9015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a90145d90 0x7f0a900b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0a900b4a20 con 0x7f0a900d1050 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0a900b48a0 con 0x7f0a9006bcc0 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a9784d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0a900b4ba0 con 0x7f0a90145d90 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a9015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a9015b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41290/0 (socket says 172.21.15.73:41290) 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 -- 172.21.15.73:0/2155108749 learned_addr learned my addr 172.21.15.73:0/2155108749 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:27.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 -- 172.21.15.73:0/2155108749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a90145d90 msgr2=0x7f0a900b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a90145d90 0x7f0a900b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 -- 172.21.15.73:0/2155108749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a9006bcc0 msgr2=0x7f0a901355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a9006bcc0 0x7f0a901355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 -- 172.21.15.73:0/2155108749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a900caa80 con 0x7f0a900d1050 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.720+0000 7f0a94de8640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a9015b610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c7f0 tx=0x7f0a8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a81ffb640 1 -- 172.21.15.73:0/2155108749 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84015070 con 0x7f0a900d1050 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a81ffb640 1 -- 172.21.15.73:0/2155108749 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a84007820 con 0x7f0a900d1050 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9015bb50 con 0x7f0a900d1050 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a81ffb640 1 -- 172.21.15.73:0/2155108749 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84007c10 con 0x7f0a900d1050 2024-09-12T03:35:27.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a90070a00 con 0x7f0a900d1050 2024-09-12T03:35:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9006c100 con 0x7f0a900d1050 2024-09-12T03:35:27.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a81ffb640 1 -- 172.21.15.73:0/2155108749 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a84018070 con 0x7f0a900d1050 2024-09-12T03:35:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a81ffb640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a740678f0 0x7f0a74069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a81ffb640 1 -- 172.21.15.73:0/2155108749 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f0a84085b80 con 0x7f0a900d1050 2024-09-12T03:35:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a955e9640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a740678f0 0x7f0a74069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:27.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.724+0000 7f0a955e9640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a740678f0 0x7f0a74069db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a880012f0 tx=0x7f0a88001660 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:27.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.728+0000 7f0a81ffb640 1 -- 172.21.15.73:0/2155108749 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a900caa80 con 0x7f0a900d1050 2024-09-12T03:35:27.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.940+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f0a900b3b80 con 0x7f0a900d1050 2024-09-12T03:35:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a81ffb640 1 -- 172.21.15.73:0/2155108749 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f0a84056880 con 0x7f0a900d1050 2024-09-12T03:35:27.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a740678f0 msgr2=0x7f0a74069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a740678f0 0x7f0a74069db0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a880012f0 tx=0x7f0a88001660 comp rx=0 tx=0).stop 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 msgr2=0x7f0a9015b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a9015b610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c7f0 tx=0x7f0a8400ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 shutdown_connections 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a740678f0 0x7f0a74069db0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a900d1050 0x7f0a9015b610 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0a90145d90 0x7f0a900b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 --2- 172.21.15.73:0/2155108749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a9006bcc0 0x7f0a901355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 >> 172.21.15.73:0/2155108749 conn(0x7f0a9009aa00 msgr2=0x7f0a900b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 shutdown_connections 2024-09-12T03:35:27.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:27.944+0000 7f0a9784d640 1 -- 172.21.15.73:0/2155108749 wait complete. 2024-09-12T03:35:27.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-12T03:35:28.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2921b640 1 Processor -- start 2024-09-12T03:35:28.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2921b640 1 -- start start 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2921b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b24071e40 0x7f5b24141350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2921b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b24141890 0x7f5b24141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2921b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b24072380 con 0x7f5b24140f70 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2921b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5b24072660 con 0x7f5b24071e40 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2921b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5b240d15e0 con 0x7f5b24141890 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b24071e40 0x7f5b24141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b24071e40 0x7f5b24141350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41292/0 (socket says 172.21.15.73:41292) 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2259c640 1 -- 172.21.15.73:0/1931897013 learned_addr learned my addr 172.21.15.73:0/1931897013 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2359e640 1 --2- 172.21.15.73:0/1931897013 >> v2:172.21.15.150:3300/0 conn(0x7f5b24141890 0x7f5b24141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2259c640 1 -- 172.21.15.73:0/1931897013 >> v2:172.21.15.150:3300/0 conn(0x7f5b24141890 msgr2=0x7f5b24141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:28.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2259c640 1 --2- 172.21.15.73:0/1931897013 >> v2:172.21.15.150:3300/0 conn(0x7f5b24141890 0x7f5b24141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2259c640 1 -- 172.21.15.73:0/1931897013 >> v1:172.21.15.150:6789/0 conn(0x7f5b24140f70 legacy=0x7f5b24071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:28.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.076+0000 7f5b2259c640 1 -- 172.21.15.73:0/1931897013 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b240d0f90 con 0x7f5b24071e40 2024-09-12T03:35:28.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2259c640 1 --2- 172.21.15.73:0/1931897013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24071e40 0x7f5b24141350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5b240b7840 tx=0x7f5b1801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55a3fc27abab31e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b21d9b640 1 -- 172.21.15.73:0/1931897013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180ab5f0 con 0x7f5b24071e40 2024-09-12T03:35:28.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b21d9b640 1 -- 172.21.15.73:0/1931897013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b180b0070 con 0x7f5b24071e40 2024-09-12T03:35:28.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b21d9b640 1 -- 172.21.15.73:0/1931897013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180ab9b0 con 0x7f5b24071e40 2024-09-12T03:35:28.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 -- 172.21.15.73:0/1931897013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24071e40 msgr2=0x7f5b24141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1931897013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24071e40 0x7f5b24141350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5b240b7840 tx=0x7f5b1801c4e0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 -- 172.21.15.73:0/1931897013 shutdown_connections 2024-09-12T03:35:28.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1931897013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24071e40 0x7f5b24141350 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1931897013 >> v2:172.21.15.150:3300/0 conn(0x7f5b24141890 0x7f5b24141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 -- 172.21.15.73:0/1931897013 >> 172.21.15.73:0/1931897013 conn(0x7f5b240b3e70 msgr2=0x7f5b240b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:28.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 -- 172.21.15.73:0/1931897013 shutdown_connections 2024-09-12T03:35:28.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 -- 172.21.15.73:0/1931897013 wait complete. 2024-09-12T03:35:28.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 Processor -- start 2024-09-12T03:35:28.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.080+0000 7f5b2921b640 1 -- start start 2024-09-12T03:35:28.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b24071e40 0x7f5b2413bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24140f70 0x7f5b2415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b24141890 0x7f5b2415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240d2650 con 0x7f5b24140f70 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240d24d0 con 0x7f5b24141890 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5b240d27d0 con 0x7f5b24071e40 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24140f70 0x7f5b2415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24140f70 0x7f5b2415a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41294/0 (socket says 172.21.15.73:41294) 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 -- 172.21.15.73:0/1430761079 learned_addr learned my addr 172.21.15.73:0/1430761079 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2359e640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b24141890 0x7f5b2415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b22d9d640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b24071e40 0x7f5b2413bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 -- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b24071e40 msgr2=0x7f5b2413bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b24071e40 0x7f5b2413bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 -- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b24141890 msgr2=0x7f5b2415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b24141890 0x7f5b2415ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 -- 172.21.15.73:0/1430761079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2413c1f0 con 0x7f5b24140f70 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2259c640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24140f70 0x7f5b2415a640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5b180ad040 tx=0x7f5b1801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b0b7fe640 1 -- 172.21.15.73:0/1430761079 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180b4800 con 0x7f5b24140f70 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b0b7fe640 1 -- 172.21.15.73:0/1430761079 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b180b49c0 con 0x7f5b24140f70 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2415b200 con 0x7f5b24140f70 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b0b7fe640 1 -- 172.21.15.73:0/1430761079 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b180b4db0 con 0x7f5b24140f70 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2415b7c0 con 0x7f5b24140f70 2024-09-12T03:35:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b24141350 con 0x7f5b24140f70 2024-09-12T03:35:28.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b0b7fe640 1 -- 172.21.15.73:0/1430761079 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b180b3380 con 0x7f5b24140f70 2024-09-12T03:35:28.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b0b7fe640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b100678c0 0x7f5b10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b0b7fe640 1 -- 172.21.15.73:0/1430761079 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f5b1811fdd0 con 0x7f5b24140f70 2024-09-12T03:35:28.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b22d9d640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b100678c0 0x7f5b10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.084+0000 7f5b22d9d640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b100678c0 0x7f5b10069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b14003d60 tx=0x7f5b14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.088+0000 7f5b0b7fe640 1 -- 172.21.15.73:0/1430761079 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5b180c4060 con 0x7f5b24140f70 2024-09-12T03:35:28.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.292+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f5b24140460 con 0x7f5b24140f70 2024-09-12T03:35:28.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.296+0000 7f5b0b7fe640 1 -- 172.21.15.73:0/1430761079 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f5b180160d0 con 0x7f5b24140f70 2024-09-12T03:35:28.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b100678c0 msgr2=0x7f5b10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b100678c0 0x7f5b10069d80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b14003d60 tx=0x7f5b14009040 comp rx=0 tx=0).stop 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24140f70 msgr2=0x7f5b2415a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24140f70 0x7f5b2415a640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5b180ad040 tx=0x7f5b1801ad20 comp rx=0 tx=0).stop 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 shutdown_connections 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b100678c0 0x7f5b10069d80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24140f70 0x7f5b2415a640 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b24141890 0x7f5b2415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 --2- 172.21.15.73:0/1430761079 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b24071e40 0x7f5b2413bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 >> 172.21.15.73:0/1430761079 conn(0x7f5b240b3e70 msgr2=0x7f5b2415c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 shutdown_connections 2024-09-12T03:35:28.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.300+0000 7f5b2921b640 1 -- 172.21.15.73:0/1430761079 wait complete. 2024-09-12T03:35:28.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-12T03:35:28.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a96ea640 1 Processor -- start 2024-09-12T03:35:28.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a96ea640 1 -- start start 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a96ea640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f53a415c2a0 0x7f53a40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a96ea640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53a40af2a0 0x7f53a406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a96ea640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a40b3290 con 0x7f53a415bec0 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a96ea640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f53a40b3570 con 0x7f53a40af2a0 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a96ea640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f53a40b3850 con 0x7f53a415c2a0 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a2ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f53a415bec0 0x7f53a40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38998/0 (socket says 172.21.15.73:38998) 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a2ffd640 1 -- 172.21.15.73:0/3433662886 learned_addr learned my addr 172.21.15.73:0/3433662886 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:28.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a37fe640 1 --2- 172.21.15.73:0/3433662886 >> v2:172.21.15.73:3300/0 conn(0x7f53a40af2a0 0x7f53a406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a27fc640 1 -- 172.21.15.73:0/3433662886 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888611336 0 0) 0x7f53a40b3290 con 0x7f53a415bec0 2024-09-12T03:35:28.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a27fc640 1 -- 172.21.15.73:0/3433662886 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5390003530 con 0x7f53a415bec0 2024-09-12T03:35:28.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f539bfff640 1 --2- 172.21.15.73:0/3433662886 >> v2:172.21.15.150:3300/0 conn(0x7f53a415c2a0 0x7f53a40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a37fe640 1 -- 172.21.15.73:0/3433662886 >> v2:172.21.15.150:3300/0 conn(0x7f53a415c2a0 msgr2=0x7f53a40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:28.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a37fe640 1 --2- 172.21.15.73:0/3433662886 >> v2:172.21.15.150:3300/0 conn(0x7f53a415c2a0 0x7f53a40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a37fe640 1 -- 172.21.15.73:0/3433662886 >> v1:172.21.15.73:6789/0 conn(0x7f53a415bec0 legacy=0x7f53a40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.423+0000 7f53a37fe640 1 -- 172.21.15.73:0/3433662886 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a40b3b30 con 0x7f53a40af2a0 2024-09-12T03:35:28.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a37fe640 1 --2- 172.21.15.73:0/3433662886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a40af2a0 0x7f53a406e000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53a40ae510 tx=0x7f539c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f328f7de427cd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a27fc640 1 -- 172.21.15.73:0/3433662886 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c0b2070 con 0x7f53a40af2a0 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a27fc640 1 -- 172.21.15.73:0/3433662886 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c0a59c0 con 0x7f53a40af2a0 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a27fc640 1 -- 172.21.15.73:0/3433662886 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c0a5d70 con 0x7f53a40af2a0 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 -- 172.21.15.73:0/3433662886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a40af2a0 msgr2=0x7f53a406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 --2- 172.21.15.73:0/3433662886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a40af2a0 0x7f53a406e000 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f53a40ae510 tx=0x7f539c01c900 comp rx=0 tx=0).stop 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 -- 172.21.15.73:0/3433662886 shutdown_connections 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 --2- 172.21.15.73:0/3433662886 >> v2:172.21.15.150:3300/0 conn(0x7f53a415c2a0 0x7f53a40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 --2- 172.21.15.73:0/3433662886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a40af2a0 0x7f53a406e000 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 -- 172.21.15.73:0/3433662886 >> 172.21.15.73:0/3433662886 conn(0x7f53a40b1f90 msgr2=0x7f53a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 -- 172.21.15.73:0/3433662886 shutdown_connections 2024-09-12T03:35:28.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 -- 172.21.15.73:0/3433662886 wait complete. 2024-09-12T03:35:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 Processor -- start 2024-09-12T03:35:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.427+0000 7f53a96ea640 1 -- start start 2024-09-12T03:35:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40af2a0 0x7f53a4154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a415bec0 0x7f53a4152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a415c2a0 0x7f53a4152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f53a406ed50 con 0x7f53a415c2a0 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f53a40af710 con 0x7f53a415bec0 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f53a406eed0 con 0x7f53a40af2a0 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a415c2a0 0x7f53a4152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a415c2a0 0x7f53a4152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41310/0 (socket says 172.21.15.73:41310) 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 -- 172.21.15.73:0/2964846912 learned_addr learned my addr 172.21.15.73:0/2964846912 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 -- 172.21.15.73:0/2964846912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40af2a0 msgr2=0x7f53a4154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40af2a0 0x7f53a4154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 -- 172.21.15.73:0/2964846912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a415bec0 msgr2=0x7f53a4152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a415bec0 0x7f53a4152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 -- 172.21.15.73:0/2964846912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a4156ea0 con 0x7f53a415c2a0 2024-09-12T03:35:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a37fe640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a415c2a0 0x7f53a4152750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f539c019510 tx=0x7f539c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f539b7fe640 1 -- 172.21.15.73:0/2964846912 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c0b2050 con 0x7f53a415c2a0 2024-09-12T03:35:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f539b7fe640 1 -- 172.21.15.73:0/2964846912 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c0be070 con 0x7f53a415c2a0 2024-09-12T03:35:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a4157180 con 0x7f53a415c2a0 2024-09-12T03:35:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f539b7fe640 1 -- 172.21.15.73:0/2964846912 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c0ada90 con 0x7f53a415c2a0 2024-09-12T03:35:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a4157740 con 0x7f53a415c2a0 2024-09-12T03:35:28.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a406f260 con 0x7f53a415c2a0 2024-09-12T03:35:28.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f539b7fe640 1 -- 172.21.15.73:0/2964846912 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f539c0adc30 con 0x7f53a415c2a0 2024-09-12T03:35:28.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f539b7fe640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53840678f0 0x7f5384069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f539b7fe640 1 -- 172.21.15.73:0/2964846912 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f539c120d20 con 0x7f53a415c2a0 2024-09-12T03:35:28.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a2ffd640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53840678f0 0x7f5384069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.431+0000 7f53a2ffd640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53840678f0 0x7f5384069db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5394007fd0 tx=0x7f5394007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.435+0000 7f539b7fe640 1 -- 172.21.15.73:0/2964846912 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f539c016520 con 0x7f53a415c2a0 2024-09-12T03:35:28.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.647+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f53a40b5170 con 0x7f53a415c2a0 2024-09-12T03:35:28.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.651+0000 7f539b7fe640 1 -- 172.21.15.73:0/2964846912 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f539c0f1ab0 con 0x7f53a415c2a0 2024-09-12T03:35:28.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53840678f0 msgr2=0x7f5384069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53840678f0 0x7f5384069db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5394007fd0 tx=0x7f5394007900 comp rx=0 tx=0).stop 2024-09-12T03:35:28.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a415c2a0 msgr2=0x7f53a4152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a415c2a0 0x7f53a4152750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f539c019510 tx=0x7f539c0196a0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 shutdown_connections 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53840678f0 0x7f5384069db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53a415c2a0 0x7f53a4152750 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53a415bec0 0x7f53a4152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 --2- 172.21.15.73:0/2964846912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53a40af2a0 0x7f53a4154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 >> 172.21.15.73:0/2964846912 conn(0x7f53a40b1f90 msgr2=0x7f53a406f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 shutdown_connections 2024-09-12T03:35:28.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.655+0000 7f53a96ea640 1 -- 172.21.15.73:0/2964846912 wait complete. 2024-09-12T03:35:28.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T03:35:28.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.775+0000 7f975f137640 1 Processor -- start 2024-09-12T03:35:28.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.775+0000 7f975f137640 1 -- start start 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975f137640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 0x7f97580d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975f137640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f97580d2e90 0x7f97580cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975f137640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f97580cf450 0x7f97580d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975f137640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f97580d32b0 con 0x7f97580cf450 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975f137640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f97580d0300 con 0x7f97580d2e90 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975f137640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f97580b0f60 con 0x7f9758161a60 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f97580cf450 0x7f97580d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f97580cf450 0x7f97580d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41324/0 (socket says 172.21.15.73:41324) 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 -- 172.21.15.73:0/2509978289 learned_addr learned my addr 172.21.15.73:0/2509978289 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f9757fff640 1 --2- 172.21.15.73:0/2509978289 >> v2:172.21.15.150:3300/0 conn(0x7f97580d2e90 0x7f97580cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975ced3640 1 --2- 172.21.15.73:0/2509978289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 0x7f97580d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 -- 172.21.15.73:0/2509978289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 msgr2=0x7f97580d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 --2- 172.21.15.73:0/2509978289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 0x7f97580d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 -- 172.21.15.73:0/2509978289 >> v2:172.21.15.150:3300/0 conn(0x7f97580d2e90 msgr2=0x7f97580cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 --2- 172.21.15.73:0/2509978289 >> v2:172.21.15.150:3300/0 conn(0x7f97580d2e90 0x7f97580cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 -- 172.21.15.73:0/2509978289 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97580cfd40 con 0x7f97580cf450 2024-09-12T03:35:28.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f9757fff640 1 --2- 172.21.15.73:0/2509978289 >> v2:172.21.15.150:3300/0 conn(0x7f97580d2e90 0x7f97580cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:28.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.779+0000 7f975d6d4640 1 --2- 172.21.15.73:0/2509978289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f97580d0a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f97580d1ef0 tx=0x7f974801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d08723e16e91c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f97577fe640 1 -- 172.21.15.73:0/2509978289 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97480a57b0 con 0x7f97580cf450 2024-09-12T03:35:28.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f97577fe640 1 -- 172.21.15.73:0/2509978289 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97480a5950 con 0x7f97580cf450 2024-09-12T03:35:28.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f97577fe640 1 -- 172.21.15.73:0/2509978289 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97480a5d20 con 0x7f97580cf450 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- 172.21.15.73:0/2509978289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 msgr2=0x7f97580d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 --2- 172.21.15.73:0/2509978289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f97580d0a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f97580d1ef0 tx=0x7f974801c930 comp rx=0 tx=0).stop 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- 172.21.15.73:0/2509978289 shutdown_connections 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 --2- 172.21.15.73:0/2509978289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f97580d0a10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 --2- 172.21.15.73:0/2509978289 >> v2:172.21.15.150:3300/0 conn(0x7f97580d2e90 0x7f97580cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 --2- 172.21.15.73:0/2509978289 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 0x7f97580d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- 172.21.15.73:0/2509978289 >> 172.21.15.73:0/2509978289 conn(0x7f975808bf90 msgr2=0x7f975809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- 172.21.15.73:0/2509978289 shutdown_connections 2024-09-12T03:35:28.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- 172.21.15.73:0/2509978289 wait complete. 2024-09-12T03:35:28.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 Processor -- start 2024-09-12T03:35:28.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- start start 2024-09-12T03:35:28.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f9758152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97580d2e90 0x7f97580cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 0x7f97581faa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f97580cfa80 con 0x7f97580cf450 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f97580cf900 con 0x7f97580d2e90 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f975806d6b0 con 0x7f9758161a60 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f9758152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f9758152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41340/0 (socket says 172.21.15.73:41340) 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 -- 172.21.15.73:0/3115407533 learned_addr learned my addr 172.21.15.73:0/3115407533 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 -- 172.21.15.73:0/3115407533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 msgr2=0x7f97581faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 0x7f97581faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 -- 172.21.15.73:0/3115407533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97580d2e90 msgr2=0x7f97580cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97580d2e90 0x7f97580cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 -- 172.21.15.73:0/3115407533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97580cc0a0 con 0x7f97580cf450 2024-09-12T03:35:28.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975ced3640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f9758152390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f975000c7f0 tx=0x7f975000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f97557fa640 1 -- 172.21.15.73:0/3115407533 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750015070 con 0x7f97580cf450 2024-09-12T03:35:28.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f97557fa640 1 -- 172.21.15.73:0/3115407533 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9750007820 con 0x7f97580cf450 2024-09-12T03:35:28.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f97557fa640 1 -- 172.21.15.73:0/3115407533 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750007c10 con 0x7f97580cf450 2024-09-12T03:35:28.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97580cc380 con 0x7f97580cf450 2024-09-12T03:35:28.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.783+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97580b1960 con 0x7f97580cf450 2024-09-12T03:35:28.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.787+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97580cef10 con 0x7f97580cf450 2024-09-12T03:35:28.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.787+0000 7f97557fa640 1 -- 172.21.15.73:0/3115407533 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9750018070 con 0x7f97580cf450 2024-09-12T03:35:28.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.787+0000 7f97557fa640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f97440678c0 0x7f9744069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:28.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.787+0000 7f97557fa640 1 -- 172.21.15.73:0/3115407533 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9750086000 con 0x7f97580cf450 2024-09-12T03:35:28.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.787+0000 7f9757fff640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f97440678c0 0x7f9744069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:28.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.787+0000 7f9757fff640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f97440678c0 0x7f9744069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f974c006b20 tx=0x7f974c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:28.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.791+0000 7f97557fa640 1 -- 172.21.15.73:0/3115407533 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9750056ce0 con 0x7f97580cf450 2024-09-12T03:35:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.939+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f975815a6e0 con 0x7f97580cf450 2024-09-12T03:35:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f97557fa640 1 -- 172.21.15.73:0/3115407533 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f97500565e0 con 0x7f97580cf450 2024-09-12T03:35:28.950 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:28.951 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T03:35:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:35:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T03:35:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T03:35:28.951 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:28.951 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f97440678c0 msgr2=0x7f9744069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f97440678c0 0x7f9744069d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f974c006b20 tx=0x7f974c008040 comp rx=0 tx=0).stop 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 msgr2=0x7f9758152390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f9758152390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f975000c7f0 tx=0x7f975000ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 shutdown_connections 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f97440678c0 0x7f9744069d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9758161a60 0x7f97581faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97580d2e90 0x7f97580cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 --2- 172.21.15.73:0/3115407533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97580cf450 0x7f9758152390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 >> 172.21.15.73:0/3115407533 conn(0x7f975808bf90 msgr2=0x7f975806daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 shutdown_connections 2024-09-12T03:35:28.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:28.943+0000 7f975f137640 1 -- 172.21.15.73:0/3115407533 wait complete. 2024-09-12T03:35:28.965 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T03:35:28.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T03:35:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f79a5918640 1 Processor -- start 2024-09-12T03:35:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f79a5918640 1 -- start start 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f79a5918640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79a015c2a0 0x7f79a00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f79a5918640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f79a00af2a0 0x7f79a006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f79a5918640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a00b3290 con 0x7f79a015bec0 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f79a5918640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f79a00b3570 con 0x7f79a015c2a0 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f79a5918640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f79a00b3850 con 0x7f79a00af2a0 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79a015c2a0 0x7f79a00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79a015c2a0 0x7f79a00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41344/0 (socket says 172.21.15.73:41344) 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799e7fc640 1 -- 172.21.15.73:0/4150711655 learned_addr learned my addr 172.21.15.73:0/4150711655 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799f7fe640 1 --2- 172.21.15.73:0/4150711655 >> v2:172.21.15.150:3300/0 conn(0x7f79a00af2a0 0x7f79a006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799e7fc640 1 -- 172.21.15.73:0/4150711655 >> v2:172.21.15.150:3300/0 conn(0x7f79a00af2a0 msgr2=0x7f79a006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799e7fc640 1 --2- 172.21.15.73:0/4150711655 >> v2:172.21.15.150:3300/0 conn(0x7f79a00af2a0 0x7f79a006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:29.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799e7fc640 1 -- 172.21.15.73:0/4150711655 >> v1:172.21.15.150:6789/0 conn(0x7f79a015bec0 legacy=0x7f79a00ad200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:35:29.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.075+0000 7f799e7fc640 1 -- 172.21.15.73:0/4150711655 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a00b3b30 con 0x7f79a015c2a0 2024-09-12T03:35:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799e7fc640 1 --2- 172.21.15.73:0/4150711655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a015c2a0 0x7f79a00aed60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79a00b2fb0 tx=0x7f799401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2777143dd7c7fe0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799dffb640 1 -- 172.21.15.73:0/4150711655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940aa610 con 0x7f79a015c2a0 2024-09-12T03:35:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799dffb640 1 -- 172.21.15.73:0/4150711655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79940af070 con 0x7f79a015c2a0 2024-09-12T03:35:29.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799dffb640 1 -- 172.21.15.73:0/4150711655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940aa9d0 con 0x7f79a015c2a0 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- 172.21.15.73:0/4150711655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a015c2a0 msgr2=0x7f79a00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 --2- 172.21.15.73:0/4150711655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a015c2a0 0x7f79a00aed60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79a00b2fb0 tx=0x7f799401c4b0 comp rx=0 tx=0).stop 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- 172.21.15.73:0/4150711655 shutdown_connections 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 --2- 172.21.15.73:0/4150711655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a015c2a0 0x7f79a00aed60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 --2- 172.21.15.73:0/4150711655 >> v2:172.21.15.150:3300/0 conn(0x7f79a00af2a0 0x7f79a006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- 172.21.15.73:0/4150711655 >> 172.21.15.73:0/4150711655 conn(0x7f79a00b1f90 msgr2=0x7f79a00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- 172.21.15.73:0/4150711655 shutdown_connections 2024-09-12T03:35:29.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- 172.21.15.73:0/4150711655 wait complete. 2024-09-12T03:35:29.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 Processor -- start 2024-09-12T03:35:29.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- start start 2024-09-12T03:35:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a00af2a0 0x7f79a014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79a015bec0 0x7f79a015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79a015c2a0 0x7f79a0149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f79a006ed50 con 0x7f79a00af2a0 2024-09-12T03:35:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f79a00af6b0 con 0x7f79a015bec0 2024-09-12T03:35:29.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f79a5918640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f79a006eed0 con 0x7f79a015c2a0 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a00af2a0 0x7f79a014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a00af2a0 0x7f79a014ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41352/0 (socket says 172.21.15.73:41352) 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 -- 172.21.15.73:0/2321160900 learned_addr learned my addr 172.21.15.73:0/2321160900 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799f7fe640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79a015c2a0 0x7f79a0149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 -- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79a015c2a0 msgr2=0x7f79a0149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79a015c2a0 0x7f79a0149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 -- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79a015bec0 msgr2=0x7f79a015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799e7fc640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79a015bec0 0x7f79a015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79a015bec0 0x7f79a015a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 -- 172.21.15.73:0/2321160900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a014d650 con 0x7f79a00af2a0 2024-09-12T03:35:29.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.079+0000 7f799effd640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a00af2a0 0x7f79a014ecb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f799000b4a0 tx=0x7f799000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f7987fff640 1 -- 172.21.15.73:0/2321160900 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990014070 con 0x7f79a00af2a0 2024-09-12T03:35:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f7987fff640 1 -- 172.21.15.73:0/2321160900 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7990010610 con 0x7f79a00af2a0 2024-09-12T03:35:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a0164000 con 0x7f79a00af2a0 2024-09-12T03:35:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f7987fff640 1 -- 172.21.15.73:0/2321160900 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990010a20 con 0x7f79a00af2a0 2024-09-12T03:35:29.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a01648a0 con 0x7f79a00af2a0 2024-09-12T03:35:29.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a006f1d0 con 0x7f79a00af2a0 2024-09-12T03:35:29.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f7987fff640 1 -- 172.21.15.73:0/2321160900 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7990017070 con 0x7f79a00af2a0 2024-09-12T03:35:29.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f7987fff640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f798c0678c0 0x7f798c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:29.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f7987fff640 1 -- 172.21.15.73:0/2321160900 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f7990085570 con 0x7f79a00af2a0 2024-09-12T03:35:29.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f799e7fc640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f798c0678c0 0x7f798c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:29.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.083+0000 7f799e7fc640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f798c0678c0 0x7f798c069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79940ae000 tx=0x7f79940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:29.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.087+0000 7f7987fff640 1 -- 172.21.15.73:0/2321160900 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7990056300 con 0x7f79a00af2a0 2024-09-12T03:35:29.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:29.239+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f79a00b2c60 con 0x7f79a00af2a0 2024-09-12T03:35:30.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.091+0000 7f7987fff640 1 -- 172.21.15.73:0/2321160900 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f7990055c00 con 0x7f79a00af2a0 2024-09-12T03:35:30.096 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T03:35:30.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f798c0678c0 msgr2=0x7f798c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:30.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f798c0678c0 0x7f798c069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f79940ae000 tx=0x7f79940a7000 comp rx=0 tx=0).stop 2024-09-12T03:35:30.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a00af2a0 msgr2=0x7f79a014ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:30.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a00af2a0 0x7f79a014ecb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f799000b4a0 tx=0x7f799000b960 comp rx=0 tx=0).stop 2024-09-12T03:35:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 shutdown_connections 2024-09-12T03:35:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f798c0678c0 0x7f798c069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79a015c2a0 0x7f79a0149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f79a015bec0 0x7f79a015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 --2- 172.21.15.73:0/2321160900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79a00af2a0 0x7f79a014ecb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 >> 172.21.15.73:0/2321160900 conn(0x7f79a00b1f90 msgr2=0x7f79a0159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:30.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.095+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 shutdown_connections 2024-09-12T03:35:30.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.099+0000 7f79a5918640 1 -- 172.21.15.73:0/2321160900 wait complete. 2024-09-12T03:35:30.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T03:35:30.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.243+0000 7fa07bd6c640 1 Processor -- start 2024-09-12T03:35:30.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.243+0000 7fa07bd6c640 1 -- start start 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa074160e10 0x7fa0740b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0740b5fe0 0x7fa074168070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0740b44d0 con 0x7fa074147e30 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa0740b2d70 con 0x7fa0740b5fe0 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa07415ed60 con 0x7fa074160e10 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0740b5fe0 0x7fa074168070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0740b5fe0 0x7fa074168070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41366/0 (socket says 172.21.15.73:41366) 2024-09-12T03:35:30.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa079b08640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa074147e30 0x7fa0740b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39010/0 (socket says 172.21.15.73:39010) 2024-09-12T03:35:30.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 -- 172.21.15.73:0/2534675029 learned_addr learned my addr 172.21.15.73:0/2534675029 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:30.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa079307640 1 --2- 172.21.15.73:0/2534675029 >> v2:172.21.15.150:3300/0 conn(0x7fa074160e10 0x7fa0740b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:30.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 -- 172.21.15.73:0/2534675029 >> v2:172.21.15.150:3300/0 conn(0x7fa074160e10 msgr2=0x7fa0740b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:30.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 --2- 172.21.15.73:0/2534675029 >> v2:172.21.15.150:3300/0 conn(0x7fa074160e10 0x7fa0740b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 -- 172.21.15.73:0/2534675029 >> v1:172.21.15.73:6789/0 conn(0x7fa074147e30 legacy=0x7fa0740b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:30.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 -- 172.21.15.73:0/2534675029 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07415f040 con 0x7fa0740b5fe0 2024-09-12T03:35:30.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07a309640 1 --2- 172.21.15.73:0/2534675029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa074168070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa07406a820 tx=0x7fa06c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83826ba2c0c996e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:30.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa078b06640 1 -- 172.21.15.73:0/2534675029 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0a5760 con 0x7fa0740b5fe0 2024-09-12T03:35:30.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa078b06640 1 -- 172.21.15.73:0/2534675029 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa06c0a5900 con 0x7fa0740b5fe0 2024-09-12T03:35:30.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa078b06640 1 -- 172.21.15.73:0/2534675029 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c0a5cd0 con 0x7fa0740b5fe0 2024-09-12T03:35:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- 172.21.15.73:0/2534675029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 msgr2=0x7fa074168070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/2534675029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa074168070 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa07406a820 tx=0x7fa06c01c8a0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- 172.21.15.73:0/2534675029 shutdown_connections 2024-09-12T03:35:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/2534675029 >> v2:172.21.15.150:3300/0 conn(0x7fa074160e10 0x7fa0740b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/2534675029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa074168070 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- 172.21.15.73:0/2534675029 >> 172.21.15.73:0/2534675029 conn(0x7fa07409aa00 msgr2=0x7fa0740b6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- 172.21.15.73:0/2534675029 shutdown_connections 2024-09-12T03:35:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.247+0000 7fa07bd6c640 1 -- 172.21.15.73:0/2534675029 wait complete. 2024-09-12T03:35:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 Processor -- start 2024-09-12T03:35:30.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 -- start start 2024-09-12T03:35:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa07409ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa074147e30 0x7fa07413d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa074160e10 0x7fa0740ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa0740b63f0 con 0x7fa0740b5fe0 2024-09-12T03:35:30.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa07415ea10 con 0x7fa074160e10 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa07416add0 con 0x7fa074147e30 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa07409ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa07409ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41368/0 (socket says 172.21.15.73:41368) 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 -- 172.21.15.73:0/1364922676 learned_addr learned my addr 172.21.15.73:0/1364922676 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07a309640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa074160e10 0x7fa0740ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 -- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa074147e30 msgr2=0x7fa07413d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079307640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa074147e30 0x7fa07413d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa074147e30 0x7fa07413d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 -- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa074160e10 msgr2=0x7fa0740ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa074160e10 0x7fa0740ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 -- 172.21.15.73:0/1364922676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074140f90 con 0x7fa0740b5fe0 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07a309640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa074160e10 0x7fa0740ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa079b08640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa07409ee60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c3a0 tx=0x7fa07000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:30.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa06a7fc640 1 -- 172.21.15.73:0/1364922676 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0700074e0 con 0x7fa0740b5fe0 2024-09-12T03:35:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa06a7fc640 1 -- 172.21.15.73:0/1364922676 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070007680 con 0x7fa0740b5fe0 2024-09-12T03:35:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa074141270 con 0x7fa0740b5fe0 2024-09-12T03:35:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa06a7fc640 1 -- 172.21.15.73:0/1364922676 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070004a30 con 0x7fa0740b5fe0 2024-09-12T03:35:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.251+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa074141830 con 0x7fa0740b5fe0 2024-09-12T03:35:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.255+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0740b5aa0 con 0x7fa0740b5fe0 2024-09-12T03:35:30.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.255+0000 7fa06a7fc640 1 -- 172.21.15.73:0/1364922676 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa07001a020 con 0x7fa0740b5fe0 2024-09-12T03:35:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.255+0000 7fa06a7fc640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0580678f0 0x7fa058069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.255+0000 7fa06a7fc640 1 -- 172.21.15.73:0/1364922676 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7fa070085340 con 0x7fa0740b5fe0 2024-09-12T03:35:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.255+0000 7fa079307640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0580678f0 0x7fa058069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:30.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.255+0000 7fa079307640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0580678f0 0x7fa058069db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa07409f3a0 tx=0x7fa064008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.259+0000 7fa06a7fc640 1 -- 172.21.15.73:0/1364922676 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa070055f60 con 0x7fa0740b5fe0 2024-09-12T03:35:30.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:30.423+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa0740cd3c0 con 0x7fa0740b5fe0 2024-09-12T03:35:31.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.095+0000 7fa06a7fc640 1 -- 172.21.15.73:0/1364922676 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7fa070055860 con 0x7fa0740b5fe0 2024-09-12T03:35:31.101 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T03:35:31.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0580678f0 msgr2=0x7fa058069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:31.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0580678f0 0x7fa058069db0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa07409f3a0 tx=0x7fa064008040 comp rx=0 tx=0).stop 2024-09-12T03:35:31.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 msgr2=0x7fa07409ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa07409ee60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa07000c3a0 tx=0x7fa07000c860 comp rx=0 tx=0).stop 2024-09-12T03:35:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 shutdown_connections 2024-09-12T03:35:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0580678f0 0x7fa058069db0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa074160e10 0x7fa0740ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa074147e30 0x7fa07413d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 --2- 172.21.15.73:0/1364922676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0740b5fe0 0x7fa07409ee60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:31.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 >> 172.21.15.73:0/1364922676 conn(0x7fa07409aa00 msgr2=0x7fa0740b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:31.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 shutdown_connections 2024-09-12T03:35:31.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.099+0000 7fa07bd6c640 1 -- 172.21.15.73:0/1364922676 wait complete. 2024-09-12T03:35:31.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T03:35:31.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec83ca640 1 Processor -- start 2024-09-12T03:35:31.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec83ca640 1 -- start start 2024-09-12T03:35:31.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec83ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcec00cfaf0 0x7fcec0168f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec83ca640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec006d9c0 con 0x7fcec00ce9d0 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec83ca640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec006dca0 con 0x7fcec015e5f0 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec83ca640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcec006d7a0 con 0x7fcec00cfaf0 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec6967640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcec00cfaf0 0x7fcec0168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec5965640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcec00ce9d0 0x7fcec00cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39014/0 (socket says 172.21.15.73:39014) 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec5965640 1 -- 172.21.15.73:0/91994696 learned_addr learned my addr 172.21.15.73:0/91994696 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec6967640 1 -- 172.21.15.73:0/91994696 >> v1:172.21.15.150:6789/0 conn(0x7fcec015e5f0 legacy=0x7fcec006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec6967640 1 -- 172.21.15.73:0/91994696 >> v1:172.21.15.73:6789/0 conn(0x7fcec00ce9d0 legacy=0x7fcec00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:31.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.255+0000 7fcec6967640 1 -- 172.21.15.73:0/91994696 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec006df80 con 0x7fcec00cfaf0 2024-09-12T03:35:31.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6967640 1 --2- 172.21.15.73:0/91994696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec0168f90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009d90 tx=0x7fceb801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7737bd257be89fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:31.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec5164640 1 -- 172.21.15.73:0/91994696 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80b2070 con 0x7fcec00cfaf0 2024-09-12T03:35:31.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec5164640 1 -- 172.21.15.73:0/91994696 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb80a5900 con 0x7fcec00cfaf0 2024-09-12T03:35:31.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec5164640 1 -- 172.21.15.73:0/91994696 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80a5cd0 con 0x7fcec00cfaf0 2024-09-12T03:35:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- 172.21.15.73:0/91994696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 msgr2=0x7fcec0168f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 --2- 172.21.15.73:0/91994696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec0168f90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009d90 tx=0x7fceb801c930 comp rx=0 tx=0).stop 2024-09-12T03:35:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- 172.21.15.73:0/91994696 shutdown_connections 2024-09-12T03:35:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 --2- 172.21.15.73:0/91994696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec0168f90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- 172.21.15.73:0/91994696 >> 172.21.15.73:0/91994696 conn(0x7fcec0074030 msgr2=0x7fcec009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- 172.21.15.73:0/91994696 shutdown_connections 2024-09-12T03:35:31.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- 172.21.15.73:0/91994696 wait complete. 2024-09-12T03:35:31.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 Processor -- start 2024-09-12T03:35:31.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- start start 2024-09-12T03:35:31.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcec015d700 0x7fcec00b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec00cb7f0 0x7fcec00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcec016c080 con 0x7fcec00cfaf0 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcec016bf00 con 0x7fcec00cb7f0 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec83ca640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcec016c200 con 0x7fcec015d700 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec015b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41388/0 (socket says 172.21.15.73:41388) 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 -- 172.21.15.73:0/2337417724 learned_addr learned my addr 172.21.15.73:0/2337417724 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 -- 172.21.15.73:0/2337417724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcec015d700 msgr2=0x7fcec00b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcec015d700 0x7fcec00b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 -- 172.21.15.73:0/2337417724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec00cb7f0 msgr2=0x7fcec00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:31.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec00cb7f0 0x7fcec00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.259+0000 7fcec6166640 1 -- 172.21.15.73:0/2337417724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec015de70 con 0x7fcec00cfaf0 2024-09-12T03:35:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fcec6166640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec015b9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00b440 tx=0x7fcebc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fceb6ffd640 1 -- 172.21.15.73:0/2337417724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc015020 con 0x7fcec00cfaf0 2024-09-12T03:35:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fceb6ffd640 1 -- 172.21.15.73:0/2337417724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc011890 con 0x7fcec00cfaf0 2024-09-12T03:35:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fceb6ffd640 1 -- 172.21.15.73:0/2337417724 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc011c80 con 0x7fcec00cfaf0 2024-09-12T03:35:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec015b090 con 0x7fcec00cfaf0 2024-09-12T03:35:31.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec015b650 con 0x7fcec00cfaf0 2024-09-12T03:35:31.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec00d4360 con 0x7fcec00cfaf0 2024-09-12T03:35:31.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fceb6ffd640 1 -- 172.21.15.73:0/2337417724 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcebc018020 con 0x7fcec00cfaf0 2024-09-12T03:35:31.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fceb6ffd640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcea40678c0 0x7fcea4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:31.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fceb6ffd640 1 -- 172.21.15.73:0/2337417724 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7fcebc085fc0 con 0x7fcec00cfaf0 2024-09-12T03:35:31.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fcec5965640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcea40678c0 0x7fcea4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:31.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.263+0000 7fcec5965640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcea40678c0 0x7fcea4069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fceb0000f70 tx=0x7fceb0007a90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:31.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.267+0000 7fceb6ffd640 1 -- 172.21.15.73:0/2337417724 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcebc01f030 con 0x7fcec00cfaf0 2024-09-12T03:35:31.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:31.467+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcec00d4100 con 0x7fcec00cfaf0 2024-09-12T03:35:32.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.159+0000 7fceb6ffd640 1 -- 172.21.15.73:0/2337417724 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7fcebc00d040 con 0x7fcec00cfaf0 2024-09-12T03:35:32.170 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 5 and data pool 6 2024-09-12T03:35:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.167+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcea40678c0 msgr2=0x7fcea4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.167+0000 7fcec83ca640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcea40678c0 0x7fcea4069d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fceb0000f70 tx=0x7fceb0007a90 comp rx=0 tx=0).stop 2024-09-12T03:35:32.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.167+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 msgr2=0x7fcec015b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.167+0000 7fcec83ca640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec015b9c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00b440 tx=0x7fcebc00b900 comp rx=0 tx=0).stop 2024-09-12T03:35:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 shutdown_connections 2024-09-12T03:35:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcea40678c0 0x7fcea4069d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcec00cb7f0 0x7fcec00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcec015d700 0x7fcec00b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 --2- 172.21.15.73:0/2337417724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcec00cfaf0 0x7fcec015b9c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 >> 172.21.15.73:0/2337417724 conn(0x7fcec00ce9d0 msgr2=0x7fcec00b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:32.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 shutdown_connections 2024-09-12T03:35:32.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.171+0000 7fcec83ca640 1 -- 172.21.15.73:0/2337417724 wait complete. 2024-09-12T03:35:32.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:32.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.311+0000 7f954408a640 1 Processor -- start 2024-09-12T03:35:32.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.311+0000 7f954408a640 1 -- start start 2024-09-12T03:35:32.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f954408a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 0x7f953c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f954408a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f953c070250 con 0x7f953c06fe50 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f954408a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f953c0aede0 con 0x7f953c15f3a0 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f954408a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f953c152480 con 0x7f953c1520a0 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9541625640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f953c06fe50 0x7f953c15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39028/0 (socket says 172.21.15.73:39028) 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9541625640 1 -- 172.21.15.73:0/764263309 learned_addr learned my addr 172.21.15.73:0/764263309 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862977814 0 0) 0x7f953c070250 con 0x7f953c06fe50 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9528003530 con 0x7f953c06fe50 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9541e26640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 0x7f953c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 811568944 0 0) 0x7f9528003530 con 0x7f953c06fe50 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 msgr2=0x7f953c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 0x7f953c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 >> v1:172.21.15.150:6789/0 conn(0x7f953c15f3a0 legacy=0x7f953c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c15fa10 con 0x7f953c06fe50 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f952c001680 con 0x7f953c06fe50 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 >> v1:172.21.15.73:6789/0 conn(0x7f953c06fe50 legacy=0x7f953c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95280039f0 0x7f9528003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 0x7f9528004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9528004d50 0x7f95280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f952800bb60 con 0x7f9528004d50 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f952800bce0 con 0x7f95280039f0 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f952800beb0 con 0x7f953c1520a0 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9542627640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9528004d50 0x7f95280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9541e26640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95280039f0 0x7f9528003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9541625640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 0x7f9528004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9542627640 1 -- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 msgr2=0x7f9528004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:32.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9542627640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c1520a0 0x7f9528004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9542627640 1 -- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95280039f0 msgr2=0x7f9528003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:32.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9542627640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95280039f0 0x7f9528003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9542627640 1 -- 172.21.15.73:0/764263309 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9528003530 con 0x7f9528004d50 2024-09-12T03:35:32.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9542627640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9528004d50 0x7f95280051d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f95380017b0 tx=0x7f953801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bb6b59ee1d6738 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.315+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95380013a0 con 0x7f9528004d50 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95380052f0 con 0x7f9528004d50 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9540e24640 1 -- 172.21.15.73:0/764263309 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538003840 con 0x7f9528004d50 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- 172.21.15.73:0/764263309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9528004d50 msgr2=0x7f95280051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 --2- 172.21.15.73:0/764263309 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9528004d50 0x7f95280051d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f95380017b0 tx=0x7f953801c400 comp rx=0 tx=0).stop 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9542627640 1 -- 172.21.15.73:0/764263309 reap_dead start 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- 172.21.15.73:0/764263309 shutdown_connections 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- 172.21.15.73:0/764263309 >> 172.21.15.73:0/764263309 conn(0x7f953c0b1f90 msgr2=0x7f953c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- 172.21.15.73:0/764263309 shutdown_connections 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- 172.21.15.73:0/764263309 wait complete. 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 Processor -- start 2024-09-12T03:35:32.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- start start 2024-09-12T03:35:32.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f953c0b3a90 0x7f953c147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f953c168220 0x7f953c099420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c149db0 0x7f953c099960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f953c073770 con 0x7f953c0b3a90 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f953c073490 con 0x7f953c168220 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f953c073a50 con 0x7f953c149db0 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f953c0b3a90 0x7f953c147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f953c0b3a90 0x7f953c147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41398/0 (socket says 172.21.15.73:41398) 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 -- 172.21.15.73:0/2277966113 learned_addr learned my addr 172.21.15.73:0/2277966113 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541625640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f953c168220 0x7f953c099420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9542627640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c149db0 0x7f953c099960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 -- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c149db0 msgr2=0x7f953c099960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c149db0 0x7f953c099960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 -- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f953c168220 msgr2=0x7f953c099420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f953c168220 0x7f953c099420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 -- 172.21.15.73:0/2277966113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953c099ea0 con 0x7f953c0b3a90 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541625640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f953c168220 0x7f953c099420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f9541e26640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f953c0b3a90 0x7f953c147ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9534009c80 tx=0x7f9534007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f95327fc640 1 -- 172.21.15.73:0/2277966113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534014610 con 0x7f953c0b3a90 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f95327fc640 1 -- 172.21.15.73:0/2277966113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9534019070 con 0x7f953c0b3a90 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953c145900 con 0x7f953c0b3a90 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f95327fc640 1 -- 172.21.15.73:0/2277966113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95340149d0 con 0x7f953c0b3a90 2024-09-12T03:35:32.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.319+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f953c145ec0 con 0x7f953c0b3a90 2024-09-12T03:35:32.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.323+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f953c073d30 con 0x7f953c0b3a90 2024-09-12T03:35:32.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.323+0000 7f95327fc640 1 -- 172.21.15.73:0/2277966113 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9534014b70 con 0x7f953c0b3a90 2024-09-12T03:35:32.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.323+0000 7f95327fc640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95200678f0 0x7f9520069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.323+0000 7f95327fc640 1 -- 172.21.15.73:0/2277966113 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f9534086720 con 0x7f953c0b3a90 2024-09-12T03:35:32.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.323+0000 7f9541625640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95200678f0 0x7f9520069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.323+0000 7f9541625640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95200678f0 0x7f9520069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f953c1f80b0 tx=0x7f952c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.327+0000 7f95327fc640 1 -- 172.21.15.73:0/2277966113 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9534057160 con 0x7f953c0b3a90 2024-09-12T03:35:32.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.491+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f953c06e540 con 0x7f953c0b3a90 2024-09-12T03:35:32.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.491+0000 7f95327fc640 1 -- 172.21.15.73:0/2277966113 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17027 (secure 0 0 0) 0x7f9534056a60 con 0x7f953c0b3a90 2024-09-12T03:35:32.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:32.498 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:35:31.472206+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:35:29.283824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T03:35:30.467360+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95200678f0 msgr2=0x7f9520069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95200678f0 0x7f9520069db0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f953c1f80b0 tx=0x7f952c009040 comp rx=0 tx=0).stop 2024-09-12T03:35:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f953c0b3a90 msgr2=0x7f953c147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f953c0b3a90 0x7f953c147ac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9534009c80 tx=0x7f9534007700 comp rx=0 tx=0).stop 2024-09-12T03:35:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 shutdown_connections 2024-09-12T03:35:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95200678f0 0x7f9520069db0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f953c149db0 0x7f953c099960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f953c168220 0x7f953c099420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 --2- 172.21.15.73:0/2277966113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f953c0b3a90 0x7f953c147ac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 >> 172.21.15.73:0/2277966113 conn(0x7f953c0b1f90 msgr2=0x7f953c0b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 shutdown_connections 2024-09-12T03:35:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.495+0000 7f954408a640 1 -- 172.21.15.73:0/2277966113 wait complete. 2024-09-12T03:35:32.518 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1c590640 1 Processor -- start 2024-09-12T03:35:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1c590640 1 -- start start 2024-09-12T03:35:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1c590640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff1415bec0 0x7eff140ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1c590640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff140af470 0x7eff1406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1c590640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff140b3290 con 0x7eff1415c2a0 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1c590640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7eff140b3570 con 0x7eff1415bec0 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1c590640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7eff140b3850 con 0x7eff140af470 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1a32c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff1415bec0 0x7eff140ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1a32c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff1415bec0 0x7eff140ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41406/0 (socket says 172.21.15.73:41406) 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1a32c640 1 -- 172.21.15.73:0/2820912716 learned_addr learned my addr 172.21.15.73:0/2820912716 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1a32c640 1 -- 172.21.15.73:0/2820912716 >> v2:172.21.15.150:3300/0 conn(0x7eff140af470 msgr2=0x7eff1406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1ab2d640 1 --2- 172.21.15.73:0/2820912716 >> v2:172.21.15.150:3300/0 conn(0x7eff140af470 0x7eff1406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1a32c640 1 --2- 172.21.15.73:0/2820912716 >> v2:172.21.15.150:3300/0 conn(0x7eff140af470 0x7eff1406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1a32c640 1 -- 172.21.15.73:0/2820912716 >> v1:172.21.15.150:6789/0 conn(0x7eff1415c2a0 legacy=0x7eff140aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.631+0000 7eff1a32c640 1 -- 172.21.15.73:0/2820912716 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff140b3b30 con 0x7eff1415bec0 2024-09-12T03:35:32.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1a32c640 1 --2- 172.21.15.73:0/2820912716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff140ad200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff140b2fb0 tx=0x7eff0401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c88c4f81c897d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1932a640 1 -- 172.21.15.73:0/2820912716 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040b1070 con 0x7eff1415bec0 2024-09-12T03:35:32.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1932a640 1 -- 172.21.15.73:0/2820912716 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff040ac620 con 0x7eff1415bec0 2024-09-12T03:35:32.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1932a640 1 -- 172.21.15.73:0/2820912716 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040ac9f0 con 0x7eff1415bec0 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- 172.21.15.73:0/2820912716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 msgr2=0x7eff140ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 --2- 172.21.15.73:0/2820912716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff140ad200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff140b2fb0 tx=0x7eff0401c4b0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- 172.21.15.73:0/2820912716 shutdown_connections 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 --2- 172.21.15.73:0/2820912716 >> v2:172.21.15.150:3300/0 conn(0x7eff140af470 0x7eff1406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 --2- 172.21.15.73:0/2820912716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff140ad200 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- 172.21.15.73:0/2820912716 >> 172.21.15.73:0/2820912716 conn(0x7eff140b1f90 msgr2=0x7eff140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- 172.21.15.73:0/2820912716 shutdown_connections 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- 172.21.15.73:0/2820912716 wait complete. 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 Processor -- start 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- start start 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff140af470 0x7eff14156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff1414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1415c2a0 0x7eff1414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7eff1406ed50 con 0x7eff1415bec0 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7eff140ad740 con 0x7eff140af470 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1c590640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7eff1406eed0 con 0x7eff1415c2a0 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff1414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff1414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41408/0 (socket says 172.21.15.73:41408) 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 -- 172.21.15.73:0/2412943409 learned_addr learned my addr 172.21.15.73:0/2412943409 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1a32c640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff140af470 0x7eff14156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 -- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1415c2a0 msgr2=0x7eff1414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1415c2a0 0x7eff1414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 -- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff140af470 msgr2=0x7eff14156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff140af470 0x7eff14156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 -- 172.21.15.73:0/2412943409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff14150960 con 0x7eff1415bec0 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff1a32c640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff140af470 0x7eff14156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.635+0000 7eff19b2b640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff1414a850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff1000b3e0 tx=0x7eff1000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff0affd640 1 -- 172.21.15.73:0/2412943409 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10015020 con 0x7eff1415bec0 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff0affd640 1 -- 172.21.15.73:0/2412943409 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff10011830 con 0x7eff1415bec0 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff141568e0 con 0x7eff1415bec0 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff0affd640 1 -- 172.21.15.73:0/2412943409 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10011c40 con 0x7eff1415bec0 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff14156ea0 con 0x7eff1415bec0 2024-09-12T03:35:32.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1406e000 con 0x7eff1415bec0 2024-09-12T03:35:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff0affd640 1 -- 172.21.15.73:0/2412943409 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff10018020 con 0x7eff1415bec0 2024-09-12T03:35:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff0affd640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efef80678c0 0x7efef8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff0affd640 1 -- 172.21.15.73:0/2412943409 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7eff10086300 con 0x7eff1415bec0 2024-09-12T03:35:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff1a32c640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efef80678c0 0x7efef8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.639+0000 7eff1a32c640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efef80678c0 0x7efef8069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff040ae000 tx=0x7eff04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.643+0000 7eff0affd640 1 -- 172.21.15.73:0/2412943409 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff1001f020 con 0x7eff1415bec0 2024-09-12T03:35:32.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.807+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff1406fcd0 con 0x7eff1415bec0 2024-09-12T03:35:32.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff0affd640 1 -- 172.21.15.73:0/2412943409 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+17027 (secure 0 0 0) 0x7eff10056d90 con 0x7eff1415bec0 2024-09-12T03:35:32.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:32.816 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:35:31.472206+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:35:29.283824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T03:35:30.467360+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efef80678c0 msgr2=0x7efef8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efef80678c0 0x7efef8069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff040ae000 tx=0x7eff04008040 comp rx=0 tx=0).stop 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 msgr2=0x7eff1414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff1414a850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff1000b3e0 tx=0x7eff1000b8a0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 shutdown_connections 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efef80678c0 0x7efef8069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff1415bec0 0x7eff1414a850 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7eff1415c2a0 0x7eff1414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 --2- 172.21.15.73:0/2412943409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff140af470 0x7eff14156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 >> 172.21.15.73:0/2412943409 conn(0x7eff140b1f90 msgr2=0x7eff14159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 shutdown_connections 2024-09-12T03:35:32.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.811+0000 7eff1c590640 1 -- 172.21.15.73:0/2412943409 wait complete. 2024-09-12T03:35:32.834 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T03:35:32.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f4905246640 1 Processor -- start 2024-09-12T03:35:32.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f4905246640 1 -- start start 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f4905246640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4900140f70 0x7f4900071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f4905246640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900071c70 0x7f4900141350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f4905246640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49000720b0 con 0x7f4900141890 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f4905246640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4900072660 con 0x7f4900140f70 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f4905246640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f49000d15e0 con 0x7f4900071c70 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4900140f70 0x7f4900071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4900140f70 0x7f4900071730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41418/0 (socket says 172.21.15.73:41418) 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fed9d640 1 -- 172.21.15.73:0/2909619907 learned_addr learned my addr 172.21.15.73:0/2909619907 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fe59c640 1 --2- 172.21.15.73:0/2909619907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900071c70 0x7f4900141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fed9d640 1 -- 172.21.15.73:0/2909619907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900071c70 msgr2=0x7f4900141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:32.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fed9d640 1 --2- 172.21.15.73:0/2909619907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900071c70 0x7f4900141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fed9d640 1 -- 172.21.15.73:0/2909619907 >> v1:172.21.15.150:6789/0 conn(0x7f4900141890 legacy=0x7f490015fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:32.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.951+0000 7f48fed9d640 1 -- 172.21.15.73:0/2909619907 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4900072380 con 0x7f4900140f70 2024-09-12T03:35:32.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f48fed9d640 1 --2- 172.21.15.73:0/2909619907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900140f70 0x7f4900071730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009870 tx=0x7f48f001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25779fb80b4ffceb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f48fdd9b640 1 -- 172.21.15.73:0/2909619907 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a95f0 con 0x7f4900140f70 2024-09-12T03:35:32.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f48fdd9b640 1 -- 172.21.15.73:0/2909619907 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f00a9790 con 0x7f4900140f70 2024-09-12T03:35:32.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f48fdd9b640 1 -- 172.21.15.73:0/2909619907 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a9b60 con 0x7f4900140f70 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 -- 172.21.15.73:0/2909619907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900140f70 msgr2=0x7f4900071730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 --2- 172.21.15.73:0/2909619907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900140f70 0x7f4900071730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009870 tx=0x7f48f001c530 comp rx=0 tx=0).stop 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 -- 172.21.15.73:0/2909619907 shutdown_connections 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 --2- 172.21.15.73:0/2909619907 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900071c70 0x7f4900141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 --2- 172.21.15.73:0/2909619907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900140f70 0x7f4900071730 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 -- 172.21.15.73:0/2909619907 >> 172.21.15.73:0/2909619907 conn(0x7f49000b3e70 msgr2=0x7f49000b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 -- 172.21.15.73:0/2909619907 shutdown_connections 2024-09-12T03:35:32.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 -- 172.21.15.73:0/2909619907 wait complete. 2024-09-12T03:35:32.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 Processor -- start 2024-09-12T03:35:32.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.955+0000 7f4905246640 1 -- start start 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900071c70 0x7f4900158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900140f70 0x7f490013adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4900141890 0x7f490015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49000d2c00 con 0x7f4900071c70 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f49000d2a80 con 0x7f4900141890 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4900168d80 con 0x7f4900140f70 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900071c70 0x7f4900158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900071c70 0x7f4900158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41434/0 (socket says 172.21.15.73:41434) 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 -- 172.21.15.73:0/4208504842 learned_addr learned my addr 172.21.15.73:0/4208504842 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 -- 172.21.15.73:0/4208504842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900140f70 msgr2=0x7f490013adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900140f70 0x7f490013adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 -- 172.21.15.73:0/4208504842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4900141890 msgr2=0x7f490015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4900141890 0x7f490015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 -- 172.21.15.73:0/4208504842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490013e380 con 0x7f4900071c70 2024-09-12T03:35:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fed9d640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900071c70 0x7f4900158990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f48f00ab040 tx=0x7f48f001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48e77fe640 1 -- 172.21.15.73:0/4208504842 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b1800 con 0x7f4900071c70 2024-09-12T03:35:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48e77fe640 1 -- 172.21.15.73:0/4208504842 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f00b19c0 con 0x7f4900071c70 2024-09-12T03:35:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48e77fe640 1 -- 172.21.15.73:0/4208504842 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b1db0 con 0x7f4900071c70 2024-09-12T03:35:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49001428e0 con 0x7f4900071c70 2024-09-12T03:35:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4900142b50 con 0x7f4900071c70 2024-09-12T03:35:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4900068930 con 0x7f4900071c70 2024-09-12T03:35:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48e77fe640 1 -- 172.21.15.73:0/4208504842 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f48f00a8350 con 0x7f4900071c70 2024-09-12T03:35:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48e77fe640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48e77fe640 1 -- 172.21.15.73:0/4208504842 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f48f01206a0 con 0x7f4900071c70 2024-09-12T03:35:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.959+0000 7f48fe59c640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:32.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.963+0000 7f48fe59c640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f48ec0678c0 0x7f48ec069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f490013e100 tx=0x7f48f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:32.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:32.967+0000 7f48e77fe640 1 -- 172.21.15.73:0/4208504842 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f48f00c3030 con 0x7f4900071c70 2024-09-12T03:35:33.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:33.163+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f49000b38b0 con 0x7f4900071c70 2024-09-12T03:35:34.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.175+0000 7f48e77fe640 1 -- 172.21.15.73:0/4208504842 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f48f00ad020 con 0x7f4900071c70 2024-09-12T03:35:34.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f48ec0678c0 msgr2=0x7f48ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:34.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f48ec0678c0 0x7f48ec069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f490013e100 tx=0x7f48f4008040 comp rx=0 tx=0).stop 2024-09-12T03:35:34.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900071c70 msgr2=0x7f4900158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:34.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900071c70 0x7f4900158990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f48f00ab040 tx=0x7f48f001ad70 comp rx=0 tx=0).stop 2024-09-12T03:35:34.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 shutdown_connections 2024-09-12T03:35:34.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f48ec0678c0 0x7f48ec069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4900141890 0x7f490015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4900140f70 0x7f490013adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 --2- 172.21.15.73:0/4208504842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4900071c70 0x7f4900158990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 >> 172.21.15.73:0/4208504842 conn(0x7f49000b3e70 msgr2=0x7f49001404f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:34.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 shutdown_connections 2024-09-12T03:35:34.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.179+0000 7f4905246640 1 -- 172.21.15.73:0/4208504842 wait complete. 2024-09-12T03:35:34.204 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T03:35:34.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T03:35:34.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.327+0000 7fb80982b640 1 Processor -- start 2024-09-12T03:35:34.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb80982b640 1 -- start start 2024-09-12T03:35:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb80982b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8041520a0 0x7fb80406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb80982b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb80406fe50 0x7fb80415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb80982b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb804070250 con 0x7fb80415f1d0 2024-09-12T03:35:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb80982b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb804152480 con 0x7fb80406fe50 2024-09-12T03:35:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb80982b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb8040aede0 con 0x7fb8041520a0 2024-09-12T03:35:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb7fbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb80406fe50 0x7fb80415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:34.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb8037fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb80415f1d0 0x7fb804071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39032/0 (socket says 172.21.15.73:39032) 2024-09-12T03:35:34.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb8037fe640 1 -- 172.21.15.73:0/3643209008 learned_addr learned my addr 172.21.15.73:0/3643209008 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:34.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb802ffd640 1 --2- 172.21.15.73:0/3643209008 >> v2:172.21.15.150:3300/0 conn(0x7fb8041520a0 0x7fb80406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:34.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb7fbfff640 1 -- 172.21.15.73:0/3643209008 >> v2:172.21.15.150:3300/0 conn(0x7fb8041520a0 msgr2=0x7fb80406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:34.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb7fbfff640 1 --2- 172.21.15.73:0/3643209008 >> v2:172.21.15.150:3300/0 conn(0x7fb8041520a0 0x7fb80406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb7fbfff640 1 -- 172.21.15.73:0/3643209008 >> v1:172.21.15.73:6789/0 conn(0x7fb80415f1d0 legacy=0x7fb804071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:34.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb8027fc640 1 -- 172.21.15.73:0/3643209008 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740246801 0 0) 0x7fb804070250 con 0x7fb80415f1d0 2024-09-12T03:35:34.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb7fbfff640 1 -- 172.21.15.73:0/3643209008 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80415fa10 con 0x7fb80406fe50 2024-09-12T03:35:34.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb7fbfff640 1 --2- 172.21.15.73:0/3643209008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80406fe50 0x7fb80415ec90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb804071710 tx=0x7fb7ec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eea153a5887c5d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:34.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.331+0000 7fb8027fc640 1 -- 172.21.15.73:0/3643209008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0b2070 con 0x7fb80406fe50 2024-09-12T03:35:34.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8027fc640 1 -- 172.21.15.73:0/3643209008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0ad680 con 0x7fb80406fe50 2024-09-12T03:35:34.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8027fc640 1 -- 172.21.15.73:0/3643209008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0ada50 con 0x7fb80406fe50 2024-09-12T03:35:34.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- 172.21.15.73:0/3643209008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80406fe50 msgr2=0x7fb80415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:34.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 --2- 172.21.15.73:0/3643209008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80406fe50 0x7fb80415ec90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb804071710 tx=0x7fb7ec01c460 comp rx=0 tx=0).stop 2024-09-12T03:35:34.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- 172.21.15.73:0/3643209008 shutdown_connections 2024-09-12T03:35:34.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 --2- 172.21.15.73:0/3643209008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80406fe50 0x7fb80415ec90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 --2- 172.21.15.73:0/3643209008 >> v2:172.21.15.150:3300/0 conn(0x7fb8041520a0 0x7fb80406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- 172.21.15.73:0/3643209008 >> 172.21.15.73:0/3643209008 conn(0x7fb8040b1f90 msgr2=0x7fb8040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:34.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- 172.21.15.73:0/3643209008 shutdown_connections 2024-09-12T03:35:34.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- 172.21.15.73:0/3643209008 wait complete. 2024-09-12T03:35:34.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 Processor -- start 2024-09-12T03:35:34.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- start start 2024-09-12T03:35:34.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb80406fe50 0x7fb80414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8041520a0 0x7fb8040cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80415f1d0 0x7fb8040ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb804073d30 con 0x7fb80415f1d0 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb804073a50 con 0x7fb80406fe50 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb80415f620 con 0x7fb8041520a0 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80415f1d0 0x7fb8040ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80415f1d0 0x7fb8040ce850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:41448/0 (socket says 172.21.15.73:41448) 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 -- 172.21.15.73:0/481041130 learned_addr learned my addr 172.21.15.73:0/481041130 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb802ffd640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb80406fe50 0x7fb80414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb7fbfff640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8041520a0 0x7fb8040cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 -- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8041520a0 msgr2=0x7fb8040cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8041520a0 0x7fb8040cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 -- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb80406fe50 msgr2=0x7fb80414dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb80406fe50 0x7fb80414dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 -- 172.21.15.73:0/481041130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8040ced90 con 0x7fb80415f1d0 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb7fbfff640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8041520a0 0x7fb8040cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb8037fe640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80415f1d0 0x7fb8040ce850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001570 tx=0x7fb7fc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb800ff9640 1 -- 172.21.15.73:0/481041130 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc018070 con 0x7fb80415f1d0 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb800ff9640 1 -- 172.21.15.73:0/481041130 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc00a640 con 0x7fb80415f1d0 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80409a740 con 0x7fb80415f1d0 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb800ff9640 1 -- 172.21.15.73:0/481041130 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc00aa30 con 0x7fb80415f1d0 2024-09-12T03:35:34.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.335+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8040ce050 con 0x7fb80415f1d0 2024-09-12T03:35:34.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.339+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80415ec90 con 0x7fb80415f1d0 2024-09-12T03:35:34.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.339+0000 7fb800ff9640 1 -- 172.21.15.73:0/481041130 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7fc01b070 con 0x7fb80415f1d0 2024-09-12T03:35:34.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.339+0000 7fb800ff9640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb7e40678c0 0x7fb7e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:34.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.339+0000 7fb800ff9640 1 -- 172.21.15.73:0/481041130 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb7fc085430 con 0x7fb80415f1d0 2024-09-12T03:35:34.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.339+0000 7fb802ffd640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb7e40678c0 0x7fb7e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:34.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.339+0000 7fb802ffd640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb7e40678c0 0x7fb7e4069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb80415de80 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:34.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.343+0000 7fb800ff9640 1 -- 172.21.15.73:0/481041130 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7fc055e70 con 0x7fb80415f1d0 2024-09-12T03:35:34.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:34.535+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb80406e540 con 0x7fb80415f1d0 2024-09-12T03:35:35.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.179+0000 7fb800ff9640 1 -- 172.21.15.73:0/481041130 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fb7fc055770 con 0x7fb80415f1d0 2024-09-12T03:35:35.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb7e40678c0 msgr2=0x7fb7e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb7e40678c0 0x7fb7e4069d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb80415de80 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2024-09-12T03:35:35.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80415f1d0 msgr2=0x7fb8040ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80415f1d0 0x7fb8040ce850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc001570 tx=0x7fb7fc00cca0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 shutdown_connections 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb7e40678c0 0x7fb7e4069d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb80415f1d0 0x7fb8040ce850 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8041520a0 0x7fb8040cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 --2- 172.21.15.73:0/481041130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb80406fe50 0x7fb80414dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 >> 172.21.15.73:0/481041130 conn(0x7fb8040b1f90 msgr2=0x7fb80406f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 shutdown_connections 2024-09-12T03:35:35.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.183+0000 7fb80982b640 1 -- 172.21.15.73:0/481041130 wait complete. 2024-09-12T03:35:35.211 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T03:35:35.211 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 Processor -- start 2024-09-12T03:35:35.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 -- start start 2024-09-12T03:35:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0881587a0 0x7fd0880b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0880b37d0 0x7fd08806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd08806e4b0 0x7fd088161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd08806f870 con 0x7fd0880b37d0 2024-09-12T03:35:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd0880b3c10 con 0x7fd08806e4b0 2024-09-12T03:35:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd08dfcd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd08806ec60 con 0x7fd0881587a0 2024-09-12T03:35:35.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd086ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0880b37d0 0x7fd08806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd086ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0880b37d0 0x7fd08806df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49592/0 (socket says 172.21.15.73:49592) 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.319+0000 7fd086ffd640 1 -- 172.21.15.73:0/3896513975 learned_addr learned my addr 172.21.15.73:0/3896513975 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd087fff640 1 --2- 172.21.15.73:0/3896513975 >> v2:172.21.15.150:3300/0 conn(0x7fd08806e4b0 0x7fd088161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd0877fe640 1 --2- 172.21.15.73:0/3896513975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0881587a0 0x7fd0880b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd086ffd640 1 -- 172.21.15.73:0/3896513975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0881587a0 msgr2=0x7fd0880b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd086ffd640 1 --2- 172.21.15.73:0/3896513975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0881587a0 0x7fd0880b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd086ffd640 1 -- 172.21.15.73:0/3896513975 >> v2:172.21.15.150:3300/0 conn(0x7fd08806e4b0 msgr2=0x7fd088161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd086ffd640 1 --2- 172.21.15.73:0/3896513975 >> v2:172.21.15.150:3300/0 conn(0x7fd08806e4b0 0x7fd088161e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd086ffd640 1 -- 172.21.15.73:0/3896513975 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08806ef40 con 0x7fd0880b37d0 2024-09-12T03:35:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd086ffd640 1 --2- 172.21.15.73:0/3896513975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880b37d0 0x7fd08806df70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd08806da30 tx=0x7fd07c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177aca1b9eead82f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd0867fc640 1 -- 172.21.15.73:0/3896513975 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0b0070 con 0x7fd0880b37d0 2024-09-12T03:35:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd0867fc640 1 -- 172.21.15.73:0/3896513975 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c0ab600 con 0x7fd0880b37d0 2024-09-12T03:35:35.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd0867fc640 1 -- 172.21.15.73:0/3896513975 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0ab9d0 con 0x7fd0880b37d0 2024-09-12T03:35:35.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 -- 172.21.15.73:0/3896513975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880b37d0 msgr2=0x7fd08806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/3896513975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880b37d0 0x7fd08806df70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd08806da30 tx=0x7fd07c01c230 comp rx=0 tx=0).stop 2024-09-12T03:35:35.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 -- 172.21.15.73:0/3896513975 shutdown_connections 2024-09-12T03:35:35.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/3896513975 >> v2:172.21.15.150:3300/0 conn(0x7fd08806e4b0 0x7fd088161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/3896513975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0880b37d0 0x7fd08806df70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/3896513975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0881587a0 0x7fd0880b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 -- 172.21.15.73:0/3896513975 >> 172.21.15.73:0/3896513975 conn(0x7fd0880b1f90 msgr2=0x7fd0880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:35.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 -- 172.21.15.73:0/3896513975 shutdown_connections 2024-09-12T03:35:35.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.323+0000 7fd08dfcd640 1 -- 172.21.15.73:0/3896513975 wait complete. 2024-09-12T03:35:35.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 Processor -- start 2024-09-12T03:35:35.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 -- start start 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd08806e4b0 0x7fd088146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0880b37d0 0x7fd08814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0881587a0 0x7fd088160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd088158b80 con 0x7fd08806e4b0 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd088072160 con 0x7fd0881587a0 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd088150df0 con 0x7fd0880b37d0 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd08806e4b0 0x7fd088146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd08806e4b0 0x7fd088146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49600/0 (socket says 172.21.15.73:49600) 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 -- 172.21.15.73:0/2685446954 learned_addr learned my addr 172.21.15.73:0/2685446954 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd086ffd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0880b37d0 0x7fd08814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd087fff640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0881587a0 0x7fd088160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 -- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0880b37d0 msgr2=0x7fd08814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0880b37d0 0x7fd08814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 -- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0881587a0 msgr2=0x7fd088160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0881587a0 0x7fd088160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 -- 172.21.15.73:0/2685446954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd088160e60 con 0x7fd08806e4b0 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd0877fe640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd08806e4b0 0x7fd088146720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd080007e40 tx=0x7fd08000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd06ffff640 1 -- 172.21.15.73:0/2685446954 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080014620 con 0x7fd08806e4b0 2024-09-12T03:35:35.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd06ffff640 1 -- 172.21.15.73:0/2685446954 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd080019070 con 0x7fd08806e4b0 2024-09-12T03:35:35.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0881501e0 con 0x7fd08806e4b0 2024-09-12T03:35:35.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd06ffff640 1 -- 172.21.15.73:0/2685446954 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080014a00 con 0x7fd08806e4b0 2024-09-12T03:35:35.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0881507a0 con 0x7fd08806e4b0 2024-09-12T03:35:35.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd088070080 con 0x7fd08806e4b0 2024-09-12T03:35:35.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd06ffff640 1 -- 172.21.15.73:0/2685446954 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd080014ba0 con 0x7fd08806e4b0 2024-09-12T03:35:35.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.327+0000 7fd06ffff640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0740678c0 0x7fd074069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.331+0000 7fd06ffff640 1 -- 172.21.15.73:0/2685446954 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd0800866e0 con 0x7fd08806e4b0 2024-09-12T03:35:35.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.331+0000 7fd086ffd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0740678c0 0x7fd074069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.331+0000 7fd086ffd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0740678c0 0x7fd074069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0ad000 tx=0x7fd07c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.335+0000 7fd06ffff640 1 -- 172.21.15.73:0/2685446954 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd080057090 con 0x7fd08806e4b0 2024-09-12T03:35:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd088073420 con 0x7fd08806e4b0 2024-09-12T03:35:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd06ffff640 1 -- 172.21.15.73:0/2685446954 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7fd080056990 con 0x7fd08806e4b0 2024-09-12T03:35:35.537 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:35.537 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"btime":"2024-09-12T03:35:35:181396+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4171638220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4171638220},{"type":"v1","addr":"172.21.15.150:6834","nonce":4171638220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/586996144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":586996144},{"type":"v1","addr":"172.21.15.150:6835","nonce":586996144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4854,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1039518252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1039518252},{"type":"v1","addr":"172.21.15.73:6835","nonce":1039518252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:35:31.472966+0000","modified":"2024-09-12T03:35:34.542272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/1768372387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1768372387},{"type":"v1","addr":"172.21.15.73:6837","nonce":1768372387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-12T03:35:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-09-12T03:35:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0740678c0 msgr2=0x7fd074069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0740678c0 0x7fd074069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd07c0ad000 tx=0x7fd07c008040 comp rx=0 tx=0).stop 2024-09-12T03:35:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd08806e4b0 msgr2=0x7fd088146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd08806e4b0 0x7fd088146720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd080007e40 tx=0x7fd08000e4b0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 shutdown_connections 2024-09-12T03:35:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0740678c0 0x7fd074069d80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0881587a0 0x7fd088160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0880b37d0 0x7fd08814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 --2- 172.21.15.73:0/2685446954 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd08806e4b0 0x7fd088146720 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 >> 172.21.15.73:0/2685446954 conn(0x7fd0880b1f90 msgr2=0x7fd0880b0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 shutdown_connections 2024-09-12T03:35:35.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.531+0000 7fd08dfcd640 1 -- 172.21.15.73:0/2685446954 wait complete. 2024-09-12T03:35:35.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:35.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.659+0000 7fb07fd7d640 1 Processor -- start 2024-09-12T03:35:35.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.659+0000 7fb07fd7d640 1 -- start start 2024-09-12T03:35:35.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0781587a0 0x7fb0780b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb07806e680 0x7fb078072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb07806ec60 con 0x7fb0780b37d0 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb07806f870 con 0x7fb07806e680 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb0780b3c10 con 0x7fb0781587a0 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07d318640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb0780b37d0 0x7fb07806df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58924/0 (socket says 172.21.15.73:58924) 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07e31a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb07806e680 0x7fb078072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07d318640 1 -- 172.21.15.73:0/1415195884 learned_addr learned my addr 172.21.15.73:0/1415195884 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07db19640 1 --2- 172.21.15.73:0/1415195884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0781587a0 0x7fb0780b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07e31a640 1 -- 172.21.15.73:0/1415195884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0781587a0 msgr2=0x7fb0780b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07e31a640 1 --2- 172.21.15.73:0/1415195884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0781587a0 0x7fb0780b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07e31a640 1 -- 172.21.15.73:0/1415195884 >> v1:172.21.15.73:6789/0 conn(0x7fb0780b37d0 legacy=0x7fb07806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07e31a640 1 -- 172.21.15.73:0/1415195884 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07806ef40 con 0x7fb07806e680 2024-09-12T03:35:35.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07cb17640 1 -- 172.21.15.73:0/1415195884 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925653771 0 0) 0x7fb07806ec60 con 0x7fb0780b37d0 2024-09-12T03:35:35.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07e31a640 1 --2- 172.21.15.73:0/1415195884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb078072160 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb0700097c0 tx=0x7fb07001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17832452e7a89c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07cb17640 1 -- 172.21.15.73:0/1415195884 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0700a7070 con 0x7fb07806e680 2024-09-12T03:35:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07cb17640 1 -- 172.21.15.73:0/1415195884 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0700b0070 con 0x7fb07806e680 2024-09-12T03:35:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07cb17640 1 -- 172.21.15.73:0/1415195884 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0700ab890 con 0x7fb07806e680 2024-09-12T03:35:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- 172.21.15.73:0/1415195884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 msgr2=0x7fb078072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/1415195884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb078072160 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb0700097c0 tx=0x7fb07001c470 comp rx=0 tx=0).stop 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- 172.21.15.73:0/1415195884 shutdown_connections 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/1415195884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb078072160 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/1415195884 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0781587a0 0x7fb0780b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- 172.21.15.73:0/1415195884 >> 172.21.15.73:0/1415195884 conn(0x7fb0780b1f90 msgr2=0x7fb0780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- 172.21.15.73:0/1415195884 shutdown_connections 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.663+0000 7fb07fd7d640 1 -- 172.21.15.73:0/1415195884 wait complete. 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 Processor -- start 2024-09-12T03:35:35.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 -- start start 2024-09-12T03:35:35.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb0781452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0780b37d0 0x7fb07815d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0781587a0 0x7fb0781f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb078073030 con 0x7fb07806e680 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb078072eb0 con 0x7fb0781587a0 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb0780731b0 con 0x7fb0780b37d0 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb0781452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb0781452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49620/0 (socket says 172.21.15.73:49620) 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 -- 172.21.15.73:0/2835602611 learned_addr learned my addr 172.21.15.73:0/2835602611 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07d318640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0780b37d0 0x7fb07815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07e31a640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0781587a0 0x7fb0781f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 -- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0780b37d0 msgr2=0x7fb07815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0780b37d0 0x7fb07815d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 -- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0781587a0 msgr2=0x7fb0781f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0781587a0 0x7fb0781f9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 -- 172.21.15.73:0/2835602611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb078145af0 con 0x7fb07806e680 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07db19640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb0781452a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb06800d800 tx=0x7fb06800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb0767fc640 1 -- 172.21.15.73:0/2835602611 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06800b6c0 con 0x7fb07806e680 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb0767fc640 1 -- 172.21.15.73:0/2835602611 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb068019070 con 0x7fb07806e680 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb078145dd0 con 0x7fb07806e680 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb0767fc640 1 -- 172.21.15.73:0/2835602611 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06800ba60 con 0x7fb07806e680 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb078146390 con 0x7fb07806e680 2024-09-12T03:35:35.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb078072160 con 0x7fb07806e680 2024-09-12T03:35:35.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.667+0000 7fb0767fc640 1 -- 172.21.15.73:0/2835602611 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb06800bc00 con 0x7fb07806e680 2024-09-12T03:35:35.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.671+0000 7fb0767fc640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb0640678c0 0x7fb064069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.671+0000 7fb07d318640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb0640678c0 0x7fb064069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.671+0000 7fb0767fc640 1 -- 172.21.15.73:0/2835602611 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb068086250 con 0x7fb07806e680 2024-09-12T03:35:35.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.671+0000 7fb07d318640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb0640678c0 0x7fb064069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb078147f10 tx=0x7fb06c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.675+0000 7fb0767fc640 1 -- 172.21.15.73:0/2835602611 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb068056c90 con 0x7fb07806e680 2024-09-12T03:35:35.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.823+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb078070080 con 0x7fb07806e680 2024-09-12T03:35:35.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb0767fc640 1 -- 172.21.15.73:0/2835602611 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17014 (secure 0 0 0) 0x7fb068056590 con 0x7fb07806e680 2024-09-12T03:35:35.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:35.831 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:35:33.137392+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:35:29.283824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T03:35:30.467360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:35.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb0640678c0 msgr2=0x7fb064069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb0640678c0 0x7fb064069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb078147f10 tx=0x7fb06c009040 comp rx=0 tx=0).stop 2024-09-12T03:35:35.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 msgr2=0x7fb0781452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb0781452a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb06800d800 tx=0x7fb06800dcc0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 shutdown_connections 2024-09-12T03:35:35.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb0640678c0 0x7fb064069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0781587a0 0x7fb0781f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0780b37d0 0x7fb07815d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 --2- 172.21.15.73:0/2835602611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb07806e680 0x7fb0781452a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 >> 172.21.15.73:0/2835602611 conn(0x7fb0780b1f90 msgr2=0x7fb0780b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:35.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 shutdown_connections 2024-09-12T03:35:35.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.827+0000 7fb07fd7d640 1 -- 172.21.15.73:0/2835602611 wait complete. 2024-09-12T03:35:35.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:35:35.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:35:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3c517640 1 Processor -- start 2024-09-12T03:35:35.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3c517640 1 -- start start 2024-09-12T03:35:35.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3c517640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 0x7f3d340ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3c517640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3d3415c2a0 0x7f3d340aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3c517640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d340b3290 con 0x7f3d340af2a0 2024-09-12T03:35:35.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3c517640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3d340b3570 con 0x7f3d3415c2a0 2024-09-12T03:35:35.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3c517640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d340b3850 con 0x7f3d3415bec0 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3d340af2a0 0x7f3d3415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58936/0 (socket says 172.21.15.73:58936) 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 -- 172.21.15.73:0/888340559 learned_addr learned my addr 172.21.15.73:0/888340559 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d39ab2640 1 --2- 172.21.15.73:0/888340559 >> v2:172.21.15.150:3300/0 conn(0x7f3d3415c2a0 0x7f3d340aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124590294 0 0) 0x7f3d340b3290 con 0x7f3d340af2a0 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d20003530 con 0x7f3d340af2a0 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3a2b3640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 0x7f3d340ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997599548 0 0) 0x7f3d20003530 con 0x7f3d340af2a0 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 msgr2=0x7f3d340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:35.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 0x7f3d340ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 >> v2:172.21.15.150:3300/0 conn(0x7f3d3415c2a0 msgr2=0x7f3d340aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 --2- 172.21.15.73:0/888340559 >> v2:172.21.15.150:3300/0 conn(0x7f3d3415c2a0 0x7f3d340aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d340b3b30 con 0x7f3d340af2a0 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f3d2c001a00 con 0x7f3d340af2a0 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 >> v1:172.21.15.73:6789/0 conn(0x7f3d340af2a0 legacy=0x7f3d3415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 0x7f3d200039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20003f40 0x7f3d20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d20004d50 0x7f3d200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340b3570 con 0x7f3d20004d50 2024-09-12T03:35:35.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340b3850 con 0x7f3d20003f40 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d2000ba20 con 0x7f3d3415bec0 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d20004d50 0x7f3d200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3a2b3640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 0x7f3d200039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 -- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 msgr2=0x7f3d200039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d3415bec0 0x7f3d200039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 -- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20003f40 msgr2=0x7f3d20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d39ab2640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20003f40 0x7f3d20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20003f40 0x7f3d20004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.963+0000 7f3d3aab4640 1 -- 172.21.15.73:0/888340559 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d20003530 con 0x7f3d20004d50 2024-09-12T03:35:35.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3aab4640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d20004d50 0x7f3d200051d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00a880 tx=0x7f3d2c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3badd79935cfdc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00a4a0 con 0x7f3d20004d50 2024-09-12T03:35:35.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d2c0ad630 con 0x7f3d20004d50 2024-09-12T03:35:35.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d392b1640 1 -- 172.21.15.73:0/888340559 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0adaa0 con 0x7f3d20004d50 2024-09-12T03:35:35.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- 172.21.15.73:0/888340559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d20004d50 msgr2=0x7f3d200051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 --2- 172.21.15.73:0/888340559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d20004d50 0x7f3d200051d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00a880 tx=0x7f3d2c01d3a0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3aab4640 1 -- 172.21.15.73:0/888340559 reap_dead start 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- 172.21.15.73:0/888340559 shutdown_connections 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- 172.21.15.73:0/888340559 >> 172.21.15.73:0/888340559 conn(0x7f3d340b1f90 msgr2=0x7f3d340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- 172.21.15.73:0/888340559 shutdown_connections 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- 172.21.15.73:0/888340559 wait complete. 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 Processor -- start 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- start start 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20004d50 0x7f3d3414fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d341e4590 0x7f3d3414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d341e3120 0x7f3d341e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340af730 con 0x7f3d341e4590 2024-09-12T03:35:35.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3d340b40f0 con 0x7f3d20004d50 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3c517640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d340afc90 con 0x7f3d341e3120 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d341e4590 0x7f3d3414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d341e4590 0x7f3d3414b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49642/0 (socket says 172.21.15.73:49642) 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 -- 172.21.15.73:0/3701481014 learned_addr learned my addr 172.21.15.73:0/3701481014 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3a2b3640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20004d50 0x7f3d3414fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d3aab4640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d341e3120 0x7f3d341e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 -- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d341e3120 msgr2=0x7f3d341e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d341e3120 0x7f3d341e35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 -- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20004d50 msgr2=0x7f3d3414fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20004d50 0x7f3d3414fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:35.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 -- 172.21.15.73:0/3701481014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d341e4d70 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.967+0000 7f3d39ab2640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d341e4590 0x7f3d3414b060 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d300108d0 tx=0x7f3d30010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d2affd640 1 -- 172.21.15.73:0/3701481014 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000f040 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d2affd640 1 -- 172.21.15.73:0/3701481014 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3000eb00 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d341e5050 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d2affd640 1 -- 172.21.15.73:0/3701481014 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3001c400 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d341e5610 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d340aed60 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d2affd640 1 -- 172.21.15.73:0/3701481014 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d3001c5a0 con 0x7f3d341e4590 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d2affd640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d180678f0 0x7f3d18069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d3a2b3640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d180678f0 0x7f3d18069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:35.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d2affd640 1 -- 172.21.15.73:0/3701481014 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3d300864b0 con 0x7f3d341e4590 2024-09-12T03:35:35.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.971+0000 7f3d3a2b3640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d180678f0 0x7f3d18069db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d240097f0 tx=0x7f3d24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:35.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:35.975+0000 7f3d2affd640 1 -- 172.21.15.73:0/3701481014 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d30018030 con 0x7f3d341e4590 2024-09-12T03:35:36.072 INFO:tasks.ceph.mds.a.smithi073.stderr:2024-09-12T03:35:36.067+0000 7fa452fa4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:35:36.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.135+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d3406fcd0 con 0x7f3d180678f0 2024-09-12T03:35:36.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.147+0000 7f3d2affd640 1 -- 172.21.15.73:0/3701481014 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249354 (secure 0 0 0) 0x7f3d3406fcd0 con 0x7f3d180678f0 2024-09-12T03:35:36.157 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:36.159 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:35:36.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d180678f0 msgr2=0x7f3d18069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d180678f0 0x7f3d18069db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d240097f0 tx=0x7f3d24008040 comp rx=0 tx=0).stop 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d341e4590 msgr2=0x7f3d3414b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d341e4590 0x7f3d3414b060 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3d300108d0 tx=0x7f3d30010d90 comp rx=0 tx=0).stop 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 shutdown_connections 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d180678f0 0x7f3d18069db0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d341e4590 0x7f3d3414b060 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d341e3120 0x7f3d341e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 --2- 172.21.15.73:0/3701481014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d20004d50 0x7f3d3414fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 >> 172.21.15.73:0/3701481014 conn(0x7f3d340b1f90 msgr2=0x7f3d341597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:36.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 shutdown_connections 2024-09-12T03:35:36.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.151+0000 7f3d3c517640 1 -- 172.21.15.73:0/3701481014 wait complete. 2024-09-12T03:35:36.174 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T03:35:35.806569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220740,"kb_used_data":4508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753980,"statfs":{"total":773094113280,"available":772868075520,"internally_reserved":0,"allocated":4616192,"data_stored":2631185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709182"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178355+0000","last_change":"2024-09-12T03:35:32.169010+0000","last_active":"2024-09-12T03:35:32.178355+0000","last_peered":"2024-09-12T03:35:32.178355+0000","last_clean":"2024-09-12T03:35:32.178355+0000","last_became_active":"2024-09-12T03:35:32.168574+0000","last_became_peered":"2024-09-12T03:35:32.168574+0000","last_unstale":"2024-09-12T03:35:32.178355+0000","last_undegraded":"2024-09-12T03:35:32.178355+0000","last_fullsized":"2024-09-12T03:35:32.178355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167459+0000","last_change":"2024-09-12T03:35:32.157902+0000","last_active":"2024-09-12T03:35:32.167459+0000","last_peered":"2024-09-12T03:35:32.167459+0000","last_clean":"2024-09-12T03:35:32.167459+0000","last_became_active":"2024-09-12T03:35:32.157125+0000","last_became_peered":"2024-09-12T03:35:32.157125+0000","last_unstale":"2024-09-12T03:35:32.167459+0000","last_undegraded":"2024-09-12T03:35:32.167459+0000","last_fullsized":"2024-09-12T03:35:32.167459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179762+0000","last_change":"2024-09-12T03:35:32.176999+0000","last_active":"2024-09-12T03:35:32.179762+0000","last_peered":"2024-09-12T03:35:32.179762+0000","last_clean":"2024-09-12T03:35:32.179762+0000","last_became_active":"2024-09-12T03:35:32.176693+0000","last_became_peered":"2024-09-12T03:35:32.176693+0000","last_unstale":"2024-09-12T03:35:32.179762+0000","last_undegraded":"2024-09-12T03:35:32.179762+0000","last_fullsized":"2024-09-12T03:35:32.179762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:02.318856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178286+0000","last_change":"2024-09-12T03:35:32.176004+0000","last_active":"2024-09-12T03:35:32.178286+0000","last_peered":"2024-09-12T03:35:32.178286+0000","last_clean":"2024-09-12T03:35:32.178286+0000","last_became_active":"2024-09-12T03:35:32.175743+0000","last_became_peered":"2024-09-12T03:35:32.175743+0000","last_unstale":"2024-09-12T03:35:32.178286+0000","last_undegraded":"2024-09-12T03:35:32.178286+0000","last_fullsized":"2024-09-12T03:35:32.178286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:29.981501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183458+0000","last_change":"2024-09-12T03:35:32.179040+0000","last_active":"2024-09-12T03:35:32.183458+0000","last_peered":"2024-09-12T03:35:32.183458+0000","last_clean":"2024-09-12T03:35:32.183458+0000","last_became_active":"2024-09-12T03:35:32.178776+0000","last_became_peered":"2024-09-12T03:35:32.178776+0000","last_unstale":"2024-09-12T03:35:32.183458+0000","last_undegraded":"2024-09-12T03:35:32.183458+0000","last_fullsized":"2024-09-12T03:35:32.183458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207842+0000","last_change":"2024-09-12T03:35:32.188889+0000","last_active":"2024-09-12T03:35:32.207842+0000","last_peered":"2024-09-12T03:35:32.207842+0000","last_clean":"2024-09-12T03:35:32.207842+0000","last_became_active":"2024-09-12T03:35:32.188042+0000","last_became_peered":"2024-09-12T03:35:32.188042+0000","last_unstale":"2024-09-12T03:35:32.207842+0000","last_undegraded":"2024-09-12T03:35:32.207842+0000","last_fullsized":"2024-09-12T03:35:32.207842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.173119+0000","last_change":"2024-09-12T03:35:32.162848+0000","last_active":"2024-09-12T03:35:32.173119+0000","last_peered":"2024-09-12T03:35:32.173119+0000","last_clean":"2024-09-12T03:35:32.173119+0000","last_became_active":"2024-09-12T03:35:32.162154+0000","last_became_peered":"2024-09-12T03:35:32.162154+0000","last_unstale":"2024-09-12T03:35:32.173119+0000","last_undegraded":"2024-09-12T03:35:32.173119+0000","last_fullsized":"2024-09-12T03:35:32.173119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208390+0000","last_change":"2024-09-12T03:35:32.195034+0000","last_active":"2024-09-12T03:35:32.208390+0000","last_peered":"2024-09-12T03:35:32.208390+0000","last_clean":"2024-09-12T03:35:32.208390+0000","last_became_active":"2024-09-12T03:35:32.194309+0000","last_became_peered":"2024-09-12T03:35:32.194309+0000","last_unstale":"2024-09-12T03:35:32.208390+0000","last_undegraded":"2024-09-12T03:35:32.208390+0000","last_fullsized":"2024-09-12T03:35:32.208390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208445+0000","last_change":"2024-09-12T03:35:32.195524+0000","last_active":"2024-09-12T03:35:32.208445+0000","last_peered":"2024-09-12T03:35:32.208445+0000","last_clean":"2024-09-12T03:35:32.208445+0000","last_became_active":"2024-09-12T03:35:32.194818+0000","last_became_peered":"2024-09-12T03:35:32.194818+0000","last_unstale":"2024-09-12T03:35:32.208445+0000","last_undegraded":"2024-09-12T03:35:32.208445+0000","last_fullsized":"2024-09-12T03:35:32.208445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208412+0000","last_change":"2024-09-12T03:35:32.195303+0000","last_active":"2024-09-12T03:35:32.208412+0000","last_peered":"2024-09-12T03:35:32.208412+0000","last_clean":"2024-09-12T03:35:32.208412+0000","last_became_active":"2024-09-12T03:35:32.194596+0000","last_became_peered":"2024-09-12T03:35:32.194596+0000","last_unstale":"2024-09-12T03:35:32.208412+0000","last_undegraded":"2024-09-12T03:35:32.208412+0000","last_fullsized":"2024-09-12T03:35:32.208412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202064+0000","last_change":"2024-09-12T03:35:32.180297+0000","last_active":"2024-09-12T03:35:32.202064+0000","last_peered":"2024-09-12T03:35:32.202064+0000","last_clean":"2024-09-12T03:35:32.202064+0000","last_became_active":"2024-09-12T03:35:32.174697+0000","last_became_peered":"2024-09-12T03:35:32.174697+0000","last_unstale":"2024-09-12T03:35:32.202064+0000","last_undegraded":"2024-09-12T03:35:32.202064+0000","last_fullsized":"2024-09-12T03:35:32.202064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.197050+0000","last_change":"2024-09-12T03:35:32.170895+0000","last_active":"2024-09-12T03:35:32.197050+0000","last_peered":"2024-09-12T03:35:32.197050+0000","last_clean":"2024-09-12T03:35:32.197050+0000","last_became_active":"2024-09-12T03:35:32.170170+0000","last_became_peered":"2024-09-12T03:35:32.170170+0000","last_unstale":"2024-09-12T03:35:32.197050+0000","last_undegraded":"2024-09-12T03:35:32.197050+0000","last_fullsized":"2024-09-12T03:35:32.197050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216087+0000","last_change":"2024-09-12T03:35:32.213125+0000","last_active":"2024-09-12T03:35:32.216087+0000","last_peered":"2024-09-12T03:35:32.216087+0000","last_clean":"2024-09-12T03:35:32.216087+0000","last_became_active":"2024-09-12T03:35:32.212385+0000","last_became_peered":"2024-09-12T03:35:32.212385+0000","last_unstale":"2024-09-12T03:35:32.216087+0000","last_undegraded":"2024-09-12T03:35:32.216087+0000","last_fullsized":"2024-09-12T03:35:32.216087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216370+0000","last_change":"2024-09-12T03:35:32.213872+0000","last_active":"2024-09-12T03:35:32.216370+0000","last_peered":"2024-09-12T03:35:32.216370+0000","last_clean":"2024-09-12T03:35:32.216370+0000","last_became_active":"2024-09-12T03:35:32.213105+0000","last_became_peered":"2024-09-12T03:35:32.213105+0000","last_unstale":"2024-09-12T03:35:32.216370+0000","last_undegraded":"2024-09-12T03:35:32.216370+0000","last_fullsized":"2024-09-12T03:35:32.216370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.175963+0000","last_change":"2024-09-12T03:35:32.173004+0000","last_active":"2024-09-12T03:35:32.175963+0000","last_peered":"2024-09-12T03:35:32.175963+0000","last_clean":"2024-09-12T03:35:32.175963+0000","last_became_active":"2024-09-12T03:35:32.172616+0000","last_became_peered":"2024-09-12T03:35:32.172616+0000","last_unstale":"2024-09-12T03:35:32.175963+0000","last_undegraded":"2024-09-12T03:35:32.175963+0000","last_fullsized":"2024-09-12T03:35:32.175963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:53.618781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207496+0000","last_change":"2024-09-12T03:35:32.180618+0000","last_active":"2024-09-12T03:35:32.207496+0000","last_peered":"2024-09-12T03:35:32.207496+0000","last_clean":"2024-09-12T03:35:32.207496+0000","last_became_active":"2024-09-12T03:35:32.179750+0000","last_became_peered":"2024-09-12T03:35:32.179750+0000","last_unstale":"2024-09-12T03:35:32.207496+0000","last_undegraded":"2024-09-12T03:35:32.207496+0000","last_fullsized":"2024-09-12T03:35:32.207496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.201962+0000","last_change":"2024-09-12T03:35:32.175438+0000","last_active":"2024-09-12T03:35:32.201962+0000","last_peered":"2024-09-12T03:35:32.201962+0000","last_clean":"2024-09-12T03:35:32.201962+0000","last_became_active":"2024-09-12T03:35:32.173214+0000","last_became_peered":"2024-09-12T03:35:32.173214+0000","last_unstale":"2024-09-12T03:35:32.201962+0000","last_undegraded":"2024-09-12T03:35:32.201962+0000","last_fullsized":"2024-09-12T03:35:32.201962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191120+0000","last_change":"2024-09-12T03:35:32.178661+0000","last_active":"2024-09-12T03:35:32.191120+0000","last_peered":"2024-09-12T03:35:32.191120+0000","last_clean":"2024-09-12T03:35:32.191120+0000","last_became_active":"2024-09-12T03:35:32.177898+0000","last_became_peered":"2024-09-12T03:35:32.177898+0000","last_unstale":"2024-09-12T03:35:32.191120+0000","last_undegraded":"2024-09-12T03:35:32.191120+0000","last_fullsized":"2024-09-12T03:35:32.191120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.177060+0000","last_change":"2024-09-12T03:35:32.175313+0000","last_active":"2024-09-12T03:35:32.177060+0000","last_peered":"2024-09-12T03:35:32.177060+0000","last_clean":"2024-09-12T03:35:32.177060+0000","last_became_active":"2024-09-12T03:35:32.174347+0000","last_became_peered":"2024-09-12T03:35:32.174347+0000","last_unstale":"2024-09-12T03:35:32.177060+0000","last_undegraded":"2024-09-12T03:35:32.177060+0000","last_fullsized":"2024-09-12T03:35:32.177060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:03.685409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.206339+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.205847+0000","last_became_peered":"2024-09-12T03:35:32.205847+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207827+0000","last_change":"2024-09-12T03:35:32.184992+0000","last_active":"2024-09-12T03:35:32.207827+0000","last_peered":"2024-09-12T03:35:32.207827+0000","last_clean":"2024-09-12T03:35:32.207827+0000","last_became_active":"2024-09-12T03:35:32.184163+0000","last_became_peered":"2024-09-12T03:35:32.184163+0000","last_unstale":"2024-09-12T03:35:32.207827+0000","last_undegraded":"2024-09-12T03:35:32.207827+0000","last_fullsized":"2024-09-12T03:35:32.207827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191170+0000","last_change":"2024-09-12T03:35:32.182587+0000","last_active":"2024-09-12T03:35:32.191170+0000","last_peered":"2024-09-12T03:35:32.191170+0000","last_clean":"2024-09-12T03:35:32.191170+0000","last_became_active":"2024-09-12T03:35:32.181769+0000","last_became_peered":"2024-09-12T03:35:32.181769+0000","last_unstale":"2024-09-12T03:35:32.191170+0000","last_undegraded":"2024-09-12T03:35:32.191170+0000","last_fullsized":"2024-09-12T03:35:32.191170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.172742+0000","last_change":"2024-09-12T03:35:32.166893+0000","last_active":"2024-09-12T03:35:32.172742+0000","last_peered":"2024-09-12T03:35:32.172742+0000","last_clean":"2024-09-12T03:35:32.172742+0000","last_became_active":"2024-09-12T03:35:32.166550+0000","last_became_peered":"2024-09-12T03:35:32.166550+0000","last_unstale":"2024-09-12T03:35:32.172742+0000","last_undegraded":"2024-09-12T03:35:32.172742+0000","last_fullsized":"2024-09-12T03:35:32.172742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:46.976689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.215852+0000","last_change":"2024-09-12T03:35:32.212944+0000","last_active":"2024-09-12T03:35:32.215852+0000","last_peered":"2024-09-12T03:35:32.215852+0000","last_clean":"2024-09-12T03:35:32.215852+0000","last_became_active":"2024-09-12T03:35:32.212437+0000","last_became_peered":"2024-09-12T03:35:32.212437+0000","last_unstale":"2024-09-12T03:35:32.215852+0000","last_undegraded":"2024-09-12T03:35:32.215852+0000","last_fullsized":"2024-09-12T03:35:32.215852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.100015+0000","last_change":"2024-09-12T03:35:30.100015+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.100015+0000","last_undegraded":"2024-09-12T03:35:30.100015+0000","last_fullsized":"2024-09-12T03:35:30.100015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207891+0000","last_change":"2024-09-12T03:35:32.206342+0000","last_active":"2024-09-12T03:35:32.207891+0000","last_peered":"2024-09-12T03:35:32.207891+0000","last_clean":"2024-09-12T03:35:32.207891+0000","last_became_active":"2024-09-12T03:35:32.205885+0000","last_became_peered":"2024-09-12T03:35:32.205885+0000","last_unstale":"2024-09-12T03:35:32.207891+0000","last_undegraded":"2024-09-12T03:35:32.207891+0000","last_fullsized":"2024-09-12T03:35:32.207891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103320+0000","last_change":"2024-09-12T03:35:30.103320+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103320+0000","last_undegraded":"2024-09-12T03:35:30.103320+0000","last_fullsized":"2024-09-12T03:35:30.103320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183864+0000","last_change":"2024-09-12T03:35:32.174736+0000","last_active":"2024-09-12T03:35:32.183864+0000","last_peered":"2024-09-12T03:35:32.183864+0000","last_clean":"2024-09-12T03:35:32.183864+0000","last_became_active":"2024-09-12T03:35:32.172869+0000","last_became_peered":"2024-09-12T03:35:32.172869+0000","last_unstale":"2024-09-12T03:35:32.183864+0000","last_undegraded":"2024-09-12T03:35:32.183864+0000","last_fullsized":"2024-09-12T03:35:32.183864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:38.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191605+0000","last_change":"2024-09-12T03:35:31.145825+0000","last_active":"2024-09-12T03:35:32.191605+0000","last_peered":"2024-09-12T03:35:32.191605+0000","last_clean":"2024-09-12T03:35:32.191605+0000","last_became_active":"2024-09-12T03:35:31.145486+0000","last_became_peered":"2024-09-12T03:35:31.145486+0000","last_unstale":"2024-09-12T03:35:32.191605+0000","last_undegraded":"2024-09-12T03:35:32.191605+0000","last_fullsized":"2024-09-12T03:35:32.191605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168382+0000","last_change":"2024-09-12T03:35:32.153193+0000","last_active":"2024-09-12T03:35:32.168382+0000","last_peered":"2024-09-12T03:35:32.168382+0000","last_clean":"2024-09-12T03:35:32.168382+0000","last_became_active":"2024-09-12T03:35:32.152295+0000","last_became_peered":"2024-09-12T03:35:32.152295+0000","last_unstale":"2024-09-12T03:35:32.168382+0000","last_undegraded":"2024-09-12T03:35:32.168382+0000","last_fullsized":"2024-09-12T03:35:32.168382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.192996+0000","last_change":"2024-09-12T03:35:31.140136+0000","last_active":"2024-09-12T03:35:32.192996+0000","last_peered":"2024-09-12T03:35:32.192996+0000","last_clean":"2024-09-12T03:35:32.192996+0000","last_became_active":"2024-09-12T03:35:31.139504+0000","last_became_peered":"2024-09-12T03:35:31.139504+0000","last_unstale":"2024-09-12T03:35:32.192996+0000","last_undegraded":"2024-09-12T03:35:32.192996+0000","last_fullsized":"2024-09-12T03:35:32.192996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208505+0000","last_change":"2024-09-12T03:35:31.122217+0000","last_active":"2024-09-12T03:35:32.208505+0000","last_peered":"2024-09-12T03:35:32.208505+0000","last_clean":"2024-09-12T03:35:32.208505+0000","last_became_active":"2024-09-12T03:35:31.121503+0000","last_became_peered":"2024-09-12T03:35:31.121503+0000","last_unstale":"2024-09-12T03:35:32.208505+0000","last_undegraded":"2024-09-12T03:35:32.208505+0000","last_fullsized":"2024-09-12T03:35:32.208505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:26.735443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207789+0000","last_change":"2024-09-12T03:35:32.180265+0000","last_active":"2024-09-12T03:35:32.207789+0000","last_peered":"2024-09-12T03:35:32.207789+0000","last_clean":"2024-09-12T03:35:32.207789+0000","last_became_active":"2024-09-12T03:35:32.179533+0000","last_became_peered":"2024-09-12T03:35:32.179533+0000","last_unstale":"2024-09-12T03:35:32.207789+0000","last_undegraded":"2024-09-12T03:35:32.207789+0000","last_fullsized":"2024-09-12T03:35:32.207789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207545+0000","last_change":"2024-09-12T03:35:31.155475+0000","last_active":"2024-09-12T03:35:32.207545+0000","last_peered":"2024-09-12T03:35:32.207545+0000","last_clean":"2024-09-12T03:35:32.207545+0000","last_became_active":"2024-09-12T03:35:31.154875+0000","last_became_peered":"2024-09-12T03:35:31.154875+0000","last_unstale":"2024-09-12T03:35:32.207545+0000","last_undegraded":"2024-09-12T03:35:32.207545+0000","last_fullsized":"2024-09-12T03:35:32.207545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206786+0000","last_change":"2024-09-12T03:35:32.184081+0000","last_active":"2024-09-12T03:35:32.206786+0000","last_peered":"2024-09-12T03:35:32.206786+0000","last_clean":"2024-09-12T03:35:32.206786+0000","last_became_active":"2024-09-12T03:35:32.183424+0000","last_became_peered":"2024-09-12T03:35:32.183424+0000","last_unstale":"2024-09-12T03:35:32.206786+0000","last_undegraded":"2024-09-12T03:35:32.206786+0000","last_fullsized":"2024-09-12T03:35:32.206786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167468+0000","last_change":"2024-09-12T03:35:31.134300+0000","last_active":"2024-09-12T03:35:32.167468+0000","last_peered":"2024-09-12T03:35:32.167468+0000","last_clean":"2024-09-12T03:35:32.167468+0000","last_became_active":"2024-09-12T03:35:31.133662+0000","last_became_peered":"2024-09-12T03:35:31.133662+0000","last_unstale":"2024-09-12T03:35:32.167468+0000","last_undegraded":"2024-09-12T03:35:32.167468+0000","last_fullsized":"2024-09-12T03:35:32.167468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179682+0000","last_change":"2024-09-12T03:35:32.176878+0000","last_active":"2024-09-12T03:35:32.179682+0000","last_peered":"2024-09-12T03:35:32.179682+0000","last_clean":"2024-09-12T03:35:32.179682+0000","last_became_active":"2024-09-12T03:35:32.176281+0000","last_became_peered":"2024-09-12T03:35:32.176281+0000","last_unstale":"2024-09-12T03:35:32.179682+0000","last_undegraded":"2024-09-12T03:35:32.179682+0000","last_fullsized":"2024-09-12T03:35:32.179682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157879+0000","last_change":"2024-09-12T03:35:31.148365+0000","last_active":"2024-09-12T03:35:32.157879+0000","last_peered":"2024-09-12T03:35:32.157879+0000","last_clean":"2024-09-12T03:35:32.157879+0000","last_became_active":"2024-09-12T03:35:31.142740+0000","last_became_peered":"2024-09-12T03:35:31.142740+0000","last_unstale":"2024-09-12T03:35:32.157879+0000","last_undegraded":"2024-09-12T03:35:32.157879+0000","last_fullsized":"2024-09-12T03:35:32.157879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179738+0000","last_change":"2024-09-12T03:35:32.176998+0000","last_active":"2024-09-12T03:35:32.179738+0000","last_peered":"2024-09-12T03:35:32.179738+0000","last_clean":"2024-09-12T03:35:32.179738+0000","last_became_active":"2024-09-12T03:35:32.176678+0000","last_became_peered":"2024-09-12T03:35:32.176678+0000","last_unstale":"2024-09-12T03:35:32.179738+0000","last_undegraded":"2024-09-12T03:35:32.179738+0000","last_fullsized":"2024-09-12T03:35:32.179738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:49.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.151633+0000","last_change":"2024-09-12T03:35:31.125827+0000","last_active":"2024-09-12T03:35:32.151633+0000","last_peered":"2024-09-12T03:35:32.151633+0000","last_clean":"2024-09-12T03:35:32.151633+0000","last_became_active":"2024-09-12T03:35:31.122580+0000","last_became_peered":"2024-09-12T03:35:31.122580+0000","last_unstale":"2024-09-12T03:35:32.151633+0000","last_undegraded":"2024-09-12T03:35:32.151633+0000","last_fullsized":"2024-09-12T03:35:32.151633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206161+0000","last_change":"2024-09-12T03:35:32.198738+0000","last_active":"2024-09-12T03:35:32.206161+0000","last_peered":"2024-09-12T03:35:32.206161+0000","last_clean":"2024-09-12T03:35:32.206161+0000","last_became_active":"2024-09-12T03:35:32.198073+0000","last_became_peered":"2024-09-12T03:35:32.198073+0000","last_unstale":"2024-09-12T03:35:32.206161+0000","last_undegraded":"2024-09-12T03:35:32.206161+0000","last_fullsized":"2024-09-12T03:35:32.206161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166727+0000","last_change":"2024-09-12T03:35:31.129565+0000","last_active":"2024-09-12T03:35:32.166727+0000","last_peered":"2024-09-12T03:35:32.166727+0000","last_clean":"2024-09-12T03:35:32.166727+0000","last_became_active":"2024-09-12T03:35:31.128696+0000","last_became_peered":"2024-09-12T03:35:31.128696+0000","last_unstale":"2024-09-12T03:35:32.166727+0000","last_undegraded":"2024-09-12T03:35:32.166727+0000","last_fullsized":"2024-09-12T03:35:32.166727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212534+0000","last_change":"2024-09-12T03:35:31.120663+0000","last_active":"2024-09-12T03:35:32.212534+0000","last_peered":"2024-09-12T03:35:32.212534+0000","last_clean":"2024-09-12T03:35:32.212534+0000","last_became_active":"2024-09-12T03:35:31.119307+0000","last_became_peered":"2024-09-12T03:35:31.119307+0000","last_unstale":"2024-09-12T03:35:32.212534+0000","last_undegraded":"2024-09-12T03:35:32.212534+0000","last_fullsized":"2024-09-12T03:35:32.212534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191162+0000","last_change":"2024-09-12T03:35:32.181504+0000","last_active":"2024-09-12T03:35:32.191162+0000","last_peered":"2024-09-12T03:35:32.191162+0000","last_clean":"2024-09-12T03:35:32.191162+0000","last_became_active":"2024-09-12T03:35:32.180735+0000","last_became_peered":"2024-09-12T03:35:32.180735+0000","last_unstale":"2024-09-12T03:35:32.191162+0000","last_undegraded":"2024-09-12T03:35:32.191162+0000","last_fullsized":"2024-09-12T03:35:32.191162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212280+0000","last_change":"2024-09-12T03:35:31.138409+0000","last_active":"2024-09-12T03:35:32.212280+0000","last_peered":"2024-09-12T03:35:32.212280+0000","last_clean":"2024-09-12T03:35:32.212280+0000","last_became_active":"2024-09-12T03:35:31.138039+0000","last_became_peered":"2024-09-12T03:35:31.138039+0000","last_unstale":"2024-09-12T03:35:32.212280+0000","last_undegraded":"2024-09-12T03:35:32.212280+0000","last_fullsized":"2024-09-12T03:35:32.212280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189481+0000","last_change":"2024-09-12T03:35:31.121034+0000","last_active":"2024-09-12T03:35:32.189481+0000","last_peered":"2024-09-12T03:35:32.189481+0000","last_clean":"2024-09-12T03:35:32.189481+0000","last_became_active":"2024-09-12T03:35:31.120768+0000","last_became_peered":"2024-09-12T03:35:31.120768+0000","last_unstale":"2024-09-12T03:35:32.189481+0000","last_undegraded":"2024-09-12T03:35:32.189481+0000","last_fullsized":"2024-09-12T03:35:32.189481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178318+0000","last_change":"2024-09-12T03:35:32.168888+0000","last_active":"2024-09-12T03:35:32.178318+0000","last_peered":"2024-09-12T03:35:32.178318+0000","last_clean":"2024-09-12T03:35:32.178318+0000","last_became_active":"2024-09-12T03:35:32.168568+0000","last_became_peered":"2024-09-12T03:35:32.168568+0000","last_unstale":"2024-09-12T03:35:32.178318+0000","last_undegraded":"2024-09-12T03:35:32.178318+0000","last_fullsized":"2024-09-12T03:35:32.178318+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166910+0000","last_change":"2024-09-12T03:35:31.134218+0000","last_active":"2024-09-12T03:35:32.166910+0000","last_peered":"2024-09-12T03:35:32.166910+0000","last_clean":"2024-09-12T03:35:32.166910+0000","last_became_active":"2024-09-12T03:35:31.133767+0000","last_became_peered":"2024-09-12T03:35:31.133767+0000","last_unstale":"2024-09-12T03:35:32.166910+0000","last_undegraded":"2024-09-12T03:35:32.166910+0000","last_fullsized":"2024-09-12T03:35:32.166910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190970+0000","last_change":"2024-09-12T03:35:32.178655+0000","last_active":"2024-09-12T03:35:32.190970+0000","last_peered":"2024-09-12T03:35:32.190970+0000","last_clean":"2024-09-12T03:35:32.190970+0000","last_became_active":"2024-09-12T03:35:32.177875+0000","last_became_peered":"2024-09-12T03:35:32.177875+0000","last_unstale":"2024-09-12T03:35:32.190970+0000","last_undegraded":"2024-09-12T03:35:32.190970+0000","last_fullsized":"2024-09-12T03:35:32.190970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099854+0000","last_change":"2024-09-12T03:35:30.099854+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099854+0000","last_undegraded":"2024-09-12T03:35:30.099854+0000","last_fullsized":"2024-09-12T03:35:30.099854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178296+0000","last_change":"2024-09-12T03:35:32.169975+0000","last_active":"2024-09-12T03:35:32.178296+0000","last_peered":"2024-09-12T03:35:32.178296+0000","last_clean":"2024-09-12T03:35:32.178296+0000","last_became_active":"2024-09-12T03:35:32.169592+0000","last_became_peered":"2024-09-12T03:35:32.169592+0000","last_unstale":"2024-09-12T03:35:32.178296+0000","last_undegraded":"2024-09-12T03:35:32.178296+0000","last_fullsized":"2024-09-12T03:35:32.178296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.209562+0000","last_change":"2024-09-12T03:35:31.154628+0000","last_active":"2024-09-12T03:35:32.209562+0000","last_peered":"2024-09-12T03:35:32.209562+0000","last_clean":"2024-09-12T03:35:32.209562+0000","last_became_active":"2024-09-12T03:35:31.153993+0000","last_became_peered":"2024-09-12T03:35:31.153993+0000","last_unstale":"2024-09-12T03:35:32.209562+0000","last_undegraded":"2024-09-12T03:35:32.209562+0000","last_fullsized":"2024-09-12T03:35:32.209562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.161598+0000","last_change":"2024-09-12T03:35:32.152935+0000","last_active":"2024-09-12T03:35:32.161598+0000","last_peered":"2024-09-12T03:35:32.161598+0000","last_clean":"2024-09-12T03:35:32.161598+0000","last_became_active":"2024-09-12T03:35:32.152123+0000","last_became_peered":"2024-09-12T03:35:32.152123+0000","last_unstale":"2024-09-12T03:35:32.161598+0000","last_undegraded":"2024-09-12T03:35:32.161598+0000","last_fullsized":"2024-09-12T03:35:32.161598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212278+0000","last_change":"2024-09-12T03:35:31.150651+0000","last_active":"2024-09-12T03:35:32.212278+0000","last_peered":"2024-09-12T03:35:32.212278+0000","last_clean":"2024-09-12T03:35:32.212278+0000","last_became_active":"2024-09-12T03:35:31.150087+0000","last_became_peered":"2024-09-12T03:35:31.150087+0000","last_unstale":"2024-09-12T03:35:32.212278+0000","last_undegraded":"2024-09-12T03:35:32.212278+0000","last_fullsized":"2024-09-12T03:35:32.212278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207722+0000","last_change":"2024-09-12T03:35:32.180787+0000","last_active":"2024-09-12T03:35:32.207722+0000","last_peered":"2024-09-12T03:35:32.207722+0000","last_clean":"2024-09-12T03:35:32.207722+0000","last_became_active":"2024-09-12T03:35:32.180128+0000","last_became_peered":"2024-09-12T03:35:32.180128+0000","last_unstale":"2024-09-12T03:35:32.207722+0000","last_undegraded":"2024-09-12T03:35:32.207722+0000","last_fullsized":"2024-09-12T03:35:32.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.213860+0000","last_change":"2024-09-12T03:35:31.148497+0000","last_active":"2024-09-12T03:35:32.213860+0000","last_peered":"2024-09-12T03:35:32.213860+0000","last_clean":"2024-09-12T03:35:32.213860+0000","last_became_active":"2024-09-12T03:35:31.147818+0000","last_became_peered":"2024-09-12T03:35:31.147818+0000","last_unstale":"2024-09-12T03:35:32.213860+0000","last_undegraded":"2024-09-12T03:35:32.213860+0000","last_fullsized":"2024-09-12T03:35:32.213860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190661+0000","last_change":"2024-09-12T03:35:32.183482+0000","last_active":"2024-09-12T03:35:32.190661+0000","last_peered":"2024-09-12T03:35:32.190661+0000","last_clean":"2024-09-12T03:35:32.190661+0000","last_became_active":"2024-09-12T03:35:32.175402+0000","last_became_peered":"2024-09-12T03:35:32.175402+0000","last_unstale":"2024-09-12T03:35:32.190661+0000","last_undegraded":"2024-09-12T03:35:32.190661+0000","last_fullsized":"2024-09-12T03:35:32.190661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.195583+0000","last_change":"2024-09-12T03:35:31.137498+0000","last_active":"2024-09-12T03:35:32.195583+0000","last_peered":"2024-09-12T03:35:32.195583+0000","last_clean":"2024-09-12T03:35:32.195583+0000","last_became_active":"2024-09-12T03:35:31.137210+0000","last_became_peered":"2024-09-12T03:35:31.137210+0000","last_unstale":"2024-09-12T03:35:32.195583+0000","last_undegraded":"2024-09-12T03:35:32.195583+0000","last_fullsized":"2024-09-12T03:35:32.195583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:10.651197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165642+0000","last_change":"2024-09-12T03:35:32.155601+0000","last_active":"2024-09-12T03:35:32.165642+0000","last_peered":"2024-09-12T03:35:32.165642+0000","last_clean":"2024-09-12T03:35:32.165642+0000","last_became_active":"2024-09-12T03:35:32.153852+0000","last_became_peered":"2024-09-12T03:35:32.153852+0000","last_unstale":"2024-09-12T03:35:32.165642+0000","last_undegraded":"2024-09-12T03:35:32.165642+0000","last_fullsized":"2024-09-12T03:35:32.165642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:57.275609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166487+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.166487+0000","last_peered":"2024-09-12T03:35:32.166487+0000","last_clean":"2024-09-12T03:35:32.166487+0000","last_became_active":"2024-09-12T03:35:31.144611+0000","last_became_peered":"2024-09-12T03:35:31.144611+0000","last_unstale":"2024-09-12T03:35:32.166487+0000","last_undegraded":"2024-09-12T03:35:32.166487+0000","last_fullsized":"2024-09-12T03:35:32.166487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.196264+0000","last_change":"2024-09-12T03:35:32.179725+0000","last_active":"2024-09-12T03:35:32.196264+0000","last_peered":"2024-09-12T03:35:32.196264+0000","last_clean":"2024-09-12T03:35:32.196264+0000","last_became_active":"2024-09-12T03:35:32.178924+0000","last_became_peered":"2024-09-12T03:35:32.178924+0000","last_unstale":"2024-09-12T03:35:32.196264+0000","last_undegraded":"2024-09-12T03:35:32.196264+0000","last_fullsized":"2024-09-12T03:35:32.196264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.188965+0000","last_change":"2024-09-12T03:35:31.119011+0000","last_active":"2024-09-12T03:35:32.188965+0000","last_peered":"2024-09-12T03:35:32.188965+0000","last_clean":"2024-09-12T03:35:32.188965+0000","last_became_active":"2024-09-12T03:35:31.118692+0000","last_became_peered":"2024-09-12T03:35:31.118692+0000","last_unstale":"2024-09-12T03:35:32.188965+0000","last_undegraded":"2024-09-12T03:35:32.188965+0000","last_fullsized":"2024-09-12T03:35:32.188965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:00.187654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141169+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.141169+0000","last_peered":"2024-09-12T03:35:32.141169+0000","last_clean":"2024-09-12T03:35:32.141169+0000","last_became_active":"2024-09-12T03:35:31.144591+0000","last_became_peered":"2024-09-12T03:35:31.144591+0000","last_unstale":"2024-09-12T03:35:32.141169+0000","last_undegraded":"2024-09-12T03:35:32.141169+0000","last_fullsized":"2024-09-12T03:35:32.141169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:00.727172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.176611+0000","last_change":"2024-09-12T03:35:32.157200+0000","last_active":"2024-09-12T03:35:32.176611+0000","last_peered":"2024-09-12T03:35:32.176611+0000","last_clean":"2024-09-12T03:35:32.176611+0000","last_became_active":"2024-09-12T03:35:32.155267+0000","last_became_peered":"2024-09-12T03:35:32.155267+0000","last_unstale":"2024-09-12T03:35:32.176611+0000","last_undegraded":"2024-09-12T03:35:32.176611+0000","last_fullsized":"2024-09-12T03:35:32.176611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168000+0000","last_change":"2024-09-12T03:35:31.143758+0000","last_active":"2024-09-12T03:35:32.168000+0000","last_peered":"2024-09-12T03:35:32.168000+0000","last_clean":"2024-09-12T03:35:32.168000+0000","last_became_active":"2024-09-12T03:35:31.143044+0000","last_became_peered":"2024-09-12T03:35:31.143044+0000","last_unstale":"2024-09-12T03:35:32.168000+0000","last_undegraded":"2024-09-12T03:35:32.168000+0000","last_fullsized":"2024-09-12T03:35:32.168000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179656+0000","last_change":"2024-09-12T03:35:32.176574+0000","last_active":"2024-09-12T03:35:32.179656+0000","last_peered":"2024-09-12T03:35:32.179656+0000","last_clean":"2024-09-12T03:35:32.179656+0000","last_became_active":"2024-09-12T03:35:32.175869+0000","last_became_peered":"2024-09-12T03:35:32.175869+0000","last_unstale":"2024-09-12T03:35:32.179656+0000","last_undegraded":"2024-09-12T03:35:32.179656+0000","last_fullsized":"2024-09-12T03:35:32.179656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.142133+0000","last_change":"2024-09-12T03:35:31.119437+0000","last_active":"2024-09-12T03:35:32.142133+0000","last_peered":"2024-09-12T03:35:32.142133+0000","last_clean":"2024-09-12T03:35:32.142133+0000","last_became_active":"2024-09-12T03:35:31.118811+0000","last_became_peered":"2024-09-12T03:35:31.118811+0000","last_unstale":"2024-09-12T03:35:32.142133+0000","last_undegraded":"2024-09-12T03:35:32.142133+0000","last_fullsized":"2024-09-12T03:35:32.142133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.128401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207530+0000","last_change":"2024-09-12T03:35:32.206219+0000","last_active":"2024-09-12T03:35:32.207530+0000","last_peered":"2024-09-12T03:35:32.207530+0000","last_clean":"2024-09-12T03:35:32.207530+0000","last_became_active":"2024-09-12T03:35:32.205898+0000","last_became_peered":"2024-09-12T03:35:32.205898+0000","last_unstale":"2024-09-12T03:35:32.207530+0000","last_undegraded":"2024-09-12T03:35:32.207530+0000","last_fullsized":"2024-09-12T03:35:32.207530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212324+0000","last_change":"2024-09-12T03:35:31.123519+0000","last_active":"2024-09-12T03:35:32.212324+0000","last_peered":"2024-09-12T03:35:32.212324+0000","last_clean":"2024-09-12T03:35:32.212324+0000","last_became_active":"2024-09-12T03:35:31.122716+0000","last_became_peered":"2024-09-12T03:35:31.122716+0000","last_unstale":"2024-09-12T03:35:32.212324+0000","last_undegraded":"2024-09-12T03:35:32.212324+0000","last_fullsized":"2024-09-12T03:35:32.212324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206103+0000","last_change":"2024-09-12T03:35:32.198862+0000","last_active":"2024-09-12T03:35:32.206103+0000","last_peered":"2024-09-12T03:35:32.206103+0000","last_clean":"2024-09-12T03:35:32.206103+0000","last_became_active":"2024-09-12T03:35:32.198370+0000","last_became_peered":"2024-09-12T03:35:32.198370+0000","last_unstale":"2024-09-12T03:35:32.206103+0000","last_undegraded":"2024-09-12T03:35:32.206103+0000","last_fullsized":"2024-09-12T03:35:32.206103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:41.567114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141700+0000","last_change":"2024-09-12T03:35:31.130491+0000","last_active":"2024-09-12T03:35:32.141700+0000","last_peered":"2024-09-12T03:35:32.141700+0000","last_clean":"2024-09-12T03:35:32.141700+0000","last_became_active":"2024-09-12T03:35:31.130189+0000","last_became_peered":"2024-09-12T03:35:31.130189+0000","last_unstale":"2024-09-12T03:35:32.141700+0000","last_undegraded":"2024-09-12T03:35:32.141700+0000","last_fullsized":"2024-09-12T03:35:32.141700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:57.745056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189301+0000","last_change":"2024-09-12T03:35:32.185743+0000","last_active":"2024-09-12T03:35:32.189301+0000","last_peered":"2024-09-12T03:35:32.189301+0000","last_clean":"2024-09-12T03:35:32.189301+0000","last_became_active":"2024-09-12T03:35:32.185415+0000","last_became_peered":"2024-09-12T03:35:32.185415+0000","last_unstale":"2024-09-12T03:35:32.189301+0000","last_undegraded":"2024-09-12T03:35:32.189301+0000","last_fullsized":"2024-09-12T03:35:32.189301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103178+0000","last_change":"2024-09-12T03:35:30.103178+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103178+0000","last_undegraded":"2024-09-12T03:35:30.103178+0000","last_fullsized":"2024-09-12T03:35:30.103178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103111+0000","last_change":"2024-09-12T03:35:30.103111+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103111+0000","last_undegraded":"2024-09-12T03:35:30.103111+0000","last_fullsized":"2024-09-12T03:35:30.103111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.186467+0000","last_change":"2024-09-12T03:35:32.180911+0000","last_active":"2024-09-12T03:35:32.186467+0000","last_peered":"2024-09-12T03:35:32.186467+0000","last_clean":"2024-09-12T03:35:32.186467+0000","last_became_active":"2024-09-12T03:35:32.180601+0000","last_became_peered":"2024-09-12T03:35:32.180601+0000","last_unstale":"2024-09-12T03:35:32.186467+0000","last_undegraded":"2024-09-12T03:35:32.186467+0000","last_fullsized":"2024-09-12T03:35:32.186467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099852+0000","last_change":"2024-09-12T03:35:30.099852+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099852+0000","last_undegraded":"2024-09-12T03:35:30.099852+0000","last_fullsized":"2024-09-12T03:35:30.099852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202018+0000","last_change":"2024-09-12T03:35:32.174912+0000","last_active":"2024-09-12T03:35:32.202018+0000","last_peered":"2024-09-12T03:35:32.202018+0000","last_clean":"2024-09-12T03:35:32.202018+0000","last_became_active":"2024-09-12T03:35:32.173337+0000","last_became_peered":"2024-09-12T03:35:32.173337+0000","last_unstale":"2024-09-12T03:35:32.202018+0000","last_undegraded":"2024-09-12T03:35:32.202018+0000","last_fullsized":"2024-09-12T03:35:32.202018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157766+0000","last_change":"2024-09-12T03:35:31.141781+0000","last_active":"2024-09-12T03:35:32.157766+0000","last_peered":"2024-09-12T03:35:32.157766+0000","last_clean":"2024-09-12T03:35:32.157766+0000","last_became_active":"2024-09-12T03:35:31.139547+0000","last_became_peered":"2024-09-12T03:35:31.139547+0000","last_unstale":"2024-09-12T03:35:32.157766+0000","last_undegraded":"2024-09-12T03:35:32.157766+0000","last_fullsized":"2024-09-12T03:35:32.157766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206154+0000","last_change":"2024-09-12T03:35:32.200175+0000","last_active":"2024-09-12T03:35:32.206154+0000","last_peered":"2024-09-12T03:35:32.206154+0000","last_clean":"2024-09-12T03:35:32.206154+0000","last_became_active":"2024-09-12T03:35:32.199519+0000","last_became_peered":"2024-09-12T03:35:32.199519+0000","last_unstale":"2024-09-12T03:35:32.206154+0000","last_undegraded":"2024-09-12T03:35:32.206154+0000","last_fullsized":"2024-09-12T03:35:32.206154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.148275+0000","last_change":"2024-09-12T03:35:31.125839+0000","last_active":"2024-09-12T03:35:32.148275+0000","last_peered":"2024-09-12T03:35:32.148275+0000","last_clean":"2024-09-12T03:35:32.148275+0000","last_became_active":"2024-09-12T03:35:31.122726+0000","last_became_peered":"2024-09-12T03:35:31.122726+0000","last_unstale":"2024-09-12T03:35:32.148275+0000","last_undegraded":"2024-09-12T03:35:32.148275+0000","last_fullsized":"2024-09-12T03:35:32.148275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.189144+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.188402+0000","last_became_peered":"2024-09-12T03:35:32.188402+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168336+0000","last_change":"2024-09-12T03:35:31.147449+0000","last_active":"2024-09-12T03:35:32.168336+0000","last_peered":"2024-09-12T03:35:32.168336+0000","last_clean":"2024-09-12T03:35:32.168336+0000","last_became_active":"2024-09-12T03:35:31.146800+0000","last_became_peered":"2024-09-12T03:35:31.146800+0000","last_unstale":"2024-09-12T03:35:32.168336+0000","last_undegraded":"2024-09-12T03:35:32.168336+0000","last_fullsized":"2024-09-12T03:35:32.168336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:51.274026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165630+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:35:32.165630+0000","last_peered":"2024-09-12T03:35:32.165630+0000","last_clean":"2024-09-12T03:35:32.165630+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:35:32.165630+0000","last_undegraded":"2024-09-12T03:35:32.165630+0000","last_fullsized":"2024-09-12T03:35:32.165630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":777199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":417792,"data_stored":177982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":185753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":186795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":761683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:35:36.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:35:36.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5070891640 1 Processor -- start 2024-09-12T03:35:36.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5070891640 1 -- start start 2024-09-12T03:35:36.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5070891640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 0x7f506c165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5070891640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506c0aede0 con 0x7f506c070020 2024-09-12T03:35:36.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5070891640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f506c15fa10 con 0x7f506c1520a0 2024-09-12T03:35:36.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5070891640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f506c152480 con 0x7f506c15f3a0 2024-09-12T03:35:36.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5069d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f506c070020 0x7f506c15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58944/0 (socket says 172.21.15.73:58944) 2024-09-12T03:35:36.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f5069d9b640 1 -- 172.21.15.73:0/1908953199 learned_addr learned my addr 172.21.15.73:0/1908953199 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:36.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.331+0000 7f506ad9d640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 0x7f506c165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581866289 0 0) 0x7f506c0aede0 con 0x7f506c070020 2024-09-12T03:35:36.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5054003530 con 0x7f506c070020 2024-09-12T03:35:36.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3397095978 0 0) 0x7f5054003530 con 0x7f506c070020 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 msgr2=0x7f506c165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 0x7f506c165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 >> v1:172.21.15.150:6789/0 conn(0x7f506c1520a0 legacy=0x7f506c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c074250 con 0x7f506c070020 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f5060001680 con 0x7f506c070020 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 >> v1:172.21.15.73:6789/0 conn(0x7f506c070020 legacy=0x7f506c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50540039f0 0x7f5054003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5054004810 0x7f5054004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 0x7f50540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f505400ba80 con 0x7f50540039f0 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f505400bc30 con 0x7f5054004810 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f505400be30 con 0x7f506c15f3a0 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506a59c640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50540039f0 0x7f5054003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5069d9b640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5054004810 0x7f5054004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506a59c640 1 -- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 msgr2=0x7f50540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506ad9d640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 0x7f50540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506a59c640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15f3a0 0x7f50540051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506a59c640 1 -- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5054004810 msgr2=0x7f5054004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506a59c640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5054004810 0x7f5054004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506a59c640 1 -- 172.21.15.73:0/1908953199 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5054003530 con 0x7f50540039f0 2024-09-12T03:35:36.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5069d9b640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5054004810 0x7f5054004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:36.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506a59c640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50540039f0 0x7f5054003e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f505c001750 tx=0x7f505c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70368102d3c78f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c0013a0 con 0x7f50540039f0 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505c0052f0 con 0x7f50540039f0 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506959a640 1 -- 172.21.15.73:0/1908953199 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c003840 con 0x7f50540039f0 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5070891640 1 -- 172.21.15.73:0/1908953199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50540039f0 msgr2=0x7f5054003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5070891640 1 --2- 172.21.15.73:0/1908953199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50540039f0 0x7f5054003e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f505c001750 tx=0x7f505c01c3c0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f506ad9d640 1 -- 172.21.15.73:0/1908953199 reap_dead start 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5070891640 1 -- 172.21.15.73:0/1908953199 shutdown_connections 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5070891640 1 -- 172.21.15.73:0/1908953199 >> 172.21.15.73:0/1908953199 conn(0x7f506c0b1f90 msgr2=0x7f506c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5070891640 1 -- 172.21.15.73:0/1908953199 shutdown_connections 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.335+0000 7f5070891640 1 -- 172.21.15.73:0/1908953199 wait complete. 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 Processor -- start 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 -- start start 2024-09-12T03:35:36.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540039f0 0x7f506c15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15e340 0x7f506c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c0ae660 0x7f506c151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f506c166710 con 0x7f506c0ae660 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f506c073d30 con 0x7f50540039f0 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f506c166890 con 0x7f506c15e340 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c0ae660 0x7f506c151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c0ae660 0x7f506c151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49664/0 (socket says 172.21.15.73:49664) 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 -- 172.21.15.73:0/3021852824 learned_addr learned my addr 172.21.15.73:0/3021852824 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5069d9b640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15e340 0x7f506c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506a59c640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540039f0 0x7f506c15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 -- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15e340 msgr2=0x7f506c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15e340 0x7f506c151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 -- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540039f0 msgr2=0x7f506c15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540039f0 0x7f506c15b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 -- 172.21.15.73:0/3021852824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c15be80 con 0x7f506c0ae660 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5069d9b640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15e340 0x7f506c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f506ad9d640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c0ae660 0x7f506c151980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f506c15f780 tx=0x7f506400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f505affd640 1 -- 172.21.15.73:0/3021852824 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506401c070 con 0x7f506c0ae660 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f505affd640 1 -- 172.21.15.73:0/3021852824 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5064017400 con 0x7f506c0ae660 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c15c160 con 0x7f506c0ae660 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f505affd640 1 -- 172.21.15.73:0/3021852824 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50640177f0 con 0x7f506c0ae660 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c15d7a0 con 0x7f506c0ae660 2024-09-12T03:35:36.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506c15ec90 con 0x7f506c0ae660 2024-09-12T03:35:36.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.339+0000 7f505affd640 1 -- 172.21.15.73:0/3021852824 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f506401f070 con 0x7f506c0ae660 2024-09-12T03:35:36.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.343+0000 7f505affd640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f504c0678c0 0x7f504c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.343+0000 7f506a59c640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f504c0678c0 0x7f504c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.343+0000 7f505affd640 1 -- 172.21.15.73:0/3021852824 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f5064085ea0 con 0x7f506c0ae660 2024-09-12T03:35:36.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.343+0000 7f506a59c640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f504c0678c0 0x7f504c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f50540057f0 tx=0x7f505c0011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:36.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.347+0000 7f505affd640 1 -- 172.21.15.73:0/3021852824 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5064012070 con 0x7f506c0ae660 2024-09-12T03:35:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.503+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f506c06e540 con 0x7f504c0678c0 2024-09-12T03:35:36.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.519+0000 7f505affd640 1 -- 172.21.15.73:0/3021852824 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249354 (secure 0 0 0) 0x7f506c06e540 con 0x7f504c0678c0 2024-09-12T03:35:36.529 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:36.530 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:35:36.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f504c0678c0 msgr2=0x7f504c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f504c0678c0 0x7f504c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f50540057f0 tx=0x7f505c0011a0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c0ae660 msgr2=0x7f506c151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c0ae660 0x7f506c151980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f506c15f780 tx=0x7f506400f4a0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 shutdown_connections 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f504c0678c0 0x7f504c069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f506c0ae660 0x7f506c151980 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f506c15e340 0x7f506c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 --2- 172.21.15.73:0/3021852824 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50540039f0 0x7f506c15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 >> 172.21.15.73:0/3021852824 conn(0x7f506c0b1f90 msgr2=0x7f506c0b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 shutdown_connections 2024-09-12T03:35:36.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.523+0000 7f5070891640 1 -- 172.21.15.73:0/3021852824 wait complete. 2024-09-12T03:35:36.546 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T03:35:35.806569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220740,"kb_used_data":4508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753980,"statfs":{"total":773094113280,"available":772868075520,"internally_reserved":0,"allocated":4616192,"data_stored":2631185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709182"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178355+0000","last_change":"2024-09-12T03:35:32.169010+0000","last_active":"2024-09-12T03:35:32.178355+0000","last_peered":"2024-09-12T03:35:32.178355+0000","last_clean":"2024-09-12T03:35:32.178355+0000","last_became_active":"2024-09-12T03:35:32.168574+0000","last_became_peered":"2024-09-12T03:35:32.168574+0000","last_unstale":"2024-09-12T03:35:32.178355+0000","last_undegraded":"2024-09-12T03:35:32.178355+0000","last_fullsized":"2024-09-12T03:35:32.178355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167459+0000","last_change":"2024-09-12T03:35:32.157902+0000","last_active":"2024-09-12T03:35:32.167459+0000","last_peered":"2024-09-12T03:35:32.167459+0000","last_clean":"2024-09-12T03:35:32.167459+0000","last_became_active":"2024-09-12T03:35:32.157125+0000","last_became_peered":"2024-09-12T03:35:32.157125+0000","last_unstale":"2024-09-12T03:35:32.167459+0000","last_undegraded":"2024-09-12T03:35:32.167459+0000","last_fullsized":"2024-09-12T03:35:32.167459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179762+0000","last_change":"2024-09-12T03:35:32.176999+0000","last_active":"2024-09-12T03:35:32.179762+0000","last_peered":"2024-09-12T03:35:32.179762+0000","last_clean":"2024-09-12T03:35:32.179762+0000","last_became_active":"2024-09-12T03:35:32.176693+0000","last_became_peered":"2024-09-12T03:35:32.176693+0000","last_unstale":"2024-09-12T03:35:32.179762+0000","last_undegraded":"2024-09-12T03:35:32.179762+0000","last_fullsized":"2024-09-12T03:35:32.179762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:02.318856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178286+0000","last_change":"2024-09-12T03:35:32.176004+0000","last_active":"2024-09-12T03:35:32.178286+0000","last_peered":"2024-09-12T03:35:32.178286+0000","last_clean":"2024-09-12T03:35:32.178286+0000","last_became_active":"2024-09-12T03:35:32.175743+0000","last_became_peered":"2024-09-12T03:35:32.175743+0000","last_unstale":"2024-09-12T03:35:32.178286+0000","last_undegraded":"2024-09-12T03:35:32.178286+0000","last_fullsized":"2024-09-12T03:35:32.178286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:29.981501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183458+0000","last_change":"2024-09-12T03:35:32.179040+0000","last_active":"2024-09-12T03:35:32.183458+0000","last_peered":"2024-09-12T03:35:32.183458+0000","last_clean":"2024-09-12T03:35:32.183458+0000","last_became_active":"2024-09-12T03:35:32.178776+0000","last_became_peered":"2024-09-12T03:35:32.178776+0000","last_unstale":"2024-09-12T03:35:32.183458+0000","last_undegraded":"2024-09-12T03:35:32.183458+0000","last_fullsized":"2024-09-12T03:35:32.183458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207842+0000","last_change":"2024-09-12T03:35:32.188889+0000","last_active":"2024-09-12T03:35:32.207842+0000","last_peered":"2024-09-12T03:35:32.207842+0000","last_clean":"2024-09-12T03:35:32.207842+0000","last_became_active":"2024-09-12T03:35:32.188042+0000","last_became_peered":"2024-09-12T03:35:32.188042+0000","last_unstale":"2024-09-12T03:35:32.207842+0000","last_undegraded":"2024-09-12T03:35:32.207842+0000","last_fullsized":"2024-09-12T03:35:32.207842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.173119+0000","last_change":"2024-09-12T03:35:32.162848+0000","last_active":"2024-09-12T03:35:32.173119+0000","last_peered":"2024-09-12T03:35:32.173119+0000","last_clean":"2024-09-12T03:35:32.173119+0000","last_became_active":"2024-09-12T03:35:32.162154+0000","last_became_peered":"2024-09-12T03:35:32.162154+0000","last_unstale":"2024-09-12T03:35:32.173119+0000","last_undegraded":"2024-09-12T03:35:32.173119+0000","last_fullsized":"2024-09-12T03:35:32.173119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208390+0000","last_change":"2024-09-12T03:35:32.195034+0000","last_active":"2024-09-12T03:35:32.208390+0000","last_peered":"2024-09-12T03:35:32.208390+0000","last_clean":"2024-09-12T03:35:32.208390+0000","last_became_active":"2024-09-12T03:35:32.194309+0000","last_became_peered":"2024-09-12T03:35:32.194309+0000","last_unstale":"2024-09-12T03:35:32.208390+0000","last_undegraded":"2024-09-12T03:35:32.208390+0000","last_fullsized":"2024-09-12T03:35:32.208390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208445+0000","last_change":"2024-09-12T03:35:32.195524+0000","last_active":"2024-09-12T03:35:32.208445+0000","last_peered":"2024-09-12T03:35:32.208445+0000","last_clean":"2024-09-12T03:35:32.208445+0000","last_became_active":"2024-09-12T03:35:32.194818+0000","last_became_peered":"2024-09-12T03:35:32.194818+0000","last_unstale":"2024-09-12T03:35:32.208445+0000","last_undegraded":"2024-09-12T03:35:32.208445+0000","last_fullsized":"2024-09-12T03:35:32.208445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208412+0000","last_change":"2024-09-12T03:35:32.195303+0000","last_active":"2024-09-12T03:35:32.208412+0000","last_peered":"2024-09-12T03:35:32.208412+0000","last_clean":"2024-09-12T03:35:32.208412+0000","last_became_active":"2024-09-12T03:35:32.194596+0000","last_became_peered":"2024-09-12T03:35:32.194596+0000","last_unstale":"2024-09-12T03:35:32.208412+0000","last_undegraded":"2024-09-12T03:35:32.208412+0000","last_fullsized":"2024-09-12T03:35:32.208412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202064+0000","last_change":"2024-09-12T03:35:32.180297+0000","last_active":"2024-09-12T03:35:32.202064+0000","last_peered":"2024-09-12T03:35:32.202064+0000","last_clean":"2024-09-12T03:35:32.202064+0000","last_became_active":"2024-09-12T03:35:32.174697+0000","last_became_peered":"2024-09-12T03:35:32.174697+0000","last_unstale":"2024-09-12T03:35:32.202064+0000","last_undegraded":"2024-09-12T03:35:32.202064+0000","last_fullsized":"2024-09-12T03:35:32.202064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.197050+0000","last_change":"2024-09-12T03:35:32.170895+0000","last_active":"2024-09-12T03:35:32.197050+0000","last_peered":"2024-09-12T03:35:32.197050+0000","last_clean":"2024-09-12T03:35:32.197050+0000","last_became_active":"2024-09-12T03:35:32.170170+0000","last_became_peered":"2024-09-12T03:35:32.170170+0000","last_unstale":"2024-09-12T03:35:32.197050+0000","last_undegraded":"2024-09-12T03:35:32.197050+0000","last_fullsized":"2024-09-12T03:35:32.197050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216087+0000","last_change":"2024-09-12T03:35:32.213125+0000","last_active":"2024-09-12T03:35:32.216087+0000","last_peered":"2024-09-12T03:35:32.216087+0000","last_clean":"2024-09-12T03:35:32.216087+0000","last_became_active":"2024-09-12T03:35:32.212385+0000","last_became_peered":"2024-09-12T03:35:32.212385+0000","last_unstale":"2024-09-12T03:35:32.216087+0000","last_undegraded":"2024-09-12T03:35:32.216087+0000","last_fullsized":"2024-09-12T03:35:32.216087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216370+0000","last_change":"2024-09-12T03:35:32.213872+0000","last_active":"2024-09-12T03:35:32.216370+0000","last_peered":"2024-09-12T03:35:32.216370+0000","last_clean":"2024-09-12T03:35:32.216370+0000","last_became_active":"2024-09-12T03:35:32.213105+0000","last_became_peered":"2024-09-12T03:35:32.213105+0000","last_unstale":"2024-09-12T03:35:32.216370+0000","last_undegraded":"2024-09-12T03:35:32.216370+0000","last_fullsized":"2024-09-12T03:35:32.216370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.175963+0000","last_change":"2024-09-12T03:35:32.173004+0000","last_active":"2024-09-12T03:35:32.175963+0000","last_peered":"2024-09-12T03:35:32.175963+0000","last_clean":"2024-09-12T03:35:32.175963+0000","last_became_active":"2024-09-12T03:35:32.172616+0000","last_became_peered":"2024-09-12T03:35:32.172616+0000","last_unstale":"2024-09-12T03:35:32.175963+0000","last_undegraded":"2024-09-12T03:35:32.175963+0000","last_fullsized":"2024-09-12T03:35:32.175963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:53.618781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207496+0000","last_change":"2024-09-12T03:35:32.180618+0000","last_active":"2024-09-12T03:35:32.207496+0000","last_peered":"2024-09-12T03:35:32.207496+0000","last_clean":"2024-09-12T03:35:32.207496+0000","last_became_active":"2024-09-12T03:35:32.179750+0000","last_became_peered":"2024-09-12T03:35:32.179750+0000","last_unstale":"2024-09-12T03:35:32.207496+0000","last_undegraded":"2024-09-12T03:35:32.207496+0000","last_fullsized":"2024-09-12T03:35:32.207496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.201962+0000","last_change":"2024-09-12T03:35:32.175438+0000","last_active":"2024-09-12T03:35:32.201962+0000","last_peered":"2024-09-12T03:35:32.201962+0000","last_clean":"2024-09-12T03:35:32.201962+0000","last_became_active":"2024-09-12T03:35:32.173214+0000","last_became_peered":"2024-09-12T03:35:32.173214+0000","last_unstale":"2024-09-12T03:35:32.201962+0000","last_undegraded":"2024-09-12T03:35:32.201962+0000","last_fullsized":"2024-09-12T03:35:32.201962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191120+0000","last_change":"2024-09-12T03:35:32.178661+0000","last_active":"2024-09-12T03:35:32.191120+0000","last_peered":"2024-09-12T03:35:32.191120+0000","last_clean":"2024-09-12T03:35:32.191120+0000","last_became_active":"2024-09-12T03:35:32.177898+0000","last_became_peered":"2024-09-12T03:35:32.177898+0000","last_unstale":"2024-09-12T03:35:32.191120+0000","last_undegraded":"2024-09-12T03:35:32.191120+0000","last_fullsized":"2024-09-12T03:35:32.191120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.177060+0000","last_change":"2024-09-12T03:35:32.175313+0000","last_active":"2024-09-12T03:35:32.177060+0000","last_peered":"2024-09-12T03:35:32.177060+0000","last_clean":"2024-09-12T03:35:32.177060+0000","last_became_active":"2024-09-12T03:35:32.174347+0000","last_became_peered":"2024-09-12T03:35:32.174347+0000","last_unstale":"2024-09-12T03:35:32.177060+0000","last_undegraded":"2024-09-12T03:35:32.177060+0000","last_fullsized":"2024-09-12T03:35:32.177060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:03.685409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.206339+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.205847+0000","last_became_peered":"2024-09-12T03:35:32.205847+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207827+0000","last_change":"2024-09-12T03:35:32.184992+0000","last_active":"2024-09-12T03:35:32.207827+0000","last_peered":"2024-09-12T03:35:32.207827+0000","last_clean":"2024-09-12T03:35:32.207827+0000","last_became_active":"2024-09-12T03:35:32.184163+0000","last_became_peered":"2024-09-12T03:35:32.184163+0000","last_unstale":"2024-09-12T03:35:32.207827+0000","last_undegraded":"2024-09-12T03:35:32.207827+0000","last_fullsized":"2024-09-12T03:35:32.207827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191170+0000","last_change":"2024-09-12T03:35:32.182587+0000","last_active":"2024-09-12T03:35:32.191170+0000","last_peered":"2024-09-12T03:35:32.191170+0000","last_clean":"2024-09-12T03:35:32.191170+0000","last_became_active":"2024-09-12T03:35:32.181769+0000","last_became_peered":"2024-09-12T03:35:32.181769+0000","last_unstale":"2024-09-12T03:35:32.191170+0000","last_undegraded":"2024-09-12T03:35:32.191170+0000","last_fullsized":"2024-09-12T03:35:32.191170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.172742+0000","last_change":"2024-09-12T03:35:32.166893+0000","last_active":"2024-09-12T03:35:32.172742+0000","last_peered":"2024-09-12T03:35:32.172742+0000","last_clean":"2024-09-12T03:35:32.172742+0000","last_became_active":"2024-09-12T03:35:32.166550+0000","last_became_peered":"2024-09-12T03:35:32.166550+0000","last_unstale":"2024-09-12T03:35:32.172742+0000","last_undegraded":"2024-09-12T03:35:32.172742+0000","last_fullsized":"2024-09-12T03:35:32.172742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:46.976689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.215852+0000","last_change":"2024-09-12T03:35:32.212944+0000","last_active":"2024-09-12T03:35:32.215852+0000","last_peered":"2024-09-12T03:35:32.215852+0000","last_clean":"2024-09-12T03:35:32.215852+0000","last_became_active":"2024-09-12T03:35:32.212437+0000","last_became_peered":"2024-09-12T03:35:32.212437+0000","last_unstale":"2024-09-12T03:35:32.215852+0000","last_undegraded":"2024-09-12T03:35:32.215852+0000","last_fullsized":"2024-09-12T03:35:32.215852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.100015+0000","last_change":"2024-09-12T03:35:30.100015+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.100015+0000","last_undegraded":"2024-09-12T03:35:30.100015+0000","last_fullsized":"2024-09-12T03:35:30.100015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207891+0000","last_change":"2024-09-12T03:35:32.206342+0000","last_active":"2024-09-12T03:35:32.207891+0000","last_peered":"2024-09-12T03:35:32.207891+0000","last_clean":"2024-09-12T03:35:32.207891+0000","last_became_active":"2024-09-12T03:35:32.205885+0000","last_became_peered":"2024-09-12T03:35:32.205885+0000","last_unstale":"2024-09-12T03:35:32.207891+0000","last_undegraded":"2024-09-12T03:35:32.207891+0000","last_fullsized":"2024-09-12T03:35:32.207891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103320+0000","last_change":"2024-09-12T03:35:30.103320+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103320+0000","last_undegraded":"2024-09-12T03:35:30.103320+0000","last_fullsized":"2024-09-12T03:35:30.103320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183864+0000","last_change":"2024-09-12T03:35:32.174736+0000","last_active":"2024-09-12T03:35:32.183864+0000","last_peered":"2024-09-12T03:35:32.183864+0000","last_clean":"2024-09-12T03:35:32.183864+0000","last_became_active":"2024-09-12T03:35:32.172869+0000","last_became_peered":"2024-09-12T03:35:32.172869+0000","last_unstale":"2024-09-12T03:35:32.183864+0000","last_undegraded":"2024-09-12T03:35:32.183864+0000","last_fullsized":"2024-09-12T03:35:32.183864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:38.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191605+0000","last_change":"2024-09-12T03:35:31.145825+0000","last_active":"2024-09-12T03:35:32.191605+0000","last_peered":"2024-09-12T03:35:32.191605+0000","last_clean":"2024-09-12T03:35:32.191605+0000","last_became_active":"2024-09-12T03:35:31.145486+0000","last_became_peered":"2024-09-12T03:35:31.145486+0000","last_unstale":"2024-09-12T03:35:32.191605+0000","last_undegraded":"2024-09-12T03:35:32.191605+0000","last_fullsized":"2024-09-12T03:35:32.191605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168382+0000","last_change":"2024-09-12T03:35:32.153193+0000","last_active":"2024-09-12T03:35:32.168382+0000","last_peered":"2024-09-12T03:35:32.168382+0000","last_clean":"2024-09-12T03:35:32.168382+0000","last_became_active":"2024-09-12T03:35:32.152295+0000","last_became_peered":"2024-09-12T03:35:32.152295+0000","last_unstale":"2024-09-12T03:35:32.168382+0000","last_undegraded":"2024-09-12T03:35:32.168382+0000","last_fullsized":"2024-09-12T03:35:32.168382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.192996+0000","last_change":"2024-09-12T03:35:31.140136+0000","last_active":"2024-09-12T03:35:32.192996+0000","last_peered":"2024-09-12T03:35:32.192996+0000","last_clean":"2024-09-12T03:35:32.192996+0000","last_became_active":"2024-09-12T03:35:31.139504+0000","last_became_peered":"2024-09-12T03:35:31.139504+0000","last_unstale":"2024-09-12T03:35:32.192996+0000","last_undegraded":"2024-09-12T03:35:32.192996+0000","last_fullsized":"2024-09-12T03:35:32.192996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208505+0000","last_change":"2024-09-12T03:35:31.122217+0000","last_active":"2024-09-12T03:35:32.208505+0000","last_peered":"2024-09-12T03:35:32.208505+0000","last_clean":"2024-09-12T03:35:32.208505+0000","last_became_active":"2024-09-12T03:35:31.121503+0000","last_became_peered":"2024-09-12T03:35:31.121503+0000","last_unstale":"2024-09-12T03:35:32.208505+0000","last_undegraded":"2024-09-12T03:35:32.208505+0000","last_fullsized":"2024-09-12T03:35:32.208505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:26.735443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207789+0000","last_change":"2024-09-12T03:35:32.180265+0000","last_active":"2024-09-12T03:35:32.207789+0000","last_peered":"2024-09-12T03:35:32.207789+0000","last_clean":"2024-09-12T03:35:32.207789+0000","last_became_active":"2024-09-12T03:35:32.179533+0000","last_became_peered":"2024-09-12T03:35:32.179533+0000","last_unstale":"2024-09-12T03:35:32.207789+0000","last_undegraded":"2024-09-12T03:35:32.207789+0000","last_fullsized":"2024-09-12T03:35:32.207789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207545+0000","last_change":"2024-09-12T03:35:31.155475+0000","last_active":"2024-09-12T03:35:32.207545+0000","last_peered":"2024-09-12T03:35:32.207545+0000","last_clean":"2024-09-12T03:35:32.207545+0000","last_became_active":"2024-09-12T03:35:31.154875+0000","last_became_peered":"2024-09-12T03:35:31.154875+0000","last_unstale":"2024-09-12T03:35:32.207545+0000","last_undegraded":"2024-09-12T03:35:32.207545+0000","last_fullsized":"2024-09-12T03:35:32.207545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206786+0000","last_change":"2024-09-12T03:35:32.184081+0000","last_active":"2024-09-12T03:35:32.206786+0000","last_peered":"2024-09-12T03:35:32.206786+0000","last_clean":"2024-09-12T03:35:32.206786+0000","last_became_active":"2024-09-12T03:35:32.183424+0000","last_became_peered":"2024-09-12T03:35:32.183424+0000","last_unstale":"2024-09-12T03:35:32.206786+0000","last_undegraded":"2024-09-12T03:35:32.206786+0000","last_fullsized":"2024-09-12T03:35:32.206786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167468+0000","last_change":"2024-09-12T03:35:31.134300+0000","last_active":"2024-09-12T03:35:32.167468+0000","last_peered":"2024-09-12T03:35:32.167468+0000","last_clean":"2024-09-12T03:35:32.167468+0000","last_became_active":"2024-09-12T03:35:31.133662+0000","last_became_peered":"2024-09-12T03:35:31.133662+0000","last_unstale":"2024-09-12T03:35:32.167468+0000","last_undegraded":"2024-09-12T03:35:32.167468+0000","last_fullsized":"2024-09-12T03:35:32.167468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179682+0000","last_change":"2024-09-12T03:35:32.176878+0000","last_active":"2024-09-12T03:35:32.179682+0000","last_peered":"2024-09-12T03:35:32.179682+0000","last_clean":"2024-09-12T03:35:32.179682+0000","last_became_active":"2024-09-12T03:35:32.176281+0000","last_became_peered":"2024-09-12T03:35:32.176281+0000","last_unstale":"2024-09-12T03:35:32.179682+0000","last_undegraded":"2024-09-12T03:35:32.179682+0000","last_fullsized":"2024-09-12T03:35:32.179682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157879+0000","last_change":"2024-09-12T03:35:31.148365+0000","last_active":"2024-09-12T03:35:32.157879+0000","last_peered":"2024-09-12T03:35:32.157879+0000","last_clean":"2024-09-12T03:35:32.157879+0000","last_became_active":"2024-09-12T03:35:31.142740+0000","last_became_peered":"2024-09-12T03:35:31.142740+0000","last_unstale":"2024-09-12T03:35:32.157879+0000","last_undegraded":"2024-09-12T03:35:32.157879+0000","last_fullsized":"2024-09-12T03:35:32.157879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179738+0000","last_change":"2024-09-12T03:35:32.176998+0000","last_active":"2024-09-12T03:35:32.179738+0000","last_peered":"2024-09-12T03:35:32.179738+0000","last_clean":"2024-09-12T03:35:32.179738+0000","last_became_active":"2024-09-12T03:35:32.176678+0000","last_became_peered":"2024-09-12T03:35:32.176678+0000","last_unstale":"2024-09-12T03:35:32.179738+0000","last_undegraded":"2024-09-12T03:35:32.179738+0000","last_fullsized":"2024-09-12T03:35:32.179738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:49.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.151633+0000","last_change":"2024-09-12T03:35:31.125827+0000","last_active":"2024-09-12T03:35:32.151633+0000","last_peered":"2024-09-12T03:35:32.151633+0000","last_clean":"2024-09-12T03:35:32.151633+0000","last_became_active":"2024-09-12T03:35:31.122580+0000","last_became_peered":"2024-09-12T03:35:31.122580+0000","last_unstale":"2024-09-12T03:35:32.151633+0000","last_undegraded":"2024-09-12T03:35:32.151633+0000","last_fullsized":"2024-09-12T03:35:32.151633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206161+0000","last_change":"2024-09-12T03:35:32.198738+0000","last_active":"2024-09-12T03:35:32.206161+0000","last_peered":"2024-09-12T03:35:32.206161+0000","last_clean":"2024-09-12T03:35:32.206161+0000","last_became_active":"2024-09-12T03:35:32.198073+0000","last_became_peered":"2024-09-12T03:35:32.198073+0000","last_unstale":"2024-09-12T03:35:32.206161+0000","last_undegraded":"2024-09-12T03:35:32.206161+0000","last_fullsized":"2024-09-12T03:35:32.206161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166727+0000","last_change":"2024-09-12T03:35:31.129565+0000","last_active":"2024-09-12T03:35:32.166727+0000","last_peered":"2024-09-12T03:35:32.166727+0000","last_clean":"2024-09-12T03:35:32.166727+0000","last_became_active":"2024-09-12T03:35:31.128696+0000","last_became_peered":"2024-09-12T03:35:31.128696+0000","last_unstale":"2024-09-12T03:35:32.166727+0000","last_undegraded":"2024-09-12T03:35:32.166727+0000","last_fullsized":"2024-09-12T03:35:32.166727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212534+0000","last_change":"2024-09-12T03:35:31.120663+0000","last_active":"2024-09-12T03:35:32.212534+0000","last_peered":"2024-09-12T03:35:32.212534+0000","last_clean":"2024-09-12T03:35:32.212534+0000","last_became_active":"2024-09-12T03:35:31.119307+0000","last_became_peered":"2024-09-12T03:35:31.119307+0000","last_unstale":"2024-09-12T03:35:32.212534+0000","last_undegraded":"2024-09-12T03:35:32.212534+0000","last_fullsized":"2024-09-12T03:35:32.212534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191162+0000","last_change":"2024-09-12T03:35:32.181504+0000","last_active":"2024-09-12T03:35:32.191162+0000","last_peered":"2024-09-12T03:35:32.191162+0000","last_clean":"2024-09-12T03:35:32.191162+0000","last_became_active":"2024-09-12T03:35:32.180735+0000","last_became_peered":"2024-09-12T03:35:32.180735+0000","last_unstale":"2024-09-12T03:35:32.191162+0000","last_undegraded":"2024-09-12T03:35:32.191162+0000","last_fullsized":"2024-09-12T03:35:32.191162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212280+0000","last_change":"2024-09-12T03:35:31.138409+0000","last_active":"2024-09-12T03:35:32.212280+0000","last_peered":"2024-09-12T03:35:32.212280+0000","last_clean":"2024-09-12T03:35:32.212280+0000","last_became_active":"2024-09-12T03:35:31.138039+0000","last_became_peered":"2024-09-12T03:35:31.138039+0000","last_unstale":"2024-09-12T03:35:32.212280+0000","last_undegraded":"2024-09-12T03:35:32.212280+0000","last_fullsized":"2024-09-12T03:35:32.212280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189481+0000","last_change":"2024-09-12T03:35:31.121034+0000","last_active":"2024-09-12T03:35:32.189481+0000","last_peered":"2024-09-12T03:35:32.189481+0000","last_clean":"2024-09-12T03:35:32.189481+0000","last_became_active":"2024-09-12T03:35:31.120768+0000","last_became_peered":"2024-09-12T03:35:31.120768+0000","last_unstale":"2024-09-12T03:35:32.189481+0000","last_undegraded":"2024-09-12T03:35:32.189481+0000","last_fullsized":"2024-09-12T03:35:32.189481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178318+0000","last_change":"2024-09-12T03:35:32.168888+0000","last_active":"2024-09-12T03:35:32.178318+0000","last_peered":"2024-09-12T03:35:32.178318+0000","last_clean":"2024-09-12T03:35:32.178318+0000","last_became_active":"2024-09-12T03:35:32.168568+0000","last_became_peered":"2024-09-12T03:35:32.168568+0000","last_unstale":"2024-09-12T03:35:32.178318+0000","last_undegraded":"2024-09-12T03:35:32.178318+0000","last_fullsized":"2024-09-12T03:35:32.178318+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166910+0000","last_change":"2024-09-12T03:35:31.134218+0000","last_active":"2024-09-12T03:35:32.166910+0000","last_peered":"2024-09-12T03:35:32.166910+0000","last_clean":"2024-09-12T03:35:32.166910+0000","last_became_active":"2024-09-12T03:35:31.133767+0000","last_became_peered":"2024-09-12T03:35:31.133767+0000","last_unstale":"2024-09-12T03:35:32.166910+0000","last_undegraded":"2024-09-12T03:35:32.166910+0000","last_fullsized":"2024-09-12T03:35:32.166910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190970+0000","last_change":"2024-09-12T03:35:32.178655+0000","last_active":"2024-09-12T03:35:32.190970+0000","last_peered":"2024-09-12T03:35:32.190970+0000","last_clean":"2024-09-12T03:35:32.190970+0000","last_became_active":"2024-09-12T03:35:32.177875+0000","last_became_peered":"2024-09-12T03:35:32.177875+0000","last_unstale":"2024-09-12T03:35:32.190970+0000","last_undegraded":"2024-09-12T03:35:32.190970+0000","last_fullsized":"2024-09-12T03:35:32.190970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099854+0000","last_change":"2024-09-12T03:35:30.099854+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099854+0000","last_undegraded":"2024-09-12T03:35:30.099854+0000","last_fullsized":"2024-09-12T03:35:30.099854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178296+0000","last_change":"2024-09-12T03:35:32.169975+0000","last_active":"2024-09-12T03:35:32.178296+0000","last_peered":"2024-09-12T03:35:32.178296+0000","last_clean":"2024-09-12T03:35:32.178296+0000","last_became_active":"2024-09-12T03:35:32.169592+0000","last_became_peered":"2024-09-12T03:35:32.169592+0000","last_unstale":"2024-09-12T03:35:32.178296+0000","last_undegraded":"2024-09-12T03:35:32.178296+0000","last_fullsized":"2024-09-12T03:35:32.178296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.209562+0000","last_change":"2024-09-12T03:35:31.154628+0000","last_active":"2024-09-12T03:35:32.209562+0000","last_peered":"2024-09-12T03:35:32.209562+0000","last_clean":"2024-09-12T03:35:32.209562+0000","last_became_active":"2024-09-12T03:35:31.153993+0000","last_became_peered":"2024-09-12T03:35:31.153993+0000","last_unstale":"2024-09-12T03:35:32.209562+0000","last_undegraded":"2024-09-12T03:35:32.209562+0000","last_fullsized":"2024-09-12T03:35:32.209562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.161598+0000","last_change":"2024-09-12T03:35:32.152935+0000","last_active":"2024-09-12T03:35:32.161598+0000","last_peered":"2024-09-12T03:35:32.161598+0000","last_clean":"2024-09-12T03:35:32.161598+0000","last_became_active":"2024-09-12T03:35:32.152123+0000","last_became_peered":"2024-09-12T03:35:32.152123+0000","last_unstale":"2024-09-12T03:35:32.161598+0000","last_undegraded":"2024-09-12T03:35:32.161598+0000","last_fullsized":"2024-09-12T03:35:32.161598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212278+0000","last_change":"2024-09-12T03:35:31.150651+0000","last_active":"2024-09-12T03:35:32.212278+0000","last_peered":"2024-09-12T03:35:32.212278+0000","last_clean":"2024-09-12T03:35:32.212278+0000","last_became_active":"2024-09-12T03:35:31.150087+0000","last_became_peered":"2024-09-12T03:35:31.150087+0000","last_unstale":"2024-09-12T03:35:32.212278+0000","last_undegraded":"2024-09-12T03:35:32.212278+0000","last_fullsized":"2024-09-12T03:35:32.212278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207722+0000","last_change":"2024-09-12T03:35:32.180787+0000","last_active":"2024-09-12T03:35:32.207722+0000","last_peered":"2024-09-12T03:35:32.207722+0000","last_clean":"2024-09-12T03:35:32.207722+0000","last_became_active":"2024-09-12T03:35:32.180128+0000","last_became_peered":"2024-09-12T03:35:32.180128+0000","last_unstale":"2024-09-12T03:35:32.207722+0000","last_undegraded":"2024-09-12T03:35:32.207722+0000","last_fullsized":"2024-09-12T03:35:32.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.213860+0000","last_change":"2024-09-12T03:35:31.148497+0000","last_active":"2024-09-12T03:35:32.213860+0000","last_peered":"2024-09-12T03:35:32.213860+0000","last_clean":"2024-09-12T03:35:32.213860+0000","last_became_active":"2024-09-12T03:35:31.147818+0000","last_became_peered":"2024-09-12T03:35:31.147818+0000","last_unstale":"2024-09-12T03:35:32.213860+0000","last_undegraded":"2024-09-12T03:35:32.213860+0000","last_fullsized":"2024-09-12T03:35:32.213860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190661+0000","last_change":"2024-09-12T03:35:32.183482+0000","last_active":"2024-09-12T03:35:32.190661+0000","last_peered":"2024-09-12T03:35:32.190661+0000","last_clean":"2024-09-12T03:35:32.190661+0000","last_became_active":"2024-09-12T03:35:32.175402+0000","last_became_peered":"2024-09-12T03:35:32.175402+0000","last_unstale":"2024-09-12T03:35:32.190661+0000","last_undegraded":"2024-09-12T03:35:32.190661+0000","last_fullsized":"2024-09-12T03:35:32.190661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.195583+0000","last_change":"2024-09-12T03:35:31.137498+0000","last_active":"2024-09-12T03:35:32.195583+0000","last_peered":"2024-09-12T03:35:32.195583+0000","last_clean":"2024-09-12T03:35:32.195583+0000","last_became_active":"2024-09-12T03:35:31.137210+0000","last_became_peered":"2024-09-12T03:35:31.137210+0000","last_unstale":"2024-09-12T03:35:32.195583+0000","last_undegraded":"2024-09-12T03:35:32.195583+0000","last_fullsized":"2024-09-12T03:35:32.195583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:10.651197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165642+0000","last_change":"2024-09-12T03:35:32.155601+0000","last_active":"2024-09-12T03:35:32.165642+0000","last_peered":"2024-09-12T03:35:32.165642+0000","last_clean":"2024-09-12T03:35:32.165642+0000","last_became_active":"2024-09-12T03:35:32.153852+0000","last_became_peered":"2024-09-12T03:35:32.153852+0000","last_unstale":"2024-09-12T03:35:32.165642+0000","last_undegraded":"2024-09-12T03:35:32.165642+0000","last_fullsized":"2024-09-12T03:35:32.165642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:57.275609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166487+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.166487+0000","last_peered":"2024-09-12T03:35:32.166487+0000","last_clean":"2024-09-12T03:35:32.166487+0000","last_became_active":"2024-09-12T03:35:31.144611+0000","last_became_peered":"2024-09-12T03:35:31.144611+0000","last_unstale":"2024-09-12T03:35:32.166487+0000","last_undegraded":"2024-09-12T03:35:32.166487+0000","last_fullsized":"2024-09-12T03:35:32.166487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.196264+0000","last_change":"2024-09-12T03:35:32.179725+0000","last_active":"2024-09-12T03:35:32.196264+0000","last_peered":"2024-09-12T03:35:32.196264+0000","last_clean":"2024-09-12T03:35:32.196264+0000","last_became_active":"2024-09-12T03:35:32.178924+0000","last_became_peered":"2024-09-12T03:35:32.178924+0000","last_unstale":"2024-09-12T03:35:32.196264+0000","last_undegraded":"2024-09-12T03:35:32.196264+0000","last_fullsized":"2024-09-12T03:35:32.196264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.188965+0000","last_change":"2024-09-12T03:35:31.119011+0000","last_active":"2024-09-12T03:35:32.188965+0000","last_peered":"2024-09-12T03:35:32.188965+0000","last_clean":"2024-09-12T03:35:32.188965+0000","last_became_active":"2024-09-12T03:35:31.118692+0000","last_became_peered":"2024-09-12T03:35:31.118692+0000","last_unstale":"2024-09-12T03:35:32.188965+0000","last_undegraded":"2024-09-12T03:35:32.188965+0000","last_fullsized":"2024-09-12T03:35:32.188965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:00.187654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141169+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.141169+0000","last_peered":"2024-09-12T03:35:32.141169+0000","last_clean":"2024-09-12T03:35:32.141169+0000","last_became_active":"2024-09-12T03:35:31.144591+0000","last_became_peered":"2024-09-12T03:35:31.144591+0000","last_unstale":"2024-09-12T03:35:32.141169+0000","last_undegraded":"2024-09-12T03:35:32.141169+0000","last_fullsized":"2024-09-12T03:35:32.141169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:00.727172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.176611+0000","last_change":"2024-09-12T03:35:32.157200+0000","last_active":"2024-09-12T03:35:32.176611+0000","last_peered":"2024-09-12T03:35:32.176611+0000","last_clean":"2024-09-12T03:35:32.176611+0000","last_became_active":"2024-09-12T03:35:32.155267+0000","last_became_peered":"2024-09-12T03:35:32.155267+0000","last_unstale":"2024-09-12T03:35:32.176611+0000","last_undegraded":"2024-09-12T03:35:32.176611+0000","last_fullsized":"2024-09-12T03:35:32.176611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168000+0000","last_change":"2024-09-12T03:35:31.143758+0000","last_active":"2024-09-12T03:35:32.168000+0000","last_peered":"2024-09-12T03:35:32.168000+0000","last_clean":"2024-09-12T03:35:32.168000+0000","last_became_active":"2024-09-12T03:35:31.143044+0000","last_became_peered":"2024-09-12T03:35:31.143044+0000","last_unstale":"2024-09-12T03:35:32.168000+0000","last_undegraded":"2024-09-12T03:35:32.168000+0000","last_fullsized":"2024-09-12T03:35:32.168000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179656+0000","last_change":"2024-09-12T03:35:32.176574+0000","last_active":"2024-09-12T03:35:32.179656+0000","last_peered":"2024-09-12T03:35:32.179656+0000","last_clean":"2024-09-12T03:35:32.179656+0000","last_became_active":"2024-09-12T03:35:32.175869+0000","last_became_peered":"2024-09-12T03:35:32.175869+0000","last_unstale":"2024-09-12T03:35:32.179656+0000","last_undegraded":"2024-09-12T03:35:32.179656+0000","last_fullsized":"2024-09-12T03:35:32.179656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.142133+0000","last_change":"2024-09-12T03:35:31.119437+0000","last_active":"2024-09-12T03:35:32.142133+0000","last_peered":"2024-09-12T03:35:32.142133+0000","last_clean":"2024-09-12T03:35:32.142133+0000","last_became_active":"2024-09-12T03:35:31.118811+0000","last_became_peered":"2024-09-12T03:35:31.118811+0000","last_unstale":"2024-09-12T03:35:32.142133+0000","last_undegraded":"2024-09-12T03:35:32.142133+0000","last_fullsized":"2024-09-12T03:35:32.142133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.128401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207530+0000","last_change":"2024-09-12T03:35:32.206219+0000","last_active":"2024-09-12T03:35:32.207530+0000","last_peered":"2024-09-12T03:35:32.207530+0000","last_clean":"2024-09-12T03:35:32.207530+0000","last_became_active":"2024-09-12T03:35:32.205898+0000","last_became_peered":"2024-09-12T03:35:32.205898+0000","last_unstale":"2024-09-12T03:35:32.207530+0000","last_undegraded":"2024-09-12T03:35:32.207530+0000","last_fullsized":"2024-09-12T03:35:32.207530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212324+0000","last_change":"2024-09-12T03:35:31.123519+0000","last_active":"2024-09-12T03:35:32.212324+0000","last_peered":"2024-09-12T03:35:32.212324+0000","last_clean":"2024-09-12T03:35:32.212324+0000","last_became_active":"2024-09-12T03:35:31.122716+0000","last_became_peered":"2024-09-12T03:35:31.122716+0000","last_unstale":"2024-09-12T03:35:32.212324+0000","last_undegraded":"2024-09-12T03:35:32.212324+0000","last_fullsized":"2024-09-12T03:35:32.212324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206103+0000","last_change":"2024-09-12T03:35:32.198862+0000","last_active":"2024-09-12T03:35:32.206103+0000","last_peered":"2024-09-12T03:35:32.206103+0000","last_clean":"2024-09-12T03:35:32.206103+0000","last_became_active":"2024-09-12T03:35:32.198370+0000","last_became_peered":"2024-09-12T03:35:32.198370+0000","last_unstale":"2024-09-12T03:35:32.206103+0000","last_undegraded":"2024-09-12T03:35:32.206103+0000","last_fullsized":"2024-09-12T03:35:32.206103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:41.567114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141700+0000","last_change":"2024-09-12T03:35:31.130491+0000","last_active":"2024-09-12T03:35:32.141700+0000","last_peered":"2024-09-12T03:35:32.141700+0000","last_clean":"2024-09-12T03:35:32.141700+0000","last_became_active":"2024-09-12T03:35:31.130189+0000","last_became_peered":"2024-09-12T03:35:31.130189+0000","last_unstale":"2024-09-12T03:35:32.141700+0000","last_undegraded":"2024-09-12T03:35:32.141700+0000","last_fullsized":"2024-09-12T03:35:32.141700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:57.745056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189301+0000","last_change":"2024-09-12T03:35:32.185743+0000","last_active":"2024-09-12T03:35:32.189301+0000","last_peered":"2024-09-12T03:35:32.189301+0000","last_clean":"2024-09-12T03:35:32.189301+0000","last_became_active":"2024-09-12T03:35:32.185415+0000","last_became_peered":"2024-09-12T03:35:32.185415+0000","last_unstale":"2024-09-12T03:35:32.189301+0000","last_undegraded":"2024-09-12T03:35:32.189301+0000","last_fullsized":"2024-09-12T03:35:32.189301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103178+0000","last_change":"2024-09-12T03:35:30.103178+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103178+0000","last_undegraded":"2024-09-12T03:35:30.103178+0000","last_fullsized":"2024-09-12T03:35:30.103178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103111+0000","last_change":"2024-09-12T03:35:30.103111+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103111+0000","last_undegraded":"2024-09-12T03:35:30.103111+0000","last_fullsized":"2024-09-12T03:35:30.103111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.186467+0000","last_change":"2024-09-12T03:35:32.180911+0000","last_active":"2024-09-12T03:35:32.186467+0000","last_peered":"2024-09-12T03:35:32.186467+0000","last_clean":"2024-09-12T03:35:32.186467+0000","last_became_active":"2024-09-12T03:35:32.180601+0000","last_became_peered":"2024-09-12T03:35:32.180601+0000","last_unstale":"2024-09-12T03:35:32.186467+0000","last_undegraded":"2024-09-12T03:35:32.186467+0000","last_fullsized":"2024-09-12T03:35:32.186467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099852+0000","last_change":"2024-09-12T03:35:30.099852+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099852+0000","last_undegraded":"2024-09-12T03:35:30.099852+0000","last_fullsized":"2024-09-12T03:35:30.099852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202018+0000","last_change":"2024-09-12T03:35:32.174912+0000","last_active":"2024-09-12T03:35:32.202018+0000","last_peered":"2024-09-12T03:35:32.202018+0000","last_clean":"2024-09-12T03:35:32.202018+0000","last_became_active":"2024-09-12T03:35:32.173337+0000","last_became_peered":"2024-09-12T03:35:32.173337+0000","last_unstale":"2024-09-12T03:35:32.202018+0000","last_undegraded":"2024-09-12T03:35:32.202018+0000","last_fullsized":"2024-09-12T03:35:32.202018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157766+0000","last_change":"2024-09-12T03:35:31.141781+0000","last_active":"2024-09-12T03:35:32.157766+0000","last_peered":"2024-09-12T03:35:32.157766+0000","last_clean":"2024-09-12T03:35:32.157766+0000","last_became_active":"2024-09-12T03:35:31.139547+0000","last_became_peered":"2024-09-12T03:35:31.139547+0000","last_unstale":"2024-09-12T03:35:32.157766+0000","last_undegraded":"2024-09-12T03:35:32.157766+0000","last_fullsized":"2024-09-12T03:35:32.157766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206154+0000","last_change":"2024-09-12T03:35:32.200175+0000","last_active":"2024-09-12T03:35:32.206154+0000","last_peered":"2024-09-12T03:35:32.206154+0000","last_clean":"2024-09-12T03:35:32.206154+0000","last_became_active":"2024-09-12T03:35:32.199519+0000","last_became_peered":"2024-09-12T03:35:32.199519+0000","last_unstale":"2024-09-12T03:35:32.206154+0000","last_undegraded":"2024-09-12T03:35:32.206154+0000","last_fullsized":"2024-09-12T03:35:32.206154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.148275+0000","last_change":"2024-09-12T03:35:31.125839+0000","last_active":"2024-09-12T03:35:32.148275+0000","last_peered":"2024-09-12T03:35:32.148275+0000","last_clean":"2024-09-12T03:35:32.148275+0000","last_became_active":"2024-09-12T03:35:31.122726+0000","last_became_peered":"2024-09-12T03:35:31.122726+0000","last_unstale":"2024-09-12T03:35:32.148275+0000","last_undegraded":"2024-09-12T03:35:32.148275+0000","last_fullsized":"2024-09-12T03:35:32.148275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.189144+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.188402+0000","last_became_peered":"2024-09-12T03:35:32.188402+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168336+0000","last_change":"2024-09-12T03:35:31.147449+0000","last_active":"2024-09-12T03:35:32.168336+0000","last_peered":"2024-09-12T03:35:32.168336+0000","last_clean":"2024-09-12T03:35:32.168336+0000","last_became_active":"2024-09-12T03:35:31.146800+0000","last_became_peered":"2024-09-12T03:35:31.146800+0000","last_unstale":"2024-09-12T03:35:32.168336+0000","last_undegraded":"2024-09-12T03:35:32.168336+0000","last_fullsized":"2024-09-12T03:35:32.168336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:51.274026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165630+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:35:32.165630+0000","last_peered":"2024-09-12T03:35:32.165630+0000","last_clean":"2024-09-12T03:35:32.165630+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:35:32.165630+0000","last_undegraded":"2024-09-12T03:35:32.165630+0000","last_fullsized":"2024-09-12T03:35:32.165630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":777199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":417792,"data_stored":177982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":185753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":186795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":761683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:35:36.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:35:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fac075640 1 Processor -- start 2024-09-12T03:35:36.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fac075640 1 -- start start 2024-09-12T03:35:36.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fac075640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 0x7f2fa40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fac075640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa40d32b0 con 0x7f2fa40cf620 2024-09-12T03:35:36.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fac075640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa40cfad0 con 0x7f2fa40d2e90 2024-09-12T03:35:36.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fac075640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa40d0300 con 0x7f2fa4161a60 2024-09-12T03:35:36.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2fa40cf620 0x7f2fa406d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58950/0 (socket says 172.21.15.73:58950) 2024-09-12T03:35:36.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 -- 172.21.15.73:0/2754487156 learned_addr learned my addr 172.21.15.73:0/2754487156 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:36.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa9e11640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 0x7f2fa40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1753682915 0 0) 0x7f2fa40d32b0 con 0x7f2fa40cf620 2024-09-12T03:35:36.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f90003530 con 0x7f2fa40cf620 2024-09-12T03:35:36.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2369826443 0 0) 0x7f2f90003530 con 0x7f2fa40cf620 2024-09-12T03:35:36.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 msgr2=0x7f2fa40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:36.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 0x7f2fa40d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 >> v1:172.21.15.150:6789/0 conn(0x7f2fa40d2e90 legacy=0x7f2fa40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa40b0f60 con 0x7f2fa40cf620 2024-09-12T03:35:36.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f2f9c001a00 con 0x7f2fa40cf620 2024-09-12T03:35:36.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 >> v1:172.21.15.73:6789/0 conn(0x7f2fa40cf620 legacy=0x7f2fa406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 0x7f2f900039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f90003f70 0x7f2f90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d50 0x7f2f900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa40d0300 con 0x7f2f90004d50 2024-09-12T03:35:36.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9000bb60 con 0x7f2f90003f70 2024-09-12T03:35:36.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9000bd60 con 0x7f2fa4161a60 2024-09-12T03:35:36.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d50 0x7f2f900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa9610640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f90003f70 0x7f2f90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa9e11640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 0x7f2f900039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 -- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 msgr2=0x7f2f900039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:36.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2fa4161a60 0x7f2f900039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 -- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f90003f70 msgr2=0x7f2f90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f90003f70 0x7f2f90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2faa612640 1 -- 172.21.15.73:0/2754487156 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f90003530 con 0x7f2f90004d50 2024-09-12T03:35:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.703+0000 7f2fa9610640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f90003f70 0x7f2f90004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:36.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2faa612640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d50 0x7f2f900051d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00a850 tx=0x7f2f9c01fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9cadde3046419e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:36.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00a4a0 con 0x7f2f90004d50 2024-09-12T03:35:36.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0ad070 con 0x7f2f90004d50 2024-09-12T03:35:36.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fa8e0f640 1 -- 172.21.15.73:0/2754487156 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0a9980 con 0x7f2f90004d50 2024-09-12T03:35:36.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- 172.21.15.73:0/2754487156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d50 msgr2=0x7f2f900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 --2- 172.21.15.73:0/2754487156 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d50 0x7f2f900051d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00a850 tx=0x7f2f9c01fb00 comp rx=0 tx=0).stop 2024-09-12T03:35:36.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2faa612640 1 -- 172.21.15.73:0/2754487156 reap_dead start 2024-09-12T03:35:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- 172.21.15.73:0/2754487156 shutdown_connections 2024-09-12T03:35:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- 172.21.15.73:0/2754487156 >> 172.21.15.73:0/2754487156 conn(0x7f2fa408bf90 msgr2=0x7f2fa409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- 172.21.15.73:0/2754487156 shutdown_connections 2024-09-12T03:35:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- 172.21.15.73:0/2754487156 wait complete. 2024-09-12T03:35:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 Processor -- start 2024-09-12T03:35:36.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- start start 2024-09-12T03:35:36.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f90004d50 0x7f2fa4157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fa41f4990 0x7f2fa415db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40caa50 0x7f2fa415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa406ceb0 con 0x7f2fa40caa50 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa40d0020 con 0x7f2fa41f4990 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2fac075640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa406d190 con 0x7f2f90004d50 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2faa612640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40caa50 0x7f2fa415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2faa612640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40caa50 0x7f2fa415e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49676/0 (socket says 172.21.15.73:49676) 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.707+0000 7f2faa612640 1 -- 172.21.15.73:0/3082514207 learned_addr learned my addr 172.21.15.73:0/3082514207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fa9610640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fa41f4990 0x7f2fa415db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fa9e11640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f90004d50 0x7f2fa4157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2faa612640 1 -- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f90004d50 msgr2=0x7f2fa4157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2faa612640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f90004d50 0x7f2fa4157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2faa612640 1 -- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fa41f4990 msgr2=0x7f2fa415db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2faa612640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fa41f4990 0x7f2fa415db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2faa612640 1 -- 172.21.15.73:0/3082514207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa41f4ee0 con 0x7f2fa40caa50 2024-09-12T03:35:36.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fa9610640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fa41f4990 0x7f2fa415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:36.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fa9e11640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f90004d50 0x7f2fa4157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:36.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2faa612640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40caa50 0x7f2fa415e0b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c09c240 tx=0x7f2f90005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:36.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2f9a7fc640 1 -- 172.21.15.73:0/3082514207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c00a480 con 0x7f2fa40caa50 2024-09-12T03:35:36.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2f9a7fc640 1 -- 172.21.15.73:0/3082514207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0a9520 con 0x7f2fa40caa50 2024-09-12T03:35:36.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa40cc490 con 0x7f2fa40caa50 2024-09-12T03:35:36.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2f9a7fc640 1 -- 172.21.15.73:0/3082514207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0a98d0 con 0x7f2fa40caa50 2024-09-12T03:35:36.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa415c270 con 0x7f2fa40caa50 2024-09-12T03:35:36.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa40cc660 con 0x7f2fa40caa50 2024-09-12T03:35:36.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2f9a7fc640 1 -- 172.21.15.73:0/3082514207 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f9c0a9a70 con 0x7f2fa40caa50 2024-09-12T03:35:36.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2f9a7fc640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2f880678c0 0x7f2f88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:36.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fa9e11640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2f880678c0 0x7f2f88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:36.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2f9a7fc640 1 -- 172.21.15.73:0/3082514207 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2f9c123180 con 0x7f2fa40caa50 2024-09-12T03:35:36.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.711+0000 7f2fa9e11640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2f880678c0 0x7f2f88069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40ce1a0 tx=0x7f2fa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:36.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.715+0000 7f2f9a7fc640 1 -- 172.21.15.73:0/3082514207 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f9c019810 con 0x7f2fa40caa50 2024-09-12T03:35:36.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.867+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fa40b1a50 con 0x7f2f880678c0 2024-09-12T03:35:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.875+0000 7f2f9a7fc640 1 -- 172.21.15.73:0/3082514207 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249354 (secure 0 0 0) 0x7f2fa40b1a50 con 0x7f2f880678c0 2024-09-12T03:35:36.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2f880678c0 msgr2=0x7f2f88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2f880678c0 0x7f2f88069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40ce1a0 tx=0x7f2fa0008040 comp rx=0 tx=0).stop 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40caa50 msgr2=0x7f2fa415e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40caa50 0x7f2fa415e0b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c09c240 tx=0x7f2f90005840 comp rx=0 tx=0).stop 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 shutdown_connections 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2f880678c0 0x7f2f88069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40caa50 0x7f2fa415e0b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fa41f4990 0x7f2fa415db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 --2- 172.21.15.73:0/3082514207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2f90004d50 0x7f2fa4157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 >> 172.21.15.73:0/3082514207 conn(0x7f2fa408bf90 msgr2=0x7f2fa40b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 shutdown_connections 2024-09-12T03:35:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:36.879+0000 7f2fac075640 1 -- 172.21.15.73:0/3082514207 wait complete. 2024-09-12T03:35:36.901 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T03:35:35.806569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220740,"kb_used_data":4508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753980,"statfs":{"total":773094113280,"available":772868075520,"internally_reserved":0,"allocated":4616192,"data_stored":2631185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709182"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178355+0000","last_change":"2024-09-12T03:35:32.169010+0000","last_active":"2024-09-12T03:35:32.178355+0000","last_peered":"2024-09-12T03:35:32.178355+0000","last_clean":"2024-09-12T03:35:32.178355+0000","last_became_active":"2024-09-12T03:35:32.168574+0000","last_became_peered":"2024-09-12T03:35:32.168574+0000","last_unstale":"2024-09-12T03:35:32.178355+0000","last_undegraded":"2024-09-12T03:35:32.178355+0000","last_fullsized":"2024-09-12T03:35:32.178355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167459+0000","last_change":"2024-09-12T03:35:32.157902+0000","last_active":"2024-09-12T03:35:32.167459+0000","last_peered":"2024-09-12T03:35:32.167459+0000","last_clean":"2024-09-12T03:35:32.167459+0000","last_became_active":"2024-09-12T03:35:32.157125+0000","last_became_peered":"2024-09-12T03:35:32.157125+0000","last_unstale":"2024-09-12T03:35:32.167459+0000","last_undegraded":"2024-09-12T03:35:32.167459+0000","last_fullsized":"2024-09-12T03:35:32.167459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179762+0000","last_change":"2024-09-12T03:35:32.176999+0000","last_active":"2024-09-12T03:35:32.179762+0000","last_peered":"2024-09-12T03:35:32.179762+0000","last_clean":"2024-09-12T03:35:32.179762+0000","last_became_active":"2024-09-12T03:35:32.176693+0000","last_became_peered":"2024-09-12T03:35:32.176693+0000","last_unstale":"2024-09-12T03:35:32.179762+0000","last_undegraded":"2024-09-12T03:35:32.179762+0000","last_fullsized":"2024-09-12T03:35:32.179762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:02.318856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178286+0000","last_change":"2024-09-12T03:35:32.176004+0000","last_active":"2024-09-12T03:35:32.178286+0000","last_peered":"2024-09-12T03:35:32.178286+0000","last_clean":"2024-09-12T03:35:32.178286+0000","last_became_active":"2024-09-12T03:35:32.175743+0000","last_became_peered":"2024-09-12T03:35:32.175743+0000","last_unstale":"2024-09-12T03:35:32.178286+0000","last_undegraded":"2024-09-12T03:35:32.178286+0000","last_fullsized":"2024-09-12T03:35:32.178286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:29.981501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183458+0000","last_change":"2024-09-12T03:35:32.179040+0000","last_active":"2024-09-12T03:35:32.183458+0000","last_peered":"2024-09-12T03:35:32.183458+0000","last_clean":"2024-09-12T03:35:32.183458+0000","last_became_active":"2024-09-12T03:35:32.178776+0000","last_became_peered":"2024-09-12T03:35:32.178776+0000","last_unstale":"2024-09-12T03:35:32.183458+0000","last_undegraded":"2024-09-12T03:35:32.183458+0000","last_fullsized":"2024-09-12T03:35:32.183458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207842+0000","last_change":"2024-09-12T03:35:32.188889+0000","last_active":"2024-09-12T03:35:32.207842+0000","last_peered":"2024-09-12T03:35:32.207842+0000","last_clean":"2024-09-12T03:35:32.207842+0000","last_became_active":"2024-09-12T03:35:32.188042+0000","last_became_peered":"2024-09-12T03:35:32.188042+0000","last_unstale":"2024-09-12T03:35:32.207842+0000","last_undegraded":"2024-09-12T03:35:32.207842+0000","last_fullsized":"2024-09-12T03:35:32.207842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.173119+0000","last_change":"2024-09-12T03:35:32.162848+0000","last_active":"2024-09-12T03:35:32.173119+0000","last_peered":"2024-09-12T03:35:32.173119+0000","last_clean":"2024-09-12T03:35:32.173119+0000","last_became_active":"2024-09-12T03:35:32.162154+0000","last_became_peered":"2024-09-12T03:35:32.162154+0000","last_unstale":"2024-09-12T03:35:32.173119+0000","last_undegraded":"2024-09-12T03:35:32.173119+0000","last_fullsized":"2024-09-12T03:35:32.173119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208390+0000","last_change":"2024-09-12T03:35:32.195034+0000","last_active":"2024-09-12T03:35:32.208390+0000","last_peered":"2024-09-12T03:35:32.208390+0000","last_clean":"2024-09-12T03:35:32.208390+0000","last_became_active":"2024-09-12T03:35:32.194309+0000","last_became_peered":"2024-09-12T03:35:32.194309+0000","last_unstale":"2024-09-12T03:35:32.208390+0000","last_undegraded":"2024-09-12T03:35:32.208390+0000","last_fullsized":"2024-09-12T03:35:32.208390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208445+0000","last_change":"2024-09-12T03:35:32.195524+0000","last_active":"2024-09-12T03:35:32.208445+0000","last_peered":"2024-09-12T03:35:32.208445+0000","last_clean":"2024-09-12T03:35:32.208445+0000","last_became_active":"2024-09-12T03:35:32.194818+0000","last_became_peered":"2024-09-12T03:35:32.194818+0000","last_unstale":"2024-09-12T03:35:32.208445+0000","last_undegraded":"2024-09-12T03:35:32.208445+0000","last_fullsized":"2024-09-12T03:35:32.208445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208412+0000","last_change":"2024-09-12T03:35:32.195303+0000","last_active":"2024-09-12T03:35:32.208412+0000","last_peered":"2024-09-12T03:35:32.208412+0000","last_clean":"2024-09-12T03:35:32.208412+0000","last_became_active":"2024-09-12T03:35:32.194596+0000","last_became_peered":"2024-09-12T03:35:32.194596+0000","last_unstale":"2024-09-12T03:35:32.208412+0000","last_undegraded":"2024-09-12T03:35:32.208412+0000","last_fullsized":"2024-09-12T03:35:32.208412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202064+0000","last_change":"2024-09-12T03:35:32.180297+0000","last_active":"2024-09-12T03:35:32.202064+0000","last_peered":"2024-09-12T03:35:32.202064+0000","last_clean":"2024-09-12T03:35:32.202064+0000","last_became_active":"2024-09-12T03:35:32.174697+0000","last_became_peered":"2024-09-12T03:35:32.174697+0000","last_unstale":"2024-09-12T03:35:32.202064+0000","last_undegraded":"2024-09-12T03:35:32.202064+0000","last_fullsized":"2024-09-12T03:35:32.202064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.197050+0000","last_change":"2024-09-12T03:35:32.170895+0000","last_active":"2024-09-12T03:35:32.197050+0000","last_peered":"2024-09-12T03:35:32.197050+0000","last_clean":"2024-09-12T03:35:32.197050+0000","last_became_active":"2024-09-12T03:35:32.170170+0000","last_became_peered":"2024-09-12T03:35:32.170170+0000","last_unstale":"2024-09-12T03:35:32.197050+0000","last_undegraded":"2024-09-12T03:35:32.197050+0000","last_fullsized":"2024-09-12T03:35:32.197050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216087+0000","last_change":"2024-09-12T03:35:32.213125+0000","last_active":"2024-09-12T03:35:32.216087+0000","last_peered":"2024-09-12T03:35:32.216087+0000","last_clean":"2024-09-12T03:35:32.216087+0000","last_became_active":"2024-09-12T03:35:32.212385+0000","last_became_peered":"2024-09-12T03:35:32.212385+0000","last_unstale":"2024-09-12T03:35:32.216087+0000","last_undegraded":"2024-09-12T03:35:32.216087+0000","last_fullsized":"2024-09-12T03:35:32.216087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216370+0000","last_change":"2024-09-12T03:35:32.213872+0000","last_active":"2024-09-12T03:35:32.216370+0000","last_peered":"2024-09-12T03:35:32.216370+0000","last_clean":"2024-09-12T03:35:32.216370+0000","last_became_active":"2024-09-12T03:35:32.213105+0000","last_became_peered":"2024-09-12T03:35:32.213105+0000","last_unstale":"2024-09-12T03:35:32.216370+0000","last_undegraded":"2024-09-12T03:35:32.216370+0000","last_fullsized":"2024-09-12T03:35:32.216370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.175963+0000","last_change":"2024-09-12T03:35:32.173004+0000","last_active":"2024-09-12T03:35:32.175963+0000","last_peered":"2024-09-12T03:35:32.175963+0000","last_clean":"2024-09-12T03:35:32.175963+0000","last_became_active":"2024-09-12T03:35:32.172616+0000","last_became_peered":"2024-09-12T03:35:32.172616+0000","last_unstale":"2024-09-12T03:35:32.175963+0000","last_undegraded":"2024-09-12T03:35:32.175963+0000","last_fullsized":"2024-09-12T03:35:32.175963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:53.618781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207496+0000","last_change":"2024-09-12T03:35:32.180618+0000","last_active":"2024-09-12T03:35:32.207496+0000","last_peered":"2024-09-12T03:35:32.207496+0000","last_clean":"2024-09-12T03:35:32.207496+0000","last_became_active":"2024-09-12T03:35:32.179750+0000","last_became_peered":"2024-09-12T03:35:32.179750+0000","last_unstale":"2024-09-12T03:35:32.207496+0000","last_undegraded":"2024-09-12T03:35:32.207496+0000","last_fullsized":"2024-09-12T03:35:32.207496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.201962+0000","last_change":"2024-09-12T03:35:32.175438+0000","last_active":"2024-09-12T03:35:32.201962+0000","last_peered":"2024-09-12T03:35:32.201962+0000","last_clean":"2024-09-12T03:35:32.201962+0000","last_became_active":"2024-09-12T03:35:32.173214+0000","last_became_peered":"2024-09-12T03:35:32.173214+0000","last_unstale":"2024-09-12T03:35:32.201962+0000","last_undegraded":"2024-09-12T03:35:32.201962+0000","last_fullsized":"2024-09-12T03:35:32.201962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191120+0000","last_change":"2024-09-12T03:35:32.178661+0000","last_active":"2024-09-12T03:35:32.191120+0000","last_peered":"2024-09-12T03:35:32.191120+0000","last_clean":"2024-09-12T03:35:32.191120+0000","last_became_active":"2024-09-12T03:35:32.177898+0000","last_became_peered":"2024-09-12T03:35:32.177898+0000","last_unstale":"2024-09-12T03:35:32.191120+0000","last_undegraded":"2024-09-12T03:35:32.191120+0000","last_fullsized":"2024-09-12T03:35:32.191120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.177060+0000","last_change":"2024-09-12T03:35:32.175313+0000","last_active":"2024-09-12T03:35:32.177060+0000","last_peered":"2024-09-12T03:35:32.177060+0000","last_clean":"2024-09-12T03:35:32.177060+0000","last_became_active":"2024-09-12T03:35:32.174347+0000","last_became_peered":"2024-09-12T03:35:32.174347+0000","last_unstale":"2024-09-12T03:35:32.177060+0000","last_undegraded":"2024-09-12T03:35:32.177060+0000","last_fullsized":"2024-09-12T03:35:32.177060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:03.685409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.206339+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.205847+0000","last_became_peered":"2024-09-12T03:35:32.205847+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207827+0000","last_change":"2024-09-12T03:35:32.184992+0000","last_active":"2024-09-12T03:35:32.207827+0000","last_peered":"2024-09-12T03:35:32.207827+0000","last_clean":"2024-09-12T03:35:32.207827+0000","last_became_active":"2024-09-12T03:35:32.184163+0000","last_became_peered":"2024-09-12T03:35:32.184163+0000","last_unstale":"2024-09-12T03:35:32.207827+0000","last_undegraded":"2024-09-12T03:35:32.207827+0000","last_fullsized":"2024-09-12T03:35:32.207827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191170+0000","last_change":"2024-09-12T03:35:32.182587+0000","last_active":"2024-09-12T03:35:32.191170+0000","last_peered":"2024-09-12T03:35:32.191170+0000","last_clean":"2024-09-12T03:35:32.191170+0000","last_became_active":"2024-09-12T03:35:32.181769+0000","last_became_peered":"2024-09-12T03:35:32.181769+0000","last_unstale":"2024-09-12T03:35:32.191170+0000","last_undegraded":"2024-09-12T03:35:32.191170+0000","last_fullsized":"2024-09-12T03:35:32.191170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.172742+0000","last_change":"2024-09-12T03:35:32.166893+0000","last_active":"2024-09-12T03:35:32.172742+0000","last_peered":"2024-09-12T03:35:32.172742+0000","last_clean":"2024-09-12T03:35:32.172742+0000","last_became_active":"2024-09-12T03:35:32.166550+0000","last_became_peered":"2024-09-12T03:35:32.166550+0000","last_unstale":"2024-09-12T03:35:32.172742+0000","last_undegraded":"2024-09-12T03:35:32.172742+0000","last_fullsized":"2024-09-12T03:35:32.172742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:46.976689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.215852+0000","last_change":"2024-09-12T03:35:32.212944+0000","last_active":"2024-09-12T03:35:32.215852+0000","last_peered":"2024-09-12T03:35:32.215852+0000","last_clean":"2024-09-12T03:35:32.215852+0000","last_became_active":"2024-09-12T03:35:32.212437+0000","last_became_peered":"2024-09-12T03:35:32.212437+0000","last_unstale":"2024-09-12T03:35:32.215852+0000","last_undegraded":"2024-09-12T03:35:32.215852+0000","last_fullsized":"2024-09-12T03:35:32.215852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.100015+0000","last_change":"2024-09-12T03:35:30.100015+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.100015+0000","last_undegraded":"2024-09-12T03:35:30.100015+0000","last_fullsized":"2024-09-12T03:35:30.100015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207891+0000","last_change":"2024-09-12T03:35:32.206342+0000","last_active":"2024-09-12T03:35:32.207891+0000","last_peered":"2024-09-12T03:35:32.207891+0000","last_clean":"2024-09-12T03:35:32.207891+0000","last_became_active":"2024-09-12T03:35:32.205885+0000","last_became_peered":"2024-09-12T03:35:32.205885+0000","last_unstale":"2024-09-12T03:35:32.207891+0000","last_undegraded":"2024-09-12T03:35:32.207891+0000","last_fullsized":"2024-09-12T03:35:32.207891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103320+0000","last_change":"2024-09-12T03:35:30.103320+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103320+0000","last_undegraded":"2024-09-12T03:35:30.103320+0000","last_fullsized":"2024-09-12T03:35:30.103320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183864+0000","last_change":"2024-09-12T03:35:32.174736+0000","last_active":"2024-09-12T03:35:32.183864+0000","last_peered":"2024-09-12T03:35:32.183864+0000","last_clean":"2024-09-12T03:35:32.183864+0000","last_became_active":"2024-09-12T03:35:32.172869+0000","last_became_peered":"2024-09-12T03:35:32.172869+0000","last_unstale":"2024-09-12T03:35:32.183864+0000","last_undegraded":"2024-09-12T03:35:32.183864+0000","last_fullsized":"2024-09-12T03:35:32.183864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:38.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191605+0000","last_change":"2024-09-12T03:35:31.145825+0000","last_active":"2024-09-12T03:35:32.191605+0000","last_peered":"2024-09-12T03:35:32.191605+0000","last_clean":"2024-09-12T03:35:32.191605+0000","last_became_active":"2024-09-12T03:35:31.145486+0000","last_became_peered":"2024-09-12T03:35:31.145486+0000","last_unstale":"2024-09-12T03:35:32.191605+0000","last_undegraded":"2024-09-12T03:35:32.191605+0000","last_fullsized":"2024-09-12T03:35:32.191605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168382+0000","last_change":"2024-09-12T03:35:32.153193+0000","last_active":"2024-09-12T03:35:32.168382+0000","last_peered":"2024-09-12T03:35:32.168382+0000","last_clean":"2024-09-12T03:35:32.168382+0000","last_became_active":"2024-09-12T03:35:32.152295+0000","last_became_peered":"2024-09-12T03:35:32.152295+0000","last_unstale":"2024-09-12T03:35:32.168382+0000","last_undegraded":"2024-09-12T03:35:32.168382+0000","last_fullsized":"2024-09-12T03:35:32.168382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.192996+0000","last_change":"2024-09-12T03:35:31.140136+0000","last_active":"2024-09-12T03:35:32.192996+0000","last_peered":"2024-09-12T03:35:32.192996+0000","last_clean":"2024-09-12T03:35:32.192996+0000","last_became_active":"2024-09-12T03:35:31.139504+0000","last_became_peered":"2024-09-12T03:35:31.139504+0000","last_unstale":"2024-09-12T03:35:32.192996+0000","last_undegraded":"2024-09-12T03:35:32.192996+0000","last_fullsized":"2024-09-12T03:35:32.192996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208505+0000","last_change":"2024-09-12T03:35:31.122217+0000","last_active":"2024-09-12T03:35:32.208505+0000","last_peered":"2024-09-12T03:35:32.208505+0000","last_clean":"2024-09-12T03:35:32.208505+0000","last_became_active":"2024-09-12T03:35:31.121503+0000","last_became_peered":"2024-09-12T03:35:31.121503+0000","last_unstale":"2024-09-12T03:35:32.208505+0000","last_undegraded":"2024-09-12T03:35:32.208505+0000","last_fullsized":"2024-09-12T03:35:32.208505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:26.735443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207789+0000","last_change":"2024-09-12T03:35:32.180265+0000","last_active":"2024-09-12T03:35:32.207789+0000","last_peered":"2024-09-12T03:35:32.207789+0000","last_clean":"2024-09-12T03:35:32.207789+0000","last_became_active":"2024-09-12T03:35:32.179533+0000","last_became_peered":"2024-09-12T03:35:32.179533+0000","last_unstale":"2024-09-12T03:35:32.207789+0000","last_undegraded":"2024-09-12T03:35:32.207789+0000","last_fullsized":"2024-09-12T03:35:32.207789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207545+0000","last_change":"2024-09-12T03:35:31.155475+0000","last_active":"2024-09-12T03:35:32.207545+0000","last_peered":"2024-09-12T03:35:32.207545+0000","last_clean":"2024-09-12T03:35:32.207545+0000","last_became_active":"2024-09-12T03:35:31.154875+0000","last_became_peered":"2024-09-12T03:35:31.154875+0000","last_unstale":"2024-09-12T03:35:32.207545+0000","last_undegraded":"2024-09-12T03:35:32.207545+0000","last_fullsized":"2024-09-12T03:35:32.207545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206786+0000","last_change":"2024-09-12T03:35:32.184081+0000","last_active":"2024-09-12T03:35:32.206786+0000","last_peered":"2024-09-12T03:35:32.206786+0000","last_clean":"2024-09-12T03:35:32.206786+0000","last_became_active":"2024-09-12T03:35:32.183424+0000","last_became_peered":"2024-09-12T03:35:32.183424+0000","last_unstale":"2024-09-12T03:35:32.206786+0000","last_undegraded":"2024-09-12T03:35:32.206786+0000","last_fullsized":"2024-09-12T03:35:32.206786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167468+0000","last_change":"2024-09-12T03:35:31.134300+0000","last_active":"2024-09-12T03:35:32.167468+0000","last_peered":"2024-09-12T03:35:32.167468+0000","last_clean":"2024-09-12T03:35:32.167468+0000","last_became_active":"2024-09-12T03:35:31.133662+0000","last_became_peered":"2024-09-12T03:35:31.133662+0000","last_unstale":"2024-09-12T03:35:32.167468+0000","last_undegraded":"2024-09-12T03:35:32.167468+0000","last_fullsized":"2024-09-12T03:35:32.167468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179682+0000","last_change":"2024-09-12T03:35:32.176878+0000","last_active":"2024-09-12T03:35:32.179682+0000","last_peered":"2024-09-12T03:35:32.179682+0000","last_clean":"2024-09-12T03:35:32.179682+0000","last_became_active":"2024-09-12T03:35:32.176281+0000","last_became_peered":"2024-09-12T03:35:32.176281+0000","last_unstale":"2024-09-12T03:35:32.179682+0000","last_undegraded":"2024-09-12T03:35:32.179682+0000","last_fullsized":"2024-09-12T03:35:32.179682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157879+0000","last_change":"2024-09-12T03:35:31.148365+0000","last_active":"2024-09-12T03:35:32.157879+0000","last_peered":"2024-09-12T03:35:32.157879+0000","last_clean":"2024-09-12T03:35:32.157879+0000","last_became_active":"2024-09-12T03:35:31.142740+0000","last_became_peered":"2024-09-12T03:35:31.142740+0000","last_unstale":"2024-09-12T03:35:32.157879+0000","last_undegraded":"2024-09-12T03:35:32.157879+0000","last_fullsized":"2024-09-12T03:35:32.157879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179738+0000","last_change":"2024-09-12T03:35:32.176998+0000","last_active":"2024-09-12T03:35:32.179738+0000","last_peered":"2024-09-12T03:35:32.179738+0000","last_clean":"2024-09-12T03:35:32.179738+0000","last_became_active":"2024-09-12T03:35:32.176678+0000","last_became_peered":"2024-09-12T03:35:32.176678+0000","last_unstale":"2024-09-12T03:35:32.179738+0000","last_undegraded":"2024-09-12T03:35:32.179738+0000","last_fullsized":"2024-09-12T03:35:32.179738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:49.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.151633+0000","last_change":"2024-09-12T03:35:31.125827+0000","last_active":"2024-09-12T03:35:32.151633+0000","last_peered":"2024-09-12T03:35:32.151633+0000","last_clean":"2024-09-12T03:35:32.151633+0000","last_became_active":"2024-09-12T03:35:31.122580+0000","last_became_peered":"2024-09-12T03:35:31.122580+0000","last_unstale":"2024-09-12T03:35:32.151633+0000","last_undegraded":"2024-09-12T03:35:32.151633+0000","last_fullsized":"2024-09-12T03:35:32.151633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206161+0000","last_change":"2024-09-12T03:35:32.198738+0000","last_active":"2024-09-12T03:35:32.206161+0000","last_peered":"2024-09-12T03:35:32.206161+0000","last_clean":"2024-09-12T03:35:32.206161+0000","last_became_active":"2024-09-12T03:35:32.198073+0000","last_became_peered":"2024-09-12T03:35:32.198073+0000","last_unstale":"2024-09-12T03:35:32.206161+0000","last_undegraded":"2024-09-12T03:35:32.206161+0000","last_fullsized":"2024-09-12T03:35:32.206161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166727+0000","last_change":"2024-09-12T03:35:31.129565+0000","last_active":"2024-09-12T03:35:32.166727+0000","last_peered":"2024-09-12T03:35:32.166727+0000","last_clean":"2024-09-12T03:35:32.166727+0000","last_became_active":"2024-09-12T03:35:31.128696+0000","last_became_peered":"2024-09-12T03:35:31.128696+0000","last_unstale":"2024-09-12T03:35:32.166727+0000","last_undegraded":"2024-09-12T03:35:32.166727+0000","last_fullsized":"2024-09-12T03:35:32.166727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212534+0000","last_change":"2024-09-12T03:35:31.120663+0000","last_active":"2024-09-12T03:35:32.212534+0000","last_peered":"2024-09-12T03:35:32.212534+0000","last_clean":"2024-09-12T03:35:32.212534+0000","last_became_active":"2024-09-12T03:35:31.119307+0000","last_became_peered":"2024-09-12T03:35:31.119307+0000","last_unstale":"2024-09-12T03:35:32.212534+0000","last_undegraded":"2024-09-12T03:35:32.212534+0000","last_fullsized":"2024-09-12T03:35:32.212534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191162+0000","last_change":"2024-09-12T03:35:32.181504+0000","last_active":"2024-09-12T03:35:32.191162+0000","last_peered":"2024-09-12T03:35:32.191162+0000","last_clean":"2024-09-12T03:35:32.191162+0000","last_became_active":"2024-09-12T03:35:32.180735+0000","last_became_peered":"2024-09-12T03:35:32.180735+0000","last_unstale":"2024-09-12T03:35:32.191162+0000","last_undegraded":"2024-09-12T03:35:32.191162+0000","last_fullsized":"2024-09-12T03:35:32.191162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212280+0000","last_change":"2024-09-12T03:35:31.138409+0000","last_active":"2024-09-12T03:35:32.212280+0000","last_peered":"2024-09-12T03:35:32.212280+0000","last_clean":"2024-09-12T03:35:32.212280+0000","last_became_active":"2024-09-12T03:35:31.138039+0000","last_became_peered":"2024-09-12T03:35:31.138039+0000","last_unstale":"2024-09-12T03:35:32.212280+0000","last_undegraded":"2024-09-12T03:35:32.212280+0000","last_fullsized":"2024-09-12T03:35:32.212280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189481+0000","last_change":"2024-09-12T03:35:31.121034+0000","last_active":"2024-09-12T03:35:32.189481+0000","last_peered":"2024-09-12T03:35:32.189481+0000","last_clean":"2024-09-12T03:35:32.189481+0000","last_became_active":"2024-09-12T03:35:31.120768+0000","last_became_peered":"2024-09-12T03:35:31.120768+0000","last_unstale":"2024-09-12T03:35:32.189481+0000","last_undegraded":"2024-09-12T03:35:32.189481+0000","last_fullsized":"2024-09-12T03:35:32.189481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178318+0000","last_change":"2024-09-12T03:35:32.168888+0000","last_active":"2024-09-12T03:35:32.178318+0000","last_peered":"2024-09-12T03:35:32.178318+0000","last_clean":"2024-09-12T03:35:32.178318+0000","last_became_active":"2024-09-12T03:35:32.168568+0000","last_became_peered":"2024-09-12T03:35:32.168568+0000","last_unstale":"2024-09-12T03:35:32.178318+0000","last_undegraded":"2024-09-12T03:35:32.178318+0000","last_fullsized":"2024-09-12T03:35:32.178318+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166910+0000","last_change":"2024-09-12T03:35:31.134218+0000","last_active":"2024-09-12T03:35:32.166910+0000","last_peered":"2024-09-12T03:35:32.166910+0000","last_clean":"2024-09-12T03:35:32.166910+0000","last_became_active":"2024-09-12T03:35:31.133767+0000","last_became_peered":"2024-09-12T03:35:31.133767+0000","last_unstale":"2024-09-12T03:35:32.166910+0000","last_undegraded":"2024-09-12T03:35:32.166910+0000","last_fullsized":"2024-09-12T03:35:32.166910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190970+0000","last_change":"2024-09-12T03:35:32.178655+0000","last_active":"2024-09-12T03:35:32.190970+0000","last_peered":"2024-09-12T03:35:32.190970+0000","last_clean":"2024-09-12T03:35:32.190970+0000","last_became_active":"2024-09-12T03:35:32.177875+0000","last_became_peered":"2024-09-12T03:35:32.177875+0000","last_unstale":"2024-09-12T03:35:32.190970+0000","last_undegraded":"2024-09-12T03:35:32.190970+0000","last_fullsized":"2024-09-12T03:35:32.190970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099854+0000","last_change":"2024-09-12T03:35:30.099854+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099854+0000","last_undegraded":"2024-09-12T03:35:30.099854+0000","last_fullsized":"2024-09-12T03:35:30.099854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178296+0000","last_change":"2024-09-12T03:35:32.169975+0000","last_active":"2024-09-12T03:35:32.178296+0000","last_peered":"2024-09-12T03:35:32.178296+0000","last_clean":"2024-09-12T03:35:32.178296+0000","last_became_active":"2024-09-12T03:35:32.169592+0000","last_became_peered":"2024-09-12T03:35:32.169592+0000","last_unstale":"2024-09-12T03:35:32.178296+0000","last_undegraded":"2024-09-12T03:35:32.178296+0000","last_fullsized":"2024-09-12T03:35:32.178296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.209562+0000","last_change":"2024-09-12T03:35:31.154628+0000","last_active":"2024-09-12T03:35:32.209562+0000","last_peered":"2024-09-12T03:35:32.209562+0000","last_clean":"2024-09-12T03:35:32.209562+0000","last_became_active":"2024-09-12T03:35:31.153993+0000","last_became_peered":"2024-09-12T03:35:31.153993+0000","last_unstale":"2024-09-12T03:35:32.209562+0000","last_undegraded":"2024-09-12T03:35:32.209562+0000","last_fullsized":"2024-09-12T03:35:32.209562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.161598+0000","last_change":"2024-09-12T03:35:32.152935+0000","last_active":"2024-09-12T03:35:32.161598+0000","last_peered":"2024-09-12T03:35:32.161598+0000","last_clean":"2024-09-12T03:35:32.161598+0000","last_became_active":"2024-09-12T03:35:32.152123+0000","last_became_peered":"2024-09-12T03:35:32.152123+0000","last_unstale":"2024-09-12T03:35:32.161598+0000","last_undegraded":"2024-09-12T03:35:32.161598+0000","last_fullsized":"2024-09-12T03:35:32.161598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212278+0000","last_change":"2024-09-12T03:35:31.150651+0000","last_active":"2024-09-12T03:35:32.212278+0000","last_peered":"2024-09-12T03:35:32.212278+0000","last_clean":"2024-09-12T03:35:32.212278+0000","last_became_active":"2024-09-12T03:35:31.150087+0000","last_became_peered":"2024-09-12T03:35:31.150087+0000","last_unstale":"2024-09-12T03:35:32.212278+0000","last_undegraded":"2024-09-12T03:35:32.212278+0000","last_fullsized":"2024-09-12T03:35:32.212278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207722+0000","last_change":"2024-09-12T03:35:32.180787+0000","last_active":"2024-09-12T03:35:32.207722+0000","last_peered":"2024-09-12T03:35:32.207722+0000","last_clean":"2024-09-12T03:35:32.207722+0000","last_became_active":"2024-09-12T03:35:32.180128+0000","last_became_peered":"2024-09-12T03:35:32.180128+0000","last_unstale":"2024-09-12T03:35:32.207722+0000","last_undegraded":"2024-09-12T03:35:32.207722+0000","last_fullsized":"2024-09-12T03:35:32.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.213860+0000","last_change":"2024-09-12T03:35:31.148497+0000","last_active":"2024-09-12T03:35:32.213860+0000","last_peered":"2024-09-12T03:35:32.213860+0000","last_clean":"2024-09-12T03:35:32.213860+0000","last_became_active":"2024-09-12T03:35:31.147818+0000","last_became_peered":"2024-09-12T03:35:31.147818+0000","last_unstale":"2024-09-12T03:35:32.213860+0000","last_undegraded":"2024-09-12T03:35:32.213860+0000","last_fullsized":"2024-09-12T03:35:32.213860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190661+0000","last_change":"2024-09-12T03:35:32.183482+0000","last_active":"2024-09-12T03:35:32.190661+0000","last_peered":"2024-09-12T03:35:32.190661+0000","last_clean":"2024-09-12T03:35:32.190661+0000","last_became_active":"2024-09-12T03:35:32.175402+0000","last_became_peered":"2024-09-12T03:35:32.175402+0000","last_unstale":"2024-09-12T03:35:32.190661+0000","last_undegraded":"2024-09-12T03:35:32.190661+0000","last_fullsized":"2024-09-12T03:35:32.190661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.195583+0000","last_change":"2024-09-12T03:35:31.137498+0000","last_active":"2024-09-12T03:35:32.195583+0000","last_peered":"2024-09-12T03:35:32.195583+0000","last_clean":"2024-09-12T03:35:32.195583+0000","last_became_active":"2024-09-12T03:35:31.137210+0000","last_became_peered":"2024-09-12T03:35:31.137210+0000","last_unstale":"2024-09-12T03:35:32.195583+0000","last_undegraded":"2024-09-12T03:35:32.195583+0000","last_fullsized":"2024-09-12T03:35:32.195583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:10.651197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165642+0000","last_change":"2024-09-12T03:35:32.155601+0000","last_active":"2024-09-12T03:35:32.165642+0000","last_peered":"2024-09-12T03:35:32.165642+0000","last_clean":"2024-09-12T03:35:32.165642+0000","last_became_active":"2024-09-12T03:35:32.153852+0000","last_became_peered":"2024-09-12T03:35:32.153852+0000","last_unstale":"2024-09-12T03:35:32.165642+0000","last_undegraded":"2024-09-12T03:35:32.165642+0000","last_fullsized":"2024-09-12T03:35:32.165642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:57.275609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166487+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.166487+0000","last_peered":"2024-09-12T03:35:32.166487+0000","last_clean":"2024-09-12T03:35:32.166487+0000","last_became_active":"2024-09-12T03:35:31.144611+0000","last_became_peered":"2024-09-12T03:35:31.144611+0000","last_unstale":"2024-09-12T03:35:32.166487+0000","last_undegraded":"2024-09-12T03:35:32.166487+0000","last_fullsized":"2024-09-12T03:35:32.166487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.196264+0000","last_change":"2024-09-12T03:35:32.179725+0000","last_active":"2024-09-12T03:35:32.196264+0000","last_peered":"2024-09-12T03:35:32.196264+0000","last_clean":"2024-09-12T03:35:32.196264+0000","last_became_active":"2024-09-12T03:35:32.178924+0000","last_became_peered":"2024-09-12T03:35:32.178924+0000","last_unstale":"2024-09-12T03:35:32.196264+0000","last_undegraded":"2024-09-12T03:35:32.196264+0000","last_fullsized":"2024-09-12T03:35:32.196264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.188965+0000","last_change":"2024-09-12T03:35:31.119011+0000","last_active":"2024-09-12T03:35:32.188965+0000","last_peered":"2024-09-12T03:35:32.188965+0000","last_clean":"2024-09-12T03:35:32.188965+0000","last_became_active":"2024-09-12T03:35:31.118692+0000","last_became_peered":"2024-09-12T03:35:31.118692+0000","last_unstale":"2024-09-12T03:35:32.188965+0000","last_undegraded":"2024-09-12T03:35:32.188965+0000","last_fullsized":"2024-09-12T03:35:32.188965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:00.187654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141169+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.141169+0000","last_peered":"2024-09-12T03:35:32.141169+0000","last_clean":"2024-09-12T03:35:32.141169+0000","last_became_active":"2024-09-12T03:35:31.144591+0000","last_became_peered":"2024-09-12T03:35:31.144591+0000","last_unstale":"2024-09-12T03:35:32.141169+0000","last_undegraded":"2024-09-12T03:35:32.141169+0000","last_fullsized":"2024-09-12T03:35:32.141169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:00.727172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.176611+0000","last_change":"2024-09-12T03:35:32.157200+0000","last_active":"2024-09-12T03:35:32.176611+0000","last_peered":"2024-09-12T03:35:32.176611+0000","last_clean":"2024-09-12T03:35:32.176611+0000","last_became_active":"2024-09-12T03:35:32.155267+0000","last_became_peered":"2024-09-12T03:35:32.155267+0000","last_unstale":"2024-09-12T03:35:32.176611+0000","last_undegraded":"2024-09-12T03:35:32.176611+0000","last_fullsized":"2024-09-12T03:35:32.176611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168000+0000","last_change":"2024-09-12T03:35:31.143758+0000","last_active":"2024-09-12T03:35:32.168000+0000","last_peered":"2024-09-12T03:35:32.168000+0000","last_clean":"2024-09-12T03:35:32.168000+0000","last_became_active":"2024-09-12T03:35:31.143044+0000","last_became_peered":"2024-09-12T03:35:31.143044+0000","last_unstale":"2024-09-12T03:35:32.168000+0000","last_undegraded":"2024-09-12T03:35:32.168000+0000","last_fullsized":"2024-09-12T03:35:32.168000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179656+0000","last_change":"2024-09-12T03:35:32.176574+0000","last_active":"2024-09-12T03:35:32.179656+0000","last_peered":"2024-09-12T03:35:32.179656+0000","last_clean":"2024-09-12T03:35:32.179656+0000","last_became_active":"2024-09-12T03:35:32.175869+0000","last_became_peered":"2024-09-12T03:35:32.175869+0000","last_unstale":"2024-09-12T03:35:32.179656+0000","last_undegraded":"2024-09-12T03:35:32.179656+0000","last_fullsized":"2024-09-12T03:35:32.179656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.142133+0000","last_change":"2024-09-12T03:35:31.119437+0000","last_active":"2024-09-12T03:35:32.142133+0000","last_peered":"2024-09-12T03:35:32.142133+0000","last_clean":"2024-09-12T03:35:32.142133+0000","last_became_active":"2024-09-12T03:35:31.118811+0000","last_became_peered":"2024-09-12T03:35:31.118811+0000","last_unstale":"2024-09-12T03:35:32.142133+0000","last_undegraded":"2024-09-12T03:35:32.142133+0000","last_fullsized":"2024-09-12T03:35:32.142133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.128401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207530+0000","last_change":"2024-09-12T03:35:32.206219+0000","last_active":"2024-09-12T03:35:32.207530+0000","last_peered":"2024-09-12T03:35:32.207530+0000","last_clean":"2024-09-12T03:35:32.207530+0000","last_became_active":"2024-09-12T03:35:32.205898+0000","last_became_peered":"2024-09-12T03:35:32.205898+0000","last_unstale":"2024-09-12T03:35:32.207530+0000","last_undegraded":"2024-09-12T03:35:32.207530+0000","last_fullsized":"2024-09-12T03:35:32.207530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212324+0000","last_change":"2024-09-12T03:35:31.123519+0000","last_active":"2024-09-12T03:35:32.212324+0000","last_peered":"2024-09-12T03:35:32.212324+0000","last_clean":"2024-09-12T03:35:32.212324+0000","last_became_active":"2024-09-12T03:35:31.122716+0000","last_became_peered":"2024-09-12T03:35:31.122716+0000","last_unstale":"2024-09-12T03:35:32.212324+0000","last_undegraded":"2024-09-12T03:35:32.212324+0000","last_fullsized":"2024-09-12T03:35:32.212324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206103+0000","last_change":"2024-09-12T03:35:32.198862+0000","last_active":"2024-09-12T03:35:32.206103+0000","last_peered":"2024-09-12T03:35:32.206103+0000","last_clean":"2024-09-12T03:35:32.206103+0000","last_became_active":"2024-09-12T03:35:32.198370+0000","last_became_peered":"2024-09-12T03:35:32.198370+0000","last_unstale":"2024-09-12T03:35:32.206103+0000","last_undegraded":"2024-09-12T03:35:32.206103+0000","last_fullsized":"2024-09-12T03:35:32.206103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:41.567114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141700+0000","last_change":"2024-09-12T03:35:31.130491+0000","last_active":"2024-09-12T03:35:32.141700+0000","last_peered":"2024-09-12T03:35:32.141700+0000","last_clean":"2024-09-12T03:35:32.141700+0000","last_became_active":"2024-09-12T03:35:31.130189+0000","last_became_peered":"2024-09-12T03:35:31.130189+0000","last_unstale":"2024-09-12T03:35:32.141700+0000","last_undegraded":"2024-09-12T03:35:32.141700+0000","last_fullsized":"2024-09-12T03:35:32.141700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:57.745056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189301+0000","last_change":"2024-09-12T03:35:32.185743+0000","last_active":"2024-09-12T03:35:32.189301+0000","last_peered":"2024-09-12T03:35:32.189301+0000","last_clean":"2024-09-12T03:35:32.189301+0000","last_became_active":"2024-09-12T03:35:32.185415+0000","last_became_peered":"2024-09-12T03:35:32.185415+0000","last_unstale":"2024-09-12T03:35:32.189301+0000","last_undegraded":"2024-09-12T03:35:32.189301+0000","last_fullsized":"2024-09-12T03:35:32.189301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103178+0000","last_change":"2024-09-12T03:35:30.103178+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103178+0000","last_undegraded":"2024-09-12T03:35:30.103178+0000","last_fullsized":"2024-09-12T03:35:30.103178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103111+0000","last_change":"2024-09-12T03:35:30.103111+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103111+0000","last_undegraded":"2024-09-12T03:35:30.103111+0000","last_fullsized":"2024-09-12T03:35:30.103111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.186467+0000","last_change":"2024-09-12T03:35:32.180911+0000","last_active":"2024-09-12T03:35:32.186467+0000","last_peered":"2024-09-12T03:35:32.186467+0000","last_clean":"2024-09-12T03:35:32.186467+0000","last_became_active":"2024-09-12T03:35:32.180601+0000","last_became_peered":"2024-09-12T03:35:32.180601+0000","last_unstale":"2024-09-12T03:35:32.186467+0000","last_undegraded":"2024-09-12T03:35:32.186467+0000","last_fullsized":"2024-09-12T03:35:32.186467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099852+0000","last_change":"2024-09-12T03:35:30.099852+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099852+0000","last_undegraded":"2024-09-12T03:35:30.099852+0000","last_fullsized":"2024-09-12T03:35:30.099852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202018+0000","last_change":"2024-09-12T03:35:32.174912+0000","last_active":"2024-09-12T03:35:32.202018+0000","last_peered":"2024-09-12T03:35:32.202018+0000","last_clean":"2024-09-12T03:35:32.202018+0000","last_became_active":"2024-09-12T03:35:32.173337+0000","last_became_peered":"2024-09-12T03:35:32.173337+0000","last_unstale":"2024-09-12T03:35:32.202018+0000","last_undegraded":"2024-09-12T03:35:32.202018+0000","last_fullsized":"2024-09-12T03:35:32.202018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157766+0000","last_change":"2024-09-12T03:35:31.141781+0000","last_active":"2024-09-12T03:35:32.157766+0000","last_peered":"2024-09-12T03:35:32.157766+0000","last_clean":"2024-09-12T03:35:32.157766+0000","last_became_active":"2024-09-12T03:35:31.139547+0000","last_became_peered":"2024-09-12T03:35:31.139547+0000","last_unstale":"2024-09-12T03:35:32.157766+0000","last_undegraded":"2024-09-12T03:35:32.157766+0000","last_fullsized":"2024-09-12T03:35:32.157766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206154+0000","last_change":"2024-09-12T03:35:32.200175+0000","last_active":"2024-09-12T03:35:32.206154+0000","last_peered":"2024-09-12T03:35:32.206154+0000","last_clean":"2024-09-12T03:35:32.206154+0000","last_became_active":"2024-09-12T03:35:32.199519+0000","last_became_peered":"2024-09-12T03:35:32.199519+0000","last_unstale":"2024-09-12T03:35:32.206154+0000","last_undegraded":"2024-09-12T03:35:32.206154+0000","last_fullsized":"2024-09-12T03:35:32.206154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.148275+0000","last_change":"2024-09-12T03:35:31.125839+0000","last_active":"2024-09-12T03:35:32.148275+0000","last_peered":"2024-09-12T03:35:32.148275+0000","last_clean":"2024-09-12T03:35:32.148275+0000","last_became_active":"2024-09-12T03:35:31.122726+0000","last_became_peered":"2024-09-12T03:35:31.122726+0000","last_unstale":"2024-09-12T03:35:32.148275+0000","last_undegraded":"2024-09-12T03:35:32.148275+0000","last_fullsized":"2024-09-12T03:35:32.148275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.189144+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.188402+0000","last_became_peered":"2024-09-12T03:35:32.188402+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168336+0000","last_change":"2024-09-12T03:35:31.147449+0000","last_active":"2024-09-12T03:35:32.168336+0000","last_peered":"2024-09-12T03:35:32.168336+0000","last_clean":"2024-09-12T03:35:32.168336+0000","last_became_active":"2024-09-12T03:35:31.146800+0000","last_became_peered":"2024-09-12T03:35:31.146800+0000","last_unstale":"2024-09-12T03:35:32.168336+0000","last_undegraded":"2024-09-12T03:35:32.168336+0000","last_fullsized":"2024-09-12T03:35:32.168336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:51.274026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165630+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:35:32.165630+0000","last_peered":"2024-09-12T03:35:32.165630+0000","last_clean":"2024-09-12T03:35:32.165630+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:35:32.165630+0000","last_undegraded":"2024-09-12T03:35:32.165630+0000","last_fullsized":"2024-09-12T03:35:32.165630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":777199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":417792,"data_stored":177982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":185753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":186795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":761683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:35:36.905 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-09-12T03:35:36.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.905 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-09-12T03:35:36.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.905 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-09-12T03:35:36.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:35:30.100015+0000', 'last_change': '2024-09-12T03:35:30.100015+0000', 'last_active': '2024-09-12T03:35:30.087198+0000', 'last_peered': '2024-09-12T03:35:30.087198+0000', 'last_clean': '2024-09-12T03:35:30.087198+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:30.100015+0000', 'last_undegraded': '2024-09-12T03:35:30.100015+0000', 'last_fullsized': '2024-09-12T03:35:30.100015+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:35:30.103320+0000', 'last_change': '2024-09-12T03:35:30.103320+0000', 'last_active': '2024-09-12T03:35:30.087198+0000', 'last_peered': '2024-09-12T03:35:30.087198+0000', 'last_clean': '2024-09-12T03:35:30.087198+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:30.103320+0000', 'last_undegraded': '2024-09-12T03:35:30.103320+0000', 'last_fullsized': '2024-09-12T03:35:30.103320+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-12T03:35:36.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:35:30.099854+0000', 'last_change': '2024-09-12T03:35:30.099854+0000', 'last_active': '2024-09-12T03:35:30.087198+0000', 'last_peered': '2024-09-12T03:35:30.087198+0000', 'last_clean': '2024-09-12T03:35:30.087198+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:30.099854+0000', 'last_undegraded': '2024-09-12T03:35:30.099854+0000', 'last_fullsized': '2024-09-12T03:35:30.099854+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:35:30.103178+0000', 'last_change': '2024-09-12T03:35:30.103178+0000', 'last_active': '2024-09-12T03:35:30.087198+0000', 'last_peered': '2024-09-12T03:35:30.087198+0000', 'last_clean': '2024-09-12T03:35:30.087198+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:30.103178+0000', 'last_undegraded': '2024-09-12T03:35:30.103178+0000', 'last_fullsized': '2024-09-12T03:35:30.103178+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:35:31.096181+0000', 'last_change': '2024-09-12T03:35:31.096181+0000', 'last_active': '2024-09-12T03:35:31.096181+0000', 'last_peered': '2024-09-12T03:35:31.096181+0000', 'last_clean': '2024-09-12T03:35:31.096181+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:31.096181+0000', 'last_undegraded': '2024-09-12T03:35:31.096181+0000', 'last_fullsized': '2024-09-12T03:35:31.096181+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:31.096181+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:35:36.908 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-12T03:35:36.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:35:30.103111+0000', 'last_change': '2024-09-12T03:35:30.103111+0000', 'last_active': '2024-09-12T03:35:30.087198+0000', 'last_peered': '2024-09-12T03:35:30.087198+0000', 'last_clean': '2024-09-12T03:35:30.087198+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:30.103111+0000', 'last_undegraded': '2024-09-12T03:35:30.103111+0000', 'last_fullsized': '2024-09-12T03:35:30.103111+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:35:36.909 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-12T03:35:36.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:35:30.099852+0000', 'last_change': '2024-09-12T03:35:30.099852+0000', 'last_active': '2024-09-12T03:35:30.087198+0000', 'last_peered': '2024-09-12T03:35:30.087198+0000', 'last_clean': '2024-09-12T03:35:30.087198+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:35:30.099852+0000', 'last_undegraded': '2024-09-12T03:35:30.099852+0000', 'last_fullsized': '2024-09-12T03:35:30.099852+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'last_clean_scrub_stamp': '2024-09-12T03:35:30.087198+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:35:36.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T03:35:37.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe1845d9640 1 Processor -- start 2024-09-12T03:35:37.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe1845d9640 1 -- start start 2024-09-12T03:35:37.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe1845d9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c15bec0 0x7fe17c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe1845d9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe17c15c2a0 0x7fe17c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe1845d9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17c0b3290 con 0x7fe17c0af2a0 2024-09-12T03:35:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe1845d9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe17c0b3570 con 0x7fe17c15c2a0 2024-09-12T03:35:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe1845d9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe17c0b3850 con 0x7fe17c15bec0 2024-09-12T03:35:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe182375640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c15bec0 0x7fe17c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe181b74640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe17c15c2a0 0x7fe17c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe182375640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c15bec0 0x7fe17c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:36400/0 (socket says 172.21.15.73:36400) 2024-09-12T03:35:37.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe182375640 1 -- 172.21.15.73:0/124491650 learned_addr learned my addr 172.21.15.73:0/124491650 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe182375640 1 -- 172.21.15.73:0/124491650 >> v2:172.21.15.150:3300/0 conn(0x7fe17c15c2a0 msgr2=0x7fe17c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe182375640 1 --2- 172.21.15.73:0/124491650 >> v2:172.21.15.150:3300/0 conn(0x7fe17c15c2a0 0x7fe17c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe182375640 1 -- 172.21.15.73:0/124491650 >> v1:172.21.15.150:6789/0 conn(0x7fe17c0af2a0 legacy=0x7fe17c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe182375640 1 -- 172.21.15.73:0/124491650 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c0b3b30 con 0x7fe17c15bec0 2024-09-12T03:35:37.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.059+0000 7fe181b74640 1 --2- 172.21.15.73:0/124491650 >> v2:172.21.15.150:3300/0 conn(0x7fe17c15c2a0 0x7fe17c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:35:37.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe182375640 1 --2- 172.21.15.73:0/124491650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c15bec0 0x7fe17c0ad200 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009870 tx=0x7fe16c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d36fc5b5521255 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:37.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe181373640 1 -- 172.21.15.73:0/124491650 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0a95f0 con 0x7fe17c15bec0 2024-09-12T03:35:37.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe181373640 1 -- 172.21.15.73:0/124491650 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16c0a9790 con 0x7fe17c15bec0 2024-09-12T03:35:37.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe181373640 1 -- 172.21.15.73:0/124491650 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0a9b60 con 0x7fe17c15bec0 2024-09-12T03:35:37.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- 172.21.15.73:0/124491650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c15bec0 msgr2=0x7fe17c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 --2- 172.21.15.73:0/124491650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c15bec0 0x7fe17c0ad200 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009870 tx=0x7fe16c01c530 comp rx=0 tx=0).stop 2024-09-12T03:35:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- 172.21.15.73:0/124491650 shutdown_connections 2024-09-12T03:35:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 --2- 172.21.15.73:0/124491650 >> v2:172.21.15.150:3300/0 conn(0x7fe17c15c2a0 0x7fe17c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 --2- 172.21.15.73:0/124491650 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c15bec0 0x7fe17c0ad200 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- 172.21.15.73:0/124491650 >> 172.21.15.73:0/124491650 conn(0x7fe17c0b1f90 msgr2=0x7fe17c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- 172.21.15.73:0/124491650 shutdown_connections 2024-09-12T03:35:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- 172.21.15.73:0/124491650 wait complete. 2024-09-12T03:35:37.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 Processor -- start 2024-09-12T03:35:37.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- start start 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c0af2a0 0x7fe17c099580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe17c15bec0 0x7fe17c14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c15c2a0 0x7fe17c150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c0af6b0 con 0x7fe17c15c2a0 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe17c0ad740 con 0x7fe17c15bec0 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe1845d9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe17c169000 con 0x7fe17c0af2a0 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe182b76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c15c2a0 0x7fe17c150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe182b76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c15c2a0 0x7fe17c150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49684/0 (socket says 172.21.15.73:49684) 2024-09-12T03:35:37.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.063+0000 7fe182b76640 1 -- 172.21.15.73:0/1188065240 learned_addr learned my addr 172.21.15.73:0/1188065240 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe181b74640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe17c15bec0 0x7fe17c14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182375640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c0af2a0 0x7fe17c099580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182b76640 1 -- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c0af2a0 msgr2=0x7fe17c099580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182b76640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c0af2a0 0x7fe17c099580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182b76640 1 -- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe17c15bec0 msgr2=0x7fe17c14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182b76640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe17c15bec0 0x7fe17c14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182b76640 1 -- 172.21.15.73:0/1188065240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17c099ac0 con 0x7fe17c15c2a0 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe181b74640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe17c15bec0 0x7fe17c14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182b76640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c15c2a0 0x7fe17c150390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe17400c7a0 tx=0x7fe17400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe172ffd640 1 -- 172.21.15.73:0/1188065240 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174003b80 con 0x7fe17c15c2a0 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe172ffd640 1 -- 172.21.15.73:0/1188065240 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe174003d20 con 0x7fe17c15c2a0 2024-09-12T03:35:37.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe17c14c9d0 con 0x7fe17c15c2a0 2024-09-12T03:35:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe172ffd640 1 -- 172.21.15.73:0/1188065240 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17400aa90 con 0x7fe17c15c2a0 2024-09-12T03:35:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe17c14e090 con 0x7fe17c15c2a0 2024-09-12T03:35:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17c0ad200 con 0x7fe17c15c2a0 2024-09-12T03:35:37.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe172ffd640 1 -- 172.21.15.73:0/1188065240 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe17400ac30 con 0x7fe17c15c2a0 2024-09-12T03:35:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe172ffd640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1600678c0 0x7fe160069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182375640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1600678c0 0x7fe160069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe172ffd640 1 -- 172.21.15.73:0/1188065240 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe174085d60 con 0x7fe17c15c2a0 2024-09-12T03:35:37.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.067+0000 7fe182375640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1600678c0 0x7fe160069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0ae000 tx=0x7fe16c0b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:37.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.071+0000 7fe172ffd640 1 -- 172.21.15.73:0/1188065240 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe174056710 con 0x7fe17c15c2a0 2024-09-12T03:35:37.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.279+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe17c06fcd0 con 0x7fe17c15c2a0 2024-09-12T03:35:37.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.279+0000 7fe172ffd640 1 -- 172.21.15.73:0/1188065240 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1764 (secure 0 0 0) 0x7fe174056010 con 0x7fe17c15c2a0 2024-09-12T03:35:37.286 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:37.287 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":82,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1726112066,"num_in_osds":8,"osd_in_since":1726112057,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":77},{"state_name":"unknown","count":14},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":21,"data_bytes":592196,"bytes_used":226037760,"bytes_avail":772868075520,"bytes_total":773094113280,"unknown_pgs_ratio":0.14432989060878754,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":2331,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"btime":"2024-09-12T03:35:35:181396+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4857}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-12T03:35:29.804945+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1600678c0 msgr2=0x7fe160069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1600678c0 0x7fe160069d80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0ae000 tx=0x7fe16c0b3040 comp rx=0 tx=0).stop 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c15c2a0 msgr2=0x7fe17c150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c15c2a0 0x7fe17c150390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe17400c7a0 tx=0x7fe17400cc60 comp rx=0 tx=0).stop 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 shutdown_connections 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1600678c0 0x7fe160069d80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe17c15c2a0 0x7fe17c150390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe17c15bec0 0x7fe17c14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 --2- 172.21.15.73:0/1188065240 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe17c0af2a0 0x7fe17c099580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 >> 172.21.15.73:0/1188065240 conn(0x7fe17c0b1f90 msgr2=0x7fe17c15ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:37.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 shutdown_connections 2024-09-12T03:35:37.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.283+0000 7fe1845d9640 1 -- 172.21.15.73:0/1188065240 wait complete. 2024-09-12T03:35:37.304 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T03:35:37.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:35:37.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:35:37.400 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:35:37.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.415+0000 7f5e5348e640 1 Processor -- start 2024-09-12T03:35:37.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5348e640 1 -- start start 2024-09-12T03:35:37.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5348e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5e4c161a60 0x7f5e4c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5348e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 0x7f5e4c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5348e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c0d32b0 con 0x7f5e4c0d2e90 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5348e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c0d0300 con 0x7f5e4c161a60 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5348e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c0cfab0 con 0x7f5e4c0cf620 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e50a29640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5e4c0d2e90 0x7f5e4c0cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58960/0 (socket says 172.21.15.73:58960) 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e50a29640 1 -- 172.21.15.73:0/3534668688 learned_addr learned my addr 172.21.15.73:0/3534668688 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574781128 0 0) 0x7f5e4c0d32b0 con 0x7f5e4c0d2e90 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e38003530 con 0x7f5e4c0d2e90 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5122a640 1 --2- 172.21.15.73:0/3534668688 >> v2:172.21.15.150:3300/0 conn(0x7f5e4c161a60 0x7f5e4c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e51a2b640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 0x7f5e4c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 369873749 0 0) 0x7f5e38003530 con 0x7f5e4c0d2e90 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 msgr2=0x7f5e4c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 0x7f5e4c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 >> v2:172.21.15.150:3300/0 conn(0x7f5e4c161a60 msgr2=0x7f5e4c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 --2- 172.21.15.73:0/3534668688 >> v2:172.21.15.150:3300/0 conn(0x7f5e4c161a60 0x7f5e4c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0b0f60 con 0x7f5e4c0d2e90 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f5e3c001680 con 0x7f5e4c0d2e90 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 >> v1:172.21.15.73:6789/0 conn(0x7f5e4c0d2e90 legacy=0x7f5e4c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e380039c0 0x7f5e38003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 0x7f5e38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e38004d50 0x7f5e380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0d0300 con 0x7f5e38004d50 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0cfab0 con 0x7f5e380039c0 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3800b9d0 con 0x7f5e4c0cf620 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e51a2b640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e38004d50 0x7f5e380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e50a29640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 0x7f5e38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e51a2b640 1 -- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 msgr2=0x7f5e38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5122a640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e380039c0 0x7f5e38003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e51a2b640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 0x7f5e38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e51a2b640 1 -- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e380039c0 msgr2=0x7f5e38003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e51a2b640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e380039c0 0x7f5e38003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e51a2b640 1 -- 172.21.15.73:0/3534668688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e38003530 con 0x7f5e38004d50 2024-09-12T03:35:37.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e50a29640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cf620 0x7f5e38004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:37.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.419+0000 7f5e5122a640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e380039c0 0x7f5e38003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e51a2b640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e38004d50 0x7f5e380051d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009fc0 tx=0x7f5e4401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40396e19f3f22858 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e440b2070 con 0x7f5e38004d50 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e440a5c90 con 0x7f5e38004d50 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e43fff640 1 -- 172.21.15.73:0/3534668688 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44009c10 con 0x7f5e38004d50 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- 172.21.15.73:0/3534668688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e38004d50 msgr2=0x7f5e380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 --2- 172.21.15.73:0/3534668688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e38004d50 0x7f5e380051d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e44009fc0 tx=0x7f5e4401cc80 comp rx=0 tx=0).stop 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e51a2b640 1 -- 172.21.15.73:0/3534668688 reap_dead start 2024-09-12T03:35:37.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- 172.21.15.73:0/3534668688 shutdown_connections 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- 172.21.15.73:0/3534668688 >> 172.21.15.73:0/3534668688 conn(0x7f5e4c08bf90 msgr2=0x7f5e4c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- 172.21.15.73:0/3534668688 shutdown_connections 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- 172.21.15.73:0/3534668688 wait complete. 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 Processor -- start 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- start start 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e38004d50 0x7f5e4c1f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e4c0cae70 0x7f5e4c0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cd320 0x7f5e4c14b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c06ceb0 con 0x7f5e4c0cae70 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c0d0020 con 0x7f5e38004d50 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5348e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c06d190 con 0x7f5e4c0cd320 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e4c0cae70 0x7f5e4c0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e4c0cae70 0x7f5e4c0ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49708/0 (socket says 172.21.15.73:49708) 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 -- 172.21.15.73:0/2604075369 learned_addr learned my addr 172.21.15.73:0/2604075369 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e5122a640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e38004d50 0x7f5e4c1f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 -- 172.21.15.73:0/2604075369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cd320 msgr2=0x7f5e4c14b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cd320 0x7f5e4c14b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 -- 172.21.15.73:0/2604075369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e38004d50 msgr2=0x7f5e4c1f6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e38004d50 0x7f5e4c1f6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 -- 172.21.15.73:0/2604075369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0cbd40 con 0x7f5e4c0cae70 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e50a29640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e4c0cae70 0x7f5e4c0ccde0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0058b0 tx=0x7f5e3c00e100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.423+0000 7f5e41ffb640 1 -- 172.21.15.73:0/2604075369 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c01b070 con 0x7f5e4c0cae70 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e41ffb640 1 -- 172.21.15.73:0/2604075369 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c011040 con 0x7f5e4c0cae70 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c0cc020 con 0x7f5e4c0cae70 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c0cc5e0 con 0x7f5e4c0cae70 2024-09-12T03:35:37.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e41ffb640 1 -- 172.21.15.73:0/2604075369 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00ee60 con 0x7f5e4c0cae70 2024-09-12T03:35:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4c0d1490 con 0x7f5e4c0cae70 2024-09-12T03:35:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e41ffb640 1 -- 172.21.15.73:0/2604075369 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e3c01f3f0 con 0x7f5e4c0cae70 2024-09-12T03:35:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e41ffb640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5e300678c0 0x7f5e30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e41ffb640 1 -- 172.21.15.73:0/2604075369 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f5e3c088850 con 0x7f5e4c0cae70 2024-09-12T03:35:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e5122a640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5e300678c0 0x7f5e30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:37.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.427+0000 7f5e5122a640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5e300678c0 0x7f5e30069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009a60 tx=0x7f5e48008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:37.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.431+0000 7f5e41ffb640 1 -- 172.21.15.73:0/2604075369 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5e3c058b30 con 0x7f5e4c0cae70 2024-09-12T03:35:37.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.579+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e4c06bcc0 con 0x7f5e300678c0 2024-09-12T03:35:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.583+0000 7f5e41ffb640 1 -- 172.21.15.73:0/2604075369 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249354 (secure 0 0 0) 0x7f5e4c06bcc0 con 0x7f5e300678c0 2024-09-12T03:35:37.593 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:37.594 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:35:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5e300678c0 msgr2=0x7f5e30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5e300678c0 0x7f5e30069d80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009a60 tx=0x7f5e48008040 comp rx=0 tx=0).stop 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e4c0cae70 msgr2=0x7f5e4c0ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e4c0cae70 0x7f5e4c0ccde0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0058b0 tx=0x7f5e3c00e100 comp rx=0 tx=0).stop 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 shutdown_connections 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5e300678c0 0x7f5e30069d80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e4c0cae70 0x7f5e4c0ccde0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5e4c0cd320 0x7f5e4c14b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 --2- 172.21.15.73:0/2604075369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5e38004d50 0x7f5e4c1f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 >> 172.21.15.73:0/2604075369 conn(0x7f5e4c08bf90 msgr2=0x7f5e4c160f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 shutdown_connections 2024-09-12T03:35:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:37.587+0000 7f5e5348e640 1 -- 172.21.15.73:0/2604075369 wait complete. 2024-09-12T03:35:37.610 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-12T03:35:35.806569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220740,"kb_used_data":4508,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753980,"statfs":{"total":773094113280,"available":772868075520,"internally_reserved":0,"allocated":4616192,"data_stored":2631185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.709182"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178355+0000","last_change":"2024-09-12T03:35:32.169010+0000","last_active":"2024-09-12T03:35:32.178355+0000","last_peered":"2024-09-12T03:35:32.178355+0000","last_clean":"2024-09-12T03:35:32.178355+0000","last_became_active":"2024-09-12T03:35:32.168574+0000","last_became_peered":"2024-09-12T03:35:32.168574+0000","last_unstale":"2024-09-12T03:35:32.178355+0000","last_undegraded":"2024-09-12T03:35:32.178355+0000","last_fullsized":"2024-09-12T03:35:32.178355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167459+0000","last_change":"2024-09-12T03:35:32.157902+0000","last_active":"2024-09-12T03:35:32.167459+0000","last_peered":"2024-09-12T03:35:32.167459+0000","last_clean":"2024-09-12T03:35:32.167459+0000","last_became_active":"2024-09-12T03:35:32.157125+0000","last_became_peered":"2024-09-12T03:35:32.157125+0000","last_unstale":"2024-09-12T03:35:32.167459+0000","last_undegraded":"2024-09-12T03:35:32.167459+0000","last_fullsized":"2024-09-12T03:35:32.167459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179762+0000","last_change":"2024-09-12T03:35:32.176999+0000","last_active":"2024-09-12T03:35:32.179762+0000","last_peered":"2024-09-12T03:35:32.179762+0000","last_clean":"2024-09-12T03:35:32.179762+0000","last_became_active":"2024-09-12T03:35:32.176693+0000","last_became_peered":"2024-09-12T03:35:32.176693+0000","last_unstale":"2024-09-12T03:35:32.179762+0000","last_undegraded":"2024-09-12T03:35:32.179762+0000","last_fullsized":"2024-09-12T03:35:32.179762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:02.318856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178286+0000","last_change":"2024-09-12T03:35:32.176004+0000","last_active":"2024-09-12T03:35:32.178286+0000","last_peered":"2024-09-12T03:35:32.178286+0000","last_clean":"2024-09-12T03:35:32.178286+0000","last_became_active":"2024-09-12T03:35:32.175743+0000","last_became_peered":"2024-09-12T03:35:32.175743+0000","last_unstale":"2024-09-12T03:35:32.178286+0000","last_undegraded":"2024-09-12T03:35:32.178286+0000","last_fullsized":"2024-09-12T03:35:32.178286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:29.981501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183458+0000","last_change":"2024-09-12T03:35:32.179040+0000","last_active":"2024-09-12T03:35:32.183458+0000","last_peered":"2024-09-12T03:35:32.183458+0000","last_clean":"2024-09-12T03:35:32.183458+0000","last_became_active":"2024-09-12T03:35:32.178776+0000","last_became_peered":"2024-09-12T03:35:32.178776+0000","last_unstale":"2024-09-12T03:35:32.183458+0000","last_undegraded":"2024-09-12T03:35:32.183458+0000","last_fullsized":"2024-09-12T03:35:32.183458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207842+0000","last_change":"2024-09-12T03:35:32.188889+0000","last_active":"2024-09-12T03:35:32.207842+0000","last_peered":"2024-09-12T03:35:32.207842+0000","last_clean":"2024-09-12T03:35:32.207842+0000","last_became_active":"2024-09-12T03:35:32.188042+0000","last_became_peered":"2024-09-12T03:35:32.188042+0000","last_unstale":"2024-09-12T03:35:32.207842+0000","last_undegraded":"2024-09-12T03:35:32.207842+0000","last_fullsized":"2024-09-12T03:35:32.207842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.173119+0000","last_change":"2024-09-12T03:35:32.162848+0000","last_active":"2024-09-12T03:35:32.173119+0000","last_peered":"2024-09-12T03:35:32.173119+0000","last_clean":"2024-09-12T03:35:32.173119+0000","last_became_active":"2024-09-12T03:35:32.162154+0000","last_became_peered":"2024-09-12T03:35:32.162154+0000","last_unstale":"2024-09-12T03:35:32.173119+0000","last_undegraded":"2024-09-12T03:35:32.173119+0000","last_fullsized":"2024-09-12T03:35:32.173119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208390+0000","last_change":"2024-09-12T03:35:32.195034+0000","last_active":"2024-09-12T03:35:32.208390+0000","last_peered":"2024-09-12T03:35:32.208390+0000","last_clean":"2024-09-12T03:35:32.208390+0000","last_became_active":"2024-09-12T03:35:32.194309+0000","last_became_peered":"2024-09-12T03:35:32.194309+0000","last_unstale":"2024-09-12T03:35:32.208390+0000","last_undegraded":"2024-09-12T03:35:32.208390+0000","last_fullsized":"2024-09-12T03:35:32.208390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208445+0000","last_change":"2024-09-12T03:35:32.195524+0000","last_active":"2024-09-12T03:35:32.208445+0000","last_peered":"2024-09-12T03:35:32.208445+0000","last_clean":"2024-09-12T03:35:32.208445+0000","last_became_active":"2024-09-12T03:35:32.194818+0000","last_became_peered":"2024-09-12T03:35:32.194818+0000","last_unstale":"2024-09-12T03:35:32.208445+0000","last_undegraded":"2024-09-12T03:35:32.208445+0000","last_fullsized":"2024-09-12T03:35:32.208445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208412+0000","last_change":"2024-09-12T03:35:32.195303+0000","last_active":"2024-09-12T03:35:32.208412+0000","last_peered":"2024-09-12T03:35:32.208412+0000","last_clean":"2024-09-12T03:35:32.208412+0000","last_became_active":"2024-09-12T03:35:32.194596+0000","last_became_peered":"2024-09-12T03:35:32.194596+0000","last_unstale":"2024-09-12T03:35:32.208412+0000","last_undegraded":"2024-09-12T03:35:32.208412+0000","last_fullsized":"2024-09-12T03:35:32.208412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202064+0000","last_change":"2024-09-12T03:35:32.180297+0000","last_active":"2024-09-12T03:35:32.202064+0000","last_peered":"2024-09-12T03:35:32.202064+0000","last_clean":"2024-09-12T03:35:32.202064+0000","last_became_active":"2024-09-12T03:35:32.174697+0000","last_became_peered":"2024-09-12T03:35:32.174697+0000","last_unstale":"2024-09-12T03:35:32.202064+0000","last_undegraded":"2024-09-12T03:35:32.202064+0000","last_fullsized":"2024-09-12T03:35:32.202064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.197050+0000","last_change":"2024-09-12T03:35:32.170895+0000","last_active":"2024-09-12T03:35:32.197050+0000","last_peered":"2024-09-12T03:35:32.197050+0000","last_clean":"2024-09-12T03:35:32.197050+0000","last_became_active":"2024-09-12T03:35:32.170170+0000","last_became_peered":"2024-09-12T03:35:32.170170+0000","last_unstale":"2024-09-12T03:35:32.197050+0000","last_undegraded":"2024-09-12T03:35:32.197050+0000","last_fullsized":"2024-09-12T03:35:32.197050+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216087+0000","last_change":"2024-09-12T03:35:32.213125+0000","last_active":"2024-09-12T03:35:32.216087+0000","last_peered":"2024-09-12T03:35:32.216087+0000","last_clean":"2024-09-12T03:35:32.216087+0000","last_became_active":"2024-09-12T03:35:32.212385+0000","last_became_peered":"2024-09-12T03:35:32.212385+0000","last_unstale":"2024-09-12T03:35:32.216087+0000","last_undegraded":"2024-09-12T03:35:32.216087+0000","last_fullsized":"2024-09-12T03:35:32.216087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.216370+0000","last_change":"2024-09-12T03:35:32.213872+0000","last_active":"2024-09-12T03:35:32.216370+0000","last_peered":"2024-09-12T03:35:32.216370+0000","last_clean":"2024-09-12T03:35:32.216370+0000","last_became_active":"2024-09-12T03:35:32.213105+0000","last_became_peered":"2024-09-12T03:35:32.213105+0000","last_unstale":"2024-09-12T03:35:32.216370+0000","last_undegraded":"2024-09-12T03:35:32.216370+0000","last_fullsized":"2024-09-12T03:35:32.216370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.175963+0000","last_change":"2024-09-12T03:35:32.173004+0000","last_active":"2024-09-12T03:35:32.175963+0000","last_peered":"2024-09-12T03:35:32.175963+0000","last_clean":"2024-09-12T03:35:32.175963+0000","last_became_active":"2024-09-12T03:35:32.172616+0000","last_became_peered":"2024-09-12T03:35:32.172616+0000","last_unstale":"2024-09-12T03:35:32.175963+0000","last_undegraded":"2024-09-12T03:35:32.175963+0000","last_fullsized":"2024-09-12T03:35:32.175963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:53.618781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207496+0000","last_change":"2024-09-12T03:35:32.180618+0000","last_active":"2024-09-12T03:35:32.207496+0000","last_peered":"2024-09-12T03:35:32.207496+0000","last_clean":"2024-09-12T03:35:32.207496+0000","last_became_active":"2024-09-12T03:35:32.179750+0000","last_became_peered":"2024-09-12T03:35:32.179750+0000","last_unstale":"2024-09-12T03:35:32.207496+0000","last_undegraded":"2024-09-12T03:35:32.207496+0000","last_fullsized":"2024-09-12T03:35:32.207496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.201962+0000","last_change":"2024-09-12T03:35:32.175438+0000","last_active":"2024-09-12T03:35:32.201962+0000","last_peered":"2024-09-12T03:35:32.201962+0000","last_clean":"2024-09-12T03:35:32.201962+0000","last_became_active":"2024-09-12T03:35:32.173214+0000","last_became_peered":"2024-09-12T03:35:32.173214+0000","last_unstale":"2024-09-12T03:35:32.201962+0000","last_undegraded":"2024-09-12T03:35:32.201962+0000","last_fullsized":"2024-09-12T03:35:32.201962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191120+0000","last_change":"2024-09-12T03:35:32.178661+0000","last_active":"2024-09-12T03:35:32.191120+0000","last_peered":"2024-09-12T03:35:32.191120+0000","last_clean":"2024-09-12T03:35:32.191120+0000","last_became_active":"2024-09-12T03:35:32.177898+0000","last_became_peered":"2024-09-12T03:35:32.177898+0000","last_unstale":"2024-09-12T03:35:32.191120+0000","last_undegraded":"2024-09-12T03:35:32.191120+0000","last_fullsized":"2024-09-12T03:35:32.191120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:27.744426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.177060+0000","last_change":"2024-09-12T03:35:32.175313+0000","last_active":"2024-09-12T03:35:32.177060+0000","last_peered":"2024-09-12T03:35:32.177060+0000","last_clean":"2024-09-12T03:35:32.177060+0000","last_became_active":"2024-09-12T03:35:32.174347+0000","last_became_peered":"2024-09-12T03:35:32.174347+0000","last_unstale":"2024-09-12T03:35:32.177060+0000","last_undegraded":"2024-09-12T03:35:32.177060+0000","last_fullsized":"2024-09-12T03:35:32.177060+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:03.685409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.206339+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.205847+0000","last_became_peered":"2024-09-12T03:35:32.205847+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207827+0000","last_change":"2024-09-12T03:35:32.184992+0000","last_active":"2024-09-12T03:35:32.207827+0000","last_peered":"2024-09-12T03:35:32.207827+0000","last_clean":"2024-09-12T03:35:32.207827+0000","last_became_active":"2024-09-12T03:35:32.184163+0000","last_became_peered":"2024-09-12T03:35:32.184163+0000","last_unstale":"2024-09-12T03:35:32.207827+0000","last_undegraded":"2024-09-12T03:35:32.207827+0000","last_fullsized":"2024-09-12T03:35:32.207827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191170+0000","last_change":"2024-09-12T03:35:32.182587+0000","last_active":"2024-09-12T03:35:32.191170+0000","last_peered":"2024-09-12T03:35:32.191170+0000","last_clean":"2024-09-12T03:35:32.191170+0000","last_became_active":"2024-09-12T03:35:32.181769+0000","last_became_peered":"2024-09-12T03:35:32.181769+0000","last_unstale":"2024-09-12T03:35:32.191170+0000","last_undegraded":"2024-09-12T03:35:32.191170+0000","last_fullsized":"2024-09-12T03:35:32.191170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.172742+0000","last_change":"2024-09-12T03:35:32.166893+0000","last_active":"2024-09-12T03:35:32.172742+0000","last_peered":"2024-09-12T03:35:32.172742+0000","last_clean":"2024-09-12T03:35:32.172742+0000","last_became_active":"2024-09-12T03:35:32.166550+0000","last_became_peered":"2024-09-12T03:35:32.166550+0000","last_unstale":"2024-09-12T03:35:32.172742+0000","last_undegraded":"2024-09-12T03:35:32.172742+0000","last_fullsized":"2024-09-12T03:35:32.172742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:46.976689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.215852+0000","last_change":"2024-09-12T03:35:32.212944+0000","last_active":"2024-09-12T03:35:32.215852+0000","last_peered":"2024-09-12T03:35:32.215852+0000","last_clean":"2024-09-12T03:35:32.215852+0000","last_became_active":"2024-09-12T03:35:32.212437+0000","last_became_peered":"2024-09-12T03:35:32.212437+0000","last_unstale":"2024-09-12T03:35:32.215852+0000","last_undegraded":"2024-09-12T03:35:32.215852+0000","last_fullsized":"2024-09-12T03:35:32.215852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.100015+0000","last_change":"2024-09-12T03:35:30.100015+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.100015+0000","last_undegraded":"2024-09-12T03:35:30.100015+0000","last_fullsized":"2024-09-12T03:35:30.100015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207891+0000","last_change":"2024-09-12T03:35:32.206342+0000","last_active":"2024-09-12T03:35:32.207891+0000","last_peered":"2024-09-12T03:35:32.207891+0000","last_clean":"2024-09-12T03:35:32.207891+0000","last_became_active":"2024-09-12T03:35:32.205885+0000","last_became_peered":"2024-09-12T03:35:32.205885+0000","last_unstale":"2024-09-12T03:35:32.207891+0000","last_undegraded":"2024-09-12T03:35:32.207891+0000","last_fullsized":"2024-09-12T03:35:32.207891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103320+0000","last_change":"2024-09-12T03:35:30.103320+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103320+0000","last_undegraded":"2024-09-12T03:35:30.103320+0000","last_fullsized":"2024-09-12T03:35:30.103320+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.183864+0000","last_change":"2024-09-12T03:35:32.174736+0000","last_active":"2024-09-12T03:35:32.183864+0000","last_peered":"2024-09-12T03:35:32.183864+0000","last_clean":"2024-09-12T03:35:32.183864+0000","last_became_active":"2024-09-12T03:35:32.172869+0000","last_became_peered":"2024-09-12T03:35:32.172869+0000","last_unstale":"2024-09-12T03:35:32.183864+0000","last_undegraded":"2024-09-12T03:35:32.183864+0000","last_fullsized":"2024-09-12T03:35:32.183864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:38.916765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191605+0000","last_change":"2024-09-12T03:35:31.145825+0000","last_active":"2024-09-12T03:35:32.191605+0000","last_peered":"2024-09-12T03:35:32.191605+0000","last_clean":"2024-09-12T03:35:32.191605+0000","last_became_active":"2024-09-12T03:35:31.145486+0000","last_became_peered":"2024-09-12T03:35:31.145486+0000","last_unstale":"2024-09-12T03:35:32.191605+0000","last_undegraded":"2024-09-12T03:35:32.191605+0000","last_fullsized":"2024-09-12T03:35:32.191605+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168382+0000","last_change":"2024-09-12T03:35:32.153193+0000","last_active":"2024-09-12T03:35:32.168382+0000","last_peered":"2024-09-12T03:35:32.168382+0000","last_clean":"2024-09-12T03:35:32.168382+0000","last_became_active":"2024-09-12T03:35:32.152295+0000","last_became_peered":"2024-09-12T03:35:32.152295+0000","last_unstale":"2024-09-12T03:35:32.168382+0000","last_undegraded":"2024-09-12T03:35:32.168382+0000","last_fullsized":"2024-09-12T03:35:32.168382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.192996+0000","last_change":"2024-09-12T03:35:31.140136+0000","last_active":"2024-09-12T03:35:32.192996+0000","last_peered":"2024-09-12T03:35:32.192996+0000","last_clean":"2024-09-12T03:35:32.192996+0000","last_became_active":"2024-09-12T03:35:31.139504+0000","last_became_peered":"2024-09-12T03:35:31.139504+0000","last_unstale":"2024-09-12T03:35:32.192996+0000","last_undegraded":"2024-09-12T03:35:32.192996+0000","last_fullsized":"2024-09-12T03:35:32.192996+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.208505+0000","last_change":"2024-09-12T03:35:31.122217+0000","last_active":"2024-09-12T03:35:32.208505+0000","last_peered":"2024-09-12T03:35:32.208505+0000","last_clean":"2024-09-12T03:35:32.208505+0000","last_became_active":"2024-09-12T03:35:31.121503+0000","last_became_peered":"2024-09-12T03:35:31.121503+0000","last_unstale":"2024-09-12T03:35:32.208505+0000","last_undegraded":"2024-09-12T03:35:32.208505+0000","last_fullsized":"2024-09-12T03:35:32.208505+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:26.735443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207789+0000","last_change":"2024-09-12T03:35:32.180265+0000","last_active":"2024-09-12T03:35:32.207789+0000","last_peered":"2024-09-12T03:35:32.207789+0000","last_clean":"2024-09-12T03:35:32.207789+0000","last_became_active":"2024-09-12T03:35:32.179533+0000","last_became_peered":"2024-09-12T03:35:32.179533+0000","last_unstale":"2024-09-12T03:35:32.207789+0000","last_undegraded":"2024-09-12T03:35:32.207789+0000","last_fullsized":"2024-09-12T03:35:32.207789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207545+0000","last_change":"2024-09-12T03:35:31.155475+0000","last_active":"2024-09-12T03:35:32.207545+0000","last_peered":"2024-09-12T03:35:32.207545+0000","last_clean":"2024-09-12T03:35:32.207545+0000","last_became_active":"2024-09-12T03:35:31.154875+0000","last_became_peered":"2024-09-12T03:35:31.154875+0000","last_unstale":"2024-09-12T03:35:32.207545+0000","last_undegraded":"2024-09-12T03:35:32.207545+0000","last_fullsized":"2024-09-12T03:35:32.207545+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206786+0000","last_change":"2024-09-12T03:35:32.184081+0000","last_active":"2024-09-12T03:35:32.206786+0000","last_peered":"2024-09-12T03:35:32.206786+0000","last_clean":"2024-09-12T03:35:32.206786+0000","last_became_active":"2024-09-12T03:35:32.183424+0000","last_became_peered":"2024-09-12T03:35:32.183424+0000","last_unstale":"2024-09-12T03:35:32.206786+0000","last_undegraded":"2024-09-12T03:35:32.206786+0000","last_fullsized":"2024-09-12T03:35:32.206786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.167468+0000","last_change":"2024-09-12T03:35:31.134300+0000","last_active":"2024-09-12T03:35:32.167468+0000","last_peered":"2024-09-12T03:35:32.167468+0000","last_clean":"2024-09-12T03:35:32.167468+0000","last_became_active":"2024-09-12T03:35:31.133662+0000","last_became_peered":"2024-09-12T03:35:31.133662+0000","last_unstale":"2024-09-12T03:35:32.167468+0000","last_undegraded":"2024-09-12T03:35:32.167468+0000","last_fullsized":"2024-09-12T03:35:32.167468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179682+0000","last_change":"2024-09-12T03:35:32.176878+0000","last_active":"2024-09-12T03:35:32.179682+0000","last_peered":"2024-09-12T03:35:32.179682+0000","last_clean":"2024-09-12T03:35:32.179682+0000","last_became_active":"2024-09-12T03:35:32.176281+0000","last_became_peered":"2024-09-12T03:35:32.176281+0000","last_unstale":"2024-09-12T03:35:32.179682+0000","last_undegraded":"2024-09-12T03:35:32.179682+0000","last_fullsized":"2024-09-12T03:35:32.179682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157879+0000","last_change":"2024-09-12T03:35:31.148365+0000","last_active":"2024-09-12T03:35:32.157879+0000","last_peered":"2024-09-12T03:35:32.157879+0000","last_clean":"2024-09-12T03:35:32.157879+0000","last_became_active":"2024-09-12T03:35:31.142740+0000","last_became_peered":"2024-09-12T03:35:31.142740+0000","last_unstale":"2024-09-12T03:35:32.157879+0000","last_undegraded":"2024-09-12T03:35:32.157879+0000","last_fullsized":"2024-09-12T03:35:32.157879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179738+0000","last_change":"2024-09-12T03:35:32.176998+0000","last_active":"2024-09-12T03:35:32.179738+0000","last_peered":"2024-09-12T03:35:32.179738+0000","last_clean":"2024-09-12T03:35:32.179738+0000","last_became_active":"2024-09-12T03:35:32.176678+0000","last_became_peered":"2024-09-12T03:35:32.176678+0000","last_unstale":"2024-09-12T03:35:32.179738+0000","last_undegraded":"2024-09-12T03:35:32.179738+0000","last_fullsized":"2024-09-12T03:35:32.179738+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:49.982125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.151633+0000","last_change":"2024-09-12T03:35:31.125827+0000","last_active":"2024-09-12T03:35:32.151633+0000","last_peered":"2024-09-12T03:35:32.151633+0000","last_clean":"2024-09-12T03:35:32.151633+0000","last_became_active":"2024-09-12T03:35:31.122580+0000","last_became_peered":"2024-09-12T03:35:31.122580+0000","last_unstale":"2024-09-12T03:35:32.151633+0000","last_undegraded":"2024-09-12T03:35:32.151633+0000","last_fullsized":"2024-09-12T03:35:32.151633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206161+0000","last_change":"2024-09-12T03:35:32.198738+0000","last_active":"2024-09-12T03:35:32.206161+0000","last_peered":"2024-09-12T03:35:32.206161+0000","last_clean":"2024-09-12T03:35:32.206161+0000","last_became_active":"2024-09-12T03:35:32.198073+0000","last_became_peered":"2024-09-12T03:35:32.198073+0000","last_unstale":"2024-09-12T03:35:32.206161+0000","last_undegraded":"2024-09-12T03:35:32.206161+0000","last_fullsized":"2024-09-12T03:35:32.206161+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:46.705741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166727+0000","last_change":"2024-09-12T03:35:31.129565+0000","last_active":"2024-09-12T03:35:32.166727+0000","last_peered":"2024-09-12T03:35:32.166727+0000","last_clean":"2024-09-12T03:35:32.166727+0000","last_became_active":"2024-09-12T03:35:31.128696+0000","last_became_peered":"2024-09-12T03:35:31.128696+0000","last_unstale":"2024-09-12T03:35:32.166727+0000","last_undegraded":"2024-09-12T03:35:32.166727+0000","last_fullsized":"2024-09-12T03:35:32.166727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212534+0000","last_change":"2024-09-12T03:35:31.120663+0000","last_active":"2024-09-12T03:35:32.212534+0000","last_peered":"2024-09-12T03:35:32.212534+0000","last_clean":"2024-09-12T03:35:32.212534+0000","last_became_active":"2024-09-12T03:35:31.119307+0000","last_became_peered":"2024-09-12T03:35:31.119307+0000","last_unstale":"2024-09-12T03:35:32.212534+0000","last_undegraded":"2024-09-12T03:35:32.212534+0000","last_fullsized":"2024-09-12T03:35:32.212534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.191162+0000","last_change":"2024-09-12T03:35:32.181504+0000","last_active":"2024-09-12T03:35:32.191162+0000","last_peered":"2024-09-12T03:35:32.191162+0000","last_clean":"2024-09-12T03:35:32.191162+0000","last_became_active":"2024-09-12T03:35:32.180735+0000","last_became_peered":"2024-09-12T03:35:32.180735+0000","last_unstale":"2024-09-12T03:35:32.191162+0000","last_undegraded":"2024-09-12T03:35:32.191162+0000","last_fullsized":"2024-09-12T03:35:32.191162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212280+0000","last_change":"2024-09-12T03:35:31.138409+0000","last_active":"2024-09-12T03:35:32.212280+0000","last_peered":"2024-09-12T03:35:32.212280+0000","last_clean":"2024-09-12T03:35:32.212280+0000","last_became_active":"2024-09-12T03:35:31.138039+0000","last_became_peered":"2024-09-12T03:35:31.138039+0000","last_unstale":"2024-09-12T03:35:32.212280+0000","last_undegraded":"2024-09-12T03:35:32.212280+0000","last_fullsized":"2024-09-12T03:35:32.212280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189481+0000","last_change":"2024-09-12T03:35:31.121034+0000","last_active":"2024-09-12T03:35:32.189481+0000","last_peered":"2024-09-12T03:35:32.189481+0000","last_clean":"2024-09-12T03:35:32.189481+0000","last_became_active":"2024-09-12T03:35:31.120768+0000","last_became_peered":"2024-09-12T03:35:31.120768+0000","last_unstale":"2024-09-12T03:35:32.189481+0000","last_undegraded":"2024-09-12T03:35:32.189481+0000","last_fullsized":"2024-09-12T03:35:32.189481+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178318+0000","last_change":"2024-09-12T03:35:32.168888+0000","last_active":"2024-09-12T03:35:32.178318+0000","last_peered":"2024-09-12T03:35:32.178318+0000","last_clean":"2024-09-12T03:35:32.178318+0000","last_became_active":"2024-09-12T03:35:32.168568+0000","last_became_peered":"2024-09-12T03:35:32.168568+0000","last_unstale":"2024-09-12T03:35:32.178318+0000","last_undegraded":"2024-09-12T03:35:32.178318+0000","last_fullsized":"2024-09-12T03:35:32.178318+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166910+0000","last_change":"2024-09-12T03:35:31.134218+0000","last_active":"2024-09-12T03:35:32.166910+0000","last_peered":"2024-09-12T03:35:32.166910+0000","last_clean":"2024-09-12T03:35:32.166910+0000","last_became_active":"2024-09-12T03:35:31.133767+0000","last_became_peered":"2024-09-12T03:35:31.133767+0000","last_unstale":"2024-09-12T03:35:32.166910+0000","last_undegraded":"2024-09-12T03:35:32.166910+0000","last_fullsized":"2024-09-12T03:35:32.166910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190970+0000","last_change":"2024-09-12T03:35:32.178655+0000","last_active":"2024-09-12T03:35:32.190970+0000","last_peered":"2024-09-12T03:35:32.190970+0000","last_clean":"2024-09-12T03:35:32.190970+0000","last_became_active":"2024-09-12T03:35:32.177875+0000","last_became_peered":"2024-09-12T03:35:32.177875+0000","last_unstale":"2024-09-12T03:35:32.190970+0000","last_undegraded":"2024-09-12T03:35:32.190970+0000","last_fullsized":"2024-09-12T03:35:32.190970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099854+0000","last_change":"2024-09-12T03:35:30.099854+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099854+0000","last_undegraded":"2024-09-12T03:35:30.099854+0000","last_fullsized":"2024-09-12T03:35:30.099854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.178296+0000","last_change":"2024-09-12T03:35:32.169975+0000","last_active":"2024-09-12T03:35:32.178296+0000","last_peered":"2024-09-12T03:35:32.178296+0000","last_clean":"2024-09-12T03:35:32.178296+0000","last_became_active":"2024-09-12T03:35:32.169592+0000","last_became_peered":"2024-09-12T03:35:32.169592+0000","last_unstale":"2024-09-12T03:35:32.178296+0000","last_undegraded":"2024-09-12T03:35:32.178296+0000","last_fullsized":"2024-09-12T03:35:32.178296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.209562+0000","last_change":"2024-09-12T03:35:31.154628+0000","last_active":"2024-09-12T03:35:32.209562+0000","last_peered":"2024-09-12T03:35:32.209562+0000","last_clean":"2024-09-12T03:35:32.209562+0000","last_became_active":"2024-09-12T03:35:31.153993+0000","last_became_peered":"2024-09-12T03:35:31.153993+0000","last_unstale":"2024-09-12T03:35:32.209562+0000","last_undegraded":"2024-09-12T03:35:32.209562+0000","last_fullsized":"2024-09-12T03:35:32.209562+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.161598+0000","last_change":"2024-09-12T03:35:32.152935+0000","last_active":"2024-09-12T03:35:32.161598+0000","last_peered":"2024-09-12T03:35:32.161598+0000","last_clean":"2024-09-12T03:35:32.161598+0000","last_became_active":"2024-09-12T03:35:32.152123+0000","last_became_peered":"2024-09-12T03:35:32.152123+0000","last_unstale":"2024-09-12T03:35:32.161598+0000","last_undegraded":"2024-09-12T03:35:32.161598+0000","last_fullsized":"2024-09-12T03:35:32.161598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212278+0000","last_change":"2024-09-12T03:35:31.150651+0000","last_active":"2024-09-12T03:35:32.212278+0000","last_peered":"2024-09-12T03:35:32.212278+0000","last_clean":"2024-09-12T03:35:32.212278+0000","last_became_active":"2024-09-12T03:35:31.150087+0000","last_became_peered":"2024-09-12T03:35:31.150087+0000","last_unstale":"2024-09-12T03:35:32.212278+0000","last_undegraded":"2024-09-12T03:35:32.212278+0000","last_fullsized":"2024-09-12T03:35:32.212278+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207722+0000","last_change":"2024-09-12T03:35:32.180787+0000","last_active":"2024-09-12T03:35:32.207722+0000","last_peered":"2024-09-12T03:35:32.207722+0000","last_clean":"2024-09-12T03:35:32.207722+0000","last_became_active":"2024-09-12T03:35:32.180128+0000","last_became_peered":"2024-09-12T03:35:32.180128+0000","last_unstale":"2024-09-12T03:35:32.207722+0000","last_undegraded":"2024-09-12T03:35:32.207722+0000","last_fullsized":"2024-09-12T03:35:32.207722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.213860+0000","last_change":"2024-09-12T03:35:31.148497+0000","last_active":"2024-09-12T03:35:32.213860+0000","last_peered":"2024-09-12T03:35:32.213860+0000","last_clean":"2024-09-12T03:35:32.213860+0000","last_became_active":"2024-09-12T03:35:31.147818+0000","last_became_peered":"2024-09-12T03:35:31.147818+0000","last_unstale":"2024-09-12T03:35:32.213860+0000","last_undegraded":"2024-09-12T03:35:32.213860+0000","last_fullsized":"2024-09-12T03:35:32.213860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.190661+0000","last_change":"2024-09-12T03:35:32.183482+0000","last_active":"2024-09-12T03:35:32.190661+0000","last_peered":"2024-09-12T03:35:32.190661+0000","last_clean":"2024-09-12T03:35:32.190661+0000","last_became_active":"2024-09-12T03:35:32.175402+0000","last_became_peered":"2024-09-12T03:35:32.175402+0000","last_unstale":"2024-09-12T03:35:32.190661+0000","last_undegraded":"2024-09-12T03:35:32.190661+0000","last_fullsized":"2024-09-12T03:35:32.190661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.149237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.195583+0000","last_change":"2024-09-12T03:35:31.137498+0000","last_active":"2024-09-12T03:35:32.195583+0000","last_peered":"2024-09-12T03:35:32.195583+0000","last_clean":"2024-09-12T03:35:32.195583+0000","last_became_active":"2024-09-12T03:35:31.137210+0000","last_became_peered":"2024-09-12T03:35:31.137210+0000","last_unstale":"2024-09-12T03:35:32.195583+0000","last_undegraded":"2024-09-12T03:35:32.195583+0000","last_fullsized":"2024-09-12T03:35:32.195583+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:10.651197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165642+0000","last_change":"2024-09-12T03:35:32.155601+0000","last_active":"2024-09-12T03:35:32.165642+0000","last_peered":"2024-09-12T03:35:32.165642+0000","last_clean":"2024-09-12T03:35:32.165642+0000","last_became_active":"2024-09-12T03:35:32.153852+0000","last_became_peered":"2024-09-12T03:35:32.153852+0000","last_unstale":"2024-09-12T03:35:32.165642+0000","last_undegraded":"2024-09-12T03:35:32.165642+0000","last_fullsized":"2024-09-12T03:35:32.165642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:02:57.275609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.166487+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.166487+0000","last_peered":"2024-09-12T03:35:32.166487+0000","last_clean":"2024-09-12T03:35:32.166487+0000","last_became_active":"2024-09-12T03:35:31.144611+0000","last_became_peered":"2024-09-12T03:35:31.144611+0000","last_unstale":"2024-09-12T03:35:32.166487+0000","last_undegraded":"2024-09-12T03:35:32.166487+0000","last_fullsized":"2024-09-12T03:35:32.166487+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.196264+0000","last_change":"2024-09-12T03:35:32.179725+0000","last_active":"2024-09-12T03:35:32.196264+0000","last_peered":"2024-09-12T03:35:32.196264+0000","last_clean":"2024-09-12T03:35:32.196264+0000","last_became_active":"2024-09-12T03:35:32.178924+0000","last_became_peered":"2024-09-12T03:35:32.178924+0000","last_unstale":"2024-09-12T03:35:32.196264+0000","last_undegraded":"2024-09-12T03:35:32.196264+0000","last_fullsized":"2024-09-12T03:35:32.196264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.188965+0000","last_change":"2024-09-12T03:35:31.119011+0000","last_active":"2024-09-12T03:35:32.188965+0000","last_peered":"2024-09-12T03:35:32.188965+0000","last_clean":"2024-09-12T03:35:32.188965+0000","last_became_active":"2024-09-12T03:35:31.118692+0000","last_became_peered":"2024-09-12T03:35:31.118692+0000","last_unstale":"2024-09-12T03:35:32.188965+0000","last_undegraded":"2024-09-12T03:35:32.188965+0000","last_fullsized":"2024-09-12T03:35:32.188965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:00.187654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141169+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:32.141169+0000","last_peered":"2024-09-12T03:35:32.141169+0000","last_clean":"2024-09-12T03:35:32.141169+0000","last_became_active":"2024-09-12T03:35:31.144591+0000","last_became_peered":"2024-09-12T03:35:31.144591+0000","last_unstale":"2024-09-12T03:35:32.141169+0000","last_undegraded":"2024-09-12T03:35:32.141169+0000","last_fullsized":"2024-09-12T03:35:32.141169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:00.727172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.176611+0000","last_change":"2024-09-12T03:35:32.157200+0000","last_active":"2024-09-12T03:35:32.176611+0000","last_peered":"2024-09-12T03:35:32.176611+0000","last_clean":"2024-09-12T03:35:32.176611+0000","last_became_active":"2024-09-12T03:35:32.155267+0000","last_became_peered":"2024-09-12T03:35:32.155267+0000","last_unstale":"2024-09-12T03:35:32.176611+0000","last_undegraded":"2024-09-12T03:35:32.176611+0000","last_fullsized":"2024-09-12T03:35:32.176611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168000+0000","last_change":"2024-09-12T03:35:31.143758+0000","last_active":"2024-09-12T03:35:32.168000+0000","last_peered":"2024-09-12T03:35:32.168000+0000","last_clean":"2024-09-12T03:35:32.168000+0000","last_became_active":"2024-09-12T03:35:31.143044+0000","last_became_peered":"2024-09-12T03:35:31.143044+0000","last_unstale":"2024-09-12T03:35:32.168000+0000","last_undegraded":"2024-09-12T03:35:32.168000+0000","last_fullsized":"2024-09-12T03:35:32.168000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.179656+0000","last_change":"2024-09-12T03:35:32.176574+0000","last_active":"2024-09-12T03:35:32.179656+0000","last_peered":"2024-09-12T03:35:32.179656+0000","last_clean":"2024-09-12T03:35:32.179656+0000","last_became_active":"2024-09-12T03:35:32.175869+0000","last_became_peered":"2024-09-12T03:35:32.175869+0000","last_unstale":"2024-09-12T03:35:32.179656+0000","last_undegraded":"2024-09-12T03:35:32.179656+0000","last_fullsized":"2024-09-12T03:35:32.179656+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.142133+0000","last_change":"2024-09-12T03:35:31.119437+0000","last_active":"2024-09-12T03:35:32.142133+0000","last_peered":"2024-09-12T03:35:32.142133+0000","last_clean":"2024-09-12T03:35:32.142133+0000","last_became_active":"2024-09-12T03:35:31.118811+0000","last_became_peered":"2024-09-12T03:35:31.118811+0000","last_unstale":"2024-09-12T03:35:32.142133+0000","last_undegraded":"2024-09-12T03:35:32.142133+0000","last_fullsized":"2024-09-12T03:35:32.142133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.128401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207530+0000","last_change":"2024-09-12T03:35:32.206219+0000","last_active":"2024-09-12T03:35:32.207530+0000","last_peered":"2024-09-12T03:35:32.207530+0000","last_clean":"2024-09-12T03:35:32.207530+0000","last_became_active":"2024-09-12T03:35:32.205898+0000","last_became_peered":"2024-09-12T03:35:32.205898+0000","last_unstale":"2024-09-12T03:35:32.207530+0000","last_undegraded":"2024-09-12T03:35:32.207530+0000","last_fullsized":"2024-09-12T03:35:32.207530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:15.161834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.212324+0000","last_change":"2024-09-12T03:35:31.123519+0000","last_active":"2024-09-12T03:35:32.212324+0000","last_peered":"2024-09-12T03:35:32.212324+0000","last_clean":"2024-09-12T03:35:32.212324+0000","last_became_active":"2024-09-12T03:35:31.122716+0000","last_became_peered":"2024-09-12T03:35:31.122716+0000","last_unstale":"2024-09-12T03:35:32.212324+0000","last_undegraded":"2024-09-12T03:35:32.212324+0000","last_fullsized":"2024-09-12T03:35:32.212324+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206103+0000","last_change":"2024-09-12T03:35:32.198862+0000","last_active":"2024-09-12T03:35:32.206103+0000","last_peered":"2024-09-12T03:35:32.206103+0000","last_clean":"2024-09-12T03:35:32.206103+0000","last_became_active":"2024-09-12T03:35:32.198370+0000","last_became_peered":"2024-09-12T03:35:32.198370+0000","last_unstale":"2024-09-12T03:35:32.206103+0000","last_undegraded":"2024-09-12T03:35:32.206103+0000","last_fullsized":"2024-09-12T03:35:32.206103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:41.567114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.141700+0000","last_change":"2024-09-12T03:35:31.130491+0000","last_active":"2024-09-12T03:35:32.141700+0000","last_peered":"2024-09-12T03:35:32.141700+0000","last_clean":"2024-09-12T03:35:32.141700+0000","last_became_active":"2024-09-12T03:35:31.130189+0000","last_became_peered":"2024-09-12T03:35:31.130189+0000","last_unstale":"2024-09-12T03:35:32.141700+0000","last_undegraded":"2024-09-12T03:35:32.141700+0000","last_fullsized":"2024-09-12T03:35:32.141700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:57.745056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.189301+0000","last_change":"2024-09-12T03:35:32.185743+0000","last_active":"2024-09-12T03:35:32.189301+0000","last_peered":"2024-09-12T03:35:32.189301+0000","last_clean":"2024-09-12T03:35:32.189301+0000","last_became_active":"2024-09-12T03:35:32.185415+0000","last_became_peered":"2024-09-12T03:35:32.185415+0000","last_unstale":"2024-09-12T03:35:32.189301+0000","last_undegraded":"2024-09-12T03:35:32.189301+0000","last_fullsized":"2024-09-12T03:35:32.189301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103178+0000","last_change":"2024-09-12T03:35:30.103178+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103178+0000","last_undegraded":"2024-09-12T03:35:30.103178+0000","last_fullsized":"2024-09-12T03:35:30.103178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:35:31.096181+0000","last_change":"2024-09-12T03:35:31.096181+0000","last_active":"2024-09-12T03:35:31.096181+0000","last_peered":"2024-09-12T03:35:31.096181+0000","last_clean":"2024-09-12T03:35:31.096181+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:31.096181+0000","last_undegraded":"2024-09-12T03:35:31.096181+0000","last_fullsized":"2024-09-12T03:35:31.096181+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.103111+0000","last_change":"2024-09-12T03:35:30.103111+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.103111+0000","last_undegraded":"2024-09-12T03:35:30.103111+0000","last_fullsized":"2024-09-12T03:35:30.103111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.186467+0000","last_change":"2024-09-12T03:35:32.180911+0000","last_active":"2024-09-12T03:35:32.186467+0000","last_peered":"2024-09-12T03:35:32.186467+0000","last_clean":"2024-09-12T03:35:32.186467+0000","last_became_active":"2024-09-12T03:35:32.180601+0000","last_became_peered":"2024-09-12T03:35:32.180601+0000","last_unstale":"2024-09-12T03:35:32.186467+0000","last_undegraded":"2024-09-12T03:35:32.186467+0000","last_fullsized":"2024-09-12T03:35:32.186467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:09.904125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-09-12T03:35:30.099852+0000","last_change":"2024-09-12T03:35:30.099852+0000","last_active":"2024-09-12T03:35:30.087198+0000","last_peered":"2024-09-12T03:35:30.087198+0000","last_clean":"2024-09-12T03:35:30.087198+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:35:30.099852+0000","last_undegraded":"2024-09-12T03:35:30.099852+0000","last_fullsized":"2024-09-12T03:35:30.099852+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.202018+0000","last_change":"2024-09-12T03:35:32.174912+0000","last_active":"2024-09-12T03:35:32.202018+0000","last_peered":"2024-09-12T03:35:32.202018+0000","last_clean":"2024-09-12T03:35:32.202018+0000","last_became_active":"2024-09-12T03:35:32.173337+0000","last_became_peered":"2024-09-12T03:35:32.173337+0000","last_unstale":"2024-09-12T03:35:32.202018+0000","last_undegraded":"2024-09-12T03:35:32.202018+0000","last_fullsized":"2024-09-12T03:35:32.202018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:52.283008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.157766+0000","last_change":"2024-09-12T03:35:31.141781+0000","last_active":"2024-09-12T03:35:32.157766+0000","last_peered":"2024-09-12T03:35:32.157766+0000","last_clean":"2024-09-12T03:35:32.157766+0000","last_became_active":"2024-09-12T03:35:31.139547+0000","last_became_peered":"2024-09-12T03:35:31.139547+0000","last_unstale":"2024-09-12T03:35:32.157766+0000","last_undegraded":"2024-09-12T03:35:32.157766+0000","last_fullsized":"2024-09-12T03:35:32.157766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.206154+0000","last_change":"2024-09-12T03:35:32.200175+0000","last_active":"2024-09-12T03:35:32.206154+0000","last_peered":"2024-09-12T03:35:32.206154+0000","last_clean":"2024-09-12T03:35:32.206154+0000","last_became_active":"2024-09-12T03:35:32.199519+0000","last_became_peered":"2024-09-12T03:35:32.199519+0000","last_unstale":"2024-09-12T03:35:32.206154+0000","last_undegraded":"2024-09-12T03:35:32.206154+0000","last_fullsized":"2024-09-12T03:35:32.206154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.148275+0000","last_change":"2024-09-12T03:35:31.125839+0000","last_active":"2024-09-12T03:35:32.148275+0000","last_peered":"2024-09-12T03:35:32.148275+0000","last_clean":"2024-09-12T03:35:32.148275+0000","last_became_active":"2024-09-12T03:35:31.122726+0000","last_became_peered":"2024-09-12T03:35:31.122726+0000","last_unstale":"2024-09-12T03:35:32.148275+0000","last_undegraded":"2024-09-12T03:35:32.148275+0000","last_fullsized":"2024-09-12T03:35:32.148275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.207894+0000","last_change":"2024-09-12T03:35:32.189144+0000","last_active":"2024-09-12T03:35:32.207894+0000","last_peered":"2024-09-12T03:35:32.207894+0000","last_clean":"2024-09-12T03:35:32.207894+0000","last_became_active":"2024-09-12T03:35:32.188402+0000","last_became_peered":"2024-09-12T03:35:32.188402+0000","last_unstale":"2024-09-12T03:35:32.207894+0000","last_undegraded":"2024-09-12T03:35:32.207894+0000","last_fullsized":"2024-09-12T03:35:32.207894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.168336+0000","last_change":"2024-09-12T03:35:31.147449+0000","last_active":"2024-09-12T03:35:32.168336+0000","last_peered":"2024-09-12T03:35:32.168336+0000","last_clean":"2024-09-12T03:35:32.168336+0000","last_became_active":"2024-09-12T03:35:31.146800+0000","last_became_peered":"2024-09-12T03:35:31.146800+0000","last_unstale":"2024-09-12T03:35:32.168336+0000","last_undegraded":"2024-09-12T03:35:32.168336+0000","last_fullsized":"2024-09-12T03:35:32.168336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:51.274026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T03:35:32.165630+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:35:32.165630+0000","last_peered":"2024-09-12T03:35:32.165630+0000","last_clean":"2024-09-12T03:35:32.165630+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:35:32.165630+0000","last_undegraded":"2024-09-12T03:35:32.165630+0000","last_fullsized":"2024-09-12T03:35:32.165630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":777199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":417792,"data_stored":177982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":185753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":186795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":185239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":171315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":761683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:35:40.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:35:40.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.739+0000 7f0407d46640 1 Processor -- start 2024-09-12T03:35:40.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f0407d46640 1 -- start start 2024-09-12T03:35:40.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f0407d46640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0400070020 0x7f040015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f0407d46640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f040015f1d0 0x7f04000adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f0407d46640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04000aede0 con 0x7f04001520a0 2024-09-12T03:35:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f0407d46640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0400152480 con 0x7f040015f1d0 2024-09-12T03:35:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f0407d46640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f040015fa10 con 0x7f0400070020 2024-09-12T03:35:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04052e1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0400070020 0x7f040015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04062e3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f040015f1d0 0x7f04000adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04062e3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f040015f1d0 0x7f04000adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:35026/0 (socket says 172.21.15.73:35026) 2024-09-12T03:35:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04052e1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0400070020 0x7f040015ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:36424/0 (socket says 172.21.15.73:36424) 2024-09-12T03:35:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04062e3640 1 -- 172.21.15.73:0/4083136662 learned_addr learned my addr 172.21.15.73:0/4083136662 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f0405ae2640 1 --1- 172.21.15.73:0/4083136662 >> v1:172.21.15.150:6789/0 conn(0x7f04001520a0 0x7f040006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:36602/0 (socket says 172.21.15.73:36602) 2024-09-12T03:35:40.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04062e3640 1 -- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0400070020 msgr2=0x7f040015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:40.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04062e3640 1 --2- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0400070020 0x7f040015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04062e3640 1 -- 172.21.15.73:0/4083136662 >> v1:172.21.15.150:6789/0 conn(0x7f04001520a0 legacy=0x7f040006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:40.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04062e3640 1 -- 172.21.15.73:0/4083136662 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0400074250 con 0x7f040015f1d0 2024-09-12T03:35:40.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.743+0000 7f04052e1640 1 --2- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0400070020 0x7f040015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:35:40.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f04062e3640 1 --2- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f040015f1d0 0x7f04000adc80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f03f00098a0 tx=0x7f03f001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff5192248b9b3bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:40.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0404ae0640 1 -- 172.21.15.73:0/4083136662 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f00aa670 con 0x7f040015f1d0 2024-09-12T03:35:40.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0404ae0640 1 -- 172.21.15.73:0/4083136662 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f00af070 con 0x7f040015f1d0 2024-09-12T03:35:40.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0404ae0640 1 -- 172.21.15.73:0/4083136662 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f00aaa30 con 0x7f040015f1d0 2024-09-12T03:35:40.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f040015f1d0 msgr2=0x7f04000adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:40.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 --2- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f040015f1d0 0x7f04000adc80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f03f00098a0 tx=0x7f03f001c510 comp rx=0 tx=0).stop 2024-09-12T03:35:40.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- 172.21.15.73:0/4083136662 shutdown_connections 2024-09-12T03:35:40.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 --2- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0400070020 0x7f040015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 --2- 172.21.15.73:0/4083136662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f040015f1d0 0x7f04000adc80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- 172.21.15.73:0/4083136662 >> 172.21.15.73:0/4083136662 conn(0x7f04000b1f90 msgr2=0x7f04000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:40.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- 172.21.15.73:0/4083136662 shutdown_connections 2024-09-12T03:35:40.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- 172.21.15.73:0/4083136662 wait complete. 2024-09-12T03:35:40.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 Processor -- start 2024-09-12T03:35:40.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- start start 2024-09-12T03:35:40.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400070020 0x7f040014d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04001520a0 0x7f04000b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f040015f1d0 0x7f04000b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f040015f680 con 0x7f04001520a0 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0400073d30 con 0x7f0400070020 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f0407d46640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f040006e800 con 0x7f040015f1d0 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f04052e1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04001520a0 0x7f04000b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f04052e1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04001520a0 0x7f04000b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49712/0 (socket says 172.21.15.73:49712) 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.747+0000 7f04052e1640 1 -- 172.21.15.73:0/3747796936 learned_addr learned my addr 172.21.15.73:0/3747796936 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f0405ae2640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400070020 0x7f040014d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f04052e1640 1 -- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f040015f1d0 msgr2=0x7f04000b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f04052e1640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f040015f1d0 0x7f04000b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f04052e1640 1 -- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400070020 msgr2=0x7f040014d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f04052e1640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400070020 0x7f040014d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f04052e1640 1 -- 172.21.15.73:0/3747796936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0400164f70 con 0x7f04001520a0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f0405ae2640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400070020 0x7f040014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f04052e1640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04001520a0 0x7f04000b13f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f03f400efc0 tx=0x7f03f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f03fe7fc640 1 -- 172.21.15.73:0/3747796936 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4018020 con 0x7f04001520a0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f03fe7fc640 1 -- 172.21.15.73:0/3747796936 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f4014680 con 0x7f04001520a0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0400165250 con 0x7f04001520a0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f03fe7fc640 1 -- 172.21.15.73:0/3747796936 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4014a50 con 0x7f04001520a0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04000ccf90 con 0x7f04001520a0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0400165640 con 0x7f04001520a0 2024-09-12T03:35:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f03fe7fc640 1 -- 172.21.15.73:0/3747796936 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03f401b020 con 0x7f04001520a0 2024-09-12T03:35:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f03fe7fc640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f03ec0678c0 0x7f03ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f03fe7fc640 1 -- 172.21.15.73:0/3747796936 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f03f4086bd0 con 0x7f04001520a0 2024-09-12T03:35:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f0405ae2640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f03ec0678c0 0x7f03ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.751+0000 7f0405ae2640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f03ec0678c0 0x7f03ec069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f03f8007fd0 tx=0x7f03f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.755+0000 7f03fe7fc640 1 -- 172.21.15.73:0/3747796936 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0400165640 con 0x7f04001520a0 2024-09-12T03:35:40.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.915+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f040015ec90 con 0x7f03ec0678c0 2024-09-12T03:35:40.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.927+0000 7f03fe7fc640 1 -- 172.21.15.73:0/3747796936 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f040015ec90 con 0x7f03ec0678c0 2024-09-12T03:35:40.935 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:40.937 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f03ec0678c0 msgr2=0x7f03ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f03ec0678c0 0x7f03ec069d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f03f8007fd0 tx=0x7f03f8009040 comp rx=0 tx=0).stop 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04001520a0 msgr2=0x7f04000b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04001520a0 0x7f04000b13f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f03f400efc0 tx=0x7f03f400c490 comp rx=0 tx=0).stop 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 shutdown_connections 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f03ec0678c0 0x7f03ec069d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04001520a0 0x7f04000b13f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f040015f1d0 0x7f04000b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 --2- 172.21.15.73:0/3747796936 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400070020 0x7f040014d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 >> 172.21.15.73:0/3747796936 conn(0x7f04000b1f90 msgr2=0x7f0400071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 shutdown_connections 2024-09-12T03:35:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:40.931+0000 7f0407d46640 1 -- 172.21.15.73:0/3747796936 wait complete. 2024-09-12T03:35:40.954 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-12T03:35:39.807827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225092,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749628,"statfs":{"total":773094113280,"available":772863619072,"internally_reserved":0,"allocated":4792320,"data_stored":2720284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002423"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.147397+0000","last_change":"2024-09-12T03:35:32.169010+0000","last_active":"2024-09-12T03:35:33.147397+0000","last_peered":"2024-09-12T03:35:33.147397+0000","last_clean":"2024-09-12T03:35:33.147397+0000","last_became_active":"2024-09-12T03:35:32.168574+0000","last_became_peered":"2024-09-12T03:35:32.168574+0000","last_unstale":"2024-09-12T03:35:33.147397+0000","last_undegraded":"2024-09-12T03:35:33.147397+0000","last_fullsized":"2024-09-12T03:35:33.147397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:00.271066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.146601+0000","last_change":"2024-09-12T03:35:32.157902+0000","last_active":"2024-09-12T03:35:33.146601+0000","last_peered":"2024-09-12T03:35:33.146601+0000","last_clean":"2024-09-12T03:35:33.146601+0000","last_became_active":"2024-09-12T03:35:32.157125+0000","last_became_peered":"2024-09-12T03:35:32.157125+0000","last_unstale":"2024-09-12T03:35:33.146601+0000","last_undegraded":"2024-09-12T03:35:33.146601+0000","last_fullsized":"2024-09-12T03:35:33.146601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:23.227865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108725+0000","last_change":"2024-09-12T03:35:32.199854+0000","last_active":"2024-09-12T03:35:34.108725+0000","last_peered":"2024-09-12T03:35:34.108725+0000","last_clean":"2024-09-12T03:35:34.108725+0000","last_became_active":"2024-09-12T03:35:32.199648+0000","last_became_peered":"2024-09-12T03:35:32.199648+0000","last_unstale":"2024-09-12T03:35:34.108725+0000","last_undegraded":"2024-09-12T03:35:34.108725+0000","last_fullsized":"2024-09-12T03:35:34.108725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:09.700670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180899+0000","last_change":"2024-09-12T03:35:32.176999+0000","last_active":"2024-09-12T03:35:33.180899+0000","last_peered":"2024-09-12T03:35:33.180899+0000","last_clean":"2024-09-12T03:35:33.180899+0000","last_became_active":"2024-09-12T03:35:32.176693+0000","last_became_peered":"2024-09-12T03:35:32.176693+0000","last_unstale":"2024-09-12T03:35:33.180899+0000","last_undegraded":"2024-09-12T03:35:33.180899+0000","last_fullsized":"2024-09-12T03:35:33.180899+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:56.889601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180824+0000","last_change":"2024-09-12T03:35:32.176004+0000","last_active":"2024-09-12T03:35:33.180824+0000","last_peered":"2024-09-12T03:35:33.180824+0000","last_clean":"2024-09-12T03:35:33.180824+0000","last_became_active":"2024-09-12T03:35:32.175743+0000","last_became_peered":"2024-09-12T03:35:32.175743+0000","last_unstale":"2024-09-12T03:35:33.180824+0000","last_undegraded":"2024-09-12T03:35:33.180824+0000","last_fullsized":"2024-09-12T03:35:33.180824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:57.206359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143719+0000","last_change":"2024-09-12T03:35:32.179040+0000","last_active":"2024-09-12T03:35:33.143719+0000","last_peered":"2024-09-12T03:35:33.143719+0000","last_clean":"2024-09-12T03:35:33.143719+0000","last_became_active":"2024-09-12T03:35:32.178776+0000","last_became_peered":"2024-09-12T03:35:32.178776+0000","last_unstale":"2024-09-12T03:35:33.143719+0000","last_undegraded":"2024-09-12T03:35:33.143719+0000","last_fullsized":"2024-09-12T03:35:33.143719+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143463+0000","last_change":"2024-09-12T03:35:32.188889+0000","last_active":"2024-09-12T03:35:33.143463+0000","last_peered":"2024-09-12T03:35:33.143463+0000","last_clean":"2024-09-12T03:35:33.143463+0000","last_became_active":"2024-09-12T03:35:32.188042+0000","last_became_peered":"2024-09-12T03:35:32.188042+0000","last_unstale":"2024-09-12T03:35:33.143463+0000","last_undegraded":"2024-09-12T03:35:33.143463+0000","last_fullsized":"2024-09-12T03:35:33.143463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:57.619032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.145923+0000","last_change":"2024-09-12T03:35:32.162848+0000","last_active":"2024-09-12T03:35:33.145923+0000","last_peered":"2024-09-12T03:35:33.145923+0000","last_clean":"2024-09-12T03:35:33.145923+0000","last_became_active":"2024-09-12T03:35:32.162154+0000","last_became_peered":"2024-09-12T03:35:32.162154+0000","last_unstale":"2024-09-12T03:35:33.145923+0000","last_undegraded":"2024-09-12T03:35:33.145923+0000","last_fullsized":"2024-09-12T03:35:33.145923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108884+0000","last_change":"2024-09-12T03:35:32.198181+0000","last_active":"2024-09-12T03:35:34.108884+0000","last_peered":"2024-09-12T03:35:34.108884+0000","last_clean":"2024-09-12T03:35:34.108884+0000","last_became_active":"2024-09-12T03:35:32.197936+0000","last_became_peered":"2024-09-12T03:35:32.197936+0000","last_unstale":"2024-09-12T03:35:34.108884+0000","last_undegraded":"2024-09-12T03:35:34.108884+0000","last_fullsized":"2024-09-12T03:35:34.108884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:09.789407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.145418+0000","last_change":"2024-09-12T03:35:32.195034+0000","last_active":"2024-09-12T03:35:33.145418+0000","last_peered":"2024-09-12T03:35:33.145418+0000","last_clean":"2024-09-12T03:35:33.145418+0000","last_became_active":"2024-09-12T03:35:32.194309+0000","last_became_peered":"2024-09-12T03:35:32.194309+0000","last_unstale":"2024-09-12T03:35:33.145418+0000","last_undegraded":"2024-09-12T03:35:33.145418+0000","last_fullsized":"2024-09-12T03:35:33.145418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:00.271066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144565+0000","last_change":"2024-09-12T03:35:32.195524+0000","last_active":"2024-09-12T03:35:33.144565+0000","last_peered":"2024-09-12T03:35:33.144565+0000","last_clean":"2024-09-12T03:35:33.144565+0000","last_became_active":"2024-09-12T03:35:32.194818+0000","last_became_peered":"2024-09-12T03:35:32.194818+0000","last_unstale":"2024-09-12T03:35:33.144565+0000","last_undegraded":"2024-09-12T03:35:33.144565+0000","last_fullsized":"2024-09-12T03:35:33.144565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:39.432074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108739+0000","last_change":"2024-09-12T03:35:32.170117+0000","last_active":"2024-09-12T03:35:34.108739+0000","last_peered":"2024-09-12T03:35:34.108739+0000","last_clean":"2024-09-12T03:35:34.108739+0000","last_became_active":"2024-09-12T03:35:32.169485+0000","last_became_peered":"2024-09-12T03:35:32.169485+0000","last_unstale":"2024-09-12T03:35:34.108739+0000","last_undegraded":"2024-09-12T03:35:34.108739+0000","last_fullsized":"2024-09-12T03:35:34.108739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:13.695312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143609+0000","last_change":"2024-09-12T03:35:32.195303+0000","last_active":"2024-09-12T03:35:33.143609+0000","last_peered":"2024-09-12T03:35:33.143609+0000","last_clean":"2024-09-12T03:35:33.143609+0000","last_became_active":"2024-09-12T03:35:32.194596+0000","last_became_peered":"2024-09-12T03:35:32.194596+0000","last_unstale":"2024-09-12T03:35:33.143609+0000","last_undegraded":"2024-09-12T03:35:33.143609+0000","last_fullsized":"2024-09-12T03:35:33.143609+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.106990+0000","last_change":"2024-09-12T03:35:32.180297+0000","last_active":"2024-09-12T03:35:34.106990+0000","last_peered":"2024-09-12T03:35:34.106990+0000","last_clean":"2024-09-12T03:35:34.106990+0000","last_became_active":"2024-09-12T03:35:32.174697+0000","last_became_peered":"2024-09-12T03:35:32.174697+0000","last_unstale":"2024-09-12T03:35:34.106990+0000","last_undegraded":"2024-09-12T03:35:34.106990+0000","last_fullsized":"2024-09-12T03:35:34.106990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:41.567114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143706+0000","last_change":"2024-09-12T03:35:32.170895+0000","last_active":"2024-09-12T03:35:33.143706+0000","last_peered":"2024-09-12T03:35:33.143706+0000","last_clean":"2024-09-12T03:35:33.143706+0000","last_became_active":"2024-09-12T03:35:32.170170+0000","last_became_peered":"2024-09-12T03:35:32.170170+0000","last_unstale":"2024-09-12T03:35:33.143706+0000","last_undegraded":"2024-09-12T03:35:33.143706+0000","last_fullsized":"2024-09-12T03:35:33.143706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:08.061336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108221+0000","last_change":"2024-09-12T03:35:32.213125+0000","last_active":"2024-09-12T03:35:34.108221+0000","last_peered":"2024-09-12T03:35:34.108221+0000","last_clean":"2024-09-12T03:35:34.108221+0000","last_became_active":"2024-09-12T03:35:32.212385+0000","last_became_peered":"2024-09-12T03:35:32.212385+0000","last_unstale":"2024-09-12T03:35:34.108221+0000","last_undegraded":"2024-09-12T03:35:34.108221+0000","last_fullsized":"2024-09-12T03:35:34.108221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:25.029804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.109426+0000","last_change":"2024-09-12T03:35:32.213872+0000","last_active":"2024-09-12T03:35:34.109426+0000","last_peered":"2024-09-12T03:35:34.109426+0000","last_clean":"2024-09-12T03:35:34.109426+0000","last_became_active":"2024-09-12T03:35:32.213105+0000","last_became_peered":"2024-09-12T03:35:32.213105+0000","last_unstale":"2024-09-12T03:35:34.109426+0000","last_undegraded":"2024-09-12T03:35:34.109426+0000","last_fullsized":"2024-09-12T03:35:34.109426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.597190+0000","last_change":"2024-09-12T03:35:32.186911+0000","last_active":"2024-09-12T03:35:33.597190+0000","last_peered":"2024-09-12T03:35:33.597190+0000","last_clean":"2024-09-12T03:35:33.597190+0000","last_became_active":"2024-09-12T03:35:32.186182+0000","last_became_peered":"2024-09-12T03:35:32.186182+0000","last_unstale":"2024-09-12T03:35:33.597190+0000","last_undegraded":"2024-09-12T03:35:33.597190+0000","last_fullsized":"2024-09-12T03:35:33.597190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.920447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180809+0000","last_change":"2024-09-12T03:35:32.173004+0000","last_active":"2024-09-12T03:35:33.180809+0000","last_peered":"2024-09-12T03:35:33.180809+0000","last_clean":"2024-09-12T03:35:33.180809+0000","last_became_active":"2024-09-12T03:35:32.172616+0000","last_became_peered":"2024-09-12T03:35:32.172616+0000","last_unstale":"2024-09-12T03:35:33.180809+0000","last_undegraded":"2024-09-12T03:35:33.180809+0000","last_fullsized":"2024-09-12T03:35:33.180809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:15.137669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.597127+0000","last_change":"2024-09-12T03:35:32.178141+0000","last_active":"2024-09-12T03:35:33.597127+0000","last_peered":"2024-09-12T03:35:33.597127+0000","last_clean":"2024-09-12T03:35:33.597127+0000","last_became_active":"2024-09-12T03:35:32.177341+0000","last_became_peered":"2024-09-12T03:35:32.177341+0000","last_unstale":"2024-09-12T03:35:33.597127+0000","last_undegraded":"2024-09-12T03:35:33.597127+0000","last_fullsized":"2024-09-12T03:35:33.597127+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:13.874593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143758+0000","last_change":"2024-09-12T03:35:32.180618+0000","last_active":"2024-09-12T03:35:33.143758+0000","last_peered":"2024-09-12T03:35:33.143758+0000","last_clean":"2024-09-12T03:35:33.143758+0000","last_became_active":"2024-09-12T03:35:32.179750+0000","last_became_peered":"2024-09-12T03:35:32.179750+0000","last_unstale":"2024-09-12T03:35:33.143758+0000","last_undegraded":"2024-09-12T03:35:33.143758+0000","last_fullsized":"2024-09-12T03:35:33.143758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:28.841687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.107431+0000","last_change":"2024-09-12T03:35:32.175438+0000","last_active":"2024-09-12T03:35:34.107431+0000","last_peered":"2024-09-12T03:35:34.107431+0000","last_clean":"2024-09-12T03:35:34.107431+0000","last_became_active":"2024-09-12T03:35:32.173214+0000","last_became_peered":"2024-09-12T03:35:32.173214+0000","last_unstale":"2024-09-12T03:35:34.107431+0000","last_undegraded":"2024-09-12T03:35:34.107431+0000","last_fullsized":"2024-09-12T03:35:34.107431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108108+0000","last_change":"2024-09-12T03:35:32.178661+0000","last_active":"2024-09-12T03:35:34.108108+0000","last_peered":"2024-09-12T03:35:34.108108+0000","last_clean":"2024-09-12T03:35:34.108108+0000","last_became_active":"2024-09-12T03:35:32.177898+0000","last_became_peered":"2024-09-12T03:35:32.177898+0000","last_unstale":"2024-09-12T03:35:34.108108+0000","last_undegraded":"2024-09-12T03:35:34.108108+0000","last_fullsized":"2024-09-12T03:35:34.108108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180569+0000","last_change":"2024-09-12T03:35:32.175313+0000","last_active":"2024-09-12T03:35:33.180569+0000","last_peered":"2024-09-12T03:35:33.180569+0000","last_clean":"2024-09-12T03:35:33.180569+0000","last_became_active":"2024-09-12T03:35:32.174347+0000","last_became_peered":"2024-09-12T03:35:32.174347+0000","last_unstale":"2024-09-12T03:35:33.180569+0000","last_undegraded":"2024-09-12T03:35:33.180569+0000","last_fullsized":"2024-09-12T03:35:33.180569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:36.673519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.597180+0000","last_change":"2024-09-12T03:35:32.172764+0000","last_active":"2024-09-12T03:35:33.597180+0000","last_peered":"2024-09-12T03:35:33.597180+0000","last_clean":"2024-09-12T03:35:33.597180+0000","last_became_active":"2024-09-12T03:35:32.171987+0000","last_became_peered":"2024-09-12T03:35:32.171987+0000","last_unstale":"2024-09-12T03:35:33.597180+0000","last_undegraded":"2024-09-12T03:35:33.597180+0000","last_fullsized":"2024-09-12T03:35:33.597180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:45.138387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144793+0000","last_change":"2024-09-12T03:35:32.206339+0000","last_active":"2024-09-12T03:35:33.144793+0000","last_peered":"2024-09-12T03:35:33.144793+0000","last_clean":"2024-09-12T03:35:33.144793+0000","last_became_active":"2024-09-12T03:35:32.205847+0000","last_became_peered":"2024-09-12T03:35:32.205847+0000","last_unstale":"2024-09-12T03:35:33.144793+0000","last_undegraded":"2024-09-12T03:35:33.144793+0000","last_fullsized":"2024-09-12T03:35:33.144793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.597444+0000","last_change":"2024-09-12T03:35:32.151966+0000","last_active":"2024-09-12T03:35:33.597444+0000","last_peered":"2024-09-12T03:35:33.597444+0000","last_clean":"2024-09-12T03:35:33.597444+0000","last_became_active":"2024-09-12T03:35:32.151109+0000","last_became_peered":"2024-09-12T03:35:32.151109+0000","last_unstale":"2024-09-12T03:35:33.597444+0000","last_undegraded":"2024-09-12T03:35:33.597444+0000","last_fullsized":"2024-09-12T03:35:33.597444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:21:19.450488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144249+0000","last_change":"2024-09-12T03:35:32.184992+0000","last_active":"2024-09-12T03:35:33.144249+0000","last_peered":"2024-09-12T03:35:33.144249+0000","last_clean":"2024-09-12T03:35:33.144249+0000","last_became_active":"2024-09-12T03:35:32.184163+0000","last_became_peered":"2024-09-12T03:35:32.184163+0000","last_unstale":"2024-09-12T03:35:33.144249+0000","last_undegraded":"2024-09-12T03:35:33.144249+0000","last_fullsized":"2024-09-12T03:35:33.144249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:49.338023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.596849+0000","last_change":"2024-09-12T03:35:32.172973+0000","last_active":"2024-09-12T03:35:33.596849+0000","last_peered":"2024-09-12T03:35:33.596849+0000","last_clean":"2024-09-12T03:35:33.596849+0000","last_became_active":"2024-09-12T03:35:32.172264+0000","last_became_peered":"2024-09-12T03:35:32.172264+0000","last_unstale":"2024-09-12T03:35:33.596849+0000","last_undegraded":"2024-09-12T03:35:33.596849+0000","last_fullsized":"2024-09-12T03:35:33.596849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:24.009330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.596900+0000","last_change":"2024-09-12T03:35:32.151530+0000","last_active":"2024-09-12T03:35:33.596900+0000","last_peered":"2024-09-12T03:35:33.596900+0000","last_clean":"2024-09-12T03:35:33.596900+0000","last_became_active":"2024-09-12T03:35:32.150800+0000","last_became_peered":"2024-09-12T03:35:32.150800+0000","last_unstale":"2024-09-12T03:35:33.596900+0000","last_undegraded":"2024-09-12T03:35:33.596900+0000","last_fullsized":"2024-09-12T03:35:33.596900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:02:21.427692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108176+0000","last_change":"2024-09-12T03:35:32.182587+0000","last_active":"2024-09-12T03:35:34.108176+0000","last_peered":"2024-09-12T03:35:34.108176+0000","last_clean":"2024-09-12T03:35:34.108176+0000","last_became_active":"2024-09-12T03:35:32.181769+0000","last_became_peered":"2024-09-12T03:35:32.181769+0000","last_unstale":"2024-09-12T03:35:34.108176+0000","last_undegraded":"2024-09-12T03:35:34.108176+0000","last_fullsized":"2024-09-12T03:35:34.108176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:26.652792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143809+0000","last_change":"2024-09-12T03:35:32.166893+0000","last_active":"2024-09-12T03:35:33.143809+0000","last_peered":"2024-09-12T03:35:33.143809+0000","last_clean":"2024-09-12T03:35:33.143809+0000","last_became_active":"2024-09-12T03:35:32.166550+0000","last_became_peered":"2024-09-12T03:35:32.166550+0000","last_unstale":"2024-09-12T03:35:33.143809+0000","last_undegraded":"2024-09-12T03:35:33.143809+0000","last_fullsized":"2024-09-12T03:35:33.143809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108687+0000","last_change":"2024-09-12T03:35:32.212944+0000","last_active":"2024-09-12T03:35:34.108687+0000","last_peered":"2024-09-12T03:35:34.108687+0000","last_clean":"2024-09-12T03:35:34.108687+0000","last_became_active":"2024-09-12T03:35:32.212437+0000","last_became_peered":"2024-09-12T03:35:32.212437+0000","last_unstale":"2024-09-12T03:35:34.108687+0000","last_undegraded":"2024-09-12T03:35:34.108687+0000","last_fullsized":"2024-09-12T03:35:34.108687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:23.647203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.597049+0000","last_change":"2024-09-12T03:35:31.153078+0000","last_active":"2024-09-12T03:35:33.597049+0000","last_peered":"2024-09-12T03:35:33.597049+0000","last_clean":"2024-09-12T03:35:33.597049+0000","last_became_active":"2024-09-12T03:35:31.152554+0000","last_became_peered":"2024-09-12T03:35:31.152554+0000","last_unstale":"2024-09-12T03:35:33.597049+0000","last_undegraded":"2024-09-12T03:35:33.597049+0000","last_fullsized":"2024-09-12T03:35:33.597049+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:00.990525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144995+0000","last_change":"2024-09-12T03:35:32.206342+0000","last_active":"2024-09-12T03:35:33.144995+0000","last_peered":"2024-09-12T03:35:33.144995+0000","last_clean":"2024-09-12T03:35:33.144995+0000","last_became_active":"2024-09-12T03:35:32.205885+0000","last_became_peered":"2024-09-12T03:35:32.205885+0000","last_unstale":"2024-09-12T03:35:33.144995+0000","last_undegraded":"2024-09-12T03:35:33.144995+0000","last_fullsized":"2024-09-12T03:35:33.144995+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108335+0000","last_change":"2024-09-12T03:35:31.138504+0000","last_active":"2024-09-12T03:35:34.108335+0000","last_peered":"2024-09-12T03:35:34.108335+0000","last_clean":"2024-09-12T03:35:34.108335+0000","last_became_active":"2024-09-12T03:35:31.138171+0000","last_became_peered":"2024-09-12T03:35:31.138171+0000","last_unstale":"2024-09-12T03:35:34.108335+0000","last_undegraded":"2024-09-12T03:35:34.108335+0000","last_fullsized":"2024-09-12T03:35:34.108335+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:41.792714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108625+0000","last_change":"2024-09-12T03:35:32.174736+0000","last_active":"2024-09-12T03:35:34.108625+0000","last_peered":"2024-09-12T03:35:34.108625+0000","last_clean":"2024-09-12T03:35:34.108625+0000","last_became_active":"2024-09-12T03:35:32.172869+0000","last_became_peered":"2024-09-12T03:35:32.172869+0000","last_unstale":"2024-09-12T03:35:34.108625+0000","last_undegraded":"2024-09-12T03:35:34.108625+0000","last_fullsized":"2024-09-12T03:35:34.108625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.145544+0000","last_change":"2024-09-12T03:35:31.145825+0000","last_active":"2024-09-12T03:35:33.145544+0000","last_peered":"2024-09-12T03:35:33.145544+0000","last_clean":"2024-09-12T03:35:33.145544+0000","last_became_active":"2024-09-12T03:35:31.145486+0000","last_became_peered":"2024-09-12T03:35:31.145486+0000","last_unstale":"2024-09-12T03:35:33.145544+0000","last_undegraded":"2024-09-12T03:35:33.145544+0000","last_fullsized":"2024-09-12T03:35:33.145544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.147336+0000","last_change":"2024-09-12T03:35:32.153193+0000","last_active":"2024-09-12T03:35:33.147336+0000","last_peered":"2024-09-12T03:35:33.147336+0000","last_clean":"2024-09-12T03:35:33.147336+0000","last_became_active":"2024-09-12T03:35:32.152295+0000","last_became_peered":"2024-09-12T03:35:32.152295+0000","last_unstale":"2024-09-12T03:35:33.147336+0000","last_undegraded":"2024-09-12T03:35:33.147336+0000","last_fullsized":"2024-09-12T03:35:33.147336+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:35.016196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.107524+0000","last_change":"2024-09-12T03:35:31.140136+0000","last_active":"2024-09-12T03:35:34.107524+0000","last_peered":"2024-09-12T03:35:34.107524+0000","last_clean":"2024-09-12T03:35:34.107524+0000","last_became_active":"2024-09-12T03:35:31.139504+0000","last_became_peered":"2024-09-12T03:35:31.139504+0000","last_unstale":"2024-09-12T03:35:34.107524+0000","last_undegraded":"2024-09-12T03:35:34.107524+0000","last_fullsized":"2024-09-12T03:35:34.107524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.107992+0000","last_change":"2024-09-12T03:35:32.172616+0000","last_active":"2024-09-12T03:35:34.107992+0000","last_peered":"2024-09-12T03:35:34.107992+0000","last_clean":"2024-09-12T03:35:34.107992+0000","last_became_active":"2024-09-12T03:35:32.172268+0000","last_became_peered":"2024-09-12T03:35:32.172268+0000","last_unstale":"2024-09-12T03:35:34.107992+0000","last_undegraded":"2024-09-12T03:35:34.107992+0000","last_fullsized":"2024-09-12T03:35:34.107992+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:58.920447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143872+0000","last_change":"2024-09-12T03:35:31.122217+0000","last_active":"2024-09-12T03:35:33.143872+0000","last_peered":"2024-09-12T03:35:33.143872+0000","last_clean":"2024-09-12T03:35:33.143872+0000","last_became_active":"2024-09-12T03:35:31.121503+0000","last_became_peered":"2024-09-12T03:35:31.121503+0000","last_unstale":"2024-09-12T03:35:33.143872+0000","last_undegraded":"2024-09-12T03:35:33.143872+0000","last_fullsized":"2024-09-12T03:35:33.143872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:26.735443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143877+0000","last_change":"2024-09-12T03:35:32.180265+0000","last_active":"2024-09-12T03:35:33.143877+0000","last_peered":"2024-09-12T03:35:33.143877+0000","last_clean":"2024-09-12T03:35:33.143877+0000","last_became_active":"2024-09-12T03:35:32.179533+0000","last_became_peered":"2024-09-12T03:35:32.179533+0000","last_unstale":"2024-09-12T03:35:33.143877+0000","last_undegraded":"2024-09-12T03:35:33.143877+0000","last_fullsized":"2024-09-12T03:35:33.143877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:13.638674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108420+0000","last_change":"2024-09-12T03:35:31.155475+0000","last_active":"2024-09-12T03:35:34.108420+0000","last_peered":"2024-09-12T03:35:34.108420+0000","last_clean":"2024-09-12T03:35:34.108420+0000","last_became_active":"2024-09-12T03:35:31.154875+0000","last_became_peered":"2024-09-12T03:35:31.154875+0000","last_unstale":"2024-09-12T03:35:34.108420+0000","last_undegraded":"2024-09-12T03:35:34.108420+0000","last_fullsized":"2024-09-12T03:35:34.108420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.107650+0000","last_change":"2024-09-12T03:35:32.184081+0000","last_active":"2024-09-12T03:35:34.107650+0000","last_peered":"2024-09-12T03:35:34.107650+0000","last_clean":"2024-09-12T03:35:34.107650+0000","last_became_active":"2024-09-12T03:35:32.183424+0000","last_became_peered":"2024-09-12T03:35:32.183424+0000","last_unstale":"2024-09-12T03:35:34.107650+0000","last_undegraded":"2024-09-12T03:35:34.107650+0000","last_fullsized":"2024-09-12T03:35:34.107650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:29.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143497+0000","last_change":"2024-09-12T03:35:31.134300+0000","last_active":"2024-09-12T03:35:33.143497+0000","last_peered":"2024-09-12T03:35:33.143497+0000","last_clean":"2024-09-12T03:35:33.143497+0000","last_became_active":"2024-09-12T03:35:31.133662+0000","last_became_peered":"2024-09-12T03:35:31.133662+0000","last_unstale":"2024-09-12T03:35:33.143497+0000","last_undegraded":"2024-09-12T03:35:33.143497+0000","last_fullsized":"2024-09-12T03:35:33.143497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.146707+0000","last_change":"2024-09-12T03:35:32.176878+0000","last_active":"2024-09-12T03:35:33.146707+0000","last_peered":"2024-09-12T03:35:33.146707+0000","last_clean":"2024-09-12T03:35:33.146707+0000","last_became_active":"2024-09-12T03:35:32.176281+0000","last_became_peered":"2024-09-12T03:35:32.176281+0000","last_unstale":"2024-09-12T03:35:33.146707+0000","last_undegraded":"2024-09-12T03:35:33.146707+0000","last_fullsized":"2024-09-12T03:35:33.146707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:13.638674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.106716+0000","last_change":"2024-09-12T03:35:31.148365+0000","last_active":"2024-09-12T03:35:34.106716+0000","last_peered":"2024-09-12T03:35:34.106716+0000","last_clean":"2024-09-12T03:35:34.106716+0000","last_became_active":"2024-09-12T03:35:31.142740+0000","last_became_peered":"2024-09-12T03:35:31.142740+0000","last_unstale":"2024-09-12T03:35:34.106716+0000","last_undegraded":"2024-09-12T03:35:34.106716+0000","last_fullsized":"2024-09-12T03:35:34.106716+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.181145+0000","last_change":"2024-09-12T03:35:32.176998+0000","last_active":"2024-09-12T03:35:33.181145+0000","last_peered":"2024-09-12T03:35:33.181145+0000","last_clean":"2024-09-12T03:35:33.181145+0000","last_became_active":"2024-09-12T03:35:32.176678+0000","last_became_peered":"2024-09-12T03:35:32.176678+0000","last_unstale":"2024-09-12T03:35:33.181145+0000","last_undegraded":"2024-09-12T03:35:33.181145+0000","last_fullsized":"2024-09-12T03:35:33.181145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:42.029244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.147581+0000","last_change":"2024-09-12T03:35:31.125827+0000","last_active":"2024-09-12T03:35:33.147581+0000","last_peered":"2024-09-12T03:35:33.147581+0000","last_clean":"2024-09-12T03:35:33.147581+0000","last_became_active":"2024-09-12T03:35:31.122580+0000","last_became_peered":"2024-09-12T03:35:31.122580+0000","last_unstale":"2024-09-12T03:35:33.147581+0000","last_undegraded":"2024-09-12T03:35:33.147581+0000","last_fullsized":"2024-09-12T03:35:33.147581+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.109344+0000","last_change":"2024-09-12T03:35:32.198738+0000","last_active":"2024-09-12T03:35:34.109344+0000","last_peered":"2024-09-12T03:35:34.109344+0000","last_clean":"2024-09-12T03:35:34.109344+0000","last_became_active":"2024-09-12T03:35:32.198073+0000","last_became_peered":"2024-09-12T03:35:32.198073+0000","last_unstale":"2024-09-12T03:35:34.109344+0000","last_undegraded":"2024-09-12T03:35:34.109344+0000","last_fullsized":"2024-09-12T03:35:34.109344+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:57.619032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.145153+0000","last_change":"2024-09-12T03:35:31.129565+0000","last_active":"2024-09-12T03:35:33.145153+0000","last_peered":"2024-09-12T03:35:33.145153+0000","last_clean":"2024-09-12T03:35:33.145153+0000","last_became_active":"2024-09-12T03:35:31.128696+0000","last_became_peered":"2024-09-12T03:35:31.128696+0000","last_unstale":"2024-09-12T03:35:33.145153+0000","last_undegraded":"2024-09-12T03:35:33.145153+0000","last_fullsized":"2024-09-12T03:35:33.145153+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:45.696758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108551+0000","last_change":"2024-09-12T03:35:32.173846+0000","last_active":"2024-09-12T03:35:34.108551+0000","last_peered":"2024-09-12T03:35:34.108551+0000","last_clean":"2024-09-12T03:35:34.108551+0000","last_became_active":"2024-09-12T03:35:32.173516+0000","last_became_peered":"2024-09-12T03:35:32.173516+0000","last_unstale":"2024-09-12T03:35:34.108551+0000","last_undegraded":"2024-09-12T03:35:34.108551+0000","last_fullsized":"2024-09-12T03:35:34.108551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:45.261434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144796+0000","last_change":"2024-09-12T03:35:31.120663+0000","last_active":"2024-09-12T03:35:33.144796+0000","last_peered":"2024-09-12T03:35:33.144796+0000","last_clean":"2024-09-12T03:35:33.144796+0000","last_became_active":"2024-09-12T03:35:31.119307+0000","last_became_peered":"2024-09-12T03:35:31.119307+0000","last_unstale":"2024-09-12T03:35:33.144796+0000","last_undegraded":"2024-09-12T03:35:33.144796+0000","last_fullsized":"2024-09-12T03:35:33.144796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108977+0000","last_change":"2024-09-12T03:35:32.181504+0000","last_active":"2024-09-12T03:35:34.108977+0000","last_peered":"2024-09-12T03:35:34.108977+0000","last_clean":"2024-09-12T03:35:34.108977+0000","last_became_active":"2024-09-12T03:35:32.180735+0000","last_became_peered":"2024-09-12T03:35:32.180735+0000","last_unstale":"2024-09-12T03:35:34.108977+0000","last_undegraded":"2024-09-12T03:35:34.108977+0000","last_fullsized":"2024-09-12T03:35:34.108977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:57.467796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.146445+0000","last_change":"2024-09-12T03:35:31.138409+0000","last_active":"2024-09-12T03:35:33.146445+0000","last_peered":"2024-09-12T03:35:33.146445+0000","last_clean":"2024-09-12T03:35:33.146445+0000","last_became_active":"2024-09-12T03:35:31.138039+0000","last_became_peered":"2024-09-12T03:35:31.138039+0000","last_unstale":"2024-09-12T03:35:33.146445+0000","last_undegraded":"2024-09-12T03:35:33.146445+0000","last_fullsized":"2024-09-12T03:35:33.146445+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108016+0000","last_change":"2024-09-12T03:35:32.198369+0000","last_active":"2024-09-12T03:35:34.108016+0000","last_peered":"2024-09-12T03:35:34.108016+0000","last_clean":"2024-09-12T03:35:34.108016+0000","last_became_active":"2024-09-12T03:35:32.197897+0000","last_became_peered":"2024-09-12T03:35:32.197897+0000","last_unstale":"2024-09-12T03:35:34.108016+0000","last_undegraded":"2024-09-12T03:35:34.108016+0000","last_fullsized":"2024-09-12T03:35:34.108016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:21:19.450488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.147347+0000","last_change":"2024-09-12T03:35:31.121034+0000","last_active":"2024-09-12T03:35:33.147347+0000","last_peered":"2024-09-12T03:35:33.147347+0000","last_clean":"2024-09-12T03:35:33.147347+0000","last_became_active":"2024-09-12T03:35:31.120768+0000","last_became_peered":"2024-09-12T03:35:31.120768+0000","last_unstale":"2024-09-12T03:35:33.147347+0000","last_undegraded":"2024-09-12T03:35:33.147347+0000","last_fullsized":"2024-09-12T03:35:33.147347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.146304+0000","last_change":"2024-09-12T03:35:32.168888+0000","last_active":"2024-09-12T03:35:33.146304+0000","last_peered":"2024-09-12T03:35:33.146304+0000","last_clean":"2024-09-12T03:35:33.146304+0000","last_became_active":"2024-09-12T03:35:32.168568+0000","last_became_peered":"2024-09-12T03:35:32.168568+0000","last_unstale":"2024-09-12T03:35:33.146304+0000","last_undegraded":"2024-09-12T03:35:33.146304+0000","last_fullsized":"2024-09-12T03:35:33.146304+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:28.841687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143728+0000","last_change":"2024-09-12T03:35:31.134218+0000","last_active":"2024-09-12T03:35:33.143728+0000","last_peered":"2024-09-12T03:35:33.143728+0000","last_clean":"2024-09-12T03:35:33.143728+0000","last_became_active":"2024-09-12T03:35:31.133767+0000","last_became_peered":"2024-09-12T03:35:31.133767+0000","last_unstale":"2024-09-12T03:35:33.143728+0000","last_undegraded":"2024-09-12T03:35:33.143728+0000","last_fullsized":"2024-09-12T03:35:33.143728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:41.020261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108062+0000","last_change":"2024-09-12T03:35:32.178655+0000","last_active":"2024-09-12T03:35:34.108062+0000","last_peered":"2024-09-12T03:35:34.108062+0000","last_clean":"2024-09-12T03:35:34.108062+0000","last_became_active":"2024-09-12T03:35:32.177875+0000","last_became_peered":"2024-09-12T03:35:32.177875+0000","last_unstale":"2024-09-12T03:35:34.108062+0000","last_undegraded":"2024-09-12T03:35:34.108062+0000","last_fullsized":"2024-09-12T03:35:34.108062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:44.465826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.596579+0000","last_change":"2024-09-12T03:35:31.153900+0000","last_active":"2024-09-12T03:35:33.596579+0000","last_peered":"2024-09-12T03:35:33.596579+0000","last_clean":"2024-09-12T03:35:33.596579+0000","last_became_active":"2024-09-12T03:35:31.152915+0000","last_became_peered":"2024-09-12T03:35:31.152915+0000","last_unstale":"2024-09-12T03:35:33.596579+0000","last_undegraded":"2024-09-12T03:35:33.596579+0000","last_fullsized":"2024-09-12T03:35:33.596579+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:15:45.986853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.146966+0000","last_change":"2024-09-12T03:35:32.169975+0000","last_active":"2024-09-12T03:35:33.146966+0000","last_peered":"2024-09-12T03:35:33.146966+0000","last_clean":"2024-09-12T03:35:33.146966+0000","last_became_active":"2024-09-12T03:35:32.169592+0000","last_became_peered":"2024-09-12T03:35:32.169592+0000","last_unstale":"2024-09-12T03:35:33.146966+0000","last_undegraded":"2024-09-12T03:35:33.146966+0000","last_fullsized":"2024-09-12T03:35:33.146966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:12.883175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108457+0000","last_change":"2024-09-12T03:35:31.154628+0000","last_active":"2024-09-12T03:35:34.108457+0000","last_peered":"2024-09-12T03:35:34.108457+0000","last_clean":"2024-09-12T03:35:34.108457+0000","last_became_active":"2024-09-12T03:35:31.153993+0000","last_became_peered":"2024-09-12T03:35:31.153993+0000","last_unstale":"2024-09-12T03:35:34.108457+0000","last_undegraded":"2024-09-12T03:35:34.108457+0000","last_fullsized":"2024-09-12T03:35:34.108457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:45.967707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.146314+0000","last_change":"2024-09-12T03:35:32.152935+0000","last_active":"2024-09-12T03:35:33.146314+0000","last_peered":"2024-09-12T03:35:33.146314+0000","last_clean":"2024-09-12T03:35:33.146314+0000","last_became_active":"2024-09-12T03:35:32.152123+0000","last_became_peered":"2024-09-12T03:35:32.152123+0000","last_unstale":"2024-09-12T03:35:33.146314+0000","last_undegraded":"2024-09-12T03:35:33.146314+0000","last_fullsized":"2024-09-12T03:35:33.146314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:08.061336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144415+0000","last_change":"2024-09-12T03:35:31.150651+0000","last_active":"2024-09-12T03:35:33.144415+0000","last_peered":"2024-09-12T03:35:33.144415+0000","last_clean":"2024-09-12T03:35:33.144415+0000","last_became_active":"2024-09-12T03:35:31.150087+0000","last_became_peered":"2024-09-12T03:35:31.150087+0000","last_unstale":"2024-09-12T03:35:33.144415+0000","last_undegraded":"2024-09-12T03:35:33.144415+0000","last_fullsized":"2024-09-12T03:35:33.144415+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:08.140254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.145078+0000","last_change":"2024-09-12T03:35:32.180787+0000","last_active":"2024-09-12T03:35:33.145078+0000","last_peered":"2024-09-12T03:35:33.145078+0000","last_clean":"2024-09-12T03:35:33.145078+0000","last_became_active":"2024-09-12T03:35:32.180128+0000","last_became_peered":"2024-09-12T03:35:32.180128+0000","last_unstale":"2024-09-12T03:35:33.145078+0000","last_undegraded":"2024-09-12T03:35:33.145078+0000","last_fullsized":"2024-09-12T03:35:33.145078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:35.016196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108858+0000","last_change":"2024-09-12T03:35:31.148497+0000","last_active":"2024-09-12T03:35:34.108858+0000","last_peered":"2024-09-12T03:35:34.108858+0000","last_clean":"2024-09-12T03:35:34.108858+0000","last_became_active":"2024-09-12T03:35:31.147818+0000","last_became_peered":"2024-09-12T03:35:31.147818+0000","last_unstale":"2024-09-12T03:35:34.108858+0000","last_undegraded":"2024-09-12T03:35:34.108858+0000","last_fullsized":"2024-09-12T03:35:34.108858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:22:33.714402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108261+0000","last_change":"2024-09-12T03:35:32.183482+0000","last_active":"2024-09-12T03:35:34.108261+0000","last_peered":"2024-09-12T03:35:34.108261+0000","last_clean":"2024-09-12T03:35:34.108261+0000","last_became_active":"2024-09-12T03:35:32.175402+0000","last_became_peered":"2024-09-12T03:35:32.175402+0000","last_unstale":"2024-09-12T03:35:34.108261+0000","last_undegraded":"2024-09-12T03:35:34.108261+0000","last_fullsized":"2024-09-12T03:35:34.108261+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:51.611569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180836+0000","last_change":"2024-09-12T03:35:31.137498+0000","last_active":"2024-09-12T03:35:33.180836+0000","last_peered":"2024-09-12T03:35:33.180836+0000","last_clean":"2024-09-12T03:35:33.180836+0000","last_became_active":"2024-09-12T03:35:31.137210+0000","last_became_peered":"2024-09-12T03:35:31.137210+0000","last_unstale":"2024-09-12T03:35:33.180836+0000","last_undegraded":"2024-09-12T03:35:33.180836+0000","last_fullsized":"2024-09-12T03:35:33.180836+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:10.651197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.181061+0000","last_change":"2024-09-12T03:35:32.155601+0000","last_active":"2024-09-12T03:35:33.181061+0000","last_peered":"2024-09-12T03:35:33.181061+0000","last_clean":"2024-09-12T03:35:33.181061+0000","last_became_active":"2024-09-12T03:35:32.153852+0000","last_became_peered":"2024-09-12T03:35:32.153852+0000","last_unstale":"2024-09-12T03:35:33.181061+0000","last_undegraded":"2024-09-12T03:35:33.181061+0000","last_fullsized":"2024-09-12T03:35:33.181061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.229201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144541+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:33.144541+0000","last_peered":"2024-09-12T03:35:33.144541+0000","last_clean":"2024-09-12T03:35:33.144541+0000","last_became_active":"2024-09-12T03:35:31.144611+0000","last_became_peered":"2024-09-12T03:35:31.144611+0000","last_unstale":"2024-09-12T03:35:33.144541+0000","last_undegraded":"2024-09-12T03:35:33.144541+0000","last_fullsized":"2024-09-12T03:35:33.144541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108811+0000","last_change":"2024-09-12T03:35:32.179725+0000","last_active":"2024-09-12T03:35:34.108811+0000","last_peered":"2024-09-12T03:35:34.108811+0000","last_clean":"2024-09-12T03:35:34.108811+0000","last_became_active":"2024-09-12T03:35:32.178924+0000","last_became_peered":"2024-09-12T03:35:32.178924+0000","last_unstale":"2024-09-12T03:35:34.108811+0000","last_undegraded":"2024-09-12T03:35:34.108811+0000","last_fullsized":"2024-09-12T03:35:34.108811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:49.175392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180802+0000","last_change":"2024-09-12T03:35:31.119011+0000","last_active":"2024-09-12T03:35:33.180802+0000","last_peered":"2024-09-12T03:35:33.180802+0000","last_clean":"2024-09-12T03:35:33.180802+0000","last_became_active":"2024-09-12T03:35:31.118692+0000","last_became_peered":"2024-09-12T03:35:31.118692+0000","last_unstale":"2024-09-12T03:35:33.180802+0000","last_undegraded":"2024-09-12T03:35:33.180802+0000","last_fullsized":"2024-09-12T03:35:33.180802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:00.187654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108203+0000","last_change":"2024-09-12T03:35:32.173760+0000","last_active":"2024-09-12T03:35:34.108203+0000","last_peered":"2024-09-12T03:35:34.108203+0000","last_clean":"2024-09-12T03:35:34.108203+0000","last_became_active":"2024-09-12T03:35:32.173436+0000","last_became_peered":"2024-09-12T03:35:32.173436+0000","last_unstale":"2024-09-12T03:35:34.108203+0000","last_undegraded":"2024-09-12T03:35:34.108203+0000","last_fullsized":"2024-09-12T03:35:34.108203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:49.550834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180681+0000","last_change":"2024-09-12T03:35:31.144991+0000","last_active":"2024-09-12T03:35:33.180681+0000","last_peered":"2024-09-12T03:35:33.180681+0000","last_clean":"2024-09-12T03:35:33.180681+0000","last_became_active":"2024-09-12T03:35:31.144591+0000","last_became_peered":"2024-09-12T03:35:31.144591+0000","last_unstale":"2024-09-12T03:35:33.180681+0000","last_undegraded":"2024-09-12T03:35:33.180681+0000","last_fullsized":"2024-09-12T03:35:33.180681+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:00.727172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143841+0000","last_change":"2024-09-12T03:35:32.157200+0000","last_active":"2024-09-12T03:35:33.143841+0000","last_peered":"2024-09-12T03:35:33.143841+0000","last_clean":"2024-09-12T03:35:33.143841+0000","last_became_active":"2024-09-12T03:35:32.155267+0000","last_became_peered":"2024-09-12T03:35:32.155267+0000","last_unstale":"2024-09-12T03:35:33.143841+0000","last_undegraded":"2024-09-12T03:35:33.143841+0000","last_fullsized":"2024-09-12T03:35:33.143841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:23.227865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108357+0000","last_change":"2024-09-12T03:35:31.143758+0000","last_active":"2024-09-12T03:35:34.108357+0000","last_peered":"2024-09-12T03:35:34.108357+0000","last_clean":"2024-09-12T03:35:34.108357+0000","last_became_active":"2024-09-12T03:35:31.143044+0000","last_became_peered":"2024-09-12T03:35:31.143044+0000","last_unstale":"2024-09-12T03:35:34.108357+0000","last_undegraded":"2024-09-12T03:35:34.108357+0000","last_fullsized":"2024-09-12T03:35:34.108357+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:37.907783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.147175+0000","last_change":"2024-09-12T03:35:32.176574+0000","last_active":"2024-09-12T03:35:33.147175+0000","last_peered":"2024-09-12T03:35:33.147175+0000","last_clean":"2024-09-12T03:35:33.147175+0000","last_became_active":"2024-09-12T03:35:32.175869+0000","last_became_peered":"2024-09-12T03:35:32.175869+0000","last_unstale":"2024-09-12T03:35:33.147175+0000","last_undegraded":"2024-09-12T03:35:33.147175+0000","last_fullsized":"2024-09-12T03:35:33.147175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:39.432074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.180593+0000","last_change":"2024-09-12T03:35:31.119437+0000","last_active":"2024-09-12T03:35:33.180593+0000","last_peered":"2024-09-12T03:35:33.180593+0000","last_clean":"2024-09-12T03:35:33.180593+0000","last_became_active":"2024-09-12T03:35:31.118811+0000","last_became_peered":"2024-09-12T03:35:31.118811+0000","last_unstale":"2024-09-12T03:35:33.180593+0000","last_undegraded":"2024-09-12T03:35:33.180593+0000","last_fullsized":"2024-09-12T03:35:33.180593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:05.128401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143794+0000","last_change":"2024-09-12T03:35:32.206219+0000","last_active":"2024-09-12T03:35:33.143794+0000","last_peered":"2024-09-12T03:35:33.143794+0000","last_clean":"2024-09-12T03:35:33.143794+0000","last_became_active":"2024-09-12T03:35:32.205898+0000","last_became_peered":"2024-09-12T03:35:32.205898+0000","last_unstale":"2024-09-12T03:35:33.143794+0000","last_undegraded":"2024-09-12T03:35:33.143794+0000","last_fullsized":"2024-09-12T03:35:33.143794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:14.365350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144783+0000","last_change":"2024-09-12T03:35:31.123519+0000","last_active":"2024-09-12T03:35:33.144783+0000","last_peered":"2024-09-12T03:35:33.144783+0000","last_clean":"2024-09-12T03:35:33.144783+0000","last_became_active":"2024-09-12T03:35:31.122716+0000","last_became_peered":"2024-09-12T03:35:31.122716+0000","last_unstale":"2024-09-12T03:35:33.144783+0000","last_undegraded":"2024-09-12T03:35:33.144783+0000","last_fullsized":"2024-09-12T03:35:33.144783+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:40.558131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.109548+0000","last_change":"2024-09-12T03:35:32.198862+0000","last_active":"2024-09-12T03:35:34.109548+0000","last_peered":"2024-09-12T03:35:34.109548+0000","last_clean":"2024-09-12T03:35:34.109548+0000","last_became_active":"2024-09-12T03:35:32.198370+0000","last_became_peered":"2024-09-12T03:35:32.198370+0000","last_unstale":"2024-09-12T03:35:34.109548+0000","last_undegraded":"2024-09-12T03:35:34.109548+0000","last_fullsized":"2024-09-12T03:35:34.109548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:28.841687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.181058+0000","last_change":"2024-09-12T03:35:31.130491+0000","last_active":"2024-09-12T03:35:33.181058+0000","last_peered":"2024-09-12T03:35:33.181058+0000","last_clean":"2024-09-12T03:35:33.181058+0000","last_became_active":"2024-09-12T03:35:31.130189+0000","last_became_peered":"2024-09-12T03:35:31.130189+0000","last_unstale":"2024-09-12T03:35:33.181058+0000","last_undegraded":"2024-09-12T03:35:33.181058+0000","last_fullsized":"2024-09-12T03:35:33.181058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:35:57.745056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.146993+0000","last_change":"2024-09-12T03:35:32.185743+0000","last_active":"2024-09-12T03:35:33.146993+0000","last_peered":"2024-09-12T03:35:33.146993+0000","last_clean":"2024-09-12T03:35:33.146993+0000","last_became_active":"2024-09-12T03:35:32.185415+0000","last_became_peered":"2024-09-12T03:35:32.185415+0000","last_unstale":"2024-09-12T03:35:33.146993+0000","last_undegraded":"2024-09-12T03:35:33.146993+0000","last_fullsized":"2024-09-12T03:35:33.146993+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:49.338023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108100+0000","last_change":"2024-09-12T03:35:31.120382+0000","last_active":"2024-09-12T03:35:34.108100+0000","last_peered":"2024-09-12T03:35:34.108100+0000","last_clean":"2024-09-12T03:35:34.108100+0000","last_became_active":"2024-09-12T03:35:31.120001+0000","last_became_peered":"2024-09-12T03:35:31.120001+0000","last_unstale":"2024-09-12T03:35:34.108100+0000","last_undegraded":"2024-09-12T03:35:34.108100+0000","last_fullsized":"2024-09-12T03:35:34.108100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:30.545647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108452+0000","last_change":"2024-09-12T03:35:32.179160+0000","last_active":"2024-09-12T03:35:34.108452+0000","last_peered":"2024-09-12T03:35:34.108452+0000","last_clean":"2024-09-12T03:35:34.108452+0000","last_became_active":"2024-09-12T03:35:32.178859+0000","last_became_peered":"2024-09-12T03:35:32.178859+0000","last_unstale":"2024-09-12T03:35:34.108452+0000","last_undegraded":"2024-09-12T03:35:34.108452+0000","last_fullsized":"2024-09-12T03:35:34.108452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:48.413464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108317+0000","last_change":"2024-09-12T03:35:31.124723+0000","last_active":"2024-09-12T03:35:34.108317+0000","last_peered":"2024-09-12T03:35:34.108317+0000","last_clean":"2024-09-12T03:35:34.108317+0000","last_became_active":"2024-09-12T03:35:31.124031+0000","last_became_peered":"2024-09-12T03:35:31.124031+0000","last_unstale":"2024-09-12T03:35:34.108317+0000","last_undegraded":"2024-09-12T03:35:34.108317+0000","last_fullsized":"2024-09-12T03:35:34.108317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:58.532237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.143604+0000","last_change":"2024-09-12T03:35:32.180911+0000","last_active":"2024-09-12T03:35:33.143604+0000","last_peered":"2024-09-12T03:35:33.143604+0000","last_clean":"2024-09-12T03:35:33.143604+0000","last_became_active":"2024-09-12T03:35:32.180601+0000","last_became_peered":"2024-09-12T03:35:32.180601+0000","last_unstale":"2024-09-12T03:35:33.143604+0000","last_undegraded":"2024-09-12T03:35:33.143604+0000","last_fullsized":"2024-09-12T03:35:33.143604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:41.567114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.596612+0000","last_change":"2024-09-12T03:35:31.130478+0000","last_active":"2024-09-12T03:35:33.596612+0000","last_peered":"2024-09-12T03:35:33.596612+0000","last_clean":"2024-09-12T03:35:33.596612+0000","last_became_active":"2024-09-12T03:35:31.129175+0000","last_became_peered":"2024-09-12T03:35:31.129175+0000","last_unstale":"2024-09-12T03:35:33.596612+0000","last_undegraded":"2024-09-12T03:35:33.596612+0000","last_fullsized":"2024-09-12T03:35:33.596612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:13.903223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.107005+0000","last_change":"2024-09-12T03:35:32.174912+0000","last_active":"2024-09-12T03:35:34.107005+0000","last_peered":"2024-09-12T03:35:34.107005+0000","last_clean":"2024-09-12T03:35:34.107005+0000","last_became_active":"2024-09-12T03:35:32.173337+0000","last_became_peered":"2024-09-12T03:35:32.173337+0000","last_unstale":"2024-09-12T03:35:34.107005+0000","last_undegraded":"2024-09-12T03:35:34.107005+0000","last_fullsized":"2024-09-12T03:35:34.107005+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:20.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.106904+0000","last_change":"2024-09-12T03:35:31.141781+0000","last_active":"2024-09-12T03:35:34.106904+0000","last_peered":"2024-09-12T03:35:34.106904+0000","last_clean":"2024-09-12T03:35:34.106904+0000","last_became_active":"2024-09-12T03:35:31.139547+0000","last_became_peered":"2024-09-12T03:35:31.139547+0000","last_unstale":"2024-09-12T03:35:34.106904+0000","last_undegraded":"2024-09-12T03:35:34.106904+0000","last_fullsized":"2024-09-12T03:35:34.106904+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:52.220219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.109524+0000","last_change":"2024-09-12T03:35:32.200175+0000","last_active":"2024-09-12T03:35:34.109524+0000","last_peered":"2024-09-12T03:35:34.109524+0000","last_clean":"2024-09-12T03:35:34.109524+0000","last_became_active":"2024-09-12T03:35:32.199519+0000","last_became_peered":"2024-09-12T03:35:32.199519+0000","last_unstale":"2024-09-12T03:35:34.109524+0000","last_undegraded":"2024-09-12T03:35:34.109524+0000","last_fullsized":"2024-09-12T03:35:34.109524+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:08.061336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.145905+0000","last_change":"2024-09-12T03:35:31.125839+0000","last_active":"2024-09-12T03:35:33.145905+0000","last_peered":"2024-09-12T03:35:33.145905+0000","last_clean":"2024-09-12T03:35:33.145905+0000","last_became_active":"2024-09-12T03:35:31.122726+0000","last_became_peered":"2024-09-12T03:35:31.122726+0000","last_unstale":"2024-09-12T03:35:33.145905+0000","last_undegraded":"2024-09-12T03:35:33.145905+0000","last_fullsized":"2024-09-12T03:35:33.145905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:14.152851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:33.144171+0000","last_change":"2024-09-12T03:35:32.189144+0000","last_active":"2024-09-12T03:35:33.144171+0000","last_peered":"2024-09-12T03:35:33.144171+0000","last_clean":"2024-09-12T03:35:33.144171+0000","last_became_active":"2024-09-12T03:35:32.188402+0000","last_became_peered":"2024-09-12T03:35:32.188402+0000","last_unstale":"2024-09-12T03:35:33.144171+0000","last_undegraded":"2024-09-12T03:35:33.144171+0000","last_fullsized":"2024-09-12T03:35:33.144171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:31.096181+0000","last_clean_scrub_stamp":"2024-09-12T03:35:31.096181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:12.883175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.109084+0000","last_change":"2024-09-12T03:35:31.147449+0000","last_active":"2024-09-12T03:35:34.109084+0000","last_peered":"2024-09-12T03:35:34.109084+0000","last_clean":"2024-09-12T03:35:34.109084+0000","last_became_active":"2024-09-12T03:35:31.146800+0000","last_became_peered":"2024-09-12T03:35:31.146800+0000","last_unstale":"2024-09-12T03:35:34.109084+0000","last_undegraded":"2024-09-12T03:35:34.109084+0000","last_fullsized":"2024-09-12T03:35:34.109084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:35:30.087198+0000","last_clean_scrub_stamp":"2024-09-12T03:35:30.087198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:51.274026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":201,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T03:35:34.108697+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:35:34.108697+0000","last_peered":"2024-09-12T03:35:34.108697+0000","last_clean":"2024-09-12T03:35:34.108697+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:35:34.108697+0000","last_undegraded":"2024-09-12T03:35:34.108697+0000","last_fullsized":"2024-09-12T03:35:34.108697+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1052672,"data_stored":783891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":191953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":192445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":458752,"data_stored":193487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":191911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":446464,"data_stored":191931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":446464,"data_stored":192423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1040384,"data_stored":782243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:35:40.962 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:35:40.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T03:35:41.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f3875bfb640 1 Processor -- start 2024-09-12T03:35:41.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f3875bfb640 1 -- start start 2024-09-12T03:35:41.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f3875bfb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3870073100 0x7f38700cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f3875bfb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f38700cdfd0 0x7f387006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f3875bfb640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38700ce8d0 con 0x7f38700cc870 2024-09-12T03:35:41.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f3875bfb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f38700cebb0 con 0x7f38700cdfd0 2024-09-12T03:35:41.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f3875bfb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f38700cee90 con 0x7f3870073100 2024-09-12T03:35:41.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386effd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3870073100 0x7f38700cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386ffff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f38700cdfd0 0x7f387006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386effd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3870073100 0x7f38700cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:36428/0 (socket says 172.21.15.73:36428) 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386effd640 1 -- 172.21.15.73:0/1414391350 learned_addr learned my addr 172.21.15.73:0/1414391350 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386effd640 1 -- 172.21.15.73:0/1414391350 >> v2:172.21.15.150:3300/0 conn(0x7f38700cdfd0 msgr2=0x7f387006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386effd640 1 --2- 172.21.15.73:0/1414391350 >> v2:172.21.15.150:3300/0 conn(0x7f38700cdfd0 0x7f387006de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386effd640 1 -- 172.21.15.73:0/1414391350 >> v1:172.21.15.150:6789/0 conn(0x7f38700cc870 legacy=0x7f38700ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386effd640 1 -- 172.21.15.73:0/1414391350 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38700cf170 con 0x7f3870073100 2024-09-12T03:35:41.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.127+0000 7f386ffff640 1 --2- 172.21.15.73:0/1414391350 >> v2:172.21.15.150:3300/0 conn(0x7f38700cdfd0 0x7f387006de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:35:41.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f386effd640 1 --2- 172.21.15.73:0/1414391350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3870073100 0x7f38700cf970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3860009870 tx=0x7f386001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7dccedea3b3b9d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:41.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f386e7fc640 1 -- 172.21.15.73:0/1414391350 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600a9610 con 0x7f3870073100 2024-09-12T03:35:41.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f386e7fc640 1 -- 172.21.15.73:0/1414391350 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38600a97b0 con 0x7f3870073100 2024-09-12T03:35:41.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f386e7fc640 1 -- 172.21.15.73:0/1414391350 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600a9b80 con 0x7f3870073100 2024-09-12T03:35:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 -- 172.21.15.73:0/1414391350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3870073100 msgr2=0x7f38700cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 --2- 172.21.15.73:0/1414391350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3870073100 0x7f38700cf970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3860009870 tx=0x7f386001c530 comp rx=0 tx=0).stop 2024-09-12T03:35:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 -- 172.21.15.73:0/1414391350 shutdown_connections 2024-09-12T03:35:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 --2- 172.21.15.73:0/1414391350 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3870073100 0x7f38700cf970 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 --2- 172.21.15.73:0/1414391350 >> v2:172.21.15.150:3300/0 conn(0x7f38700cdfd0 0x7f387006de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 -- 172.21.15.73:0/1414391350 >> 172.21.15.73:0/1414391350 conn(0x7f38700b1c80 msgr2=0x7f38700b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:41.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 -- 172.21.15.73:0/1414391350 shutdown_connections 2024-09-12T03:35:41.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.131+0000 7f3875bfb640 1 -- 172.21.15.73:0/1414391350 wait complete. 2024-09-12T03:35:41.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 Processor -- start 2024-09-12T03:35:41.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 -- start start 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3870073100 0x7f38701424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38700cc870 0x7f387015f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38700cdfd0 0x7f387015fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f38700b3490 con 0x7f3870073100 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f38700b3310 con 0x7f38700cc870 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f38700b3610 con 0x7f38700cdfd0 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3870073100 0x7f38701424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3870073100 0x7f38701424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49718/0 (socket says 172.21.15.73:49718) 2024-09-12T03:35:41.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 -- 172.21.15.73:0/462583808 learned_addr learned my addr 172.21.15.73:0/462583808 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386ffff640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38700cdfd0 0x7f387015fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386effd640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38700cc870 0x7f387015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 -- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38700cdfd0 msgr2=0x7f387015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38700cdfd0 0x7f387015fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 -- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38700cc870 msgr2=0x7f387015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38700cc870 0x7f387015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 -- 172.21.15.73:0/462583808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387015d3c0 con 0x7f3870073100 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f386f7fe640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3870073100 0x7f38701424f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f385800c450 tx=0x7f385800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3867fff640 1 -- 172.21.15.73:0/462583808 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858016020 con 0x7f3870073100 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3867fff640 1 -- 172.21.15.73:0/462583808 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38580052d0 con 0x7f3870073100 2024-09-12T03:35:41.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387009d230 con 0x7f3870073100 2024-09-12T03:35:41.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3867fff640 1 -- 172.21.15.73:0/462583808 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3858007260 con 0x7f3870073100 2024-09-12T03:35:41.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.135+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387009d7f0 con 0x7f3870073100 2024-09-12T03:35:41.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.139+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f387015d590 con 0x7f3870073100 2024-09-12T03:35:41.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.139+0000 7f3867fff640 1 -- 172.21.15.73:0/462583808 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3858007400 con 0x7f3870073100 2024-09-12T03:35:41.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.139+0000 7f3867fff640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3850067920 0x7f3850069de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.139+0000 7f386effd640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3850067920 0x7f3850069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.139+0000 7f3867fff640 1 -- 172.21.15.73:0/462583808 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3858085750 con 0x7f3870073100 2024-09-12T03:35:41.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.139+0000 7f386effd640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3850067920 0x7f3850069de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38600ae000 tx=0x7f38600b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:41.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.143+0000 7f3867fff640 1 -- 172.21.15.73:0/462583808 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3858020020 con 0x7f3870073100 2024-09-12T03:35:41.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.351+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f38700af8d0 con 0x7f3870073100 2024-09-12T03:35:41.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.355+0000 7f3867fff640 1 -- 172.21.15.73:0/462583808 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f3858005480 con 0x7f3870073100 2024-09-12T03:35:41.362 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T03:35:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:35:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-09-12T03:35:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-09-12T03:35:41.362 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T03:35:41.362 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3850067920 msgr2=0x7f3850069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3850067920 0x7f3850069de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38600ae000 tx=0x7f38600b3040 comp rx=0 tx=0).stop 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3870073100 msgr2=0x7f38701424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3870073100 0x7f38701424f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f385800c450 tx=0x7f385800c910 comp rx=0 tx=0).stop 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 shutdown_connections 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3850067920 0x7f3850069de0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38700cdfd0 0x7f387015fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38700cc870 0x7f387015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 --2- 172.21.15.73:0/462583808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3870073100 0x7f38701424f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 >> 172.21.15.73:0/462583808 conn(0x7f38700b1c80 msgr2=0x7f38700b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 shutdown_connections 2024-09-12T03:35:41.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.359+0000 7f3875bfb640 1 -- 172.21.15.73:0/462583808 wait complete. 2024-09-12T03:35:41.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc57a181640 1 Processor -- start 2024-09-12T03:35:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc57a181640 1 -- start start 2024-09-12T03:35:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc57a181640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 0x7fc5740ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc57a181640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc57415c2a0 0x7fc5740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc57a181640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5740b3290 con 0x7fc5740af2a0 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc57a181640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc5740b3570 con 0x7fc57415c2a0 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc57a181640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc5740b3850 con 0x7fc57415bec0 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc57415c2a0 0x7fc5740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc57415c2a0 0x7fc5740aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49720/0 (socket says 172.21.15.73:49720) 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 -- 172.21.15.73:0/4066386357 learned_addr learned my addr 172.21.15.73:0/4066386357 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc573fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc5740af2a0 0x7fc57415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58972/0 (socket says 172.21.15.73:58972) 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc5737fe640 1 --2- 172.21.15.73:0/4066386357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 0x7fc5740ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 -- 172.21.15.73:0/4066386357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 msgr2=0x7fc5740ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 --2- 172.21.15.73:0/4066386357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 0x7fc5740ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 -- 172.21.15.73:0/4066386357 >> v1:172.21.15.73:6789/0 conn(0x7fc5740af2a0 legacy=0x7fc57415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 -- 172.21.15.73:0/4066386357 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5740b3b30 con 0x7fc57415c2a0 2024-09-12T03:35:41.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc572ffd640 1 --2- 172.21.15.73:0/4066386357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5740aed60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009e50 tx=0x7fc56c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1849493185a3d75f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:41.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.491+0000 7fc5727fc640 1 -- 172.21.15.73:0/4066386357 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0a58d0 con 0x7fc57415c2a0 2024-09-12T03:35:41.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc5727fc640 1 -- 172.21.15.73:0/4066386357 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c0a5a70 con 0x7fc57415c2a0 2024-09-12T03:35:41.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc5727fc640 1 -- 172.21.15.73:0/4066386357 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0a5e40 con 0x7fc57415c2a0 2024-09-12T03:35:41.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- 172.21.15.73:0/4066386357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 msgr2=0x7fc5740aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 --2- 172.21.15.73:0/4066386357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5740aed60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009e50 tx=0x7fc56c01ca00 comp rx=0 tx=0).stop 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- 172.21.15.73:0/4066386357 shutdown_connections 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 --2- 172.21.15.73:0/4066386357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5740aed60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 --2- 172.21.15.73:0/4066386357 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 0x7fc5740ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- 172.21.15.73:0/4066386357 >> 172.21.15.73:0/4066386357 conn(0x7fc5740b1f90 msgr2=0x7fc5740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- 172.21.15.73:0/4066386357 shutdown_connections 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- 172.21.15.73:0/4066386357 wait complete. 2024-09-12T03:35:41.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 Processor -- start 2024-09-12T03:35:41.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- start start 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5740af2a0 0x7fc57415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 0x7fc574146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5741f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740af6b0 con 0x7fc57415c2a0 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc5740ad740 con 0x7fc5740af2a0 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc57a181640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc574169000 con 0x7fc57415bec0 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5741f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5741f7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49730/0 (socket says 172.21.15.73:49730) 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 -- 172.21.15.73:0/2397434806 learned_addr learned my addr 172.21.15.73:0/2397434806 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc5737fe640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5740af2a0 0x7fc57415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 -- 172.21.15.73:0/2397434806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 msgr2=0x7fc574146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 0x7fc574146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 -- 172.21.15.73:0/2397434806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5740af2a0 msgr2=0x7fc57415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5740af2a0 0x7fc57415b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 -- 172.21.15.73:0/2397434806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc574146bd0 con 0x7fc57415c2a0 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc573fff640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5741f7350 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c410 tx=0x7fc56400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc55bfff640 1 -- 172.21.15.73:0/2397434806 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5640074e0 con 0x7fc57415c2a0 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc55bfff640 1 -- 172.21.15.73:0/2397434806 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc564007680 con 0x7fc57415c2a0 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.495+0000 7fc55bfff640 1 -- 172.21.15.73:0/2397434806 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564004a10 con 0x7fc57415c2a0 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57415a1d0 con 0x7fc57415c2a0 2024-09-12T03:35:41.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57415a790 con 0x7fc57415c2a0 2024-09-12T03:35:41.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5740ad200 con 0x7fc57415c2a0 2024-09-12T03:35:41.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc55bfff640 1 -- 172.21.15.73:0/2397434806 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc56401a020 con 0x7fc57415c2a0 2024-09-12T03:35:41.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc55bfff640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc5600678c0 0x7fc560069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:41.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc55bfff640 1 -- 172.21.15.73:0/2397434806 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc5640855a0 con 0x7fc57415c2a0 2024-09-12T03:35:41.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc5737fe640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc5600678c0 0x7fc560069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:41.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.499+0000 7fc5737fe640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc5600678c0 0x7fc560069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc56800b800 tx=0x7fc568008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:41.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.503+0000 7fc55bfff640 1 -- 172.21.15.73:0/2397434806 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc564055fe0 con 0x7fc57415c2a0 2024-09-12T03:35:41.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.699+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc57406fcd0 con 0x7fc57415c2a0 2024-09-12T03:35:41.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.699+0000 7fc55bfff640 1 -- 172.21.15.73:0/2397434806 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7fc56405ae20 con 0x7fc57415c2a0 2024-09-12T03:35:41.707 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:41.707 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"btime":"2024-09-12T03:35:35:181396+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4171638220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4171638220},{"type":"v1","addr":"172.21.15.150:6834","nonce":4171638220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/586996144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":586996144},{"type":"v1","addr":"172.21.15.150:6835","nonce":586996144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4854,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1039518252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1039518252},{"type":"v1","addr":"172.21.15.73:6835","nonce":1039518252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:35:31.472966+0000","modified":"2024-09-12T03:35:34.542272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/1768372387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1768372387},{"type":"v1","addr":"172.21.15.73:6837","nonce":1768372387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-12T03:35:41.707 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc5600678c0 msgr2=0x7fc560069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc5600678c0 0x7fc560069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc56800b800 tx=0x7fc568008040 comp rx=0 tx=0).stop 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 msgr2=0x7fc5741f7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5741f7350 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c410 tx=0x7fc56400c8d0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 shutdown_connections 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc5600678c0 0x7fc560069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57415c2a0 0x7fc5741f7350 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc57415bec0 0x7fc574146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 --2- 172.21.15.73:0/2397434806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5740af2a0 0x7fc57415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:41.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 >> 172.21.15.73:0/2397434806 conn(0x7fc5740b1f90 msgr2=0x7fc574158320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:41.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 shutdown_connections 2024-09-12T03:35:41.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:41.703+0000 7fc57a181640 1 -- 172.21.15.73:0/2397434806 wait complete. 2024-09-12T03:35:42.129 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:35:31.472966+0000', 'modified': '2024-09-12T03:35:34.542272+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4857}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4857': {'gid': 4857, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/1768372387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 1768372387}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 1768372387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4857, 'qdb_cluster': [4857]} 2024-09-12T03:35:42.129 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:35:42.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T03:35:42.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8893914640 1 Processor -- start 2024-09-12T03:35:42.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8893914640 1 -- start start 2024-09-12T03:35:42.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8893914640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c1567e0 0x7f888c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8893914640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f888c0b3c40 0x7f888c15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8893914640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f888c0b4620 con 0x7f888c0b40a0 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8893914640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f888c0b4900 con 0x7f888c0b3c40 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8893914640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f888c0b4be0 con 0x7f888c1567e0 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8890eaf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f888c0b3c40 0x7f888c15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8890eaf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f888c0b3c40 0x7f888c15fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49734/0 (socket says 172.21.15.73:49734) 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8890eaf640 1 -- 172.21.15.73:0/976016174 learned_addr learned my addr 172.21.15.73:0/976016174 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f88916b0640 1 --2- 172.21.15.73:0/976016174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c1567e0 0x7f888c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8890eaf640 1 -- 172.21.15.73:0/976016174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c1567e0 msgr2=0x7f888c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8890eaf640 1 --2- 172.21.15.73:0/976016174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c1567e0 0x7f888c0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8890eaf640 1 -- 172.21.15.73:0/976016174 >> v1:172.21.15.150:6789/0 conn(0x7f888c0b40a0 legacy=0x7f888c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.259+0000 7f8890eaf640 1 -- 172.21.15.73:0/976016174 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c0b4ec0 con 0x7f888c0b3c40 2024-09-12T03:35:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8890eaf640 1 --2- 172.21.15.73:0/976016174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c15fd50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f887c009870 tx=0x7f887c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaaf6fa71cf59fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8883fff640 1 -- 172.21.15.73:0/976016174 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0b0070 con 0x7f888c0b3c40 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8883fff640 1 -- 172.21.15.73:0/976016174 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c0ab600 con 0x7f888c0b3c40 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8883fff640 1 -- 172.21.15.73:0/976016174 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0ab9d0 con 0x7f888c0b3c40 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- 172.21.15.73:0/976016174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 msgr2=0x7f888c15fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 --2- 172.21.15.73:0/976016174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c15fd50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f887c009870 tx=0x7f887c01c460 comp rx=0 tx=0).stop 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- 172.21.15.73:0/976016174 shutdown_connections 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 --2- 172.21.15.73:0/976016174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c15fd50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 --2- 172.21.15.73:0/976016174 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c1567e0 0x7f888c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- 172.21.15.73:0/976016174 >> 172.21.15.73:0/976016174 conn(0x7f888c073580 msgr2=0x7f888c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- 172.21.15.73:0/976016174 shutdown_connections 2024-09-12T03:35:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- 172.21.15.73:0/976016174 wait complete. 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 Processor -- start 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- start start 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c0b40a0 0x7f888c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888c1567e0 0x7f888c1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f888c1609d0 con 0x7f888c0b3c40 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f888c0b5c00 con 0x7f888c1567e0 2024-09-12T03:35:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8893914640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f888c160b50 con 0x7f888c0b40a0 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c1474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49750/0 (socket says 172.21.15.73:49750) 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 -- 172.21.15.73:0/59568789 learned_addr learned my addr 172.21.15.73:0/59568789 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8890eaf640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c0b40a0 0x7f888c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f8891eb1640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888c1567e0 0x7f888c1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 -- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c0b40a0 msgr2=0x7f888c154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c0b40a0 0x7f888c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 -- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888c1567e0 msgr2=0x7f888c1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888c1567e0 0x7f888c1554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.263+0000 7f88916b0640 1 -- 172.21.15.73:0/59568789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c06e9e0 con 0x7f888c0b3c40 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88916b0640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c1474d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f888800cd20 tx=0x7f888800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8881ffb640 1 -- 172.21.15.73:0/59568789 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880039a0 con 0x7f888c0b3c40 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8881ffb640 1 -- 172.21.15.73:0/59568789 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888003b40 con 0x7f888c0b3c40 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888c148aa0 con 0x7f888c0b3c40 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8881ffb640 1 -- 172.21.15.73:0/59568789 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888004020 con 0x7f888c0b3c40 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f888c06ec80 con 0x7f888c0b3c40 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8881ffb640 1 -- 172.21.15.73:0/59568789 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88880041c0 con 0x7f888c0b3c40 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8881ffb640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88700678c0 0x7f8870069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8881ffb640 1 -- 172.21.15.73:0/59568789 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f88880862e0 con 0x7f888c0b3c40 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8890eaf640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88700678c0 0x7f8870069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8890eaf640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88700678c0 0x7f8870069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f887c0ad000 tx=0x7f887c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 Processor -- start 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 -- start start 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a9273aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273af290 0x55a9273af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a927296b60 con 0x55a9273f9440 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a9271fdc70 con 0x55a9273f8b20 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55a9271a3ed0 con 0x55a9273af290 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8890eaf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a9273aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8890eaf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a9273aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49758/0 (socket says 172.21.15.73:49758) 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.267+0000 7f8890eaf640 1 -- 172.21.15.73:0/4169991494 learned_addr learned my addr 172.21.15.73:0/4169991494 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88916b0640 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8890eaf640 1 -- 172.21.15.73:0/4169991494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273af290 msgr2=0x55a9273af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8890eaf640 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273af290 0x55a9273af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8890eaf640 1 -- 172.21.15.73:0/4169991494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 msgr2=0x55a9273f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8890eaf640 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8890eaf640 1 -- 172.21.15.73:0/4169991494 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9271b5e50 con 0x55a9273f9440 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8890eaf640 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a9273aed50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f887c000c10 tx=0x7f887c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e751641b86c06f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8876ffd640 1 -- 172.21.15.73:0/4169991494 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0c6070 con 0x55a9273f9440 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8876ffd640 1 -- 172.21.15.73:0/4169991494 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c0abdf0 con 0x55a9273f9440 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8876ffd640 1 -- 172.21.15.73:0/4169991494 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0b0040 con 0x55a9273f9440 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- 172.21.15.73:0/4169991494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 msgr2=0x55a9273aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a9273aed50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f887c000c10 tx=0x7f887c004740 comp rx=0 tx=0).stop 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- 172.21.15.73:0/4169991494 shutdown_connections 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a9273aed50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273af290 0x55a9273af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 --2- 172.21.15.73:0/4169991494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- 172.21.15.73:0/4169991494 >> 172.21.15.73:0/4169991494 conn(0x55a9273b5600 msgr2=0x55a9273ad630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- 172.21.15.73:0/4169991494 shutdown_connections 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- 172.21.15.73:0/4169991494 wait complete. 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- start start 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 Processor -- start 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 0x55a9273b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a92725fb00 con 0x55a9273b4390 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a9271d8360 con 0x55a9273f8b20 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55a9271d52d0 con 0x55a9273f9440 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 10 client.0 _ll_register_callbacks cb 0x55a92739a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273ba230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49772/0 (socket says 172.21.15.73:49772) 2024-09-12T03:35:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 -- 172.21.15.73:0/2855241419 learned_addr learned my addr 172.21.15.73:0/2855241419 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88916b0640 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8890eaf640 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 0x55a9273b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 -- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 msgr2=0x55a9273b9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 0x55a9273b9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 -- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 msgr2=0x55a9273b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273b3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 -- 172.21.15.73:0/2855241419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9271a4120 con 0x55a9273b4390 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f8891eb1640 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273ba230 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8884005420 tx=0x7f888400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a00afaade19b1f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f886bfff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f886bfff640 1 -- 172.21.15.73:0/2855241419 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884016030 con 0x55a9273b4390 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f886bfff640 1 -- 172.21.15.73:0/2855241419 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8884003870 con 0x55a9273b4390 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f887c0abdf0 con 0x55a9273b4390 2024-09-12T03:35:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f886bfff640 1 -- 172.21.15.73:0/2855241419 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f888401f050 con 0x55a9273b4390 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 10 client.5055 fetch_fsmap learned FSMap version 17 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a92719d450 con 0x55a9273b4390 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f886bfff640 1 -- 172.21.15.73:0/2855241419 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c0abdf0 con 0x55a9273b4390 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f886bfff640 1 -- 172.21.15.73:0/2855241419 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f8884022020 con 0x55a9273b4390 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 10 client.5055 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.271+0000 7f88969d0000 10 client.5055 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 20 client.5055 populate_metadata read hostname 'smithi073' 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a927407280 0x55a927409670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 4 client.5055 mds_command: new command op to 4857 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 --> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a927197c00 con 0x55a927407280 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88916b0640 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a927407280 0x55a927409670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88916b0640 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a927407280 0x55a927409670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f5a512607cf8bc server_cookie=cfe18277fcf68469 in_seq=0 out_seq=0 2024-09-12T03:35:42.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f886bfff640 10 client.5055 ms_handle_connect on v2:172.21.15.73:6836/1768372387 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f886bfff640 1 -- 172.21.15.73:0/2855241419 <== mds.0 v2:172.21.15.73:6836/1768372387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a927197c00 con 0x55a927407280 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f886bfff640 10 client.5055 handle_command_reply: tid=0 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 client.5055 shutdown 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 msgr2=0x55a9273ba230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273ba230 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8884005420 tx=0x7f888400d520 comp rx=0 tx=0).stop 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 shutdown_connections 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273ba230 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a927407280 0x55a927409670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 0x55a9273b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f886bfff640 0 client.5055 ms_handle_reset on v2:172.21.15.73:6836/1768372387 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 --2- 172.21.15.73:0/2855241419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 >> 172.21.15.73:0/2855241419 conn(0x55a9273af290 msgr2=0x55a9273add40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 shutdown_connections 2024-09-12T03:35:42.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 1 -- 172.21.15.73:0/2855241419 wait complete. 2024-09-12T03:35:42.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.275+0000 7f88969d0000 20 client.5055 trim_cache size 0 max 16384 2024-09-12T03:35:42.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 Processor -- start 2024-09-12T03:35:42.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 -- start start 2024-09-12T03:35:42.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273f8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 0x55a927409670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f888c2035b0 con 0x55a9273b4390 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f888c06ff80 con 0x55a9273f8b20 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f888c202f90 con 0x55a9273f9440 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88916b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88916b0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273f7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49788/0 (socket says 172.21.15.73:49788) 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.291+0000 7f88916b0640 1 -- 172.21.15.73:0/3800239373 learned_addr learned my addr 172.21.15.73:0/3800239373 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 -- 172.21.15.73:0/3800239373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 msgr2=0x55a927409670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 --2- 172.21.15.73:0/3800239373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 0x55a927409670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 -- 172.21.15.73:0/3800239373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 msgr2=0x55a9273f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 --2- 172.21.15.73:0/3800239373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 -- 172.21.15.73:0/3800239373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a927184fd0 con 0x55a9273b4390 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 --2- 172.21.15.73:0/3800239373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273f7cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88880565b0 tx=0x7f888801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218a4d93f7ad8cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88767fc640 1 -- 172.21.15.73:0/3800239373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888072070 con 0x55a9273b4390 2024-09-12T03:35:42.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88767fc640 1 -- 172.21.15.73:0/3800239373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888805f200 con 0x55a9273b4390 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88767fc640 1 -- 172.21.15.73:0/3800239373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888801d040 con 0x55a9273b4390 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/3800239373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 msgr2=0x55a9273f7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- 172.21.15.73:0/3800239373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273f7cf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88880565b0 tx=0x7f888801a040 comp rx=0 tx=0).stop 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/3800239373 shutdown_connections 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- 172.21.15.73:0/3800239373 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f9440 0x55a927409670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- 172.21.15.73:0/3800239373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273f8b20 0x55a9273f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- 172.21.15.73:0/3800239373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273b4390 0x55a9273f7cf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/3800239373 >> 172.21.15.73:0/3800239373 conn(0x55a9273af290 msgr2=0x55a9273b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/3800239373 shutdown_connections 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/3800239373 wait complete. 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- start start 2024-09-12T03:35:42.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 Processor -- start 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273b4390 0x55a92740c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f8b20 0x55a927427960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a927427ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a9271fcf80 con 0x55a9273f9440 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55a9271b5ca0 con 0x55a9273b4390 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55a9272022a0 con 0x55a9273f8b20 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 10 client.0 _ll_register_callbacks cb 0x7f8884007c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:35:42.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a927427ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a927427ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49800/0 (socket says 172.21.15.73:49800) 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 -- 172.21.15.73:0/1737472065 learned_addr learned my addr 172.21.15.73:0/1737472065 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273b4390 0x55a92740c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8890eaf640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f8b20 0x55a927427960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 -- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f8b20 msgr2=0x55a927427960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f8b20 0x55a927427960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 -- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273b4390 msgr2=0x55a92740c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273b4390 0x55a92740c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 -- 172.21.15.73:0/1737472065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a927280750 con 0x55a9273f9440 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273b4390 0x55a92740c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f8891eb1640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a927427ea0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8884004330 tx=0x7f8884003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817ff8e8eb5f3d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f886bfff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:35:42.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f886bfff640 1 -- 172.21.15.73:0/1737472065 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8884027020 con 0x55a9273f9440 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f886bfff640 1 -- 172.21.15.73:0/1737472065 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f888400da20 con 0x55a9273f9440 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f888805f200 con 0x55a9273f9440 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f886bfff640 1 -- 172.21.15.73:0/1737472065 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f8884031050 con 0x55a9273f9440 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 10 client.5061 fetch_fsmap learned FSMap version 17 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a92718ba30 con 0x55a9273f9440 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f886bfff640 1 -- 172.21.15.73:0/1737472065 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888805f200 con 0x55a9273f9440 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f886bfff640 1 -- 172.21.15.73:0/1737472065 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f8884034020 con 0x55a9273f9440 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 10 client.5061 fetch_fsmap finished waiting for FSMap version 17 2024-09-12T03:35:42.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 10 client.5061 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 20 client.5061 populate_metadata read hostname 'smithi073' 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a9274283e0 0x55a92746bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 4 client.5061 mds_command: new command op to 4857 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 --> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] -- command(tid 0: {"prefix": "status"}) -- 0x55a92720b3a0 con 0x55a9274283e0 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.295+0000 7f88916b0640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a9274283e0 0x55a92746bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88916b0640 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a9274283e0 0x55a92746bec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58dae412b1fd083c server_cookie=3e4206f248a4dcc2 in_seq=0 out_seq=0 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f886bfff640 10 client.5061 ms_handle_connect on v2:172.21.15.73:6836/1768372387 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f886bfff640 1 -- 172.21.15.73:0/1737472065 <== mds.0 v2:172.21.15.73:6836/1768372387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a92720b3a0 con 0x55a9274283e0 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f886bfff640 10 client.5061 handle_command_reply: tid=0 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 client.5061 shutdown 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 msgr2=0x55a927427ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a927427ea0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8884004330 tx=0x7f8884003700 comp rx=0 tx=0).stop 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 shutdown_connections 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a9273f9440 0x55a927427ea0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.73:6836/1768372387,v1:172.21.15.73:6837/1768372387] conn(0x55a9274283e0 0x55a92746bec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55a9273f8b20 0x55a927427960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 --2- 172.21.15.73:0/1737472065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a9273b4390 0x55a92740c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f886bfff640 0 client.5061 ms_handle_reset on v2:172.21.15.73:6836/1768372387 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 >> 172.21.15.73:0/1737472065 conn(0x55a9273af290 msgr2=0x55a9273f6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 shutdown_connections 2024-09-12T03:35:42.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 1 -- 172.21.15.73:0/1737472065 wait complete. 2024-09-12T03:35:42.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f88969d0000 20 client.5061 trim_cache size 0 max 16384 2024-09-12T03:35:42.311 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:35:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:35:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:35:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4857, 2024-09-12T03:35:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:35:42.311 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:35:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:35:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.137817752, 2024-09-12T03:35:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 17, 2024-09-12T03:35:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 39, 2024-09-12T03:35:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 39, 2024-09-12T03:35:42.312 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 17.087648832999999 2024-09-12T03:35:42.312 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:35:42.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88700678c0 msgr2=0x7f8870069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88700678c0 0x7f8870069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f887c0ad000 tx=0x7f887c008040 comp rx=0 tx=0).stop 2024-09-12T03:35:42.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 msgr2=0x7f888c1474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c1474d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f888800cd20 tx=0x7f888800a5c0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 shutdown_connections 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88700678c0 0x7f8870069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f888c1567e0 0x7f888c1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f888c0b40a0 0x7f888c154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 --2- 172.21.15.73:0/59568789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f888c0b3c40 0x7f888c1474d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 >> 172.21.15.73:0/59568789 conn(0x7f888c073580 msgr2=0x7f888c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 shutdown_connections 2024-09-12T03:35:42.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.299+0000 7f8893914640 1 -- 172.21.15.73:0/59568789 wait complete. 2024-09-12T03:35:42.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:35:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6fe530640 1 Processor -- start 2024-09-12T03:35:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6fe530640 1 -- start start 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6fe530640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6f80ce9d0 0x7fc6f80cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6fe530640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f80cf920 0x7fc6f80d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6fe530640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f806d9c0 con 0x7fc6f815e5f0 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6fe530640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f806d7a0 con 0x7fc6f80ce9d0 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6fe530640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f806dca0 con 0x7fc6f80cf920 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6f80ce9d0 0x7fc6f80cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc6f80ce9d0 0x7fc6f80cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49802/0 (socket says 172.21.15.73:49802) 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.415+0000 7fc6f77fe640 1 -- 172.21.15.73:0/1900455374 learned_addr learned my addr 172.21.15.73:0/1900455374 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fcacd640 1 --2- 172.21.15.73:0/1900455374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f80cf920 0x7fc6f80d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f77fe640 1 -- 172.21.15.73:0/1900455374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f80cf920 msgr2=0x7fc6f80d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f77fe640 1 --2- 172.21.15.73:0/1900455374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f80cf920 0x7fc6f80d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f77fe640 1 -- 172.21.15.73:0/1900455374 >> v1:172.21.15.150:6789/0 conn(0x7fc6f815e5f0 legacy=0x7fc6f806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f77fe640 1 -- 172.21.15.73:0/1900455374 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f806df80 con 0x7fc6f80ce9d0 2024-09-12T03:35:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f77fe640 1 --2- 172.21.15.73:0/1900455374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80ce9d0 0x7fc6f80cf3e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009870 tx=0x7fc6e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bce873758e9059 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f6ffd640 1 -- 172.21.15.73:0/1900455374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80ab5f0 con 0x7fc6f80ce9d0 2024-09-12T03:35:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f6ffd640 1 -- 172.21.15.73:0/1900455374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e80b0070 con 0x7fc6f80ce9d0 2024-09-12T03:35:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6f6ffd640 1 -- 172.21.15.73:0/1900455374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80ab9b0 con 0x7fc6f80ce9d0 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 -- 172.21.15.73:0/1900455374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80ce9d0 msgr2=0x7fc6f80cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 --2- 172.21.15.73:0/1900455374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80ce9d0 0x7fc6f80cf3e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009870 tx=0x7fc6e801c520 comp rx=0 tx=0).stop 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 -- 172.21.15.73:0/1900455374 shutdown_connections 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 --2- 172.21.15.73:0/1900455374 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f80cf920 0x7fc6f80d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 --2- 172.21.15.73:0/1900455374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80ce9d0 0x7fc6f80cf3e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 -- 172.21.15.73:0/1900455374 >> 172.21.15.73:0/1900455374 conn(0x7fc6f8074030 msgr2=0x7fc6f809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 -- 172.21.15.73:0/1900455374 shutdown_connections 2024-09-12T03:35:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.419+0000 7fc6fe530640 1 -- 172.21.15.73:0/1900455374 wait complete. 2024-09-12T03:35:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 Processor -- start 2024-09-12T03:35:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 -- start start 2024-09-12T03:35:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80cf920 0x7fc6f815c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f815c790 0x7fc6f815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f815d860 0x7fc6f815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80d3c80 con 0x7fc6f80cf920 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80d3b00 con 0x7fc6f815c790 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f80cfd30 con 0x7fc6f815d860 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80cf920 0x7fc6f815c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80cf920 0x7fc6f815c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49812/0 (socket says 172.21.15.73:49812) 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 -- 172.21.15.73:0/4030598812 learned_addr learned my addr 172.21.15.73:0/4030598812 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f77fe640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f815c790 0x7fc6f815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 -- 172.21.15.73:0/4030598812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f815d860 msgr2=0x7fc6f815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f815d860 0x7fc6f815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 -- 172.21.15.73:0/4030598812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f815c790 msgr2=0x7fc6f815fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f815c790 0x7fc6f815fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 -- 172.21.15.73:0/4030598812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f815cc20 con 0x7fc6f80cf920 2024-09-12T03:35:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f7fff640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80cf920 0x7fc6f815c210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000c480 tx=0x7fc6e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f4ff9640 1 -- 172.21.15.73:0/4030598812 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0012830 con 0x7fc6f80cf920 2024-09-12T03:35:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f4ff9640 1 -- 172.21.15.73:0/4030598812 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6e0017070 con 0x7fc6f80cf920 2024-09-12T03:35:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f80cb5f0 con 0x7fc6f80cf920 2024-09-12T03:35:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f4ff9640 1 -- 172.21.15.73:0/4030598812 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0012c30 con 0x7fc6f80cf920 2024-09-12T03:35:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f80cbbb0 con 0x7fc6f80cf920 2024-09-12T03:35:42.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f80d2e80 con 0x7fc6f80cf920 2024-09-12T03:35:42.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f4ff9640 1 -- 172.21.15.73:0/4030598812 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc6e001c460 con 0x7fc6f80cf920 2024-09-12T03:35:42.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f4ff9640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc6dc0678f0 0x7fc6dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:42.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f77fe640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc6dc0678f0 0x7fc6dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:42.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.423+0000 7fc6f4ff9640 1 -- 172.21.15.73:0/4030598812 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc6e0085bb0 con 0x7fc6f80cf920 2024-09-12T03:35:42.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.427+0000 7fc6f77fe640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc6dc0678f0 0x7fc6dc069db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80af000 tx=0x7fc6e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:42.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.431+0000 7fc6f4ff9640 1 -- 172.21.15.73:0/4030598812 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc6e00565f0 con 0x7fc6f80cf920 2024-09-12T03:35:42.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.623+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc6f80d41d0 con 0x7fc6f80cf920 2024-09-12T03:35:42.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.623+0000 7fc6f4ff9640 1 -- 172.21.15.73:0/4030598812 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fc6e0055ef0 con 0x7fc6f80cf920 2024-09-12T03:35:42.630 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:35:42.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc6dc0678f0 msgr2=0x7fc6dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc6dc0678f0 0x7fc6dc069db0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80af000 tx=0x7fc6e8008040 comp rx=0 tx=0).stop 2024-09-12T03:35:42.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80cf920 msgr2=0x7fc6f815c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:42.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80cf920 0x7fc6f815c210 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000c480 tx=0x7fc6e000c940 comp rx=0 tx=0).stop 2024-09-12T03:35:42.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 shutdown_connections 2024-09-12T03:35:42.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc6dc0678f0 0x7fc6dc069db0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc6f815d860 0x7fc6f815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6f815c790 0x7fc6f815fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 --2- 172.21.15.73:0/4030598812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f80cf920 0x7fc6f815c210 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:42.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 >> 172.21.15.73:0/4030598812 conn(0x7fc6f80ce9d0 msgr2=0x7fc6f80d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:42.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 shutdown_connections 2024-09-12T03:35:42.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42.627+0000 7fc6fe530640 1 -- 172.21.15.73:0/4030598812 wait complete. 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:35:42.647 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:35:42.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:42.648 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:42.654 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:35:42.655 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:42.656 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:35:42.657 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:42.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:42.657 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:35:42.705 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:35:42.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:42.706 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:35:42.759 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:35:42.759 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:42.760 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:35:42.761 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:42.761 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:35:42.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:35:42.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:35:42.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:35:42.761 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:35:42.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:42.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:42.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:42.881 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T03:35:42.928 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:35:42.928 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:35:42.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:42.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:35:42.985 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T03:35:42.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:42.985 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:43.031 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:35:43.032 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:43.032 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:43.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:43.141 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:43.190 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:43.192 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:43.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:43.193 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:43.239 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:35:43.240 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T03:35:43.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:43.299 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:43.348 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:43.349 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:43.350 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:43.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:43.351 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:43.365 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-09-12T03:35:43.359+0000 7f0dd4cc2580 -1 init, newargv = 0x56184c33fdb0 newargc=15 2024-09-12T03:35:43.365 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[37833]: starting ceph client 2024-09-12T03:35:43.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[37833]: starting fuse 2024-09-12T03:35:44.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:35:44.488 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:44.536 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:35:44.537 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:35:44.538 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:35:44.539 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:35:44.539 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:35:44.539 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:44.539 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:35:44.539 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:44.539 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:35:44.539 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:44.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:44.540 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:35:44.587 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:35:44.587 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:44.588 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:35:44.589 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-09-12T03:35:44.590 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:35:44.712 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.37833.asok 2024-09-12T03:35:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:44.721 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37833.asok 2024-09-12T03:35:44.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:44.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37833.asok status 2024-09-12T03:35:44.875 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "37833", 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:35:44.876 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5076, 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5076 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4136496602 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 4136496602 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5076 192.168.0.1:0/4136496602", 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/4136496602", 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 17, 2024-09-12T03:35:44.878 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 39, 2024-09-12T03:35:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:35:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:35:44.879 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:35:44.879 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:35:44.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:44.890 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:35:44.890 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:44.896 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:35:44.896 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:44.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:44.896 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:44.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:35:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.111+0000 7f228bedd640 1 Processor -- start 2024-09-12T03:35:45.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.111+0000 7f228bedd640 1 -- start start 2024-09-12T03:35:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f228bedd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f22841457a0 0x7f22840d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f228bedd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22840b4510 0x7f22840d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f228bedd640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22840d27a0 con 0x7f22840cf800 2024-09-12T03:35:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f228bedd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f22840d2a80 con 0x7f22841457a0 2024-09-12T03:35:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f228bedd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f22840d2d60 con 0x7f22840b4510 2024-09-12T03:35:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f2289c79640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f22841457a0 0x7f22840d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:45.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f2289c79640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f22841457a0 0x7f22840d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54762/0 (socket says 172.21.15.73:54762) 2024-09-12T03:35:45.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f2289c79640 1 -- 172.21.15.73:0/3586822198 learned_addr learned my addr 172.21.15.73:0/3586822198 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:45.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f2289c79640 1 -- 172.21.15.73:0/3586822198 >> v2:172.21.15.150:3300/0 conn(0x7f22840b4510 msgr2=0x7f22840d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:45.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f2289c79640 1 --2- 172.21.15.73:0/3586822198 >> v2:172.21.15.150:3300/0 conn(0x7f22840b4510 0x7f22840d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f2289c79640 1 -- 172.21.15.73:0/3586822198 >> v1:172.21.15.150:6789/0 conn(0x7f22840cf800 legacy=0x7f22840b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:45.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.115+0000 7f2289c79640 1 -- 172.21.15.73:0/3586822198 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22840d01f0 con 0x7f22841457a0 2024-09-12T03:35:45.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f2289c79640 1 --2- 172.21.15.73:0/3586822198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f22840d1ea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2280009870 tx=0x7f228001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32fca74a06cd7c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:45.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f2288c77640 1 -- 172.21.15.73:0/3586822198 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22800b0070 con 0x7f22841457a0 2024-09-12T03:35:45.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f2288c77640 1 -- 172.21.15.73:0/3586822198 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22800ab600 con 0x7f22841457a0 2024-09-12T03:35:45.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f2288c77640 1 -- 172.21.15.73:0/3586822198 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22800ab9d0 con 0x7f22841457a0 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- 172.21.15.73:0/3586822198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 msgr2=0x7f22840d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 --2- 172.21.15.73:0/3586822198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f22840d1ea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2280009870 tx=0x7f228001c450 comp rx=0 tx=0).stop 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- 172.21.15.73:0/3586822198 shutdown_connections 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 --2- 172.21.15.73:0/3586822198 >> v2:172.21.15.150:3300/0 conn(0x7f22840b4510 0x7f22840d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 --2- 172.21.15.73:0/3586822198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f22840d1ea0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- 172.21.15.73:0/3586822198 >> 172.21.15.73:0/3586822198 conn(0x7f228406bcc0 msgr2=0x7f228406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- 172.21.15.73:0/3586822198 shutdown_connections 2024-09-12T03:35:45.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- 172.21.15.73:0/3586822198 wait complete. 2024-09-12T03:35:45.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 Processor -- start 2024-09-12T03:35:45.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- start start 2024-09-12T03:35:45.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22840b4510 0x7f228415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22840cf800 0x7f2284143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f2284135980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f22841690b0 con 0x7f22841457a0 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f22840d1670 con 0x7f22840cf800 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2284169230 con 0x7f22840b4510 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f2284135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f2284135980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54778/0 (socket says 172.21.15.73:54778) 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 -- 172.21.15.73:0/139321490 learned_addr learned my addr 172.21.15.73:0/139321490 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f2289478640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22840cf800 0x7f2284143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 -- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22840b4510 msgr2=0x7f228415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f2289c79640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22840b4510 0x7f228415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22840b4510 0x7f228415b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 -- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22840cf800 msgr2=0x7f2284143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22840cf800 0x7f2284143990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 -- 172.21.15.73:0/139321490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228415d5e0 con 0x7f22841457a0 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f2289478640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22840cf800 0x7f2284143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228a47a640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f2284135980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f227c00b970 tx=0x7f227c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f227a7fc640 1 -- 172.21.15.73:0/139321490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c019070 con 0x7f22841457a0 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f227a7fc640 1 -- 172.21.15.73:0/139321490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c00cb60 con 0x7f22841457a0 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f227a7fc640 1 -- 172.21.15.73:0/139321490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c014440 con 0x7f22841457a0 2024-09-12T03:35:45.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2284144290 con 0x7f22841457a0 2024-09-12T03:35:45.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.119+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2284144850 con 0x7f22841457a0 2024-09-12T03:35:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.123+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22840d0710 con 0x7f22841457a0 2024-09-12T03:35:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.123+0000 7f227a7fc640 1 -- 172.21.15.73:0/139321490 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f227c01c070 con 0x7f22841457a0 2024-09-12T03:35:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.123+0000 7f227a7fc640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f22680678c0 0x7f2268069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.123+0000 7f227a7fc640 1 -- 172.21.15.73:0/139321490 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f227c085b10 con 0x7f22841457a0 2024-09-12T03:35:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.123+0000 7f2289c79640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f22680678c0 0x7f2268069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.123+0000 7f2289c79640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f22680678c0 0x7f2268069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22800ad000 tx=0x7f2280008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:45.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.127+0000 7f227a7fc640 1 -- 172.21.15.73:0/139321490 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f227c056550 con 0x7f22841457a0 2024-09-12T03:35:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.327+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f228413f650 con 0x7f22841457a0 2024-09-12T03:35:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.327+0000 7f227a7fc640 1 -- 172.21.15.73:0/139321490 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f227c055e50 con 0x7f22841457a0 2024-09-12T03:35:45.333 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:35:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f22680678c0 msgr2=0x7f2268069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f22680678c0 0x7f2268069d80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22800ad000 tx=0x7f2280008040 comp rx=0 tx=0).stop 2024-09-12T03:35:45.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 msgr2=0x7f2284135980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f2284135980 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f227c00b970 tx=0x7f227c00be30 comp rx=0 tx=0).stop 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 shutdown_connections 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f22680678c0 0x7f2268069d80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22841457a0 0x7f2284135980 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22840cf800 0x7f2284143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 --2- 172.21.15.73:0/139321490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f22840b4510 0x7f228415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 >> 172.21.15.73:0/139321490 conn(0x7f228406bcc0 msgr2=0x7f228415fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 shutdown_connections 2024-09-12T03:35:45.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:45.331+0000 7f228bedd640 1 -- 172.21.15.73:0/139321490 wait complete. 2024-09-12T03:35:45.352 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:35:45.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:35:45.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:35:45.352 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:35:45.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:45.353 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:35:45.353 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:35:45.353 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:35:45.353 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:35:45.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:45.353 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:45.361 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42434sec preferred_lft 42434sec 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.362 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:35:45.363 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.364 INFO:teuthology.orchestra.run.smithi150.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:35:45.364 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:45.364 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:35:45.364 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:35:45.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:45.364 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:35:45.417 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:35:45.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:45.419 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:35:45.470 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:35:45.470 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:35:45.470 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:35:45.471 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:35:45.471 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:35:45.472 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:35:45.472 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:35:45.472 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:35:45.472 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:35:45.472 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:35:45.559 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:35:45.586 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:45.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:45.594 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:35:45.601 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:35:45.601 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:35:45.601 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:35:45.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:45.602 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:35:45.658 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:35:45.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:45.659 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:45.706 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:35:45.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:35:45.707 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:45.753 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:45.811 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:45.859 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:45.860 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:45.861 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:45.862 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:45.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:45.863 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:45.911 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:35:45.911 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T03:35:45.955 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:45.970 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:46.018 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:46.019 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:46.020 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:46.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:46.021 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:46.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:35:46.028+0000 7f9268172580 -1 init, newargv = 0x56076c0e7060 newargc=15 2024-09-12T03:35:46.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34750]: starting ceph client 2024-09-12T03:35:46.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34750]: starting fuse 2024-09-12T03:35:47.138 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:35:47.155 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:35:47.203 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:35:47.204 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:35:47.205 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:47.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.206 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:35:47.250 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:35:47.250 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:35:47.250 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:35:47.250 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:35:47.250 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:35:47.251 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:35:47.252 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:35:47.252 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:35:47.252 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:35:47.253 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:35:47.253 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:35:47.253 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:35:47.253 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:35:47.253 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:35:47.253 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:35:47.375 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.34750.asok 2024-09-12T03:35:47.379 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:35:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:35:47.386 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34750.asok 2024-09-12T03:35:47.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34750.asok status 2024-09-12T03:35:47.542 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:35:47.542 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "34750", 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:35:47.543 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4520, 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4520 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2894786894 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:35:47.544 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2894786894 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4520 192.168.0.1:0/2894786894", 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/2894786894", 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 17, 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 39, 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:35:47.545 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:35:47.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.556 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:35:47.556 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:47.561 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:35:47.562 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:47.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:47.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.620 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T03:35:47.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.636 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0 ./subdir) 2024-09-12T03:35:47.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.688 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:35:47.738 INFO:teuthology.orchestra.run.smithi073.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-12T03:35:47.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:35:47.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.739 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir) 2024-09-12T03:35:47.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.794 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:35:47.851 INFO:teuthology.orchestra.run.smithi073.stdout:1024 2024-09-12T03:35:47.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.852 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0M ./subdir) 2024-09-12T03:35:47.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:47.910 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:35:47.957 INFO:teuthology.orchestra.run.smithi073.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-12T03:35:47.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:35:47.959 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:35:47.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:35:48.061 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:35:48.115 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:35:48.115 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:35:48.115 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:48.115 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:48.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:48.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf65291640 1 Processor -- start 2024-09-12T03:35:48.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf65291640 1 -- start start 2024-09-12T03:35:48.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf65291640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf6015bec0 0x7fbf600ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf65291640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf600aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf65291640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf600b3290 con 0x7fbf600af2a0 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf65291640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbf600b3570 con 0x7fbf6015bec0 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf65291640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbf600b3850 con 0x7fbf6015c2a0 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf6015bec0 0x7fbf600ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbf6015bec0 0x7fbf600ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54786/0 (socket says 172.21.15.73:54786) 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5effd640 1 -- 172.21.15.73:0/1171047699 learned_addr learned my addr 172.21.15.73:0/1171047699 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5e7fc640 1 --2- 172.21.15.73:0/1171047699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf600aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5effd640 1 -- 172.21.15.73:0/1171047699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 msgr2=0x7fbf600aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5effd640 1 --2- 172.21.15.73:0/1171047699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf600aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5effd640 1 -- 172.21.15.73:0/1171047699 >> v1:172.21.15.150:6789/0 conn(0x7fbf600af2a0 legacy=0x7fbf6015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:48.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5effd640 1 -- 172.21.15.73:0/1171047699 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf600b3b30 con 0x7fbf6015bec0 2024-09-12T03:35:48.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.283+0000 7fbf5e7fc640 1 --2- 172.21.15.73:0/1171047699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf600aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:48.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf5effd640 1 --2- 172.21.15.73:0/1171047699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf6015bec0 0x7fbf600ad200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009870 tx=0x7fbf5401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5174b2a6c328736d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:48.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf5dffb640 1 -- 172.21.15.73:0/1171047699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540aa610 con 0x7fbf6015bec0 2024-09-12T03:35:48.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf5dffb640 1 -- 172.21.15.73:0/1171047699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf540af070 con 0x7fbf6015bec0 2024-09-12T03:35:48.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf5dffb640 1 -- 172.21.15.73:0/1171047699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf540aa9d0 con 0x7fbf6015bec0 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 -- 172.21.15.73:0/1171047699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf6015bec0 msgr2=0x7fbf600ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 --2- 172.21.15.73:0/1171047699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf6015bec0 0x7fbf600ad200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009870 tx=0x7fbf5401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 -- 172.21.15.73:0/1171047699 shutdown_connections 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 --2- 172.21.15.73:0/1171047699 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf600aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 --2- 172.21.15.73:0/1171047699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf6015bec0 0x7fbf600ad200 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 -- 172.21.15.73:0/1171047699 >> 172.21.15.73:0/1171047699 conn(0x7fbf600b1f90 msgr2=0x7fbf600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 -- 172.21.15.73:0/1171047699 shutdown_connections 2024-09-12T03:35:48.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 -- 172.21.15.73:0/1171047699 wait complete. 2024-09-12T03:35:48.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 Processor -- start 2024-09-12T03:35:48.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.287+0000 7fbf65291640 1 -- start start 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf600af2a0 0x7fbf601526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf6009b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf60154a10 0x7fbf60154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbf600ad740 con 0x7fbf60154a10 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbf600afc90 con 0x7fbf600af2a0 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbf60169000 con 0x7fbf6015c2a0 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf60154a10 0x7fbf60154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf60154a10 0x7fbf60154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54796/0 (socket says 172.21.15.73:54796) 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 -- 172.21.15.73:0/805339361 learned_addr learned my addr 172.21.15.73:0/805339361 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5effd640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf600af2a0 0x7fbf601526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5e7fc640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf6009b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 -- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 msgr2=0x7fbf6009b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf6009b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 -- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf600af2a0 msgr2=0x7fbf601526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf600af2a0 0x7fbf601526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 -- 172.21.15.73:0/805339361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6015d390 con 0x7fbf60154a10 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5f7fe640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf60154a10 0x7fbf60154ea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c780 tx=0x7fbf5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf477fe640 1 -- 172.21.15.73:0/805339361 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58004b70 con 0x7fbf60154a10 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf477fe640 1 -- 172.21.15.73:0/805339361 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf58004d10 con 0x7fbf60154a10 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf477fe640 1 -- 172.21.15.73:0/805339361 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800aa90 con 0x7fbf60154a10 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6015d670 con 0x7fbf60154a10 2024-09-12T03:35:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf60151ec0 con 0x7fbf60154a10 2024-09-12T03:35:48.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf600ad200 con 0x7fbf60154a10 2024-09-12T03:35:48.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf477fe640 1 -- 172.21.15.73:0/805339361 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbf5800ac30 con 0x7fbf60154a10 2024-09-12T03:35:48.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf477fe640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbf4c0678c0 0x7fbf4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5effd640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbf4c0678c0 0x7fbf4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf477fe640 1 -- 172.21.15.73:0/805339361 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbf580860c0 con 0x7fbf60154a10 2024-09-12T03:35:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.291+0000 7fbf5effd640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbf4c0678c0 0x7fbf4c069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf540ae000 tx=0x7fbf540a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:48.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.295+0000 7fbf477fe640 1 -- 172.21.15.73:0/805339361 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbf58020070 con 0x7fbf60154a10 2024-09-12T03:35:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.467+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbf6006fcd0 con 0x7fbf60154a10 2024-09-12T03:35:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf477fe640 1 -- 172.21.15.73:0/805339361 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7fbf58056a70 con 0x7fbf60154a10 2024-09-12T03:35:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbf4c0678c0 msgr2=0x7fbf4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbf4c0678c0 0x7fbf4c069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf540ae000 tx=0x7fbf540a7000 comp rx=0 tx=0).stop 2024-09-12T03:35:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf60154a10 msgr2=0x7fbf60154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf60154a10 0x7fbf60154ea0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c780 tx=0x7fbf5800cc40 comp rx=0 tx=0).stop 2024-09-12T03:35:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 shutdown_connections 2024-09-12T03:35:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbf4c0678c0 0x7fbf4c069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf60154a10 0x7fbf60154ea0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbf6015c2a0 0x7fbf6009b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 --2- 172.21.15.73:0/805339361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf600af2a0 0x7fbf601526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 >> 172.21.15.73:0/805339361 conn(0x7fbf600b1f90 msgr2=0x7fbf60158990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 shutdown_connections 2024-09-12T03:35:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.471+0000 7fbf65291640 1 -- 172.21.15.73:0/805339361 wait complete. 2024-09-12T03:35:48.494 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:35:48.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:48.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T03:35:48.505 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[37833]: fuse finished with error 0 and tester_r 0 2024-09-12T03:35:48.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:35:48.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:48.507 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:35:48.559 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:35:48.559 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:48.559 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:48.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:35:48.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7063501640 1 Processor -- start 2024-09-12T03:35:48.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7063501640 1 -- start start 2024-09-12T03:35:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7063501640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c145600 0x7f705c145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7063501640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f705c0b15b0 0x7f705c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7063501640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705c0b0510 con 0x7f705c0b19f0 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7063501640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f705c146020 con 0x7f705c0b15b0 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7063501640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f705c0b07f0 con 0x7f705c145600 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7060a9c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f705c0b15b0 0x7f705c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7060a9c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f705c0b15b0 0x7f705c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54806/0 (socket says 172.21.15.73:54806) 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7060a9c640 1 -- 172.21.15.73:0/2983938191 learned_addr learned my addr 172.21.15.73:0/2983938191 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f706129d640 1 --2- 172.21.15.73:0/2983938191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c145600 0x7f705c145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7060a9c640 1 -- 172.21.15.73:0/2983938191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c145600 msgr2=0x7f705c145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7060a9c640 1 --2- 172.21.15.73:0/2983938191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c145600 0x7f705c145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7060a9c640 1 -- 172.21.15.73:0/2983938191 >> v1:172.21.15.73:6789/0 conn(0x7f705c0b19f0 legacy=0x7f705c15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7053fff640 1 -- 172.21.15.73:0/2983938191 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617312364 0 0) 0x7f705c0b0510 con 0x7f705c0b19f0 2024-09-12T03:35:48.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.719+0000 7f7060a9c640 1 -- 172.21.15.73:0/2983938191 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c0b0ad0 con 0x7f705c0b15b0 2024-09-12T03:35:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7060a9c640 1 --2- 172.21.15.73:0/2983938191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c0b2030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f704c009870 tx=0x7f704c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9457d688d42e824f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7053fff640 1 -- 172.21.15.73:0/2983938191 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c0ab640 con 0x7f705c0b15b0 2024-09-12T03:35:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7053fff640 1 -- 172.21.15.73:0/2983938191 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704c0b0070 con 0x7f705c0b15b0 2024-09-12T03:35:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7053fff640 1 -- 172.21.15.73:0/2983938191 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c0aba00 con 0x7f705c0b15b0 2024-09-12T03:35:48.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- 172.21.15.73:0/2983938191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 msgr2=0x7f705c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 --2- 172.21.15.73:0/2983938191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c0b2030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f704c009870 tx=0x7f704c01c530 comp rx=0 tx=0).stop 2024-09-12T03:35:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- 172.21.15.73:0/2983938191 shutdown_connections 2024-09-12T03:35:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 --2- 172.21.15.73:0/2983938191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c0b2030 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 --2- 172.21.15.73:0/2983938191 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c145600 0x7f705c145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- 172.21.15.73:0/2983938191 >> 172.21.15.73:0/2983938191 conn(0x7f705c09aa00 msgr2=0x7f705c0b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- 172.21.15.73:0/2983938191 shutdown_connections 2024-09-12T03:35:48.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- 172.21.15.73:0/2983938191 wait complete. 2024-09-12T03:35:48.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 Processor -- start 2024-09-12T03:35:48.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- start start 2024-09-12T03:35:48.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0b19f0 0x7f705c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c145600 0x7f705c14f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f705c0b6f20 con 0x7f705c0b15b0 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f705c0b2980 con 0x7f705c145600 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.723+0000 7f7063501640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f705c0b70a0 con 0x7f705c0b19f0 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54810/0 (socket says 172.21.15.73:54810) 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 -- 172.21.15.73:0/2428663231 learned_addr learned my addr 172.21.15.73:0/2428663231 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7060a9c640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0b19f0 0x7f705c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 -- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0b19f0 msgr2=0x7f705c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7061a9e640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c145600 0x7f705c14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0b19f0 0x7f705c154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 -- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c145600 msgr2=0x7f705c14f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c145600 0x7f705c14f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 -- 172.21.15.73:0/2428663231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c151c00 con 0x7f705c0b15b0 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7060a9c640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0b19f0 0x7f705c154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f706129d640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c143500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f705800d5f0 tx=0x7f705800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7051ffb640 1 -- 172.21.15.73:0/2428663231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70580125f0 con 0x7f705c0b15b0 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7051ffb640 1 -- 172.21.15.73:0/2428663231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058019070 con 0x7f705c0b15b0 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705c14e370 con 0x7f705c0b15b0 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7051ffb640 1 -- 172.21.15.73:0/2428663231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70580129b0 con 0x7f705c0b15b0 2024-09-12T03:35:48.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f705c14e930 con 0x7f705c0b15b0 2024-09-12T03:35:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705c0b2030 con 0x7f705c0b15b0 2024-09-12T03:35:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7051ffb640 1 -- 172.21.15.73:0/2428663231 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7058012b50 con 0x7f705c0b15b0 2024-09-12T03:35:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7051ffb640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70400678c0 0x7f7040069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7051ffb640 1 -- 172.21.15.73:0/2428663231 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f70580861d0 con 0x7f705c0b15b0 2024-09-12T03:35:48.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7060a9c640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70400678c0 0x7f7040069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:48.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.727+0000 7f7060a9c640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70400678c0 0x7f7040069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f704c0af000 tx=0x7f704c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:48.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.731+0000 7f7051ffb640 1 -- 172.21.15.73:0/2428663231 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f705c151c00 con 0x7f705c0b15b0 2024-09-12T03:35:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.903+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f705c0afe30 con 0x7f705c0b15b0 2024-09-12T03:35:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.903+0000 7f7051ffb640 1 -- 172.21.15.73:0/2428663231 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7f7058056c10 con 0x7f705c0b15b0 2024-09-12T03:35:48.909 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:35:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70400678c0 msgr2=0x7f7040069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70400678c0 0x7f7040069d80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f704c0af000 tx=0x7f704c008040 comp rx=0 tx=0).stop 2024-09-12T03:35:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 msgr2=0x7f705c143500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c143500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f705800d5f0 tx=0x7f705800dab0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 shutdown_connections 2024-09-12T03:35:48.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70400678c0 0x7f7040069d80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f705c145600 0x7f705c14f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f705c0b19f0 0x7f705c154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 --2- 172.21.15.73:0/2428663231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f705c0b15b0 0x7f705c143500 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:48.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 >> 172.21.15.73:0/2428663231 conn(0x7f705c09aa00 msgr2=0x7f705c06f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:48.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 shutdown_connections 2024-09-12T03:35:48.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:48.907+0000 7f7063501640 1 -- 172.21.15.73:0/2428663231 wait complete. 2024-09-12T03:35:48.927 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:35:48.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:48.927 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:35:48.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34750]: fuse finished with error 0 and tester_r 0 2024-09-12T03:35:48.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:35:48.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:48.942 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:35:49.026 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:35:49.026 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:49.026 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:49.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:35:49.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:35:49.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:49.032 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T03:35:49.079 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T03:35:49.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:35:49.080 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:35:49.080 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:49.080 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:49.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:35:49.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:35:49.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:35:49.087 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T03:35:49.134 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T03:35:49.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:35:49.135 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 Processor -- start 2024-09-12T03:35:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- start start 2024-09-12T03:35:49.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0d3060 0x7f697c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f697c0cf450 0x7f697c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f697c0d0300 con 0x7f697c161a60 2024-09-12T03:35:49.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f697c0b0f60 con 0x7f697c0cf450 2024-09-12T03:35:49.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f697c0cfd40 con 0x7f697c0d3060 2024-09-12T03:35:49.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697bfff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f697c0cf450 0x7f697c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697affd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0d3060 0x7f697c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697bfff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f697c0cf450 0x7f697c06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:39028/0 (socket says 172.21.15.73:39028) 2024-09-12T03:35:49.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697bfff640 1 -- 172.21.15.73:0/1465337622 learned_addr learned my addr 172.21.15.73:0/1465337622 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:49.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697b7fe640 1 --1- 172.21.15.73:0/1465337622 >> v1:172.21.15.150:6789/0 conn(0x7f697c161a60 0x7f697c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:38562/0 (socket says 172.21.15.73:38562) 2024-09-12T03:35:49.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697affd640 1 -- 172.21.15.73:0/1465337622 >> v2:172.21.15.150:3300/0 conn(0x7f697c0cf450 msgr2=0x7f697c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:49.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697affd640 1 --2- 172.21.15.73:0/1465337622 >> v2:172.21.15.150:3300/0 conn(0x7f697c0cf450 0x7f697c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697affd640 1 -- 172.21.15.73:0/1465337622 >> v1:172.21.15.150:6789/0 conn(0x7f697c161a60 legacy=0x7f697c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697affd640 1 -- 172.21.15.73:0/1465337622 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c0d0020 con 0x7f697c0d3060 2024-09-12T03:35:49.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697affd640 1 --2- 172.21.15.73:0/1465337622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0d3060 0x7f697c0cef10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69700097c0 tx=0x7f697001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc15cf33a758a137 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697a7fc640 1 -- 172.21.15.73:0/1465337622 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69700b1070 con 0x7f697c0d3060 2024-09-12T03:35:49.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697a7fc640 1 -- 172.21.15.73:0/1465337622 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69700a8050 con 0x7f697c0d3060 2024-09-12T03:35:49.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f697a7fc640 1 -- 172.21.15.73:0/1465337622 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69700ac860 con 0x7f697c0d3060 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- 172.21.15.73:0/1465337622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0d3060 msgr2=0x7f697c0cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- 172.21.15.73:0/1465337622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0d3060 0x7f697c0cef10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f69700097c0 tx=0x7f697001c3e0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- 172.21.15.73:0/1465337622 shutdown_connections 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- 172.21.15.73:0/1465337622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0d3060 0x7f697c0cef10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- 172.21.15.73:0/1465337622 >> v2:172.21.15.150:3300/0 conn(0x7f697c0cf450 0x7f697c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- 172.21.15.73:0/1465337622 >> 172.21.15.73:0/1465337622 conn(0x7f697c08bf90 msgr2=0x7f697c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- 172.21.15.73:0/1465337622 shutdown_connections 2024-09-12T03:35:49.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- 172.21.15.73:0/1465337622 wait complete. 2024-09-12T03:35:49.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 Processor -- start 2024-09-12T03:35:49.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- start start 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0cf450 0x7f697c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697c0d3060 0x7f697c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697c161a60 0x7f697c153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f697c16af20 con 0x7f697c161a60 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f697c06e610 con 0x7f697c0d3060 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.259+0000 7f6982155640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f697c16b0a0 con 0x7f697c0cf450 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697c161a60 0x7f697c153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697c161a60 0x7f697c153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54814/0 (socket says 172.21.15.73:54814) 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 -- 172.21.15.73:0/944378675 learned_addr learned my addr 172.21.15.73:0/944378675 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697b7fe640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0cf450 0x7f697c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697affd640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697c0d3060 0x7f697c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 -- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0cf450 msgr2=0x7f697c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0cf450 0x7f697c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 -- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697c0d3060 msgr2=0x7f697c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697c0d3060 0x7f697c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 -- 172.21.15.73:0/944378675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697c0c9130 con 0x7f697c161a60 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697bfff640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697c161a60 0x7f697c153170 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e7f0 tx=0x7f696c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6963fff640 1 -- 172.21.15.73:0/944378675 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c017070 con 0x7f697c161a60 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6963fff640 1 -- 172.21.15.73:0/944378675 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696c00c940 con 0x7f697c161a60 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697c0ca590 con 0x7f697c161a60 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6963fff640 1 -- 172.21.15.73:0/944378675 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c00eea0 con 0x7f697c161a60 2024-09-12T03:35:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f697c0ca830 con 0x7f697c161a60 2024-09-12T03:35:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697c06d6b0 con 0x7f697c161a60 2024-09-12T03:35:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6963fff640 1 -- 172.21.15.73:0/944378675 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f696c01a070 con 0x7f697c161a60 2024-09-12T03:35:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6963fff640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69680678f0 0x7f6968069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f6963fff640 1 -- 172.21.15.73:0/944378675 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f696c085c30 con 0x7f697c161a60 2024-09-12T03:35:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697b7fe640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69680678f0 0x7f6968069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.263+0000 7f697b7fe640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69680678f0 0x7f6968069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6974005fd0 tx=0x7f6974005b80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.267+0000 7f6963fff640 1 -- 172.21.15.73:0/944378675 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f697c0c9130 con 0x7f697c161a60 2024-09-12T03:35:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.447+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f697c0ce740 con 0x7f697c161a60 2024-09-12T03:35:49.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.447+0000 7f6963fff640 1 -- 172.21.15.73:0/944378675 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7f696c056670 con 0x7f697c161a60 2024-09-12T03:35:49.455 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:49.455 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"btime":"2024-09-12T03:35:35:181396+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4171638220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4171638220},{"type":"v1","addr":"172.21.15.150:6834","nonce":4171638220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/586996144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":586996144},{"type":"v1","addr":"172.21.15.150:6835","nonce":586996144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4854,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1039518252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1039518252},{"type":"v1","addr":"172.21.15.73:6835","nonce":1039518252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:35:31.472966+0000","modified":"2024-09-12T03:35:34.542272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/1768372387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1768372387},{"type":"v1","addr":"172.21.15.73:6837","nonce":1768372387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-12T03:35:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-09-12T03:35:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69680678f0 msgr2=0x7f6968069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69680678f0 0x7f6968069db0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6974005fd0 tx=0x7f6974005b80 comp rx=0 tx=0).stop 2024-09-12T03:35:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697c161a60 msgr2=0x7f697c153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697c161a60 0x7f697c153170 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f696c00e7f0 tx=0x7f696c00ecb0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 shutdown_connections 2024-09-12T03:35:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69680678f0 0x7f6968069db0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697c161a60 0x7f697c153170 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f697c0d3060 0x7f697c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 --2- 172.21.15.73:0/944378675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697c0cf450 0x7f697c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 >> 172.21.15.73:0/944378675 conn(0x7f697c08bf90 msgr2=0x7f697c160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:49.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 shutdown_connections 2024-09-12T03:35:49.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.451+0000 7f6982155640 1 -- 172.21.15.73:0/944378675 wait complete. 2024-09-12T03:35:49.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 Processor -- start 2024-09-12T03:35:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 -- start start 2024-09-12T03:35:49.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd23015bec0 0x7fd2300ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd23015c2a0 0x7fd2300aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2300b3290 con 0x7fd2300af2a0 2024-09-12T03:35:49.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd2300b3570 con 0x7fd23015c2a0 2024-09-12T03:35:49.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd2300b3850 con 0x7fd23015bec0 2024-09-12T03:35:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd23015c2a0 0x7fd2300aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd2300af2a0 0x7fd23015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58894/0 (socket says 172.21.15.73:58894) 2024-09-12T03:35:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22f7fe640 1 -- 172.21.15.73:0/2869761836 learned_addr learned my addr 172.21.15.73:0/2869761836 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22effd640 1 --2- 172.21.15.73:0/2869761836 >> v2:172.21.15.150:3300/0 conn(0x7fd23015bec0 0x7fd2300ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22dffb640 1 -- 172.21.15.73:0/2869761836 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045484748 0 0) 0x7fd2300b3290 con 0x7fd2300af2a0 2024-09-12T03:35:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22dffb640 1 -- 172.21.15.73:0/2869761836 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd218003530 con 0x7fd2300af2a0 2024-09-12T03:35:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22e7fc640 1 -- 172.21.15.73:0/2869761836 >> v2:172.21.15.150:3300/0 conn(0x7fd23015bec0 msgr2=0x7fd2300ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22e7fc640 1 --2- 172.21.15.73:0/2869761836 >> v2:172.21.15.150:3300/0 conn(0x7fd23015bec0 0x7fd2300ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22e7fc640 1 -- 172.21.15.73:0/2869761836 >> v1:172.21.15.73:6789/0 conn(0x7fd2300af2a0 legacy=0x7fd23015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22e7fc640 1 -- 172.21.15.73:0/2869761836 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2300b3b30 con 0x7fd23015c2a0 2024-09-12T03:35:49.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22e7fc640 1 --2- 172.21.15.73:0/2869761836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300aed60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd230071710 tx=0x7fd22001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8354985240684ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22dffb640 1 -- 172.21.15.73:0/2869761836 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2200b2070 con 0x7fd23015c2a0 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22dffb640 1 -- 172.21.15.73:0/2869761836 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2200a59c0 con 0x7fd23015c2a0 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd22dffb640 1 -- 172.21.15.73:0/2869761836 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2200a5d70 con 0x7fd23015c2a0 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 -- 172.21.15.73:0/2869761836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 msgr2=0x7fd2300aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 --2- 172.21.15.73:0/2869761836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300aed60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd230071710 tx=0x7fd22001c900 comp rx=0 tx=0).stop 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 -- 172.21.15.73:0/2869761836 shutdown_connections 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 --2- 172.21.15.73:0/2869761836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300aed60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 --2- 172.21.15.73:0/2869761836 >> v2:172.21.15.150:3300/0 conn(0x7fd23015bec0 0x7fd2300ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.575+0000 7fd235727640 1 -- 172.21.15.73:0/2869761836 >> 172.21.15.73:0/2869761836 conn(0x7fd2300b1f90 msgr2=0x7fd2300b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- 172.21.15.73:0/2869761836 shutdown_connections 2024-09-12T03:35:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- 172.21.15.73:0/2869761836 wait complete. 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 Processor -- start 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- start start 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2300af2a0 0x7fd23014f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23015bec0 0x7fd2301535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd2300af6b0 con 0x7fd23015c2a0 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd2300ad740 con 0x7fd2300af2a0 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd230169000 con 0x7fd23015bec0 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54826/0 (socket says 172.21.15.73:54826) 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 -- 172.21.15.73:0/435036090 learned_addr learned my addr 172.21.15.73:0/435036090 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 -- 172.21.15.73:0/435036090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23015bec0 msgr2=0x7fd2301535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23015bec0 0x7fd2301535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 -- 172.21.15.73:0/435036090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2300af2a0 msgr2=0x7fd23014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2300af2a0 0x7fd23014f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 -- 172.21.15.73:0/435036090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23015d7b0 con 0x7fd23015c2a0 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd22f7fe640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300d0000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c450 tx=0x7fd22800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd2177fe640 1 -- 172.21.15.73:0/435036090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228017070 con 0x7fd23015c2a0 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd2177fe640 1 -- 172.21.15.73:0/435036090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228005cf0 con 0x7fd23015c2a0 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd2177fe640 1 -- 172.21.15.73:0/435036090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280072b0 con 0x7fd23015c2a0 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23014fc40 con 0x7fd23015c2a0 2024-09-12T03:35:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.579+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23015c6b0 con 0x7fd23015c2a0 2024-09-12T03:35:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.583+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2300ad200 con 0x7fd23015c2a0 2024-09-12T03:35:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.583+0000 7fd2177fe640 1 -- 172.21.15.73:0/435036090 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd228007450 con 0x7fd23015c2a0 2024-09-12T03:35:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.583+0000 7fd2177fe640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd21c0678c0 0x7fd21c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.583+0000 7fd2177fe640 1 -- 172.21.15.73:0/435036090 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd228085110 con 0x7fd23015c2a0 2024-09-12T03:35:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.583+0000 7fd22effd640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd21c0678c0 0x7fd21c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.583+0000 7fd22effd640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd21c0678c0 0x7fd21c069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2300d0be0 tx=0x7fd224008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.587+0000 7fd2177fe640 1 -- 172.21.15.73:0/435036090 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd228007740 con 0x7fd23015c2a0 2024-09-12T03:35:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.775+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd23006fcd0 con 0x7fd23015c2a0 2024-09-12T03:35:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd2177fe640 1 -- 172.21.15.73:0/435036090 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7fd228055ab0 con 0x7fd23015c2a0 2024-09-12T03:35:49.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:49.784 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"btime":"2024-09-12T03:35:35:181396+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4171638220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4171638220},{"type":"v1","addr":"172.21.15.150:6834","nonce":4171638220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/586996144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":586996144},{"type":"v1","addr":"172.21.15.150:6835","nonce":586996144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4854,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1039518252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1039518252},{"type":"v1","addr":"172.21.15.73:6835","nonce":1039518252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:35:31.472966+0000","modified":"2024-09-12T03:35:34.542272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/1768372387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1768372387},{"type":"v1","addr":"172.21.15.73:6837","nonce":1768372387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-12T03:35:49.784 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-09-12T03:35:49.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd21c0678c0 msgr2=0x7fd21c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd21c0678c0 0x7fd21c069d80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2300d0be0 tx=0x7fd224008040 comp rx=0 tx=0).stop 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 msgr2=0x7fd2300d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300d0000 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c450 tx=0x7fd22800c910 comp rx=0 tx=0).stop 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 shutdown_connections 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd21c0678c0 0x7fd21c069d80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd23015c2a0 0x7fd2300d0000 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd23015bec0 0x7fd2301535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 --2- 172.21.15.73:0/435036090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd2300af2a0 0x7fd23014f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 >> 172.21.15.73:0/435036090 conn(0x7fd2300b1f90 msgr2=0x7fd2300b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 shutdown_connections 2024-09-12T03:35:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.779+0000 7fd235727640 1 -- 172.21.15.73:0/435036090 wait complete. 2024-09-12T03:35:49.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:49.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.919+0000 7ff1db4f7640 1 Processor -- start 2024-09-12T03:35:49.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.919+0000 7ff1db4f7640 1 -- start start 2024-09-12T03:35:49.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1db4f7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff1d4073e60 0x7ff1d406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1db4f7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 0x7ff1d40b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1db4f7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d40b4670 con 0x7ff1d406fef0 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1db4f7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d406ee50 con 0x7ff1d4073e60 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1db4f7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d406f130 con 0x7ff1d40b3d50 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d8a92640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff1d406fef0 0x7ff1d415b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58902/0 (socket says 172.21.15.73:58902) 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d8a92640 1 -- 172.21.15.73:0/3879195345 learned_addr learned my addr 172.21.15.73:0/3879195345 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3531558159 0 0) 0x7ff1d40b4670 con 0x7ff1d406fef0 2024-09-12T03:35:49.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c0003450 con 0x7ff1d406fef0 2024-09-12T03:35:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9293640 1 --2- 172.21.15.73:0/3879195345 >> v2:172.21.15.150:3300/0 conn(0x7ff1d4073e60 0x7ff1d406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9a94640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 0x7ff1d40b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3513386252 0 0) 0x7ff1c0003450 con 0x7ff1d406fef0 2024-09-12T03:35:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 msgr2=0x7ff1d40b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 0x7ff1d40b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 >> v2:172.21.15.150:3300/0 conn(0x7ff1d4073e60 msgr2=0x7ff1d406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 --2- 172.21.15.73:0/3879195345 >> v2:172.21.15.150:3300/0 conn(0x7ff1d4073e60 0x7ff1d406e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d406f410 con 0x7ff1d406fef0 2024-09-12T03:35:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7ff1c4001680 con 0x7ff1d406fef0 2024-09-12T03:35:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 >> v1:172.21.15.73:6789/0 conn(0x7ff1d406fef0 legacy=0x7ff1d415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1c0003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 0x7ff1c000a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c000afa0 0x7ff1c000d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d406ee50 con 0x7ff1c0003ab0 2024-09-12T03:35:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d406f130 con 0x7ff1c000afa0 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c000dd60 con 0x7ff1d40b3d50 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9293640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1c0003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d8a92640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 0x7ff1c000a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9a94640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c000afa0 0x7ff1c000d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9293640 1 -- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 msgr2=0x7ff1c000a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9293640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d40b3d50 0x7ff1c000a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9293640 1 -- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c000afa0 msgr2=0x7ff1c000d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9293640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c000afa0 0x7ff1c000d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9293640 1 -- 172.21.15.73:0/3879195345 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c0003450 con 0x7ff1c0003ab0 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.923+0000 7ff1d9a94640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1c000afa0 0x7ff1c000d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1c0003ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000ba00 tx=0x7ff1d001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490fd753b9c54a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00b2070 con 0x7ff1c0003ab0 2024-09-12T03:35:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d00ad410 con 0x7ff1c0003ab0 2024-09-12T03:35:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1cbfff640 1 -- 172.21.15.73:0/3879195345 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000b600 con 0x7ff1c0003ab0 2024-09-12T03:35:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- 172.21.15.73:0/3879195345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 msgr2=0x7ff1c0003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 --2- 172.21.15.73:0/3879195345 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1c0003ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000ba00 tx=0x7ff1d001c6a0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9a94640 1 -- 172.21.15.73:0/3879195345 reap_dead start 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- 172.21.15.73:0/3879195345 shutdown_connections 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- 172.21.15.73:0/3879195345 >> 172.21.15.73:0/3879195345 conn(0x7ff1d40b1f90 msgr2=0x7ff1d40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- 172.21.15.73:0/3879195345 shutdown_connections 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- 172.21.15.73:0/3879195345 wait complete. 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 Processor -- start 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- start start 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1d414a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d414a060 0x7ff1d4146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1d415cb30 0x7ff1d415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d40729a0 con 0x7ff1c0003ab0 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4072820 con 0x7ff1d415cb30 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d4072b20 con 0x7ff1d414a060 2024-09-12T03:35:49.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1d414a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1d414a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54834/0 (socket says 172.21.15.73:54834) 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 -- 172.21.15.73:0/1060377584 learned_addr learned my addr 172.21.15.73:0/1060377584 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 -- 172.21.15.73:0/1060377584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d414a060 msgr2=0x7ff1d4146010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d414a060 0x7ff1d4146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 -- 172.21.15.73:0/1060377584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1d415cb30 msgr2=0x7ff1d415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1d415cb30 0x7ff1d415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 -- 172.21.15.73:0/1060377584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d414b2d0 con 0x7ff1c0003ab0 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1d9293640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1d414a720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff1d001c4d0 tx=0x7ff1c0003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1c9ffb640 1 -- 172.21.15.73:0/1060377584 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00bd070 con 0x7ff1c0003ab0 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1c9ffb640 1 -- 172.21.15.73:0/1060377584 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d00b8430 con 0x7ff1c0003ab0 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d414b5b0 con 0x7ff1c0003ab0 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1c9ffb640 1 -- 172.21.15.73:0/1060377584 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00b2040 con 0x7ff1c0003ab0 2024-09-12T03:35:49.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.927+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d414bb70 con 0x7ff1c0003ab0 2024-09-12T03:35:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.931+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d40b4650 con 0x7ff1c0003ab0 2024-09-12T03:35:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.931+0000 7ff1c9ffb640 1 -- 172.21.15.73:0/1060377584 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1d00c0070 con 0x7ff1c0003ab0 2024-09-12T03:35:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.931+0000 7ff1c9ffb640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff1b80678c0 0x7ff1b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.931+0000 7ff1d8a92640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff1b80678c0 0x7ff1b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.931+0000 7ff1c9ffb640 1 -- 172.21.15.73:0/1060377584 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff1d011f940 con 0x7ff1c0003ab0 2024-09-12T03:35:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.931+0000 7ff1d8a92640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff1b80678c0 0x7ff1b8069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001060 tx=0x7ff1c4000ff0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:49.935+0000 7ff1c9ffb640 1 -- 172.21.15.73:0/1060377584 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff1d00163b0 con 0x7ff1c0003ab0 2024-09-12T03:35:50.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.087+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1d40723f0 con 0x7ff1c0003ab0 2024-09-12T03:35:50.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1c9ffb640 1 -- 172.21.15.73:0/1060377584 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17014 (secure 0 0 0) 0x7ff1d00efd30 con 0x7ff1c0003ab0 2024-09-12T03:35:50.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:50.092 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:35:33.137392+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:35:29.283824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T03:35:30.467360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff1b80678c0 msgr2=0x7ff1b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff1b80678c0 0x7ff1b8069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4001060 tx=0x7ff1c4000ff0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 msgr2=0x7ff1d414a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1d414a720 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff1d001c4d0 tx=0x7ff1c0003740 comp rx=0 tx=0).stop 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 shutdown_connections 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff1b80678c0 0x7ff1b8069d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1d415cb30 0x7ff1d415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff1d414a060 0x7ff1d4146010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 --2- 172.21.15.73:0/1060377584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1c0003ab0 0x7ff1d414a720 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 >> 172.21.15.73:0/1060377584 conn(0x7ff1d40b1f90 msgr2=0x7ff1d41538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 shutdown_connections 2024-09-12T03:35:50.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.091+0000 7ff1db4f7640 1 -- 172.21.15.73:0/1060377584 wait complete. 2024-09-12T03:35:50.109 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:35:50.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:50.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f46339ac640 1 Processor -- start 2024-09-12T03:35:50.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f46339ac640 1 -- start start 2024-09-12T03:35:50.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f46339ac640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f462c0b40c0 0x7f462c09aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f46339ac640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462c0b5c90 con 0x7f462c15e450 2024-09-12T03:35:50.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f46339ac640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462c0b4580 con 0x7f462c06c3d0 2024-09-12T03:35:50.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f46339ac640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f462c0b4860 con 0x7f462c0b40c0 2024-09-12T03:35:50.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f4631f49640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f462c0b40c0 0x7f462c09aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f4631748640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f462c15e450 0x7f462c06bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58906/0 (socket says 172.21.15.73:58906) 2024-09-12T03:35:50.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f4631f49640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f462c0b40c0 0x7f462c09aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54838/0 (socket says 172.21.15.73:54838) 2024-09-12T03:35:50.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.215+0000 7f4631748640 1 -- 172.21.15.73:0/3649598230 learned_addr learned my addr 172.21.15.73:0/3649598230 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:50.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4631f49640 1 -- 172.21.15.73:0/3649598230 >> v1:172.21.15.150:6789/0 conn(0x7f462c06c3d0 legacy=0x7f462c162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:50.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4631f49640 1 -- 172.21.15.73:0/3649598230 >> v1:172.21.15.73:6789/0 conn(0x7f462c15e450 legacy=0x7f462c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4623fff640 1 -- 172.21.15.73:0/3649598230 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75794387 0 0) 0x7f46240014a0 con 0x7f462c15e450 2024-09-12T03:35:50.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4631f49640 1 -- 172.21.15.73:0/3649598230 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c0b5f10 con 0x7f462c0b40c0 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4631f49640 1 --2- 172.21.15.73:0/3649598230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c0b40c0 0x7f462c09aa00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46280097c0 tx=0x7f462801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85538abc4a5e486 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4623fff640 1 -- 172.21.15.73:0/3649598230 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280b0070 con 0x7f462c0b40c0 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4623fff640 1 -- 172.21.15.73:0/3649598230 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46280ab600 con 0x7f462c0b40c0 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f4623fff640 1 -- 172.21.15.73:0/3649598230 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46280ab9d0 con 0x7f462c0b40c0 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f46339ac640 1 -- 172.21.15.73:0/3649598230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c0b40c0 msgr2=0x7f462c09aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f46339ac640 1 --2- 172.21.15.73:0/3649598230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c0b40c0 0x7f462c09aa00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f46280097c0 tx=0x7f462801c3d0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f46339ac640 1 -- 172.21.15.73:0/3649598230 shutdown_connections 2024-09-12T03:35:50.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f46339ac640 1 --2- 172.21.15.73:0/3649598230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c0b40c0 0x7f462c09aa00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f46339ac640 1 -- 172.21.15.73:0/3649598230 >> 172.21.15.73:0/3649598230 conn(0x7f462c0b6800 msgr2=0x7f462c0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:50.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f46339ac640 1 -- 172.21.15.73:0/3649598230 shutdown_connections 2024-09-12T03:35:50.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.219+0000 7f46339ac640 1 -- 172.21.15.73:0/3649598230 wait complete. 2024-09-12T03:35:50.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 Processor -- start 2024-09-12T03:35:50.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 -- start start 2024-09-12T03:35:50.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c06c3d0 0x7f462c14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f462c0b40c0 0x7f462c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f462c15e450 0x7f462c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f462c15f9c0 con 0x7f462c06c3d0 2024-09-12T03:35:50.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f462c15f840 con 0x7f462c15e450 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f462c162e90 con 0x7f462c0b40c0 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c06c3d0 0x7f462c14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c06c3d0 0x7f462c14db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54854/0 (socket says 172.21.15.73:54854) 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 -- 172.21.15.73:0/2040887591 learned_addr learned my addr 172.21.15.73:0/2040887591 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4630f47640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f462c0b40c0 0x7f462c15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 -- 172.21.15.73:0/2040887591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f462c0b40c0 msgr2=0x7f462c15caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f462c0b40c0 0x7f462c15caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 -- 172.21.15.73:0/2040887591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f462c15e450 msgr2=0x7f462c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f462c15e450 0x7f462c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 -- 172.21.15.73:0/2040887591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c155610 con 0x7f462c06c3d0 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4631748640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c06c3d0 0x7f462c14db30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f462400c7f0 tx=0x7f462400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4621ffb640 1 -- 172.21.15.73:0/2040887591 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624018070 con 0x7f462c06c3d0 2024-09-12T03:35:50.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4621ffb640 1 -- 172.21.15.73:0/2040887591 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462400a640 con 0x7f462c06c3d0 2024-09-12T03:35:50.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c1558f0 con 0x7f462c06c3d0 2024-09-12T03:35:50.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4621ffb640 1 -- 172.21.15.73:0/2040887591 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f462400aa30 con 0x7f462c06c3d0 2024-09-12T03:35:50.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c155eb0 con 0x7f462c06c3d0 2024-09-12T03:35:50.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462c09aa00 con 0x7f462c06c3d0 2024-09-12T03:35:50.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4621ffb640 1 -- 172.21.15.73:0/2040887591 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f462401b070 con 0x7f462c06c3d0 2024-09-12T03:35:50.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4621ffb640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f46100678c0 0x7f4610069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4621ffb640 1 -- 172.21.15.73:0/2040887591 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f46240854a0 con 0x7f462c06c3d0 2024-09-12T03:35:50.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.223+0000 7f4630f47640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f46100678c0 0x7f4610069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.227+0000 7f4630f47640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f46100678c0 0x7f4610069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f462c15d890 tx=0x7f461c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.231+0000 7f4621ffb640 1 -- 172.21.15.73:0/2040887591 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f462c0b5c90 con 0x7f462c06c3d0 2024-09-12T03:35:50.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.419+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f462c154d80 con 0x7f462c06c3d0 2024-09-12T03:35:50.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.419+0000 7f4621ffb640 1 -- 172.21.15.73:0/2040887591 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7f4624055e50 con 0x7f462c06c3d0 2024-09-12T03:35:50.421 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:50.421 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"btime":"2024-09-12T03:35:35:181396+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4171638220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4171638220},{"type":"v1","addr":"172.21.15.150:6834","nonce":4171638220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/586996144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":586996144},{"type":"v1","addr":"172.21.15.150:6835","nonce":586996144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4854,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1039518252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1039518252},{"type":"v1","addr":"172.21.15.73:6835","nonce":1039518252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:35:31.472966+0000","modified":"2024-09-12T03:35:34.542272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/1768372387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1768372387},{"type":"v1","addr":"172.21.15.73:6837","nonce":1768372387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-12T03:35:50.421 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-09-12T03:35:50.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f46100678c0 msgr2=0x7f4610069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f46100678c0 0x7f4610069d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f462c15d890 tx=0x7f461c009040 comp rx=0 tx=0).stop 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c06c3d0 msgr2=0x7f462c14db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c06c3d0 0x7f462c14db30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f462400c7f0 tx=0x7f462400ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 shutdown_connections 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f46100678c0 0x7f4610069d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f462c15e450 0x7f462c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f462c0b40c0 0x7f462c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 --2- 172.21.15.73:0/2040887591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f462c06c3d0 0x7f462c14db30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 >> 172.21.15.73:0/2040887591 conn(0x7f462c0b6800 msgr2=0x7f462c162330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 shutdown_connections 2024-09-12T03:35:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.423+0000 7f46339ac640 1 -- 172.21.15.73:0/2040887591 wait complete. 2024-09-12T03:35:50.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a70031640 1 Processor -- start 2024-09-12T03:35:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a70031640 1 -- start start 2024-09-12T03:35:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a70031640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7a68161a60 0x7f7a680d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a70031640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a680d2e90 0x7f7a680cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a70031640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a680d32b0 con 0x7f7a680cf450 2024-09-12T03:35:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a70031640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7a680d0300 con 0x7f7a680d2e90 2024-09-12T03:35:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a70031640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f7a6806e6c0 con 0x7f7a68161a60 2024-09-12T03:35:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6e5ce640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7a680cf450 0x7f7a680d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58910/0 (socket says 172.21.15.73:58910) 2024-09-12T03:35:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6d5cc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a680d2e90 0x7f7a680cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6e5ce640 1 -- 172.21.15.73:0/120383383 learned_addr learned my addr 172.21.15.73:0/120383383 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6ddcd640 1 --2- 172.21.15.73:0/120383383 >> v2:172.21.15.150:3300/0 conn(0x7f7a68161a60 0x7f7a680d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6d5cc640 1 -- 172.21.15.73:0/120383383 >> v2:172.21.15.150:3300/0 conn(0x7f7a68161a60 msgr2=0x7f7a680d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6d5cc640 1 --2- 172.21.15.73:0/120383383 >> v2:172.21.15.150:3300/0 conn(0x7f7a68161a60 0x7f7a680d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6d5cc640 1 -- 172.21.15.73:0/120383383 >> v1:172.21.15.73:6789/0 conn(0x7f7a680cf450 legacy=0x7f7a680d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6d5cc640 1 -- 172.21.15.73:0/120383383 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a680b0f60 con 0x7f7a680d2e90 2024-09-12T03:35:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6ddcd640 1 --2- 172.21.15.73:0/120383383 >> v2:172.21.15.150:3300/0 conn(0x7f7a68161a60 0x7f7a680d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.563+0000 7f7a6d5cc640 1 --2- 172.21.15.73:0/120383383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680d2e90 0x7f7a680cef10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a6808e010 tx=0x7f7a5801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40a61801ae818fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6cdcb640 1 -- 172.21.15.73:0/120383383 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a580b1070 con 0x7f7a680d2e90 2024-09-12T03:35:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6cdcb640 1 -- 172.21.15.73:0/120383383 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a580ac620 con 0x7f7a680d2e90 2024-09-12T03:35:50.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6cdcb640 1 -- 172.21.15.73:0/120383383 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a680d1930 con 0x7f7a680d2e90 2024-09-12T03:35:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- 172.21.15.73:0/120383383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680d2e90 msgr2=0x7f7a680cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 --2- 172.21.15.73:0/120383383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680d2e90 0x7f7a680cef10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a6808e010 tx=0x7f7a5801c3c0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- 172.21.15.73:0/120383383 shutdown_connections 2024-09-12T03:35:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 --2- 172.21.15.73:0/120383383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680d2e90 0x7f7a680cef10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 --2- 172.21.15.73:0/120383383 >> v2:172.21.15.150:3300/0 conn(0x7f7a68161a60 0x7f7a680d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- 172.21.15.73:0/120383383 >> 172.21.15.73:0/120383383 conn(0x7f7a6808bf90 msgr2=0x7f7a6809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- 172.21.15.73:0/120383383 shutdown_connections 2024-09-12T03:35:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- 172.21.15.73:0/120383383 wait complete. 2024-09-12T03:35:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 Processor -- start 2024-09-12T03:35:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- start start 2024-09-12T03:35:50.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680cf450 0x7f7a68153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a680d2e90 0x7f7a680b9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a68161a60 0x7f7a680b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6816af20 con 0x7f7a680cf450 2024-09-12T03:35:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6806d190 con 0x7f7a68161a60 2024-09-12T03:35:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6816b0a0 con 0x7f7a680d2e90 2024-09-12T03:35:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680cf450 0x7f7a68153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680cf450 0x7f7a68153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54864/0 (socket says 172.21.15.73:54864) 2024-09-12T03:35:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 -- 172.21.15.73:0/3456172709 learned_addr learned my addr 172.21.15.73:0/3456172709 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6e5ce640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a68161a60 0x7f7a680b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6d5cc640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a680d2e90 0x7f7a680b9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 -- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a680d2e90 msgr2=0x7f7a680b9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a680d2e90 0x7f7a680b9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 -- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a68161a60 msgr2=0x7f7a680b9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a68161a60 0x7f7a680b9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 -- 172.21.15.73:0/3456172709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a68153dc0 con 0x7f7a680cf450 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6e5ce640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a68161a60 0x7f7a680b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a6ddcd640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680cf450 0x7f7a68153880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c7f0 tx=0x7f7a6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a5e7fc640 1 -- 172.21.15.73:0/3456172709 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64015070 con 0x7f7a680cf450 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a5e7fc640 1 -- 172.21.15.73:0/3456172709 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a64007820 con 0x7f7a680cf450 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a680b9fc0 con 0x7f7a680cf450 2024-09-12T03:35:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a5e7fc640 1 -- 172.21.15.73:0/3456172709 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64007c10 con 0x7f7a680cf450 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.567+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a68157810 con 0x7f7a680cf450 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.571+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a680cef10 con 0x7f7a680cf450 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.571+0000 7f7a5e7fc640 1 -- 172.21.15.73:0/3456172709 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a64018070 con 0x7f7a680cf450 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.571+0000 7f7a5e7fc640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a4c0678c0 0x7f7a4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.571+0000 7f7a6d5cc640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a4c0678c0 0x7f7a4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.571+0000 7f7a5e7fc640 1 -- 172.21.15.73:0/3456172709 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7a64085ec0 con 0x7f7a680cf450 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.571+0000 7f7a6d5cc640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a4c0678c0 0x7f7a4c069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a580ae000 tx=0x7f7a58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.575+0000 7f7a5e7fc640 1 -- 172.21.15.73:0/3456172709 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a64056900 con 0x7f7a680cf450 2024-09-12T03:35:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.771+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a6809d8a0 con 0x7f7a680cf450 2024-09-12T03:35:50.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a5e7fc640 1 -- 172.21.15.73:0/3456172709 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5226 (secure 0 0 0) 0x7f7a64056200 con 0x7f7a680cf450 2024-09-12T03:35:50.775 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:50.775 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"btime":"2024-09-12T03:35:35:181396+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4171638220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4171638220},{"type":"v1","addr":"172.21.15.150:6834","nonce":4171638220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/586996144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":586996144},{"type":"v1","addr":"172.21.15.150:6835","nonce":586996144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4854,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1039518252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1039518252},{"type":"v1","addr":"172.21.15.73:6835","nonce":1039518252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:35:31.472966+0000","modified":"2024-09-12T03:35:34.542272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4857},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4857":{"gid":4857,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/1768372387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1768372387},{"type":"v1","addr":"172.21.15.73:6837","nonce":1768372387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4857,"qdb_cluster":[4857]},"id":2}]} 2024-09-12T03:35:50.775 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-09-12T03:35:50.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a4c0678c0 msgr2=0x7f7a4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a4c0678c0 0x7f7a4c069d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a580ae000 tx=0x7f7a58008040 comp rx=0 tx=0).stop 2024-09-12T03:35:50.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680cf450 msgr2=0x7f7a68153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680cf450 0x7f7a68153880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400c7f0 tx=0x7f7a6400ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 shutdown_connections 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a4c0678c0 0x7f7a4c069d80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a68161a60 0x7f7a680b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a680d2e90 0x7f7a680b9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 --2- 172.21.15.73:0/3456172709 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a680cf450 0x7f7a68153880 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 >> 172.21.15.73:0/3456172709 conn(0x7f7a6808bf90 msgr2=0x7f7a680b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 shutdown_connections 2024-09-12T03:35:50.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.775+0000 7f7a70031640 1 -- 172.21.15.73:0/3456172709 wait complete. 2024-09-12T03:35:50.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.907+0000 7f005dca5640 1 Processor -- start 2024-09-12T03:35:50.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.907+0000 7f005dca5640 1 -- start start 2024-09-12T03:35:50.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f005dca5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815bec0 0x7f00580ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f005dca5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00580b3290 con 0x7f005815c2a0 2024-09-12T03:35:50.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f005dca5640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00580b3570 con 0x7f00580af470 2024-09-12T03:35:50.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f005dca5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f00580b3850 con 0x7f005815bec0 2024-09-12T03:35:50.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f0056ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f005815c2a0 0x7f00580aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58920/0 (socket says 172.21.15.73:58920) 2024-09-12T03:35:50.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f0056ffd640 1 -- 172.21.15.73:0/1999191859 learned_addr learned my addr 172.21.15.73:0/1999191859 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:50.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00577fe640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815bec0 0x7f00580ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240840845 0 0) 0x7f00580b3290 con 0x7f005815c2a0 2024-09-12T03:35:50.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0040003530 con 0x7f005815c2a0 2024-09-12T03:35:50.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2335683904 0 0) 0x7f0040003530 con 0x7f005815c2a0 2024-09-12T03:35:50.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815bec0 msgr2=0x7f00580ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:50.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815bec0 0x7f00580ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 >> v1:172.21.15.150:6789/0 conn(0x7f00580af470 legacy=0x7f005806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00580b3b30 con 0x7f005815c2a0 2024-09-12T03:35:50.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f004c001680 con 0x7f005815c2a0 2024-09-12T03:35:50.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 >> v1:172.21.15.73:6789/0 conn(0x7f005815c2a0 legacy=0x7f00580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f0040003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815bec0 0x7f0040004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0040004d50 0x7f00400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00580b3850 con 0x7f00400039f0 2024-09-12T03:35:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f004000bab0 con 0x7f0040004d50 2024-09-12T03:35:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f004000bcb0 con 0x7f005815bec0 2024-09-12T03:35:50.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00577fe640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f0040003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00577fe640 1 -- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815bec0 msgr2=0x7f0040004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00577fe640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815bec0 0x7f0040004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00577fe640 1 -- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0040004d50 msgr2=0x7f00400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00577fe640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0040004d50 0x7f00400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.911+0000 7f00577fe640 1 -- 172.21.15.73:0/1999191859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0040003530 con 0x7f00400039f0 2024-09-12T03:35:50.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f0040003e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0050009f90 tx=0x7f005001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccbe8134ab48655 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00500b2070 con 0x7f00400039f0 2024-09-12T03:35:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00500a5c40 con 0x7f00400039f0 2024-09-12T03:35:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00567fc640 1 -- 172.21.15.73:0/1999191859 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050009c10 con 0x7f00400039f0 2024-09-12T03:35:50.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- 172.21.15.73:0/1999191859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 msgr2=0x7f0040003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 --2- 172.21.15.73:0/1999191859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f0040003e10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0050009f90 tx=0x7f005001cc50 comp rx=0 tx=0).stop 2024-09-12T03:35:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f0057fff640 1 -- 172.21.15.73:0/1999191859 reap_dead start 2024-09-12T03:35:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- 172.21.15.73:0/1999191859 shutdown_connections 2024-09-12T03:35:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- 172.21.15.73:0/1999191859 >> 172.21.15.73:0/1999191859 conn(0x7f00580b1f90 msgr2=0x7f00580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:50.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- 172.21.15.73:0/1999191859 shutdown_connections 2024-09-12T03:35:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- 172.21.15.73:0/1999191859 wait complete. 2024-09-12T03:35:50.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 Processor -- start 2024-09-12T03:35:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- start start 2024-09-12T03:35:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f005814d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00581fbc70 0x7f00581507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815aa30 0x7f005815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00580ad790 con 0x7f00400039f0 2024-09-12T03:35:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f00580ad610 con 0x7f00581fbc70 2024-09-12T03:35:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f005806ef20 con 0x7f005815aa30 2024-09-12T03:35:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f005814d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f005814d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54874/0 (socket says 172.21.15.73:54874) 2024-09-12T03:35:50.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 -- 172.21.15.73:0/988154257 learned_addr learned my addr 172.21.15.73:0/988154257 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:50.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 -- 172.21.15.73:0/988154257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815aa30 msgr2=0x7f005815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f0056ffd640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00581fbc70 0x7f00581507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815aa30 0x7f005815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 -- 172.21.15.73:0/988154257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00581fbc70 msgr2=0x7f00581507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:50.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00581fbc70 0x7f00581507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:50.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 -- 172.21.15.73:0/988154257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00581510e0 con 0x7f00400039f0 2024-09-12T03:35:50.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f00577fe640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f005814d670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f005001ca80 tx=0x7f0050009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f003ffff640 1 -- 172.21.15.73:0/988154257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00500b2040 con 0x7f00400039f0 2024-09-12T03:35:50.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f003ffff640 1 -- 172.21.15.73:0/988154257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00500a5a40 con 0x7f00400039f0 2024-09-12T03:35:50.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00581513c0 con 0x7f00400039f0 2024-09-12T03:35:50.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f003ffff640 1 -- 172.21.15.73:0/988154257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00500adc70 con 0x7f00400039f0 2024-09-12T03:35:50.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.915+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0058151980 con 0x7f00400039f0 2024-09-12T03:35:50.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.919+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005806fcd0 con 0x7f00400039f0 2024-09-12T03:35:50.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.919+0000 7f003ffff640 1 -- 172.21.15.73:0/988154257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00500bf020 con 0x7f00400039f0 2024-09-12T03:35:50.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.919+0000 7f003ffff640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00440678f0 0x7f0044069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:50.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.919+0000 7f0056ffd640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00440678f0 0x7f0044069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:50.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.919+0000 7f003ffff640 1 -- 172.21.15.73:0/988154257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0050120490 con 0x7f00400039f0 2024-09-12T03:35:50.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.919+0000 7f0056ffd640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00440678f0 0x7f0044069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00580b1170 tx=0x7f004c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:50.923+0000 7f003ffff640 1 -- 172.21.15.73:0/988154257 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0050016990 con 0x7f00400039f0 2024-09-12T03:35:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.083+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00580d0a50 con 0x7f00400039f0 2024-09-12T03:35:51.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.087+0000 7f003ffff640 1 -- 172.21.15.73:0/988154257 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17014 (secure 0 0 0) 0x7f00500f0da0 con 0x7f00400039f0 2024-09-12T03:35:51.089 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:51.089 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":39,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:35:33.137392+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:35:29.283824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-12T03:35:30.467360+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:51.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00440678f0 msgr2=0x7f0044069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00440678f0 0x7f0044069db0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00580b1170 tx=0x7f004c009040 comp rx=0 tx=0).stop 2024-09-12T03:35:51.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 msgr2=0x7f005814d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f005814d670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f005001ca80 tx=0x7f0050009750 comp rx=0 tx=0).stop 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 shutdown_connections 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00440678f0 0x7f0044069db0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f005815aa30 0x7f005815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00581fbc70 0x7f00581507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 --2- 172.21.15.73:0/988154257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00400039f0 0x7f005814d670 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 >> 172.21.15.73:0/988154257 conn(0x7f00580b1f90 msgr2=0x7f0058159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 shutdown_connections 2024-09-12T03:35:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.091+0000 7f005dca5640 1 -- 172.21.15.73:0/988154257 wait complete. 2024-09-12T03:35:51.107 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:35:51.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85abf4b640 1 Processor -- start 2024-09-12T03:35:51.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85abf4b640 1 -- start start 2024-09-12T03:35:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85abf4b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415bec0 0x7f85a40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85abf4b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85a415c2a0 0x7f85a40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85abf4b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85a40b3290 con 0x7f85a40af2a0 2024-09-12T03:35:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85abf4b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f85a40b3570 con 0x7f85a415c2a0 2024-09-12T03:35:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85abf4b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f85a40b3850 con 0x7f85a415bec0 2024-09-12T03:35:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85a94e6640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85a415c2a0 0x7f85a40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85a9ce7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415bec0 0x7f85a40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85a94e6640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f85a415c2a0 0x7f85a40aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:39116/0 (socket says 172.21.15.73:39116) 2024-09-12T03:35:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85aa4e8640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f85a40af2a0 0x7f85a415fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:38592/0 (socket says 172.21.15.73:38592) 2024-09-12T03:35:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.215+0000 7f85a94e6640 1 -- 172.21.15.73:0/198668125 learned_addr learned my addr 172.21.15.73:0/198668125 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.219+0000 7f85a9ce7640 1 -- 172.21.15.73:0/198668125 >> v2:172.21.15.150:3300/0 conn(0x7f85a415c2a0 msgr2=0x7f85a40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.219+0000 7f85a9ce7640 1 --2- 172.21.15.73:0/198668125 >> v2:172.21.15.150:3300/0 conn(0x7f85a415c2a0 0x7f85a40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.219+0000 7f85a9ce7640 1 -- 172.21.15.73:0/198668125 >> v1:172.21.15.150:6789/0 conn(0x7f85a40af2a0 legacy=0x7f85a415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.219+0000 7f85a9ce7640 1 -- 172.21.15.73:0/198668125 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a40b3b30 con 0x7f85a415bec0 2024-09-12T03:35:51.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85a9ce7640 1 --2- 172.21.15.73:0/198668125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415bec0 0x7f85a40ad200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f85940097c0 tx=0x7f859401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a85ed513328b183 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:51.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85a8ce5640 1 -- 172.21.15.73:0/198668125 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940a7070 con 0x7f85a415bec0 2024-09-12T03:35:51.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85a8ce5640 1 -- 172.21.15.73:0/198668125 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85940b0070 con 0x7f85a415bec0 2024-09-12T03:35:51.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85a8ce5640 1 -- 172.21.15.73:0/198668125 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85940ab890 con 0x7f85a415bec0 2024-09-12T03:35:51.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 -- 172.21.15.73:0/198668125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415bec0 msgr2=0x7f85a40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 --2- 172.21.15.73:0/198668125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415bec0 0x7f85a40ad200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f85940097c0 tx=0x7f859401c470 comp rx=0 tx=0).stop 2024-09-12T03:35:51.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 -- 172.21.15.73:0/198668125 shutdown_connections 2024-09-12T03:35:51.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 --2- 172.21.15.73:0/198668125 >> v2:172.21.15.150:3300/0 conn(0x7f85a415c2a0 0x7f85a40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 --2- 172.21.15.73:0/198668125 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415bec0 0x7f85a40ad200 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 -- 172.21.15.73:0/198668125 >> 172.21.15.73:0/198668125 conn(0x7f85a40b1f90 msgr2=0x7f85a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:51.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 -- 172.21.15.73:0/198668125 shutdown_connections 2024-09-12T03:35:51.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 -- 172.21.15.73:0/198668125 wait complete. 2024-09-12T03:35:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 Processor -- start 2024-09-12T03:35:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.223+0000 7f85abf4b640 1 -- start start 2024-09-12T03:35:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85a40af2a0 0x7f85a414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85a415bec0 0x7f85a40cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415c2a0 0x7f85a4151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f85a40af6b0 con 0x7f85a415bec0 2024-09-12T03:35:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f85a40ad740 con 0x7f85a40af2a0 2024-09-12T03:35:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f85a4169000 con 0x7f85a415c2a0 2024-09-12T03:35:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85a415bec0 0x7f85a40cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85a415bec0 0x7f85a40cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54876/0 (socket says 172.21.15.73:54876) 2024-09-12T03:35:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 -- 172.21.15.73:0/1814414978 learned_addr learned my addr 172.21.15.73:0/1814414978 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:51.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a9ce7640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85a40af2a0 0x7f85a414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85aa4e8640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415c2a0 0x7f85a4151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 -- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415c2a0 msgr2=0x7f85a4151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415c2a0 0x7f85a4151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 -- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85a40af2a0 msgr2=0x7f85a414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85a40af2a0 0x7f85a414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 -- 172.21.15.73:0/1814414978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a40af830 con 0x7f85a415bec0 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a94e6640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85a415bec0 0x7f85a40cfe50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f85a000e870 tx=0x7f85a000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:51.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f859a7fc640 1 -- 172.21.15.73:0/1814414978 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0017070 con 0x7f85a415bec0 2024-09-12T03:35:51.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f859a7fc640 1 -- 172.21.15.73:0/1814414978 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a000c940 con 0x7f85a415bec0 2024-09-12T03:35:51.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a415d7d0 con 0x7f85a415bec0 2024-09-12T03:35:51.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f859a7fc640 1 -- 172.21.15.73:0/1814414978 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a000cd10 con 0x7f85a415bec0 2024-09-12T03:35:51.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a415dd50 con 0x7f85a415bec0 2024-09-12T03:35:51.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a40ad200 con 0x7f85a415bec0 2024-09-12T03:35:51.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f859a7fc640 1 -- 172.21.15.73:0/1814414978 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85a001a070 con 0x7f85a415bec0 2024-09-12T03:35:51.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f859a7fc640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85880678c0 0x7f8588069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f85a9ce7640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85880678c0 0x7f8588069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.227+0000 7f859a7fc640 1 -- 172.21.15.73:0/1814414978 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f85a0085ca0 con 0x7f85a415bec0 2024-09-12T03:35:51.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.231+0000 7f85a9ce7640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85880678c0 0x7f8588069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85940af000 tx=0x7f85940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:51.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.235+0000 7f859a7fc640 1 -- 172.21.15.73:0/1814414978 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f85a0056650 con 0x7f85a415bec0 2024-09-12T03:35:51.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.415+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f85a406fcd0 con 0x7f85a415bec0 2024-09-12T03:35:51.417 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T03:35:51.415+0000 7fe1c1027640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:35:51.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.419+0000 7f859a7fc640 1 -- 172.21.15.73:0/1814414978 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f85a0055f50 con 0x7f85a415bec0 2024-09-12T03:35:51.420 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:35:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.419+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85880678c0 msgr2=0x7f8588069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.419+0000 7f85abf4b640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85880678c0 0x7f8588069d80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85940af000 tx=0x7f85940a7000 comp rx=0 tx=0).stop 2024-09-12T03:35:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.419+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85a415bec0 msgr2=0x7f85a40cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.419+0000 7f85abf4b640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85a415bec0 0x7f85a40cfe50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f85a000e870 tx=0x7f85a000ed30 comp rx=0 tx=0).stop 2024-09-12T03:35:51.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 shutdown_connections 2024-09-12T03:35:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85880678c0 0x7f8588069d80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85a415bec0 0x7f85a40cfe50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85a415c2a0 0x7f85a4151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 --2- 172.21.15.73:0/1814414978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85a40af2a0 0x7f85a414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 >> 172.21.15.73:0/1814414978 conn(0x7f85a40b1f90 msgr2=0x7f85a40b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:51.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 shutdown_connections 2024-09-12T03:35:51.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.423+0000 7f85abf4b640 1 -- 172.21.15.73:0/1814414978 wait complete. 2024-09-12T03:35:51.431 INFO:tasks.ceph.mds.a.smithi073.stderr: -1961> 2024-09-12T03:35:36.067+0000 7fa452fa4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:35:51.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:35:51.469 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:35:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9586598640 1 Processor -- start 2024-09-12T03:35:51.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9586598640 1 -- start start 2024-09-12T03:35:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9586598640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95801630c0 0x7f958006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9586598640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 0x7f95801634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9586598640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958006e470 con 0x7f95800b3290 2024-09-12T03:35:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9586598640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f958006e750 con 0x7f95801630c0 2024-09-12T03:35:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9586598640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f958006ea30 con 0x7f958006df70 2024-09-12T03:35:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9584b35640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f95800b3290 0x7f95800ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58930/0 (socket says 172.21.15.73:58930) 2024-09-12T03:35:51.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f9584b35640 1 -- 172.21.15.73:0/3871999811 learned_addr learned my addr 172.21.15.73:0/3871999811 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065018629 0 0) 0x7f958006e470 con 0x7f95800b3290 2024-09-12T03:35:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957f7fe640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 0x7f95801634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957ffff640 1 --2- 172.21.15.73:0/3871999811 >> v2:172.21.15.150:3300/0 conn(0x7f95801630c0 0x7f958006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9568003530 con 0x7f95800b3290 2024-09-12T03:35:51.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 544715488 0 0) 0x7f9568003530 con 0x7f95800b3290 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 msgr2=0x7f95801634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 0x7f95801634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 >> v2:172.21.15.150:3300/0 conn(0x7f95801630c0 msgr2=0x7f958006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 --2- 172.21.15.73:0/3871999811 >> v2:172.21.15.150:3300/0 conn(0x7f95801630c0 0x7f958006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958006ed10 con 0x7f95800b3290 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957f7fe640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 0x7f95801634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.567+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f9578001a00 con 0x7f95800b3290 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 >> v1:172.21.15.73:6789/0 conn(0x7f95800b3290 legacy=0x7f95800ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 0x7f95680039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9568003fb0 0x7f9568004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9568004d50 0x7f95680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f958006e750 con 0x7f9568004d50 2024-09-12T03:35:51.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f958006ea30 con 0x7f9568003fb0 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f956800bab0 con 0x7f958006df70 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9568004d50 0x7f95680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957ffff640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 0x7f95680039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957f7fe640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9568003fb0 0x7f9568004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 -- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 msgr2=0x7f95680039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f958006df70 0x7f95680039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 -- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9568003fb0 msgr2=0x7f9568004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9568003fb0 0x7f9568004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 -- 172.21.15.73:0/3871999811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9568003530 con 0x7f9568004d50 2024-09-12T03:35:51.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957f7fe640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9568003fb0 0x7f9568004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:51.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9568004d50 0x7f95680051d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f957800a880 tx=0x7f957801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb1157a6730a651 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957800a4a0 con 0x7f9568004d50 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95780ad650 con 0x7f9568004d50 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f957effd640 1 -- 172.21.15.73:0/3871999811 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95780adac0 con 0x7f9568004d50 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9586598640 1 -- 172.21.15.73:0/3871999811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9568004d50 msgr2=0x7f95680051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9586598640 1 --2- 172.21.15.73:0/3871999811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9568004d50 0x7f95680051d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f957800a880 tx=0x7f957801d3a0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9584b35640 1 -- 172.21.15.73:0/3871999811 reap_dead start 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9586598640 1 -- 172.21.15.73:0/3871999811 shutdown_connections 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9586598640 1 -- 172.21.15.73:0/3871999811 >> 172.21.15.73:0/3871999811 conn(0x7f95800b1f90 msgr2=0x7f95800b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9586598640 1 -- 172.21.15.73:0/3871999811 shutdown_connections 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.571+0000 7f9586598640 1 -- 172.21.15.73:0/3871999811 wait complete. 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 Processor -- start 2024-09-12T03:35:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 -- start start 2024-09-12T03:35:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9580155430 0x7f95801f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f958009d820 0x7f9580157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9580157fe0 0x7f958009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f958006fbd0 con 0x7f958009d820 2024-09-12T03:35:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f958006fa50 con 0x7f9580155430 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f95800ad910 con 0x7f9580157fe0 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f958009d820 0x7f9580157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f958009d820 0x7f9580157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54920/0 (socket says 172.21.15.73:54920) 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 -- 172.21.15.73:0/3045355618 learned_addr learned my addr 172.21.15.73:0/3045355618 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9584b35640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9580157fe0 0x7f958009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957ffff640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9580155430 0x7f95801f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 -- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9580157fe0 msgr2=0x7f958009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9580157fe0 0x7f958009ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 -- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9580155430 msgr2=0x7f95801f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9580155430 0x7f95801f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 -- 172.21.15.73:0/3045355618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958009aca0 con 0x7f958009d820 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957f7fe640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f958009d820 0x7f9580157aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f957400f6b0 tx=0x7f957400fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957cff9640 1 -- 172.21.15.73:0/3045355618 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574018070 con 0x7f958009d820 2024-09-12T03:35:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957cff9640 1 -- 172.21.15.73:0/3045355618 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9574009880 con 0x7f958009d820 2024-09-12T03:35:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958009af80 con 0x7f958009d820 2024-09-12T03:35:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957cff9640 1 -- 172.21.15.73:0/3045355618 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574009c50 con 0x7f958009d820 2024-09-12T03:35:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958009b540 con 0x7f958009d820 2024-09-12T03:35:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95801583f0 con 0x7f958009d820 2024-09-12T03:35:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.575+0000 7f957cff9640 1 -- 172.21.15.73:0/3045355618 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f957401b070 con 0x7f958009d820 2024-09-12T03:35:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.579+0000 7f957cff9640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f956c0678f0 0x7f956c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.579+0000 7f957cff9640 1 -- 172.21.15.73:0/3045355618 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f9574086090 con 0x7f958009d820 2024-09-12T03:35:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.579+0000 7f957ffff640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f956c0678f0 0x7f956c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:51.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.579+0000 7f957ffff640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f956c0678f0 0x7f956c069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f958015b0b0 tx=0x7f9570008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.583+0000 7f957cff9640 1 -- 172.21.15.73:0/3045355618 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f95801583f0 con 0x7f958009d820 2024-09-12T03:35:51.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:51.783+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f958006e3d0 con 0x7f958009d820 2024-09-12T03:35:52.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.419+0000 7f957cff9640 1 -- 172.21.15.73:0/3045355618 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f95740569f0 con 0x7f958009d820 2024-09-12T03:35:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f956c0678f0 msgr2=0x7f956c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f956c0678f0 0x7f956c069db0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f958015b0b0 tx=0x7f9570008040 comp rx=0 tx=0).stop 2024-09-12T03:35:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f958009d820 msgr2=0x7f9580157aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f958009d820 0x7f9580157aa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f957400f6b0 tx=0x7f957400fb70 comp rx=0 tx=0).stop 2024-09-12T03:35:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 shutdown_connections 2024-09-12T03:35:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f956c0678f0 0x7f956c069db0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f958009d820 0x7f9580157aa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9580157fe0 0x7f958009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 --2- 172.21.15.73:0/3045355618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9580155430 0x7f95801f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 >> 172.21.15.73:0/3045355618 conn(0x7f95800b1f90 msgr2=0x7f958015baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 shutdown_connections 2024-09-12T03:35:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.423+0000 7f9586598640 1 -- 172.21.15.73:0/3045355618 wait complete. 2024-09-12T03:35:52.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:35:52.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cff972640 1 Processor -- start 2024-09-12T03:35:52.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cff972640 1 -- start start 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cff972640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cf815bec0 0x7f3cf80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cff972640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf815c2a0 0x7f3cf80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cff972640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf80b3290 con 0x7f3cf80af2a0 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cff972640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3cf80b3570 con 0x7f3cf815bec0 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cff972640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf80b3850 con 0x7f3cf815c2a0 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfd70e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cf815bec0 0x7f3cf80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfcf0d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf815c2a0 0x7f3cf80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfd70e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3cf815bec0 0x7f3cf80ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:39168/0 (socket says 172.21.15.73:39168) 2024-09-12T03:35:52.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfd70e640 1 -- 172.21.15.73:0/874740909 learned_addr learned my addr 172.21.15.73:0/874740909 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfcf0d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf815c2a0 0x7f3cf80aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:37974/0 (socket says 172.21.15.73:37974) 2024-09-12T03:35:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfd70e640 1 -- 172.21.15.73:0/874740909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf815c2a0 msgr2=0x7f3cf80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfd70e640 1 --2- 172.21.15.73:0/874740909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf815c2a0 0x7f3cf80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfd70e640 1 -- 172.21.15.73:0/874740909 >> v1:172.21.15.150:6789/0 conn(0x7f3cf80af2a0 legacy=0x7f3cf815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cf7fff640 1 -- 172.21.15.73:0/874740909 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629725380 0 0) 0x7f3cf80b3290 con 0x7f3cf80af2a0 2024-09-12T03:35:52.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.619+0000 7f3cfd70e640 1 -- 172.21.15.73:0/874740909 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf80b3b30 con 0x7f3cf815bec0 2024-09-12T03:35:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cfd70e640 1 --2- 172.21.15.73:0/874740909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815bec0 0x7f3cf80ad200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009870 tx=0x7f3cf001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5448672569ef042 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cf7fff640 1 -- 172.21.15.73:0/874740909 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00a95f0 con 0x7f3cf815bec0 2024-09-12T03:35:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cf7fff640 1 -- 172.21.15.73:0/874740909 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf00a9790 con 0x7f3cf815bec0 2024-09-12T03:35:52.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cf7fff640 1 -- 172.21.15.73:0/874740909 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00a9b60 con 0x7f3cf815bec0 2024-09-12T03:35:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 -- 172.21.15.73:0/874740909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815bec0 msgr2=0x7f3cf80ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 --2- 172.21.15.73:0/874740909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815bec0 0x7f3cf80ad200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009870 tx=0x7f3cf001c530 comp rx=0 tx=0).stop 2024-09-12T03:35:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 -- 172.21.15.73:0/874740909 shutdown_connections 2024-09-12T03:35:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 --2- 172.21.15.73:0/874740909 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf815c2a0 0x7f3cf80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 --2- 172.21.15.73:0/874740909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815bec0 0x7f3cf80ad200 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 -- 172.21.15.73:0/874740909 >> 172.21.15.73:0/874740909 conn(0x7f3cf80b1f90 msgr2=0x7f3cf80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 -- 172.21.15.73:0/874740909 shutdown_connections 2024-09-12T03:35:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 -- 172.21.15.73:0/874740909 wait complete. 2024-09-12T03:35:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 Processor -- start 2024-09-12T03:35:52.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.623+0000 7f3cff972640 1 -- start start 2024-09-12T03:35:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf80af2a0 0x7f3cf8148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cf815bec0 0x7f3cf8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815c2a0 0x7f3cf80d0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf80af6f0 con 0x7f3cf815bec0 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf80ad740 con 0x7f3cf815c2a0 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf8169000 con 0x7f3cf80af2a0 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cf815bec0 0x7f3cf8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cf815bec0 0x7f3cf8147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54934/0 (socket says 172.21.15.73:54934) 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 -- 172.21.15.73:0/103168139 learned_addr learned my addr 172.21.15.73:0/103168139 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfd70e640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf80af2a0 0x7f3cf8148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfdf0f640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815c2a0 0x7f3cf80d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 -- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf80af2a0 msgr2=0x7f3cf8148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf80af2a0 0x7f3cf8148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 -- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815c2a0 msgr2=0x7f3cf80d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815c2a0 0x7f3cf80d0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 -- 172.21.15.73:0/103168139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf81485c0 con 0x7f3cf815bec0 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfcf0d640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cf815bec0 0x7f3cf8147830 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00efc0 tx=0x7f3cec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cf5ffb640 1 -- 172.21.15.73:0/103168139 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec018020 con 0x7f3cf815bec0 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cf5ffb640 1 -- 172.21.15.73:0/103168139 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cec014480 con 0x7f3cf815bec0 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf8148860 con 0x7f3cf815bec0 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cf5ffb640 1 -- 172.21.15.73:0/103168139 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec014850 con 0x7f3cf815bec0 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf8148e20 con 0x7f3cf815bec0 2024-09-12T03:35:52.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf80ad200 con 0x7f3cf815bec0 2024-09-12T03:35:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cf5ffb640 1 -- 172.21.15.73:0/103168139 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3cec01b020 con 0x7f3cf815bec0 2024-09-12T03:35:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cf5ffb640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ce40678c0 0x7f3ce4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfd70e640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ce40678c0 0x7f3ce4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cf5ffb640 1 -- 172.21.15.73:0/103168139 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6187+0+0 (secure 0 0 0) 0x7f3cec0868a0 con 0x7f3cf815bec0 2024-09-12T03:35:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.627+0000 7f3cfd70e640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ce40678c0 0x7f3ce4069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00ae000 tx=0x7f3cf00b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:52.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.631+0000 7f3cf5ffb640 1 -- 172.21.15.73:0/103168139 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3cec022070 con 0x7f3cf815bec0 2024-09-12T03:35:52.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:52.783+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3cf806fcd0 con 0x7f3cf815bec0 2024-09-12T03:35:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.431+0000 7f3cf5ffb640 1 -- 172.21.15.73:0/103168139 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) ==== 181+0+0 (secure 0 0 0) 0x7f3cec010040 con 0x7f3cf815bec0 2024-09-12T03:35:53.433 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:35:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ce40678c0 msgr2=0x7f3ce4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ce40678c0 0x7f3ce4069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00ae000 tx=0x7f3cf00b3040 comp rx=0 tx=0).stop 2024-09-12T03:35:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cf815bec0 msgr2=0x7f3cf8147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:53.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cf815bec0 0x7f3cf8147830 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00efc0 tx=0x7f3cec00c490 comp rx=0 tx=0).stop 2024-09-12T03:35:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 shutdown_connections 2024-09-12T03:35:53.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3ce40678c0 0x7f3ce4069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cf815bec0 0x7f3cf8147830 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3cf815c2a0 0x7f3cf80d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 --2- 172.21.15.73:0/103168139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3cf80af2a0 0x7f3cf8148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.435+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 >> 172.21.15.73:0/103168139 conn(0x7f3cf80b1f90 msgr2=0x7f3cf80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.439+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 shutdown_connections 2024-09-12T03:35:53.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.439+0000 7f3cff972640 1 -- 172.21.15.73:0/103168139 wait complete. 2024-09-12T03:35:53.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:35:53.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf2c9f640 1 Processor -- start 2024-09-12T03:35:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf2c9f640 1 -- start start 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf2c9f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec145780 0x7fbcec06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf2c9f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcec0b0bc0 con 0x7fbcec0b07e0 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf2c9f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcec145bb0 con 0x7fbcec145310 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf2c9f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec0b64b0 con 0x7fbcec145780 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf0a3b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbcec0b07e0 0x7fbcec070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58946/0 (socket says 172.21.15.73:58946) 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf0a3b640 1 -- 172.21.15.73:0/1569233102 learned_addr learned my addr 172.21.15.73:0/1569233102 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898305676 0 0) 0x7fbcdc001120 con 0x7fbcec0b07e0 2024-09-12T03:35:53.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd4003530 con 0x7fbcec0b07e0 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2558090710 0 0) 0x7fbcd4003530 con 0x7fbcec0b07e0 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec145780 msgr2=0x7fbcec06bcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec145780 0x7fbcec06bcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 >> v1:172.21.15.150:6789/0 conn(0x7fbcec145310 legacy=0x7fbcec06f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec06f0a0 con 0x7fbcec0b07e0 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fbcdc001870 con 0x7fbcec0b07e0 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 >> v1:172.21.15.73:6789/0 conn(0x7fbcec0b07e0 legacy=0x7fbcec070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd40039f0 0x7fbcd4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec145780 0x7fbcd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcd4004e70 0x7fbcd400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0b64b0 con 0x7fbcd40039f0 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4005660 con 0x7fbcd4004e70 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd400bf10 con 0x7fbcec145780 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.583+0000 7fbcf0a3b640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd40039f0 0x7fbcd4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf0a3b640 1 -- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec145780 msgr2=0x7fbcd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcebfff640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec145780 0x7fbcd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf0a3b640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec145780 0x7fbcd4004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf0a3b640 1 -- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcd4004e70 msgr2=0x7fbcd400b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf0a3b640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcd4004e70 0x7fbcd400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf0a3b640 1 -- 172.21.15.73:0/1569233102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd4003530 con 0x7fbcd40039f0 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf0a3b640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd40039f0 0x7fbcd4003e10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c410 tx=0x7fbcdc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b1c69ff409ae51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00c0e0 con 0x7fbcd40039f0 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcdc0a9070 con 0x7fbcd40039f0 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbceb7fe640 1 -- 172.21.15.73:0/1569233102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc005d40 con 0x7fbcd40039f0 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/1569233102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd40039f0 msgr2=0x7fbcd4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf2c9f640 1 --2- 172.21.15.73:0/1569233102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcd40039f0 0x7fbcd4003e10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c410 tx=0x7fbcdc01cc60 comp rx=0 tx=0).stop 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf123c640 1 -- 172.21.15.73:0/1569233102 reap_dead start 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/1569233102 shutdown_connections 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/1569233102 >> 172.21.15.73:0/1569233102 conn(0x7fbcec0b6650 msgr2=0x7fbcec0b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:53.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/1569233102 shutdown_connections 2024-09-12T03:35:53.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.587+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/1569233102 wait complete. 2024-09-12T03:35:53.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 Processor -- start 2024-09-12T03:35:53.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 -- start start 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec09ea80 0x7fbcec09ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcec15fbd0 0x7fbcec160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec140080 0x7fbcec140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0700f0 con 0x7fbcec15fbd0 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec06ff70 con 0x7fbcec140080 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec0b5a80 con 0x7fbcec09ea80 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcec15fbd0 0x7fbcec160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcec15fbd0 0x7fbcec160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54944/0 (socket says 172.21.15.73:54944) 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 -- 172.21.15.73:0/219450300 learned_addr learned my addr 172.21.15.73:0/219450300 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf123c640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec140080 0x7fbcec140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:53.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf0a3b640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec09ea80 0x7fbcec09ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 -- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec09ea80 msgr2=0x7fbcec09ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec09ea80 0x7fbcec09ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 -- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec140080 msgr2=0x7fbcec140500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec140080 0x7fbcec140500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 -- 172.21.15.73:0/219450300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec161380 con 0x7fbcec15fbd0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf123c640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec140080 0x7fbcec140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcebfff640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcec15fbd0 0x7fbcec160a50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbce000d8b0 tx=0x7fbce000dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbce97fa640 1 -- 172.21.15.73:0/219450300 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0003db0 con 0x7fbcec15fbd0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbce97fa640 1 -- 172.21.15.73:0/219450300 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce0017070 con 0x7fbcec15fbd0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec13a8c0 con 0x7fbcec15fbd0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbce97fa640 1 -- 172.21.15.73:0/219450300 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce00052f0 con 0x7fbcec15fbd0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec13ae80 con 0x7fbcec15fbd0 2024-09-12T03:35:53.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec13a6b0 con 0x7fbcec15fbd0 2024-09-12T03:35:53.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbce97fa640 1 -- 172.21.15.73:0/219450300 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbce0005490 con 0x7fbcec15fbd0 2024-09-12T03:35:53.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbce97fa640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbcd80678c0 0x7fbcd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:53.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbce97fa640 1 -- 172.21.15.73:0/219450300 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5749+0+0 (secure 0 0 0) 0x7fbce0085e70 con 0x7fbcec15fbd0 2024-09-12T03:35:53.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.591+0000 7fbcf0a3b640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbcd80678c0 0x7fbcd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:53.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.595+0000 7fbcf0a3b640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbcd80678c0 0x7fbcd8069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c3e0 tx=0x7fbcdc0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:53.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.599+0000 7fbce97fa640 1 -- 172.21.15.73:0/219450300 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbce0056a10 con 0x7fbcec15fbd0 2024-09-12T03:35:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:53.759+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbcec070790 con 0x7fbcec15fbd0 2024-09-12T03:35:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.439+0000 7fbce97fa640 1 -- 172.21.15.73:0/219450300 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) ==== 169+0+0 (secure 0 0 0) 0x7fbce0056310 con 0x7fbcec15fbd0 2024-09-12T03:35:54.442 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T03:35:54.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbcd80678c0 msgr2=0x7fbcd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbcd80678c0 0x7fbcd8069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c3e0 tx=0x7fbcdc0a7070 comp rx=0 tx=0).stop 2024-09-12T03:35:54.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcec15fbd0 msgr2=0x7fbcec160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcec15fbd0 0x7fbcec160a50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbce000d8b0 tx=0x7fbce000dd70 comp rx=0 tx=0).stop 2024-09-12T03:35:54.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 shutdown_connections 2024-09-12T03:35:54.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbcd80678c0 0x7fbcd8069d80 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c3e0 tx=0x7fbcdc0a7070 comp rx=0 tx=0).stop 2024-09-12T03:35:54.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcec15fbd0 0x7fbcec160a50 secure :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbce000d8b0 tx=0x7fbce000dd70 comp rx=0 tx=0).stop 2024-09-12T03:35:54.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcec140080 0x7fbcec140500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 --2- 172.21.15.73:0/219450300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbcec09ea80 0x7fbcec09ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.443+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 >> 172.21.15.73:0/219450300 conn(0x7fbcec0b6650 msgr2=0x7fbcec15e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:54.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.447+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 shutdown_connections 2024-09-12T03:35:54.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.447+0000 7fbcf2c9f640 1 -- 172.21.15.73:0/219450300 wait complete. 2024-09-12T03:35:54.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T03:35:54.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98ca3f0640 1 Processor -- start 2024-09-12T03:35:54.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98ca3f0640 1 -- start start 2024-09-12T03:35:54.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98ca3f0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 0x7f98c40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98ca3f0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f98c40d2e90 0x7f98c40cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98ca3f0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98c40d32b0 con 0x7f98c40cf450 2024-09-12T03:35:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98ca3f0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f98c40d0300 con 0x7f98c40d2e90 2024-09-12T03:35:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98ca3f0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98c406e6c0 con 0x7f98c4161a60 2024-09-12T03:35:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98c898d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98c40cf450 0x7f98c40d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58948/0 (socket says 172.21.15.73:58948) 2024-09-12T03:35:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.591+0000 7f98c898d640 1 -- 172.21.15.73:0/1039416239 learned_addr learned my addr 172.21.15.73:0/1039416239 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c3fff640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 0x7f98c40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 --2- 172.21.15.73:0/1039416239 >> v2:172.21.15.150:3300/0 conn(0x7f98c40d2e90 0x7f98c40cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961546280 0 0) 0x7f98c40d32b0 con 0x7f98c40cf450 2024-09-12T03:35:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ac003530 con 0x7f98c40cf450 2024-09-12T03:35:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3231450586 0 0) 0x7f98ac003530 con 0x7f98c40cf450 2024-09-12T03:35:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 msgr2=0x7f98c40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 0x7f98c40d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 >> v2:172.21.15.150:3300/0 conn(0x7f98c40d2e90 msgr2=0x7f98c40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 --2- 172.21.15.73:0/1039416239 >> v2:172.21.15.150:3300/0 conn(0x7f98c40d2e90 0x7f98c40cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c40b0f60 con 0x7f98c40cf450 2024-09-12T03:35:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f98bc001680 con 0x7f98c40cf450 2024-09-12T03:35:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 >> v1:172.21.15.73:6789/0 conn(0x7f98c40cf450 legacy=0x7f98c40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 0x7f98ac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac003f40 0x7f98ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac004d50 0x7f98ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98c40d0300 con 0x7f98ac003f40 2024-09-12T03:35:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98c406e6c0 con 0x7f98ac004d50 2024-09-12T03:35:54.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac00ba20 con 0x7f98c4161a60 2024-09-12T03:35:54.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac003f40 0x7f98ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c3fff640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 0x7f98ac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 -- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 msgr2=0x7f98ac0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:54.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 0x7f98ac0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 -- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac004d50 msgr2=0x7f98ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac004d50 0x7f98ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 -- 172.21.15.73:0/1039416239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac003530 con 0x7f98ac003f40 2024-09-12T03:35:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c3fff640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c4161a60 0x7f98ac0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c37fe640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac003f40 0x7f98ac004810 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009ae0 tx=0x7f98b801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd031765380bd98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b80b2070 con 0x7f98ac003f40 2024-09-12T03:35:54.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b80a5520 con 0x7f98ac003f40 2024-09-12T03:35:54.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.595+0000 7f98c2ffd640 1 -- 172.21.15.73:0/1039416239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98b80096b0 con 0x7f98ac003f40 2024-09-12T03:35:54.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- 172.21.15.73:0/1039416239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac003f40 msgr2=0x7f98ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 --2- 172.21.15.73:0/1039416239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac003f40 0x7f98ac004810 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f98b8009ae0 tx=0x7f98b801ca40 comp rx=0 tx=0).stop 2024-09-12T03:35:54.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 -- 172.21.15.73:0/1039416239 reap_dead start 2024-09-12T03:35:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- 172.21.15.73:0/1039416239 shutdown_connections 2024-09-12T03:35:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- 172.21.15.73:0/1039416239 >> 172.21.15.73:0/1039416239 conn(0x7f98c408bf90 msgr2=0x7f98c409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- 172.21.15.73:0/1039416239 shutdown_connections 2024-09-12T03:35:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- 172.21.15.73:0/1039416239 wait complete. 2024-09-12T03:35:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 Processor -- start 2024-09-12T03:35:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- start start 2024-09-12T03:35:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac003f40 0x7f98c415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c40b82d0 0x7f98c40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c415d2d0 0x7f98c415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98c40cf8a0 con 0x7f98c415d2d0 2024-09-12T03:35:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f98c406d190 con 0x7f98ac003f40 2024-09-12T03:35:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f98c40cfa20 con 0x7f98c40b82d0 2024-09-12T03:35:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c415d2d0 0x7f98c415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c415d2d0 0x7f98c415d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54956/0 (socket says 172.21.15.73:54956) 2024-09-12T03:35:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 -- 172.21.15.73:0/3501928933 learned_addr learned my addr 172.21.15.73:0/3501928933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:54.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c37fe640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c40b82d0 0x7f98c40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c3fff640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac003f40 0x7f98c415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 -- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c40b82d0 msgr2=0x7f98c40c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c40b82d0 0x7f98c40c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 -- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac003f40 msgr2=0x7f98c415bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac003f40 0x7f98c415bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 -- 172.21.15.73:0/3501928933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c40c9490 con 0x7f98c415d2d0 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c898d640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c415d2d0 0x7f98c415d750 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f98bc001060 tx=0x7f98bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c0ff9640 1 -- 172.21.15.73:0/3501928933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0074e0 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c0ff9640 1 -- 172.21.15.73:0/3501928933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc0047f0 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98c0ff9640 1 -- 172.21.15.73:0/3501928933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98bc007680 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c40b8990 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.599+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c40b8f50 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.603+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c40d3270 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.603+0000 7f98c0ff9640 1 -- 172.21.15.73:0/3501928933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98bc004c20 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.603+0000 7f98c0ff9640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98b00678f0 0x7f98b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.603+0000 7f98c0ff9640 1 -- 172.21.15.73:0/3501928933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f98bc084e30 con 0x7f98c415d2d0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.603+0000 7f98c3fff640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98b00678f0 0x7f98b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.603+0000 7f98c3fff640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98b00678f0 0x7f98b0069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f98c40d0bd0 tx=0x7f98b400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:54.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.607+0000 7f98c0ff9640 1 -- 172.21.15.73:0/3501928933 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f98bc01b070 con 0x7f98c415d2d0 2024-09-12T03:35:54.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.771+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f98c406dc10 con 0x7f98c415d2d0 2024-09-12T03:35:54.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98c0ff9640 1 -- 172.21.15.73:0/3501928933 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f98bc055b70 con 0x7f98c415d2d0 2024-09-12T03:35:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98b00678f0 msgr2=0x7f98b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98b00678f0 0x7f98b0069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f98c40d0bd0 tx=0x7f98b400b040 comp rx=0 tx=0).stop 2024-09-12T03:35:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c415d2d0 msgr2=0x7f98c415d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c415d2d0 0x7f98c415d750 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f98bc001060 tx=0x7f98bc00c8f0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 shutdown_connections 2024-09-12T03:35:54.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f98b00678f0 0x7f98b0069db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98c415d2d0 0x7f98c415d750 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f98c40b82d0 0x7f98c40c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 --2- 172.21.15.73:0/3501928933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98ac003f40 0x7f98c415bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 >> 172.21.15.73:0/3501928933 conn(0x7f98c408bf90 msgr2=0x7f98c40b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 shutdown_connections 2024-09-12T03:35:54.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.779+0000 7f98ca3f0640 1 -- 172.21.15.73:0/3501928933 wait complete. 2024-09-12T03:35:54.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2024-09-12T03:35:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a10982640 1 Processor -- start 2024-09-12T03:35:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a10982640 1 -- start start 2024-09-12T03:35:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a10982640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2a0c1520a0 0x7f2a0c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a10982640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2a0c06fe50 0x7f2a0c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a10982640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0c070250 con 0x7f2a0c15f1d0 2024-09-12T03:35:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a10982640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c152480 con 0x7f2a0c1520a0 2024-09-12T03:35:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a10982640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c0aede0 con 0x7f2a0c06fe50 2024-09-12T03:35:54.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a0a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2a0c1520a0 0x7f2a0c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a0a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2a0c1520a0 0x7f2a0c06f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54972/0 (socket says 172.21.15.73:54972) 2024-09-12T03:35:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a0a59c640 1 -- 172.21.15.73:0/1321316116 learned_addr learned my addr 172.21.15.73:0/1321316116 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a09d9b640 1 --2- 172.21.15.73:0/1321316116 >> v2:172.21.15.150:3300/0 conn(0x7f2a0c06fe50 0x7f2a0c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a0a59c640 1 -- 172.21.15.73:0/1321316116 >> v2:172.21.15.150:3300/0 conn(0x7f2a0c06fe50 msgr2=0x7f2a0c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a0a59c640 1 --2- 172.21.15.73:0/1321316116 >> v2:172.21.15.150:3300/0 conn(0x7f2a0c06fe50 0x7f2a0c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a0a59c640 1 -- 172.21.15.73:0/1321316116 >> v1:172.21.15.150:6789/0 conn(0x7f2a0c15f1d0 legacy=0x7f2a0c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.915+0000 7f2a0a59c640 1 -- 172.21.15.73:0/1321316116 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c15fa10 con 0x7f2a0c1520a0 2024-09-12T03:35:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a0a59c640 1 --2- 172.21.15.73:0/1321316116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c06f910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c06e510 tx=0x7f29fc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7e983a647f4579 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a0959a640 1 -- 172.21.15.73:0/1321316116 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0b1070 con 0x7f2a0c1520a0 2024-09-12T03:35:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a0959a640 1 -- 172.21.15.73:0/1321316116 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc0a8050 con 0x7f2a0c1520a0 2024-09-12T03:35:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a0959a640 1 -- 172.21.15.73:0/1321316116 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc0ac860 con 0x7f2a0c1520a0 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- 172.21.15.73:0/1321316116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 msgr2=0x7f2a0c06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 --2- 172.21.15.73:0/1321316116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c06f910 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c06e510 tx=0x7f29fc01c4c0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- 172.21.15.73:0/1321316116 shutdown_connections 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 --2- 172.21.15.73:0/1321316116 >> v2:172.21.15.150:3300/0 conn(0x7f2a0c06fe50 0x7f2a0c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 --2- 172.21.15.73:0/1321316116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c06f910 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- 172.21.15.73:0/1321316116 >> 172.21.15.73:0/1321316116 conn(0x7f2a0c0b1f90 msgr2=0x7f2a0c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- 172.21.15.73:0/1321316116 shutdown_connections 2024-09-12T03:35:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- 172.21.15.73:0/1321316116 wait complete. 2024-09-12T03:35:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 Processor -- start 2024-09-12T03:35:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- start start 2024-09-12T03:35:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c06fe50 0x7f2a0c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c15f1d0 0x7f2a0c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c073d30 con 0x7f2a0c1520a0 2024-09-12T03:35:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c073a50 con 0x7f2a0c15f1d0 2024-09-12T03:35:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a10982640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c15f660 con 0x7f2a0c06fe50 2024-09-12T03:35:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.919+0000 7f2a09d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c0999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54976/0 (socket says 172.21.15.73:54976) 2024-09-12T03:35:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 -- 172.21.15.73:0/1613236971 learned_addr learned my addr 172.21.15.73:0/1613236971 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a0a59c640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c06fe50 0x7f2a0c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a0ad9d640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c15f1d0 0x7f2a0c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 -- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c06fe50 msgr2=0x7f2a0c0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c06fe50 0x7f2a0c0b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 -- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c15f1d0 msgr2=0x7f2a0c152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:54.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c15f1d0 0x7f2a0c152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:54.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 -- 172.21.15.73:0/1613236971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c0affa0 con 0x7f2a0c1520a0 2024-09-12T03:35:54.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a0ad9d640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c15f1d0 0x7f2a0c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a09d9b640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c0999d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000c7f0 tx=0x7f2a0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f29faffd640 1 -- 172.21.15.73:0/1613236971 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00015070 con 0x7f2a0c1520a0 2024-09-12T03:35:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f29faffd640 1 -- 172.21.15.73:0/1613236971 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a00007820 con 0x7f2a0c1520a0 2024-09-12T03:35:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c0b0240 con 0x7f2a0c1520a0 2024-09-12T03:35:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f29faffd640 1 -- 172.21.15.73:0/1613236971 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a00007c10 con 0x7f2a0c1520a0 2024-09-12T03:35:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c0b0800 con 0x7f2a0c1520a0 2024-09-12T03:35:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0c15ec90 con 0x7f2a0c1520a0 2024-09-12T03:35:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f29faffd640 1 -- 172.21.15.73:0/1613236971 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a00018070 con 0x7f2a0c1520a0 2024-09-12T03:35:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f29faffd640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29ec0678c0 0x7f29ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f29faffd640 1 -- 172.21.15.73:0/1613236971 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f2a00085c90 con 0x7f2a0c1520a0 2024-09-12T03:35:54.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a0a59c640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29ec0678c0 0x7f29ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:54.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.923+0000 7f2a0a59c640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29ec0678c0 0x7f29ec069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ae000 tx=0x7f29fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:54.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:54.927+0000 7f29faffd640 1 -- 172.21.15.73:0/1613236971 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2a000568b0 con 0x7f2a0c1520a0 2024-09-12T03:35:55.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.151+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) -- 0x7f2a0c06e540 con 0x7f2a0c1520a0 2024-09-12T03:35:55.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.443+0000 7f29faffd640 1 -- 172.21.15.73:0/1613236971 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v90) ==== 160+0+0 (secure 0 0 0) 0x7f2a000561b0 con 0x7f2a0c1520a0 2024-09-12T03:35:55.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29ec0678c0 msgr2=0x7f29ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29ec0678c0 0x7f29ec069d80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0ae000 tx=0x7f29fc008040 comp rx=0 tx=0).stop 2024-09-12T03:35:55.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 msgr2=0x7f2a0c0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c0999d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000c7f0 tx=0x7f2a0000ccb0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 shutdown_connections 2024-09-12T03:35:55.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29ec0678c0 0x7f29ec069d80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a0c1520a0 0x7f2a0c0999d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a0c15f1d0 0x7f2a0c152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 --2- 172.21.15.73:0/1613236971 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2a0c06fe50 0x7f2a0c0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 >> 172.21.15.73:0/1613236971 conn(0x7f2a0c0b1f90 msgr2=0x7f2a0c1515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:55.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 shutdown_connections 2024-09-12T03:35:55.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.447+0000 7f2a10982640 1 -- 172.21.15.73:0/1613236971 wait complete. 2024-09-12T03:35:55.467 INFO:tasks.cephfs_test_runner:test: ... ok 2024-09-12T03:35:55.467 INFO:tasks.cephfs_test_runner:Starting test: test_human_readable_quota_invalid_values (tasks.cephfs.test_quota.TestQuota) test invalid values for ceph.quota.max_bytes 2024-09-12T03:35:55.467 INFO:tasks.cephfs_test_runner:test_human_readable_quota_invalid_values (tasks.cephfs.test_quota.TestQuota) 2024-09-12T03:35:55.468 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:35:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c8d2c9640 1 Processor -- start 2024-09-12T03:35:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c8d2c9640 1 -- start start 2024-09-12T03:35:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c8d2c9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0c88144d60 0x7f0c88070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c8d2c9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c88071030 con 0x7f0c880b4090 2024-09-12T03:35:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c8d2c9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8806fa50 con 0x7f0c880b52b0 2024-09-12T03:35:55.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c8d2c9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0c88070660 con 0x7f0c88144d60 2024-09-12T03:35:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0c880b4090 0x7f0c880b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52008/0 (socket says 172.21.15.73:52008) 2024-09-12T03:35:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/3097352513 learned_addr learned my addr 172.21.15.73:0/3097352513 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c86ffd640 1 --2- 172.21.15.73:0/3097352513 >> v2:172.21.15.150:3300/0 conn(0x7f0c88144d60 0x7f0c88070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267349377 0 0) 0x7f0c88071030 con 0x7f0c880b4090 2024-09-12T03:35:55.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c74003530 con 0x7f0c880b4090 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2011000577 0 0) 0x7f0c74003530 con 0x7f0c880b4090 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 >> v2:172.21.15.150:3300/0 conn(0x7f0c88144d60 msgr2=0x7f0c88070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 --2- 172.21.15.73:0/3097352513 >> v2:172.21.15.150:3300/0 conn(0x7f0c88144d60 0x7f0c88070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 >> v1:172.21.15.150:6789/0 conn(0x7f0c880b52b0 legacy=0x7f0c880ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8806fd30 con 0x7f0c880b4090 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f0c70001680 con 0x7f0c880b4090 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c86ffd640 1 --2- 172.21.15.73:0/3097352513 >> v2:172.21.15.150:3300/0 conn(0x7f0c88144d60 0x7f0c88070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 >> v1:172.21.15.73:6789/0 conn(0x7f0c880b4090 legacy=0x7f0c880b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c740039c0 0x7f0c74003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c74004810 0x7f0c74004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74005220 0x7f0c7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88070660 con 0x7f0c74004810 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7400e360 con 0x7f0c740039c0 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7400e560 con 0x7f0c74005220 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c74004810 0x7f0c74004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c86ffd640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c740039c0 0x7f0c74003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c877fe640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74005220 0x7f0c7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74005220 msgr2=0x7f0c7400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74005220 0x7f0c7400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c740039c0 msgr2=0x7f0c74003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c740039c0 0x7f0c74003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/3097352513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c74003530 con 0x7f0c74004810 2024-09-12T03:35:55.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.591+0000 7f0c877fe640 1 -- 172.21.15.73:0/3097352513 reap_dead start 2024-09-12T03:35:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c7e7fc640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c74004810 0x7f0c74004c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c1c0 tx=0x7f0c7001f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cd3ad4ba6ebf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:55.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70007d00 con 0x7f0c74004810 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c70005b00 con 0x7f0c74004810 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c867fc640 1 -- 172.21.15.73:0/3097352513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70007070 con 0x7f0c74004810 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/3097352513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c74004810 msgr2=0x7f0c74004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c74004810 0x7f0c74004c90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c1c0 tx=0x7f0c7001f3d0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/3097352513 shutdown_connections 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/3097352513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c74004810 0x7f0c74004c90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/3097352513 >> 172.21.15.73:0/3097352513 conn(0x7f0c8809aa00 msgr2=0x7f0c880b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/3097352513 shutdown_connections 2024-09-12T03:35:55.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/3097352513 wait complete. 2024-09-12T03:35:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 Processor -- start 2024-09-12T03:35:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.595+0000 7f0c8d2c9640 1 -- start start 2024-09-12T03:35:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74004810 0x7f0c8809d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8809b180 0x7f0c8813e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88141830 0x7f0c88141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0c880b6e50 con 0x7f0c8809b180 2024-09-12T03:35:55.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0c880702f0 con 0x7f0c88141830 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0c880b6fd0 con 0x7f0c74004810 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8809b180 0x7f0c8813e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8809b180 0x7f0c8813e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56710/0 (socket says 172.21.15.73:56710) 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/2242720770 learned_addr learned my addr 172.21.15.73:0/2242720770 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c86ffd640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74004810 0x7f0c8809d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c877fe640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88141830 0x7f0c88141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74004810 msgr2=0x7f0c8809d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74004810 0x7f0c8809d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88141830 msgr2=0x7f0c88141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88141830 0x7f0c88141cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 -- 172.21.15.73:0/2242720770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8815b400 con 0x7f0c8809b180 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7e7fc640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8809b180 0x7f0c8813e940 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c7001f200 tx=0x7f0c74005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:55.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7ffff640 1 -- 172.21.15.73:0/2242720770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c700bf070 con 0x7f0c8809b180 2024-09-12T03:35:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7ffff640 1 -- 172.21.15.73:0/2242720770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c70000ee0 con 0x7f0c8809b180 2024-09-12T03:35:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7ffff640 1 -- 172.21.15.73:0/2242720770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c70007d00 con 0x7f0c8809b180 2024-09-12T03:35:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8809deb0 con 0x7f0c8809b180 2024-09-12T03:35:55.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8809e470 con 0x7f0c8809b180 2024-09-12T03:35:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c880b4500 con 0x7f0c8809b180 2024-09-12T03:35:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7ffff640 1 -- 172.21.15.73:0/2242720770 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c700c2070 con 0x7f0c8809b180 2024-09-12T03:35:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7ffff640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0c680678f0 0x7f0c68069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c7ffff640 1 -- 172.21.15.73:0/2242720770 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f0c70122ea0 con 0x7f0c8809b180 2024-09-12T03:35:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.599+0000 7f0c86ffd640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0c680678f0 0x7f0c68069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.603+0000 7f0c86ffd640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0c680678f0 0x7f0c68069db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c880aecd0 tx=0x7f0c78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:55.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.603+0000 7f0c7ffff640 1 -- 172.21.15.73:0/2242720770 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c700c9020 con 0x7f0c8809b180 2024-09-12T03:35:55.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.763+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c880ae740 con 0x7f0c8809b180 2024-09-12T03:35:55.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.771+0000 7f0c7ffff640 1 -- 172.21.15.73:0/2242720770 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+13317 (secure 0 0 0) 0x7f0c700190e0 con 0x7f0c8809b180 2024-09-12T03:35:55.773 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:55.773 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":42,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:35:54.433857+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/1768372387":"2024-09-13T03:35:51.417524+0000","172.21.15.73:6836/1768372387":"2024-09-13T03:35:51.417524+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:35:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0c680678f0 msgr2=0x7f0c68069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0c680678f0 0x7f0c68069db0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c880aecd0 tx=0x7f0c78008040 comp rx=0 tx=0).stop 2024-09-12T03:35:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8809b180 msgr2=0x7f0c8813e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8809b180 0x7f0c8813e940 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c7001f200 tx=0x7f0c74005840 comp rx=0 tx=0).stop 2024-09-12T03:35:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 shutdown_connections 2024-09-12T03:35:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0c680678f0 0x7f0c68069db0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c8809b180 0x7f0c8813e940 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c88141830 0x7f0c88141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 --2- 172.21.15.73:0/2242720770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0c74004810 0x7f0c8809d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.775+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 >> 172.21.15.73:0/2242720770 conn(0x7f0c8809aa00 msgr2=0x7f0c8806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.779+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 shutdown_connections 2024-09-12T03:35:55.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.779+0000 7f0c8d2c9640 1 -- 172.21.15.73:0/2242720770 wait complete. 2024-09-12T03:35:55.799 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T03:34:25.956292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T03:35:55.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T03:35:55.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37dd5cd640 1 Processor -- start 2024-09-12T03:35:55.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37dd5cd640 1 -- start start 2024-09-12T03:35:55.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37dd5cd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f37d815bec0 0x7f37d80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37dd5cd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 0x7f37d80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37dd5cd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d80b3290 con 0x7f37d80af2a0 2024-09-12T03:35:55.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37dd5cd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f37d80b3570 con 0x7f37d815bec0 2024-09-12T03:35:55.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37dd5cd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37d80b3850 con 0x7f37d815c2a0 2024-09-12T03:35:55.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f37d80af2a0 0x7f37d815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52020/0 (socket says 172.21.15.73:52020) 2024-09-12T03:35:55.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 -- 172.21.15.73:0/3392684995 learned_addr learned my addr 172.21.15.73:0/3392684995 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d6ffd640 1 --2- 172.21.15.73:0/3392684995 >> v2:172.21.15.150:3300/0 conn(0x7f37d815bec0 0x7f37d80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995200658 0 0) 0x7f37d80b3290 con 0x7f37d80af2a0 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c0003530 con 0x7f37d80af2a0 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 223174293 0 0) 0x7f37c0003530 con 0x7f37d80af2a0 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 msgr2=0x7f37d80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 0x7f37d80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 >> v2:172.21.15.150:3300/0 conn(0x7f37d815bec0 msgr2=0x7f37d80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 --2- 172.21.15.73:0/3392684995 >> v2:172.21.15.150:3300/0 conn(0x7f37d815bec0 0x7f37d80ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d80b3b30 con 0x7f37d80af2a0 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f37d0001a00 con 0x7f37d80af2a0 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 >> v1:172.21.15.73:6789/0 conn(0x7f37d80af2a0 legacy=0x7f37d815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c00039c0 0x7f37c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 0x7f37c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80b3570 con 0x7f37c0004d50 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80b3850 con 0x7f37c00039c0 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37c000bb60 con 0x7f37d815c2a0 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d6ffd640 1 --2- 172.21.15.73:0/3392684995 >> v2:172.21.15.150:3300/0 conn(0x7f37d815bec0 0x7f37d80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d67fc640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 0x7f37c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 -- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 msgr2=0x7f37c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 0x7f37c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d6ffd640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c00039c0 0x7f37c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 -- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c00039c0 msgr2=0x7f37c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c00039c0 0x7f37c0003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d77fe640 1 -- 172.21.15.73:0/3392684995 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c0003530 con 0x7f37c0004d50 2024-09-12T03:35:55.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.911+0000 7f37d67fc640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d815c2a0 0x7f37c0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d77fe640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37c00051d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f37d000a880 tx=0x7f37d001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540a8f7ab27ac75c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d000a4a0 con 0x7f37c0004d50 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d00ad630 con 0x7f37c0004d50 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d5ffb640 1 -- 172.21.15.73:0/3392684995 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d00ada20 con 0x7f37c0004d50 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- 172.21.15.73:0/3392684995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 msgr2=0x7f37c00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 --2- 172.21.15.73:0/3392684995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37c00051d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f37d000a880 tx=0x7f37d001d3a0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d77fe640 1 -- 172.21.15.73:0/3392684995 reap_dead start 2024-09-12T03:35:55.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- 172.21.15.73:0/3392684995 shutdown_connections 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- 172.21.15.73:0/3392684995 >> 172.21.15.73:0/3392684995 conn(0x7f37d80b1f90 msgr2=0x7f37d80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- 172.21.15.73:0/3392684995 shutdown_connections 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- 172.21.15.73:0/3392684995 wait complete. 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 Processor -- start 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- start start 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37d8147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d809a280 0x7f37d815f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d809b850 0x7f37d80aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80af730 con 0x7f37c0004d50 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80b40f0 con 0x7f37d809a280 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37dd5cd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37d80afc90 con 0x7f37d809b850 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37d8147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37d8147710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56738/0 (socket says 172.21.15.73:56738) 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.915+0000 7f37d6ffd640 1 -- 172.21.15.73:0/1001797871 learned_addr learned my addr 172.21.15.73:0/1001797871 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d77fe640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d809b850 0x7f37d80aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d67fc640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d809a280 0x7f37d815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d6ffd640 1 -- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d809b850 msgr2=0x7f37d80aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d6ffd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d809b850 0x7f37d80aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d6ffd640 1 -- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d809a280 msgr2=0x7f37d815f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d6ffd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d809a280 0x7f37d815f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d6ffd640 1 -- 172.21.15.73:0/1001797871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d809a7b0 con 0x7f37c0004d50 2024-09-12T03:35:55.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d67fc640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d809a280 0x7f37d815f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:55.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d6ffd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37d8147710 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00f580 tx=0x7f37cc00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:55.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37bf7fe640 1 -- 172.21.15.73:0/1001797871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc018070 con 0x7f37c0004d50 2024-09-12T03:35:55.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37bf7fe640 1 -- 172.21.15.73:0/1001797871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc014890 con 0x7f37c0004d50 2024-09-12T03:35:55.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37bf7fe640 1 -- 172.21.15.73:0/1001797871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc014c60 con 0x7f37c0004d50 2024-09-12T03:35:55.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d809aa90 con 0x7f37c0004d50 2024-09-12T03:35:55.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d809b050 con 0x7f37c0004d50 2024-09-12T03:35:55.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d80aed60 con 0x7f37c0004d50 2024-09-12T03:35:55.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37bf7fe640 1 -- 172.21.15.73:0/1001797871 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37cc01b070 con 0x7f37c0004d50 2024-09-12T03:35:55.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37bf7fe640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37c40678f0 0x7f37c4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:55.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37bf7fe640 1 -- 172.21.15.73:0/1001797871 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f37cc085e60 con 0x7f37c0004d50 2024-09-12T03:35:55.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d67fc640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37c40678f0 0x7f37c4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:55.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.919+0000 7f37d67fc640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37c40678f0 0x7f37c4069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37c8006fd0 tx=0x7f37c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:55.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:55.923+0000 7f37bf7fe640 1 -- 172.21.15.73:0/1001797871 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f37cc056b20 con 0x7f37c0004d50 2024-09-12T03:35:56.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.091+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f37d806fcd0 con 0x7f37c0004d50 2024-09-12T03:35:56.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.091+0000 7f37bf7fe640 1 -- 172.21.15.73:0/1001797871 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f37cc056420 con 0x7f37c0004d50 2024-09-12T03:35:56.094 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-12T03:35:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37c40678f0 msgr2=0x7f37c4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37c40678f0 0x7f37c4069db0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37c8006fd0 tx=0x7f37c8008040 comp rx=0 tx=0).stop 2024-09-12T03:35:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 msgr2=0x7f37d8147710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37d8147710 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00f580 tx=0x7f37cc00fa40 comp rx=0 tx=0).stop 2024-09-12T03:35:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 shutdown_connections 2024-09-12T03:35:56.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37c40678f0 0x7f37c4069db0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37d809b850 0x7f37d80aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37d809a280 0x7f37d815f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 --2- 172.21.15.73:0/1001797871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c0004d50 0x7f37d8147710 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 >> 172.21.15.73:0/1001797871 conn(0x7f37d80b1f90 msgr2=0x7f37d80b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 shutdown_connections 2024-09-12T03:35:56.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.095+0000 7f37dd5cd640 1 -- 172.21.15.73:0/1001797871 wait complete. 2024-09-12T03:35:56.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values' 2024-09-12T03:35:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.227+0000 7f3b79ce9640 1 Processor -- start 2024-09-12T03:35:56.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.227+0000 7f3b79ce9640 1 -- start start 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b79ce9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3b7415c2a0 0x7f3b740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b79ce9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 0x7f3b7406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b79ce9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b740b3290 con 0x7f3b7415bec0 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b79ce9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3b740b3570 con 0x7f3b7415c2a0 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b79ce9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3b740b3850 con 0x7f3b740af2a0 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b737fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3b7415bec0 0x7f3b740ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52036/0 (socket says 172.21.15.73:52036) 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b737fe640 1 -- 172.21.15.73:0/613743817 learned_addr learned my addr 172.21.15.73:0/613743817 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524955785 0 0) 0x7f3b740b3290 con 0x7f3b7415bec0 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b5c003530 con 0x7f3b7415bec0 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 --2- 172.21.15.73:0/613743817 >> v2:172.21.15.150:3300/0 conn(0x7f3b7415c2a0 0x7f3b740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b73fff640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 0x7f3b7406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:56.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2728168482 0 0) 0x7f3b5c003530 con 0x7f3b7415bec0 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 msgr2=0x7f3b7406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 0x7f3b7406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 >> v2:172.21.15.150:3300/0 conn(0x7f3b7415c2a0 msgr2=0x7f3b740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 --2- 172.21.15.73:0/613743817 >> v2:172.21.15.150:3300/0 conn(0x7f3b7415c2a0 0x7f3b740aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b740b3b30 con 0x7f3b7415bec0 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f3b64001680 con 0x7f3b7415bec0 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 >> v1:172.21.15.73:6789/0 conn(0x7f3b7415bec0 legacy=0x7f3b740ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c0039c0 0x7f3b5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 0x7f3b5c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3b740b3570 con 0x7f3b5c004810 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b740b3850 con 0x7f3b5c0039c0 2024-09-12T03:35:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c00bad0 con 0x7f3b740af2a0 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b737fe640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c0039c0 0x7f3b5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b73fff640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 0x7f3b5c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 -- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 msgr2=0x7f3b5c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b740af2a0 0x7f3b5c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 -- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c0039c0 msgr2=0x7f3b5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b5c0039c0 0x7f3b5c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 -- 172.21.15.73:0/613743817 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c003530 con 0x7f3b5c004810 2024-09-12T03:35:56.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.231+0000 7f3b72ffd640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b5c004c90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3b7415c6b0 tx=0x7f3b6801c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f4371d2ece6f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:56.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800b600 con 0x7f3b5c004810 2024-09-12T03:35:56.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b680b0070 con 0x7f3b5c004810 2024-09-12T03:35:56.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b727fc640 1 -- 172.21.15.73:0/613743817 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b680ab8b0 con 0x7f3b5c004810 2024-09-12T03:35:56.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- 172.21.15.73:0/613743817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 msgr2=0x7f3b5c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:56.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 --2- 172.21.15.73:0/613743817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b5c004c90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3b7415c6b0 tx=0x7f3b6801c660 comp rx=0 tx=0).stop 2024-09-12T03:35:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b73fff640 1 -- 172.21.15.73:0/613743817 reap_dead start 2024-09-12T03:35:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- 172.21.15.73:0/613743817 shutdown_connections 2024-09-12T03:35:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- 172.21.15.73:0/613743817 >> 172.21.15.73:0/613743817 conn(0x7f3b740b1f90 msgr2=0x7f3b740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- 172.21.15.73:0/613743817 shutdown_connections 2024-09-12T03:35:56.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- 172.21.15.73:0/613743817 wait complete. 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 Processor -- start 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- start start 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b74155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b74152ba0 0x7f3b74153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b7414d0c0 0x7f3b7414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3b740af730 con 0x7f3b5c004810 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3b740b40f0 con 0x7f3b74152ba0 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3b740afc90 con 0x7f3b7414d0c0 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b74155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:56.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b74155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56742/0 (socket says 172.21.15.73:56742) 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 -- 172.21.15.73:0/168113338 learned_addr learned my addr 172.21.15.73:0/168113338 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 -- 172.21.15.73:0/168113338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b7414d0c0 msgr2=0x7f3b7414d550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b7414d0c0 0x7f3b7414d550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 -- 172.21.15.73:0/168113338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b74152ba0 msgr2=0x7f3b74153020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b74152ba0 0x7f3b74153020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 -- 172.21.15.73:0/168113338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b74153740 con 0x7f3b5c004810 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b737fe640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b74155400 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b640058b0 tx=0x7f3b64011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b5bfff640 1 -- 172.21.15.73:0/168113338 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64010040 con 0x7f3b5c004810 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b5bfff640 1 -- 172.21.15.73:0/168113338 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6401a070 con 0x7f3b5c004810 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b5bfff640 1 -- 172.21.15.73:0/168113338 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400fe60 con 0x7f3b5c004810 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b74153a20 con 0x7f3b5c004810 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.235+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b74153fe0 con 0x7f3b5c004810 2024-09-12T03:35:56.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.239+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b740aed60 con 0x7f3b5c004810 2024-09-12T03:35:56.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.239+0000 7f3b5bfff640 1 -- 172.21.15.73:0/168113338 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3b6401f460 con 0x7f3b5c004810 2024-09-12T03:35:56.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.239+0000 7f3b5bfff640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b600678f0 0x7f3b60069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:56.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.239+0000 7f3b5bfff640 1 -- 172.21.15.73:0/168113338 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f3b64088ee0 con 0x7f3b5c004810 2024-09-12T03:35:56.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.239+0000 7f3b72ffd640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b600678f0 0x7f3b60069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:56.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.239+0000 7f3b72ffd640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b600678f0 0x7f3b60069db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b680af000 tx=0x7f3b680046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:56.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.243+0000 7f3b5bfff640 1 -- 172.21.15.73:0/168113338 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3b64059c20 con 0x7f3b5c004810 2024-09-12T03:35:56.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:56.451+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]} v 0) -- 0x7f3b7406fcd0 con 0x7f3b5c004810 2024-09-12T03:35:57.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.451+0000 7f3b5bfff640 1 -- 172.21.15.73:0/168113338 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]}]=0 v92) ==== 156+0+0 (secure 0 0 0) 0x7f3b64059520 con 0x7f3b5c004810 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b600678f0 msgr2=0x7f3b60069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b600678f0 0x7f3b60069db0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b680af000 tx=0x7f3b680046d0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 msgr2=0x7f3b74155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b74155400 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b640058b0 tx=0x7f3b64011de0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 shutdown_connections 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b600678f0 0x7f3b60069db0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3b7414d0c0 0x7f3b7414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3b74152ba0 0x7f3b74153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 --2- 172.21.15.73:0/168113338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b5c004810 0x7f3b74155400 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 >> 172.21.15.73:0/168113338 conn(0x7f3b740b1f90 msgr2=0x7f3b740b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:57.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 shutdown_connections 2024-09-12T03:35:57.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.455+0000 7f3b79ce9640 1 -- 172.21.15.73:0/168113338 wait complete. 2024-09-12T03:35:57.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T03:35:57.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f52a14c1640 1 Processor -- start 2024-09-12T03:35:57.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f52a14c1640 1 -- start start 2024-09-12T03:35:57.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f52a14c1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c15c2a0 0x7f529c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f52a14c1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529c0b3290 con 0x7f529c0af2a0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f52a14c1640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f529c0b3570 con 0x7f529c15bec0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f52a14c1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f529c0b3850 con 0x7f529c15c2a0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f529c0af2a0 0x7f529c06e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52038/0 (socket says 172.21.15.73:52038) 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529b7fe640 1 -- 172.21.15.73:0/3577207477 learned_addr learned my addr 172.21.15.73:0/3577207477 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688078048 0 0) 0x7f529c0b3290 con 0x7f529c0af2a0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5288003530 con 0x7f529c0af2a0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3041637341 0 0) 0x7f5288003530 con 0x7f529c0af2a0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c15c2a0 msgr2=0x7f529c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c15c2a0 0x7f529c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 >> v1:172.21.15.150:6789/0 conn(0x7f529c15bec0 legacy=0x7f529c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c0b3b30 con 0x7f529c0af2a0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f5294001a00 con 0x7f529c0af2a0 2024-09-12T03:35:57.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 >> v1:172.21.15.73:6789/0 conn(0x7f529c0af2a0 legacy=0x7f529c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52880039f0 0x7f5288003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c15c2a0 0x7f5288004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5288004dc0 0x7f5288005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f529c0b3850 con 0x7f52880039f0 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f528800bbe0 con 0x7f5288004dc0 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f528800bde0 con 0x7f529c15c2a0 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529affd640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52880039f0 0x7f5288003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529affd640 1 -- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c15c2a0 msgr2=0x7f5288004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529affd640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f529c15c2a0 0x7f5288004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529affd640 1 -- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5288004dc0 msgr2=0x7f5288005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529affd640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5288004dc0 0x7f5288005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.603+0000 7f529affd640 1 -- 172.21.15.73:0/3577207477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5288003530 con 0x7f52880039f0 2024-09-12T03:35:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f529affd640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52880039f0 0x7f5288003df0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f528c007fd0 tx=0x7f528c01c1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded0072ddbd21256 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c001250 con 0x7f52880039f0 2024-09-12T03:35:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c005270 con 0x7f52880039f0 2024-09-12T03:35:57.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f529a7fc640 1 -- 172.21.15.73:0/3577207477 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c003620 con 0x7f52880039f0 2024-09-12T03:35:57.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 -- 172.21.15.73:0/3577207477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52880039f0 msgr2=0x7f5288003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 --2- 172.21.15.73:0/3577207477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52880039f0 0x7f5288003df0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f528c007fd0 tx=0x7f528c01c1f0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f529b7fe640 1 -- 172.21.15.73:0/3577207477 reap_dead start 2024-09-12T03:35:57.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 -- 172.21.15.73:0/3577207477 shutdown_connections 2024-09-12T03:35:57.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 -- 172.21.15.73:0/3577207477 >> 172.21.15.73:0/3577207477 conn(0x7f529c0b1f90 msgr2=0x7f529c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:57.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 -- 172.21.15.73:0/3577207477 shutdown_connections 2024-09-12T03:35:57.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 -- 172.21.15.73:0/3577207477 wait complete. 2024-09-12T03:35:57.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 Processor -- start 2024-09-12T03:35:57.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.607+0000 7f52a14c1640 1 -- start start 2024-09-12T03:35:57.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52880039f0 0x7f529c0998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c15ed80 0x7f529c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c160fe0 0x7f529c161490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f529c06ef20 con 0x7f529c15ed80 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f529c0af6d0 con 0x7f529c160fe0 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f529c06f0a0 con 0x7f52880039f0 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c15ed80 0x7f529c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c15ed80 0x7f529c15f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56768/0 (socket says 172.21.15.73:56768) 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 -- 172.21.15.73:0/2040648381 learned_addr learned my addr 172.21.15.73:0/2040648381 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f529b7fe640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c160fe0 0x7f529c161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f529affd640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52880039f0 0x7f529c0998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 -- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52880039f0 msgr2=0x7f529c0998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52880039f0 0x7f529c0998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 -- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c160fe0 msgr2=0x7f529c161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c160fe0 0x7f529c161490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 -- 172.21.15.73:0/2040648381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529c15ff40 con 0x7f529c15ed80 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f529b7fe640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c160fe0 0x7f529c161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52927fc640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c15ed80 0x7f529c15f200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f528400b4d0 tx=0x7f528400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f5293fff640 1 -- 172.21.15.73:0/2040648381 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284014070 con 0x7f529c15ed80 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f5293fff640 1 -- 172.21.15.73:0/2040648381 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5284010610 con 0x7f529c15ed80 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529c160220 con 0x7f529c15ed80 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f5293fff640 1 -- 172.21.15.73:0/2040648381 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840109e0 con 0x7f529c15ed80 2024-09-12T03:35:57.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529c1607e0 con 0x7f529c15ed80 2024-09-12T03:35:57.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529c06e000 con 0x7f529c15ed80 2024-09-12T03:35:57.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f5293fff640 1 -- 172.21.15.73:0/2040648381 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5284017070 con 0x7f529c15ed80 2024-09-12T03:35:57.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f5293fff640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f527c0678f0 0x7f527c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:57.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f5293fff640 1 -- 172.21.15.73:0/2040648381 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f5284085520 con 0x7f529c15ed80 2024-09-12T03:35:57.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f529affd640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f527c0678f0 0x7f527c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:57.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.611+0000 7f529affd640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f527c0678f0 0x7f527c069db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f528c0aa000 tx=0x7f528c001030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:57.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.615+0000 7f5293fff640 1 -- 172.21.15.73:0/2040648381 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f52840561d0 con 0x7f529c15ed80 2024-09-12T03:35:57.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.779+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f529c0cf650 con 0x7f529c15ed80 2024-09-12T03:35:57.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.783+0000 7f5293fff640 1 -- 172.21.15.73:0/2040648381 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f5284055ad0 con 0x7f529c15ed80 2024-09-12T03:35:57.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f527c0678f0 msgr2=0x7f527c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f527c0678f0 0x7f527c069db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f528c0aa000 tx=0x7f528c001030 comp rx=0 tx=0).stop 2024-09-12T03:35:57.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c15ed80 msgr2=0x7f529c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:57.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c15ed80 0x7f529c15f200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f528400b4d0 tx=0x7f528400b990 comp rx=0 tx=0).stop 2024-09-12T03:35:57.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 shutdown_connections 2024-09-12T03:35:57.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f527c0678f0 0x7f527c069db0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c15ed80 0x7f529c15f200 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f529c160fe0 0x7f529c161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 --2- 172.21.15.73:0/2040648381 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f52880039f0 0x7f529c0998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:57.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 >> 172.21.15.73:0/2040648381 conn(0x7f529c0b1f90 msgr2=0x7f529c15a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:57.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 shutdown_connections 2024-09-12T03:35:57.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:57.787+0000 7f52a14c1640 1 -- 172.21.15.73:0/2040648381 wait complete. 2024-09-12T03:35:57.806 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:35:57.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:35:57.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:35:57.927 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:35:57.927 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:57.927 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:57.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:35:57.933 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:57.933 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:57.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:35:57.939 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:35:57.939 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:57.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:35:57.980 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:35:57.980 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:35:57.985 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:35:57.985 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T03:35:57.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:35:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.151+0000 7fd6dff91640 1 Processor -- start 2024-09-12T03:35:58.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.151+0000 7fd6dff91640 1 -- start start 2024-09-12T03:35:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dff91640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6d80b3330 0x7fd6d80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dff91640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d815bc80 0x7fd6d80b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dff91640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d80b3c50 con 0x7fd6d80b51b0 2024-09-12T03:35:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dff91640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d80d0b80 con 0x7fd6d80b3330 2024-09-12T03:35:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dff91640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d80d0e60 con 0x7fd6d815bc80 2024-09-12T03:35:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dd52c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd6d80b51b0 0x7fd6d815b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52050/0 (socket says 172.21.15.73:52050) 2024-09-12T03:35:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dd52c640 1 -- 172.21.15.73:0/2794038325 learned_addr learned my addr 172.21.15.73:0/2794038325 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645846199 0 0) 0x7fd6d80b3c50 con 0x7fd6d80b51b0 2024-09-12T03:35:58.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c4003530 con 0x7fd6d80b51b0 2024-09-12T03:35:58.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 503144656 0 0) 0x7fd6c4003530 con 0x7fd6d80b51b0 2024-09-12T03:35:58.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d815bc80 msgr2=0x7fd6d80b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d815bc80 0x7fd6d80b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 >> v2:172.21.15.150:3300/0 conn(0x7fd6d80b3330 msgr2=0x7fd6d80b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 --2- 172.21.15.73:0/2794038325 >> v2:172.21.15.150:3300/0 conn(0x7fd6d80b3330 0x7fd6d80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d80b46d0 con 0x7fd6d80b51b0 2024-09-12T03:35:58.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fd6c8001680 con 0x7fd6d80b51b0 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 >> v1:172.21.15.73:6789/0 conn(0x7fd6d80b51b0 legacy=0x7fd6d815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c40039c0 0x7fd6c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d815bc80 0x7fd6c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c4004da0 0x7fd6c4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80d0b80 con 0x7fd6c4004da0 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80d0e60 con 0x7fd6c40039c0 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c400dee0 con 0x7fd6d815bc80 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6de52e640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c4004da0 0x7fd6c4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6ddd2d640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c40039c0 0x7fd6c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6de52e640 1 -- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d815bc80 msgr2=0x7fd6c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6de52e640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d815bc80 0x7fd6c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6de52e640 1 -- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c40039c0 msgr2=0x7fd6c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6de52e640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c40039c0 0x7fd6c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6de52e640 1 -- 172.21.15.73:0/2794038325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c4003530 con 0x7fd6c4004da0 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.155+0000 7fd6de52e640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c4004da0 0x7fd6c4005220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009c70 tx=0x7fd6d001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725906319be8dc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00b2070 con 0x7fd6c4004da0 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d00a5c80 con 0x7fd6c4004da0 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dcd2b640 1 -- 172.21.15.73:0/2794038325 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0006e60 con 0x7fd6c4004da0 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- 172.21.15.73:0/2794038325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c4004da0 msgr2=0x7fd6c4005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 --2- 172.21.15.73:0/2794038325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c4004da0 0x7fd6c4005220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009c70 tx=0x7fd6d001cc50 comp rx=0 tx=0).stop 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6de52e640 1 -- 172.21.15.73:0/2794038325 reap_dead start 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- 172.21.15.73:0/2794038325 shutdown_connections 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- 172.21.15.73:0/2794038325 >> 172.21.15.73:0/2794038325 conn(0x7fd6d80b6870 msgr2=0x7fd6d80b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- 172.21.15.73:0/2794038325 shutdown_connections 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- 172.21.15.73:0/2794038325 wait complete. 2024-09-12T03:35:58.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 Processor -- start 2024-09-12T03:35:58.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- start start 2024-09-12T03:35:58.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80c9020 0x7fd6d80c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d80af840 0x7fd6d80afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8135010 0x7fd6d81354c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d8144d00 con 0x7fd6d80af840 2024-09-12T03:35:58.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80b4c90 con 0x7fd6d80c9020 2024-09-12T03:35:58.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d8144e80 con 0x7fd6d8135010 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d80af840 0x7fd6d80afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d80af840 0x7fd6d80afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56788/0 (socket says 172.21.15.73:56788) 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 -- 172.21.15.73:0/3168048241 learned_addr learned my addr 172.21.15.73:0/3168048241 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6ddd2d640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80c9020 0x7fd6d80c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6de52e640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8135010 0x7fd6d81354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 -- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8135010 msgr2=0x7fd6d81354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8135010 0x7fd6d81354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 -- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80c9020 msgr2=0x7fd6d80c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80c9020 0x7fd6d80c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 -- 172.21.15.73:0/3168048241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d80c9940 con 0x7fd6d80af840 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6de52e640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8135010 0x7fd6d81354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:35:58.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dd52c640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d80af840 0x7fd6d80afcc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800f410 tx=0x7fd6c800f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:58.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6ce7fc640 1 -- 172.21.15.73:0/3168048241 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8007d00 con 0x7fd6d80af840 2024-09-12T03:35:58.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6ce7fc640 1 -- 172.21.15.73:0/3168048241 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c800a0d0 con 0x7fd6d80af840 2024-09-12T03:35:58.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d80b03e0 con 0x7fd6d80af840 2024-09-12T03:35:58.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6ce7fc640 1 -- 172.21.15.73:0/3168048241 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800a4c0 con 0x7fd6d80af840 2024-09-12T03:35:58.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.159+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d8135c60 con 0x7fd6d80af840 2024-09-12T03:35:58.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.163+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d80b55d0 con 0x7fd6d80af840 2024-09-12T03:35:58.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.163+0000 7fd6ce7fc640 1 -- 172.21.15.73:0/3168048241 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6c8014070 con 0x7fd6d80af840 2024-09-12T03:35:58.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.163+0000 7fd6ce7fc640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.163+0000 7fd6ce7fc640 1 -- 172.21.15.73:0/3168048241 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7fd6c80886d0 con 0x7fd6d80af840 2024-09-12T03:35:58.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.163+0000 7fd6ddd2d640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.163+0000 7fd6ddd2d640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4006fd0 tx=0x7fd6d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:58.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.167+0000 7fd6ce7fc640 1 -- 172.21.15.73:0/3168048241 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd6c8059380 con 0x7fd6d80af840 2024-09-12T03:35:58.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.359+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6d806da60 con 0x7fd6d80af840 2024-09-12T03:35:58.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6ce7fc640 1 -- 172.21.15.73:0/3168048241 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3914 (secure 0 0 0) 0x7fd6c8058c80 con 0x7fd6d80af840 2024-09-12T03:35:58.364 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:35:58.364 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"btime":"2024-09-12T03:35:52:420297+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6834/4171638220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4171638220},{"type":"v1","addr":"172.21.15.150:6834","nonce":4171638220}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4645,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/586996144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6833","nonce":586996144},{"type":"v1","addr":"172.21.15.150:6835","nonce":586996144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4854,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1039518252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1039518252},{"type":"v1","addr":"172.21.15.73:6835","nonce":1039518252}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5148,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/2035935839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":2035935839},{"type":"v1","addr":"172.21.15.73:6837","nonce":2035935839}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-09-12T03:35:58.364 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 19 2024-09-12T03:35:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 msgr2=0x7fd6bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4006fd0 tx=0x7fd6d4008040 comp rx=0 tx=0).stop 2024-09-12T03:35:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d80af840 msgr2=0x7fd6d80afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d80af840 0x7fd6d80afcc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800f410 tx=0x7fd6c800f8d0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 shutdown_connections 2024-09-12T03:35:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d80af840 0x7fd6d80afcc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d8135010 0x7fd6d81354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 --2- 172.21.15.73:0/3168048241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d80c9020 0x7fd6d80c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 >> 172.21.15.73:0/3168048241 conn(0x7fd6d80b6870 msgr2=0x7fd6d806ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 shutdown_connections 2024-09-12T03:35:58.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.363+0000 7fd6dff91640 1 -- 172.21.15.73:0/3168048241 wait complete. 2024-09-12T03:35:58.381 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T03:35:58.381 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T03:35:58.382 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:35:58.382 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:58.382 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T03:35:58.382 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T03:35:58.382 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:35:58.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:58.383 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T03:35:58.383 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T03:35:58.383 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:35:58.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:58.384 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T03:35:58.384 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T03:35:58.384 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:35:58.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:35:58.392 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:35:58.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T03:35:58.393 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:35:58.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T03:35:58.397 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:35:58.397 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T03:35:58.401 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:35:58.401 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T03:35:58.436 INFO:tasks.ceph.mds.a:Started 2024-09-12T03:35:58.436 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:58.437 INFO:tasks.ceph.mds.c:Started 2024-09-12T03:35:58.437 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:58.448 INFO:tasks.ceph.mds.b:Started 2024-09-12T03:35:58.449 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:58.450 INFO:tasks.ceph.mds.d:Started 2024-09-12T03:35:58.450 DEBUG:teuthology.parallel:result is None 2024-09-12T03:35:58.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T03:35:58.493 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:35:58.499 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:35:58.519 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:35:58.524 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-12T03:35:58.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.563+0000 7f0722cd0640 1 Processor -- start 2024-09-12T03:35:58.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.563+0000 7f0722cd0640 1 -- start start 2024-09-12T03:35:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0722cd0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f071c15e450 0x7f071c0b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0722cd0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 0x7f071c0d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0722cd0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071c0d1f70 con 0x7f071c0b7670 2024-09-12T03:35:58.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0722cd0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f071c0b58d0 con 0x7f071c15e450 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0722cd0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f071c0b55f0 con 0x7f071c0d4840 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f071c0b7670 0x7f071c0d4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52076/0 (socket says 172.21.15.73:52076) 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 -- 172.21.15.73:0/3466426315 learned_addr learned my addr 172.21.15.73:0/3466426315 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0720a6c640 1 --2- 172.21.15.73:0/3466426315 >> v2:172.21.15.150:3300/0 conn(0x7f071c15e450 0x7f071c0b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f072126d640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 0x7f071c0d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641734150 0 0) 0x7f071c0d1f70 con 0x7f071c0b7670 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0704003530 con 0x7f071c0b7670 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3946449 0 0) 0x7f0704003530 con 0x7f071c0b7670 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 msgr2=0x7f071c0d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 0x7f071c0d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 >> v2:172.21.15.150:3300/0 conn(0x7f071c15e450 msgr2=0x7f071c0b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 --2- 172.21.15.73:0/3466426315 >> v2:172.21.15.150:3300/0 conn(0x7f071c15e450 0x7f071c0b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c0d2210 con 0x7f071c0b7670 2024-09-12T03:35:58.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f070c0016a0 con 0x7f071c0b7670 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0720a6c640 1 --2- 172.21.15.73:0/3466426315 >> v2:172.21.15.150:3300/0 conn(0x7f071c15e450 0x7f071c0b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 >> v1:172.21.15.73:6789/0 conn(0x7f071c0b7670 legacy=0x7f071c0d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 0x7f07040039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f0704004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704004d50 0x7f07040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f071c0b58d0 con 0x7f0704003f40 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f071c0b55f0 con 0x7f0704004d50 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f070400b9d0 con 0x7f071c0d4840 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f0704004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f0720a6c640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 0x7f07040039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f072126d640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704004d50 0x7f07040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 -- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 msgr2=0x7f07040039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0d4840 0x7f07040039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 -- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704004d50 msgr2=0x7f07040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:35:58.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0704004d50 0x7f07040051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.567+0000 7f071bfff640 1 -- 172.21.15.73:0/3466426315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0704003530 con 0x7f0704003f40 2024-09-12T03:35:58.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f071bfff640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f0704004810 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c210 tx=0x7f070c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c74eccbcefb63e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:58.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c007d80 con 0x7f0704003f40 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c005b00 con 0x7f0704003f40 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f071b7fe640 1 -- 172.21.15.73:0/3466426315 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c007070 con 0x7f0704003f40 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- 172.21.15.73:0/3466426315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 msgr2=0x7f0704004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 --2- 172.21.15.73:0/3466426315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f0704004810 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c210 tx=0x7f070c01f390 comp rx=0 tx=0).stop 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f072126d640 1 -- 172.21.15.73:0/3466426315 reap_dead start 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- 172.21.15.73:0/3466426315 shutdown_connections 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- 172.21.15.73:0/3466426315 >> 172.21.15.73:0/3466426315 conn(0x7f071c08bf90 msgr2=0x7f071c09d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- 172.21.15.73:0/3466426315 shutdown_connections 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- 172.21.15.73:0/3466426315 wait complete. 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 Processor -- start 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- start start 2024-09-12T03:35:58.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f071c158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0caa70 0x7f071c0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b8ce0 0x7f071c0b9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f071c15e9b0 con 0x7f0704003f40 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f071c15e830 con 0x7f071c0b8ce0 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f071c0d2a10 con 0x7f071c0caa70 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f071c158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f071c158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56824/0 (socket says 172.21.15.73:56824) 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 -- 172.21.15.73:0/1215635024 learned_addr learned my addr 172.21.15.73:0/1215635024 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f072126d640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b8ce0 0x7f071c0b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f071bfff640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0caa70 0x7f071c0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 -- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0caa70 msgr2=0x7f071c0c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0caa70 0x7f071c0c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 -- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b8ce0 msgr2=0x7f071c0b9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b8ce0 0x7f071c0b9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 -- 172.21.15.73:0/1215635024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c15ecd0 con 0x7f0704003f40 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0720a6c640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f071c158740 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0710011d30 tx=0x7f071000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f07197fa640 1 -- 172.21.15.73:0/1215635024 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071000fd20 con 0x7f0704003f40 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f07197fa640 1 -- 172.21.15.73:0/1215635024 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0710004030 con 0x7f0704003f40 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071c15efb0 con 0x7f0704003f40 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f07197fa640 1 -- 172.21.15.73:0/1215635024 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710004420 con 0x7f0704003f40 2024-09-12T03:35:58.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.571+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071c0c9d00 con 0x7f0704003f40 2024-09-12T03:35:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.575+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071c0b7130 con 0x7f0704003f40 2024-09-12T03:35:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.575+0000 7f07197fa640 1 -- 172.21.15.73:0/1215635024 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0710012040 con 0x7f0704003f40 2024-09-12T03:35:58.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.575+0000 7f07197fa640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f07080678c0 0x7f0708069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:35:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.575+0000 7f07197fa640 1 -- 172.21.15.73:0/1215635024 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f07100862a0 con 0x7f0704003f40 2024-09-12T03:35:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.575+0000 7f071bfff640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f07080678c0 0x7f0708069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:35:58.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.575+0000 7f071bfff640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f07080678c0 0x7f0708069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f070c0ae000 tx=0x7f070c001ae0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:35:58.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.579+0000 7f07197fa640 1 -- 172.21.15.73:0/1215635024 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0710019070 con 0x7f0704003f40 2024-09-12T03:35:58.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:58.751+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f071c0ba170 con 0x7f0704003f40 2024-09-12T03:35:59.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.811+0000 7f07197fa640 1 -- 172.21.15.73:0/1215635024 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) ==== 97+0+0 (secure 0 0 0) 0x7f0710056900 con 0x7f0704003f40 2024-09-12T03:35:59.813 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f07080678c0 msgr2=0x7f0708069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f07080678c0 0x7f0708069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f070c0ae000 tx=0x7f070c001ae0 comp rx=0 tx=0).stop 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 msgr2=0x7f071c158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f071c158740 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0710011d30 tx=0x7f071000f610 comp rx=0 tx=0).stop 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 shutdown_connections 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f07080678c0 0x7f0708069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f071c0b8ce0 0x7f071c0b9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f071c0caa70 0x7f071c0c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 --2- 172.21.15.73:0/1215635024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0704003f40 0x7f071c158740 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:35:59.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 >> 172.21.15.73:0/1215635024 conn(0x7f071c08bf90 msgr2=0x7f071c15b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:35:59.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 shutdown_connections 2024-09-12T03:35:59.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:35:59.815+0000 7f0722cd0640 1 -- 172.21.15.73:0/1215635024 wait complete. 2024-09-12T03:35:59.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T03:36:00.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec70b76640 1 Processor -- start 2024-09-12T03:36:00.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec70b76640 1 -- start start 2024-09-12T03:36:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec70b76640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec6c15e260 0x7fec6c0afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec70b76640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 0x7fec6c161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec70b76640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec6c0afbb0 con 0x7fec6c1623e0 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec70b76640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fec6c162830 con 0x7fec6c15e260 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec70b76640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec6c0af310 con 0x7fec6c067e30 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fec6c1623e0 0x7fec6c15e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52080/0 (socket says 172.21.15.73:52080) 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 -- 172.21.15.73:0/2140306605 learned_addr learned my addr 172.21.15.73:0/2140306605 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec69d9b640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 0x7fec6c161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6a59c640 1 --2- 172.21.15.73:0/2140306605 >> v2:172.21.15.150:3300/0 conn(0x7fec6c15e260 0x7fec6c0afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787951759 0 0) 0x7fec6c0afbb0 con 0x7fec6c1623e0 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec54003530 con 0x7fec6c1623e0 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1141777154 0 0) 0x7fec54003530 con 0x7fec6c1623e0 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 msgr2=0x7fec6c161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 0x7fec6c161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 >> v2:172.21.15.150:3300/0 conn(0x7fec6c15e260 msgr2=0x7fec6c0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 --2- 172.21.15.73:0/2140306605 >> v2:172.21.15.150:3300/0 conn(0x7fec6c15e260 0x7fec6c0afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c0af5f0 con 0x7fec6c1623e0 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fec64001a00 con 0x7fec6c1623e0 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 >> v1:172.21.15.73:6789/0 conn(0x7fec6c1623e0 legacy=0x7fec6c15e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 0x7fec540039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec54003f40 0x7fec54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec54004d50 0x7fec540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c162830 con 0x7fec54004d50 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c0af310 con 0x7fec54003f40 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec5400b9d0 con 0x7fec6c067e30 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec54004d50 0x7fec540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec69d9b640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec54003f40 0x7fec54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6a59c640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 0x7fec540039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 -- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 msgr2=0x7fec540039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c067e30 0x7fec540039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 -- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec54003f40 msgr2=0x7fec54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec54003f40 0x7fec54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.003+0000 7fec6ad9d640 1 -- 172.21.15.73:0/2140306605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec54003530 con 0x7fec54004d50 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec6ad9d640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec54004d50 0x7fec540051d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec6400a920 tx=0x7fec6401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a7aa1dc286fe30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6400a4c0 con 0x7fec54004d50 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec640072f0 con 0x7fec54004d50 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec6959a640 1 -- 172.21.15.73:0/2140306605 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64007720 con 0x7fec54004d50 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 -- 172.21.15.73:0/2140306605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec54004d50 msgr2=0x7fec540051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 --2- 172.21.15.73:0/2140306605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec54004d50 0x7fec540051d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec6400a920 tx=0x7fec6401d3e0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec6ad9d640 1 -- 172.21.15.73:0/2140306605 reap_dead start 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 -- 172.21.15.73:0/2140306605 shutdown_connections 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 -- 172.21.15.73:0/2140306605 >> 172.21.15.73:0/2140306605 conn(0x7fec6c073580 msgr2=0x7fec6c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:00.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 -- 172.21.15.73:0/2140306605 shutdown_connections 2024-09-12T03:36:00.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 -- 172.21.15.73:0/2140306605 wait complete. 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 Processor -- start 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.007+0000 7fec70b76640 1 -- start start 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c1612e0 0x7fec6c1442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c1616c0 0x7fec6c1447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0ce670 0x7fec6c142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c0b06b0 con 0x7fec6c1616c0 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec6c0b0530 con 0x7fec6c0ce670 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec6c0b51d0 con 0x7fec6c1612e0 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c1616c0 0x7fec6c1447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c1616c0 0x7fec6c1447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56846/0 (socket says 172.21.15.73:56846) 2024-09-12T03:36:00.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 -- 172.21.15.73:0/1241128428 learned_addr learned my addr 172.21.15.73:0/1241128428 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec6a59c640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c1612e0 0x7fec6c1442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec6ad9d640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0ce670 0x7fec6c142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 -- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c1612e0 msgr2=0x7fec6c1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c1612e0 0x7fec6c1442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 -- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0ce670 msgr2=0x7fec6c142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0ce670 0x7fec6c142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 -- 172.21.15.73:0/1241128428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6c0cec10 con 0x7fec6c1616c0 2024-09-12T03:36:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec69d9b640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c1616c0 0x7fec6c1447e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fec5c011560 tx=0x7fec5c011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec5affd640 1 -- 172.21.15.73:0/1241128428 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c015930 con 0x7fec6c1616c0 2024-09-12T03:36:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec5affd640 1 -- 172.21.15.73:0/1241128428 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5c015ad0 con 0x7fec6c1616c0 2024-09-12T03:36:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6c0ceef0 con 0x7fec6c1616c0 2024-09-12T03:36:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec5affd640 1 -- 172.21.15.73:0/1241128428 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c01d400 con 0x7fec6c1616c0 2024-09-12T03:36:00.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6c0cf4b0 con 0x7fec6c1616c0 2024-09-12T03:36:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec6c0afff0 con 0x7fec6c1616c0 2024-09-12T03:36:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec5affd640 1 -- 172.21.15.73:0/1241128428 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec5c013400 con 0x7fec6c1616c0 2024-09-12T03:36:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec5affd640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec4c0678f0 0x7fec4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec6a59c640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec4c0678f0 0x7fec4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.011+0000 7fec5affd640 1 -- 172.21.15.73:0/1241128428 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fec5c086350 con 0x7fec6c1616c0 2024-09-12T03:36:00.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.015+0000 7fec6a59c640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec4c0678f0 0x7fec4c069db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec60009b60 tx=0x7fec60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.019+0000 7fec5affd640 1 -- 172.21.15.73:0/1241128428 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec5c019030 con 0x7fec6c1616c0 2024-09-12T03:36:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.235+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fec6c06d350 con 0x7fec6c1616c0 2024-09-12T03:36:00.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.235+0000 7fec5affd640 1 -- 172.21.15.73:0/1241128428 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fec5c057060 con 0x7fec6c1616c0 2024-09-12T03:36:00.237 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:00.237 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:36:00.237 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-09-12T03:36:00.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.237 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-09-12T03:36:00.237 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ==", 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw==", 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.238 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA==", 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.239 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ==", 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.240 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg==", 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw==", 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-09-12T03:36:00.242 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig==", 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ==", 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.243 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A==", 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.244 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg==", 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ==", 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.245 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g==", 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.246 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg==", 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-09-12T03:36:00.247 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA==", 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw==", 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.248 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ==", 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:36:00.249 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQASYeJmw4+ENRAAkTAy3UFY3keAJJFJvyQaAA==", 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.250 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw==", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA==", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:36:00.251 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.252 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T03:36:00.252 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec4c0678f0 msgr2=0x7fec4c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec4c0678f0 0x7fec4c069db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec60009b60 tx=0x7fec60008040 comp rx=0 tx=0).stop 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c1616c0 msgr2=0x7fec6c1447e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c1616c0 0x7fec6c1447e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fec5c011560 tx=0x7fec5c011a20 comp rx=0 tx=0).stop 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 shutdown_connections 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec4c0678f0 0x7fec4c069db0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c1616c0 0x7fec6c1447e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec6c0ce670 0x7fec6c142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 --2- 172.21.15.73:0/1241128428 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec6c1612e0 0x7fec6c1442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 >> 172.21.15.73:0/1241128428 conn(0x7fec6c073580 msgr2=0x7fec6c0b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:00.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 shutdown_connections 2024-09-12T03:36:00.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.239+0000 7fec70b76640 1 -- 172.21.15.73:0/1241128428 wait complete. 2024-09-12T03:36:00.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T03:36:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.359+0000 7fbbaf7e4640 1 Processor -- start 2024-09-12T03:36:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbaf7e4640 1 -- start start 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbaf7e4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbba815f3a0 0x7fbba8165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbaf7e4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba80aede0 con 0x7fbba8070020 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbaf7e4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba815fa10 con 0x7fbba81520a0 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbaf7e4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fbba8152480 con 0x7fbba815f3a0 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbacd7f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbba8070020 0x7fbba815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52094/0 (socket says 172.21.15.73:52094) 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbacd7f640 1 -- 172.21.15.73:0/1742420618 learned_addr learned my addr 172.21.15.73:0/1742420618 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbadd81640 1 --2- 172.21.15.73:0/1742420618 >> v2:172.21.15.150:3300/0 conn(0x7fbba815f3a0 0x7fbba8165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129635522 0 0) 0x7fbba80aede0 con 0x7fbba8070020 2024-09-12T03:36:00.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb90003530 con 0x7fbba8070020 2024-09-12T03:36:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016670553 0 0) 0x7fbb90003530 con 0x7fbba8070020 2024-09-12T03:36:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 >> v2:172.21.15.150:3300/0 conn(0x7fbba815f3a0 msgr2=0x7fbba8165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 --2- 172.21.15.73:0/1742420618 >> v2:172.21.15.150:3300/0 conn(0x7fbba815f3a0 0x7fbba8165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 >> v1:172.21.15.150:6789/0 conn(0x7fbba81520a0 legacy=0x7fbba806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba8074250 con 0x7fbba8070020 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fbb9c001680 con 0x7fbba8070020 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 >> v1:172.21.15.73:6789/0 conn(0x7fbba8070020 legacy=0x7fbba815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb900039c0 0x7fbb90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb90004810 0x7fbb90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbb9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9000c040 con 0x7fbb900051d0 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9000c1f0 con 0x7fbb90004810 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9000c3f0 con 0x7fbb900039c0 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbadd81640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbb9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbad580640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb900039c0 0x7fbb90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbacd7f640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb90004810 0x7fbb90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbadd81640 1 -- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb900039c0 msgr2=0x7fbb90003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbadd81640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb900039c0 0x7fbb90003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbadd81640 1 -- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb90004810 msgr2=0x7fbb90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbadd81640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb90004810 0x7fbb90004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbadd81640 1 -- 172.21.15.73:0/1742420618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb90003530 con 0x7fbb900051d0 2024-09-12T03:36:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.363+0000 7fbbad580640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbb900039c0 0x7fbb90003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbadd81640 1 -- 172.21.15.73:0/1742420618 reap_dead start 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbadd81640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbb9000b9d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009fa0 tx=0x7fbba001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198b2e601af72540 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00b2070 con 0x7fbb900051d0 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba00a5d50 con 0x7fbb900051d0 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbba7fff640 1 -- 172.21.15.73:0/1742420618 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0009bf0 con 0x7fbb900051d0 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/1742420618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 msgr2=0x7fbb9000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbb9000b9d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009fa0 tx=0x7fbba001cc80 comp rx=0 tx=0).stop 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/1742420618 shutdown_connections 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/1742420618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbb9000b9d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/1742420618 >> 172.21.15.73:0/1742420618 conn(0x7fbba80b1f90 msgr2=0x7fbba80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/1742420618 shutdown_connections 2024-09-12T03:36:00.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/1742420618 wait complete. 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 Processor -- start 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- start start 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbba81f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8154600 0x7fbba8154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba806ee80 0x7fbba806f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8073770 con 0x7fbb900051d0 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbba815f850 con 0x7fbba806ee80 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbba8073a50 con 0x7fbba8154600 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbba81f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbba81f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56852/0 (socket says 172.21.15.73:56852) 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 -- 172.21.15.73:0/2139602688 learned_addr learned my addr 172.21.15.73:0/2139602688 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbacd7f640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8154600 0x7fbba8154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbadd81640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba806ee80 0x7fbba806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 -- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8154600 msgr2=0x7fbba8154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8154600 0x7fbba8154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 -- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba806ee80 msgr2=0x7fbba806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba806ee80 0x7fbba806f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 -- 172.21.15.73:0/2139602688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba8142340 con 0x7fbb900051d0 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbad580640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbba81f4480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d7a0 tx=0x7fbb9800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbba5ffb640 1 -- 172.21.15.73:0/2139602688 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98005270 con 0x7fbb900051d0 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbba5ffb640 1 -- 172.21.15.73:0/2139602688 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb98017070 con 0x7fbb900051d0 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba8155150 con 0x7fbb900051d0 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbba5ffb640 1 -- 172.21.15.73:0/2139602688 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800b6b0 con 0x7fbb900051d0 2024-09-12T03:36:00.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.367+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81428f0 con 0x7fbb900051d0 2024-09-12T03:36:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.371+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba8068e50 con 0x7fbb900051d0 2024-09-12T03:36:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.371+0000 7fbba5ffb640 1 -- 172.21.15.73:0/2139602688 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbb9800b850 con 0x7fbb900051d0 2024-09-12T03:36:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.371+0000 7fbba5ffb640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbb940678f0 0x7fbb94069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.371+0000 7fbba5ffb640 1 -- 172.21.15.73:0/2139602688 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fbb98085910 con 0x7fbb900051d0 2024-09-12T03:36:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.371+0000 7fbbacd7f640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbb940678f0 0x7fbb94069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.371+0000 7fbbacd7f640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbb940678f0 0x7fbb94069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c001ec0 tx=0x7fbb9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.375+0000 7fbba5ffb640 1 -- 172.21.15.73:0/2139602688 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbb980566a0 con 0x7fbb900051d0 2024-09-12T03:36:00.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.535+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbba814d0a0 con 0x7fbb900051d0 2024-09-12T03:36:00.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.535+0000 7fbba5ffb640 1 -- 172.21.15.73:0/2139602688 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7fbb98055fa0 con 0x7fbb900051d0 2024-09-12T03:36:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:00.537 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T03:36:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T03:36:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T03:36:00.538 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:00.538 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T03:36:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbb940678f0 msgr2=0x7fbb94069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbb940678f0 0x7fbb94069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c001ec0 tx=0x7fbb9c009040 comp rx=0 tx=0).stop 2024-09-12T03:36:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 msgr2=0x7fbba81f4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbba81f4480 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d7a0 tx=0x7fbb9800dc60 comp rx=0 tx=0).stop 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 shutdown_connections 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbb940678f0 0x7fbb94069db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbba806ee80 0x7fbba806f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbba8154600 0x7fbba8154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 --2- 172.21.15.73:0/2139602688 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb900051d0 0x7fbba81f4480 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 >> 172.21.15.73:0/2139602688 conn(0x7fbba80b1f90 msgr2=0x7fbba80b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 shutdown_connections 2024-09-12T03:36:00.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.539+0000 7fbbaf7e4640 1 -- 172.21.15.73:0/2139602688 wait complete. 2024-09-12T03:36:00.555 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T03:36:00.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T03:36:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad16573640 1 Processor -- start 2024-09-12T03:36:00.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad16573640 1 -- start start 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad16573640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1015bec0 0x7fad100ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad16573640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad100b3290 con 0x7fad100af470 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad16573640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad100b3570 con 0x7fad1015c2a0 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad16573640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fad100b3850 con 0x7fad1015bec0 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad14b10640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fad100af470 0x7fad1006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52106/0 (socket says 172.21.15.73:52106) 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad14b10640 1 -- 172.21.15.73:0/1845420509 learned_addr learned my addr 172.21.15.73:0/1845420509 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad0ffff640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1015bec0 0x7fad100ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848328891 0 0) 0x7fad100b3290 con 0x7fad100af470 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.663+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf8003530 con 0x7fad100af470 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850636104 0 0) 0x7facf8003530 con 0x7fad100af470 2024-09-12T03:36:00.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1015bec0 msgr2=0x7fad100ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1015bec0 0x7fad100ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 >> v1:172.21.15.150:6789/0 conn(0x7fad1015c2a0 legacy=0x7fad100aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad100b3b30 con 0x7fad100af470 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fad08001a00 con 0x7fad100af470 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 >> v1:172.21.15.73:6789/0 conn(0x7fad100af470 legacy=0x7fad1006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1015bec0 0x7facf80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7facf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf8004d50 0x7facf80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad100b3850 con 0x7facf8003f70 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7facf800bab0 con 0x7facf8004d50 2024-09-12T03:36:00.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7facf800bcb0 con 0x7fad1015bec0 2024-09-12T03:36:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7facf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0f7fe640 1 -- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1015bec0 msgr2=0x7facf80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad1015bec0 0x7facf80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0f7fe640 1 -- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf8004d50 msgr2=0x7facf80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad14b10640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf8004d50 0x7facf80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7facf8004d50 0x7facf80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0f7fe640 1 -- 172.21.15.73:0/1845420509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf8003530 con 0x7facf8003f70 2024-09-12T03:36:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7facf8004810 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fad1006da50 tx=0x7fad0401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e7841a218888fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad040013a0 con 0x7facf8003f70 2024-09-12T03:36:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad040052f0 con 0x7facf8003f70 2024-09-12T03:36:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad0effd640 1 -- 172.21.15.73:0/1845420509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04003840 con 0x7facf8003f70 2024-09-12T03:36:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad16573640 1 -- 172.21.15.73:0/1845420509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 msgr2=0x7facf8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad16573640 1 --2- 172.21.15.73:0/1845420509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7facf8004810 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fad1006da50 tx=0x7fad0401c3c0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad14b10640 1 -- 172.21.15.73:0/1845420509 reap_dead start 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad16573640 1 -- 172.21.15.73:0/1845420509 shutdown_connections 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad16573640 1 -- 172.21.15.73:0/1845420509 >> 172.21.15.73:0/1845420509 conn(0x7fad100b1f90 msgr2=0x7fad100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad16573640 1 -- 172.21.15.73:0/1845420509 shutdown_connections 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.667+0000 7fad16573640 1 -- 172.21.15.73:0/1845420509 wait complete. 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 Processor -- start 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 -- start start 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7fad101f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad10150380 0x7fad10151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad101f25d0 0x7fad101f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fad100afc90 con 0x7facf8003f70 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fad100b40f0 con 0x7fad101f25d0 2024-09-12T03:36:00.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fad100ad200 con 0x7fad10150380 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7fad101f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7fad101f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56866/0 (socket says 172.21.15.73:56866) 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 -- 172.21.15.73:0/3118534108 learned_addr learned my addr 172.21.15.73:0/3118534108 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad14b10640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad101f25d0 0x7fad101f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad10150380 0x7fad10151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 -- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad10150380 msgr2=0x7fad10151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad10150380 0x7fad10151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 -- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad101f25d0 msgr2=0x7fad101f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad101f25d0 0x7fad101f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 -- 172.21.15.73:0/3118534108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad101517b0 con 0x7facf8003f70 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad10150380 0x7fad10151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:00.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad14b10640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad101f25d0 0x7fad101f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0ffff640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7fad101f50d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e850 tx=0x7fad0000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0cff9640 1 -- 172.21.15.73:0/3118534108 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00017070 con 0x7facf8003f70 2024-09-12T03:36:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0cff9640 1 -- 172.21.15.73:0/3118534108 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0000c8e0 con 0x7facf8003f70 2024-09-12T03:36:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad10151a80 con 0x7facf8003f70 2024-09-12T03:36:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0cff9640 1 -- 172.21.15.73:0/3118534108 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000ccd0 con 0x7facf8003f70 2024-09-12T03:36:00.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad10152040 con 0x7facf8003f70 2024-09-12T03:36:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad100ad630 con 0x7facf8003f70 2024-09-12T03:36:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0cff9640 1 -- 172.21.15.73:0/3118534108 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fad0001a070 con 0x7facf8003f70 2024-09-12T03:36:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.671+0000 7fad0cff9640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7facfc0678c0 0x7facfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.675+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7facfc0678c0 0x7facfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.675+0000 7fad0cff9640 1 -- 172.21.15.73:0/3118534108 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fad00085940 con 0x7facf8003f70 2024-09-12T03:36:00.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.675+0000 7fad0f7fe640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7facfc0678c0 0x7facfc069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad100ae510 tx=0x7fad040011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:00.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.679+0000 7fad0cff9640 1 -- 172.21.15.73:0/3118534108 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fad00056640 con 0x7facf8003f70 2024-09-12T03:36:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:00.831+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fad100b4f40 con 0x7facf8003f70 2024-09-12T03:36:01.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.819+0000 7fad0cff9640 1 -- 172.21.15.73:0/3118534108 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7fad00055f40 con 0x7facf8003f70 2024-09-12T03:36:01.821 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T03:36:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7facfc0678c0 msgr2=0x7facfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:01.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7facfc0678c0 0x7facfc069d80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad100ae510 tx=0x7fad040011a0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 msgr2=0x7fad101f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7fad101f50d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e850 tx=0x7fad0000ed10 comp rx=0 tx=0).stop 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 shutdown_connections 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7facfc0678c0 0x7facfc069d80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fad101f25d0 0x7fad101f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fad10150380 0x7fad10151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 --2- 172.21.15.73:0/3118534108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7facf8003f70 0x7fad101f50d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 >> 172.21.15.73:0/3118534108 conn(0x7fad100b1f90 msgr2=0x7fad100b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 shutdown_connections 2024-09-12T03:36:01.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.823+0000 7fad16573640 1 -- 172.21.15.73:0/3118534108 wait complete. 2024-09-12T03:36:01.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T03:36:01.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96c059640 1 Processor -- start 2024-09-12T03:36:01.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96c059640 1 -- start start 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96c059640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9640cc870 0x7fb9640cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96c059640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb9640cdfd0 0x7fb96406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96c059640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9640ce8d0 con 0x7fb964073100 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96c059640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb9640cebb0 con 0x7fb9640cc870 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96c059640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb9640cee90 con 0x7fb9640cdfd0 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb969df5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9640cc870 0x7fb9640cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb969df5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9640cc870 0x7fb9640cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56876/0 (socket says 172.21.15.73:56876) 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb969df5640 1 -- 172.21.15.73:0/1610121206 learned_addr learned my addr 172.21.15.73:0/1610121206 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb9695f4640 1 --1- 172.21.15.73:0/1610121206 >> v1:172.21.15.73:6789/0 conn(0x7fb964073100 0x7fb9640ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52112/0 (socket says 172.21.15.73:52112) 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb96a5f6640 1 --2- 172.21.15.73:0/1610121206 >> v2:172.21.15.150:3300/0 conn(0x7fb9640cdfd0 0x7fb96406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:01.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.979+0000 7fb969df5640 1 -- 172.21.15.73:0/1610121206 >> v2:172.21.15.150:3300/0 conn(0x7fb9640cdfd0 msgr2=0x7fb96406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:01.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb969df5640 1 --2- 172.21.15.73:0/1610121206 >> v2:172.21.15.150:3300/0 conn(0x7fb9640cdfd0 0x7fb96406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb969df5640 1 -- 172.21.15.73:0/1610121206 >> v1:172.21.15.73:6789/0 conn(0x7fb964073100 legacy=0x7fb9640ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:01.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb969df5640 1 -- 172.21.15.73:0/1610121206 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640cf170 con 0x7fb9640cc870 2024-09-12T03:36:01.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb968df3640 1 -- 172.21.15.73:0/1610121206 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014765660 0 0) 0x7fb9640ce8d0 con 0x7fb964073100 2024-09-12T03:36:01.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb969df5640 1 --2- 172.21.15.73:0/1610121206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cc870 0x7fb9640cf970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb964071d30 tx=0x7fb96001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c69cceaba749d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:01.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb968df3640 1 -- 172.21.15.73:0/1610121206 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600aa670 con 0x7fb9640cc870 2024-09-12T03:36:01.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb968df3640 1 -- 172.21.15.73:0/1610121206 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9600af070 con 0x7fb9640cc870 2024-09-12T03:36:01.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb968df3640 1 -- 172.21.15.73:0/1610121206 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600aaa30 con 0x7fb9640cc870 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 -- 172.21.15.73:0/1610121206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cc870 msgr2=0x7fb9640cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 --2- 172.21.15.73:0/1610121206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cc870 0x7fb9640cf970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb964071d30 tx=0x7fb96001c4f0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 -- 172.21.15.73:0/1610121206 shutdown_connections 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 --2- 172.21.15.73:0/1610121206 >> v2:172.21.15.150:3300/0 conn(0x7fb9640cdfd0 0x7fb96406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 --2- 172.21.15.73:0/1610121206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cc870 0x7fb9640cf970 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 -- 172.21.15.73:0/1610121206 >> 172.21.15.73:0/1610121206 conn(0x7fb9640b1c80 msgr2=0x7fb9640b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 -- 172.21.15.73:0/1610121206 shutdown_connections 2024-09-12T03:36:01.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.983+0000 7fb96c059640 1 -- 172.21.15.73:0/1610121206 wait complete. 2024-09-12T03:36:01.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 Processor -- start 2024-09-12T03:36:01.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 -- start start 2024-09-12T03:36:01.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb964073100 0x7fb96413c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:01.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9640cc870 0x7fb9641fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:01.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cdfd0 0x7fb96415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:01.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb964169520 con 0x7fb9640cdfd0 2024-09-12T03:36:01.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9641693a0 con 0x7fb9640cc870 2024-09-12T03:36:01.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb9641696a0 con 0x7fb964073100 2024-09-12T03:36:01.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cdfd0 0x7fb96415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cdfd0 0x7fb96415b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56892/0 (socket says 172.21.15.73:56892) 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 -- 172.21.15.73:0/641250723 learned_addr learned my addr 172.21.15.73:0/641250723 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb969df5640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb964073100 0x7fb96413c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 -- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb964073100 msgr2=0x7fb96413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb964073100 0x7fb96413c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 -- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9640cc870 msgr2=0x7fb9641fa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb9695f4640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9640cc870 0x7fb9641fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9640cc870 0x7fb9641fa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 -- 172.21.15.73:0/641250723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96409c240 con 0x7fb9640cdfd0 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96a5f6640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cdfd0 0x7fb96415b670 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb95c007e60 tx=0x7fb95c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb95a7fc640 1 -- 172.21.15.73:0/641250723 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c014420 con 0x7fb9640cdfd0 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb95a7fc640 1 -- 172.21.15.73:0/641250723 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c019070 con 0x7fb9640cdfd0 2024-09-12T03:36:01.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb95a7fc640 1 -- 172.21.15.73:0/641250723 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c014820 con 0x7fb9640cdfd0 2024-09-12T03:36:01.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96413a990 con 0x7fb9640cdfd0 2024-09-12T03:36:01.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96409c7c0 con 0x7fb9640cdfd0 2024-09-12T03:36:01.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9640cf970 con 0x7fb9640cdfd0 2024-09-12T03:36:01.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb95a7fc640 1 -- 172.21.15.73:0/641250723 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb95c0149c0 con 0x7fb9640cdfd0 2024-09-12T03:36:01.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb95a7fc640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9480678c0 0x7fb948069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:01.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb95a7fc640 1 -- 172.21.15.73:0/641250723 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5619+0+0 (secure 0 0 0) 0x7fb95c0863d0 con 0x7fb9640cdfd0 2024-09-12T03:36:01.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.987+0000 7fb969df5640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9480678c0 0x7fb948069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:01.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.991+0000 7fb969df5640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9480678c0 0x7fb948069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9600ae000 tx=0x7fb9600a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:01.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:01.995+0000 7fb95a7fc640 1 -- 172.21.15.73:0/641250723 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb95c056ff0 con 0x7fb9640cdfd0 2024-09-12T03:36:02.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.155+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb96409c990 con 0x7fb9640cdfd0 2024-09-12T03:36:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.823+0000 7fb95a7fc640 1 -- 172.21.15.73:0/641250723 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7fb95c0568f0 con 0x7fb9640cdfd0 2024-09-12T03:36:02.825 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9480678c0 msgr2=0x7fb948069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9480678c0 0x7fb948069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb9600ae000 tx=0x7fb9600a7000 comp rx=0 tx=0).stop 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cdfd0 msgr2=0x7fb96415b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cdfd0 0x7fb96415b670 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb95c007e60 tx=0x7fb95c00e4b0 comp rx=0 tx=0).stop 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 shutdown_connections 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9480678c0 0x7fb948069d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9640cdfd0 0x7fb96415b670 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:02.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9640cc870 0x7fb9641fa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 --2- 172.21.15.73:0/641250723 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb964073100 0x7fb96413c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 >> 172.21.15.73:0/641250723 conn(0x7fb9640b1c80 msgr2=0x7fb96413f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:02.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 shutdown_connections 2024-09-12T03:36:02.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.827+0000 7fb96c059640 1 -- 172.21.15.73:0/641250723 wait complete. 2024-09-12T03:36:02.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T03:36:02.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc8921de640 1 Processor -- start 2024-09-12T03:36:02.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc8921de640 1 -- start start 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc8921de640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc88c1520a0 0x7fc88c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc8921de640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc88c15f3a0 0x7fc88c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc8921de640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c070250 con 0x7fc88c06fe50 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc8921de640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c152480 con 0x7fc88c15f3a0 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc8921de640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c0aede0 con 0x7fc88c1520a0 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc88c15f3a0 0x7fc88c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc88c15f3a0 0x7fc88c0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56896/0 (socket says 172.21.15.73:56896) 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88bfff640 1 -- 172.21.15.73:0/511260317 learned_addr learned my addr 172.21.15.73:0/511260317 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88bfff640 1 -- 172.21.15.73:0/511260317 >> v2:172.21.15.150:3300/0 conn(0x7fc88c1520a0 msgr2=0x7fc88c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88b7fe640 1 --2- 172.21.15.73:0/511260317 >> v2:172.21.15.150:3300/0 conn(0x7fc88c1520a0 0x7fc88c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:02.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88bfff640 1 --2- 172.21.15.73:0/511260317 >> v2:172.21.15.150:3300/0 conn(0x7fc88c1520a0 0x7fc88c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88bfff640 1 -- 172.21.15.73:0/511260317 >> v1:172.21.15.150:6789/0 conn(0x7fc88c06fe50 legacy=0x7fc88c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88bfff640 1 -- 172.21.15.73:0/511260317 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c15fa10 con 0x7fc88c15f3a0 2024-09-12T03:36:03.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.995+0000 7fc88b7fe640 1 --2- 172.21.15.73:0/511260317 >> v2:172.21.15.150:3300/0 conn(0x7fc88c1520a0 0x7fc88c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:03.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc88bfff640 1 --2- 172.21.15.73:0/511260317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c15f3a0 0x7fc88c0adc80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc88c071710 tx=0x7fc87c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9aadd821ad6ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:03.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc88a7fc640 1 -- 172.21.15.73:0/511260317 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0b1070 con 0x7fc88c15f3a0 2024-09-12T03:36:03.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc88a7fc640 1 -- 172.21.15.73:0/511260317 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c0ac630 con 0x7fc88c15f3a0 2024-09-12T03:36:03.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc88a7fc640 1 -- 172.21.15.73:0/511260317 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0a8050 con 0x7fc88c15f3a0 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 -- 172.21.15.73:0/511260317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c15f3a0 msgr2=0x7fc88c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 --2- 172.21.15.73:0/511260317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c15f3a0 0x7fc88c0adc80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc88c071710 tx=0x7fc87c01c4e0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 -- 172.21.15.73:0/511260317 shutdown_connections 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 --2- 172.21.15.73:0/511260317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c15f3a0 0x7fc88c0adc80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 --2- 172.21.15.73:0/511260317 >> v2:172.21.15.150:3300/0 conn(0x7fc88c1520a0 0x7fc88c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 -- 172.21.15.73:0/511260317 >> 172.21.15.73:0/511260317 conn(0x7fc88c0b1f90 msgr2=0x7fc88c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 -- 172.21.15.73:0/511260317 shutdown_connections 2024-09-12T03:36:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:02.999+0000 7fc8921de640 1 -- 172.21.15.73:0/511260317 wait complete. 2024-09-12T03:36:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 Processor -- start 2024-09-12T03:36:03.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 -- start start 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc88c06fe50 0x7fc88c13d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c1520a0 0x7fc88c14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc88c15f3a0 0x7fc88c14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c073d30 con 0x7fc88c1520a0 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c073a50 con 0x7fc88c15f3a0 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c167f10 con 0x7fc88c06fe50 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c1520a0 0x7fc88c14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c1520a0 0x7fc88c14e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56902/0 (socket says 172.21.15.73:56902) 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 -- 172.21.15.73:0/2903219450 learned_addr learned my addr 172.21.15.73:0/2903219450 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88b7fe640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc88c06fe50 0x7fc88c13d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88bfff640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc88c15f3a0 0x7fc88c14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 -- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc88c06fe50 msgr2=0x7fc88c13d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc88c06fe50 0x7fc88c13d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 -- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc88c15f3a0 msgr2=0x7fc88c14bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc88c15f3a0 0x7fc88c14bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 -- 172.21.15.73:0/2903219450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c14ee60 con 0x7fc88c1520a0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc88affd640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c1520a0 0x7fc88c14e0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b410 tx=0x7fc87400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc883fff640 1 -- 172.21.15.73:0/2903219450 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874015030 con 0x7fc88c1520a0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc883fff640 1 -- 172.21.15.73:0/2903219450 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc874004020 con 0x7fc88c1520a0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c14f140 con 0x7fc88c1520a0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc883fff640 1 -- 172.21.15.73:0/2903219450 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874004410 con 0x7fc88c1520a0 2024-09-12T03:36:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c14f700 con 0x7fc88c1520a0 2024-09-12T03:36:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c15e4b0 con 0x7fc88c1520a0 2024-09-12T03:36:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.003+0000 7fc883fff640 1 -- 172.21.15.73:0/2903219450 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc874018070 con 0x7fc88c1520a0 2024-09-12T03:36:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.007+0000 7fc883fff640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8700678c0 0x7fc870069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.007+0000 7fc88b7fe640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8700678c0 0x7fc870069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.007+0000 7fc883fff640 1 -- 172.21.15.73:0/2903219450 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6001+0+0 (secure 0 0 0) 0x7fc8740859b0 con 0x7fc88c1520a0 2024-09-12T03:36:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.007+0000 7fc88b7fe640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8700678c0 0x7fc870069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc8840075b0 tx=0x7fc884007540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.011+0000 7fc883fff640 1 -- 172.21.15.73:0/2903219450 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc8740563c0 con 0x7fc88c1520a0 2024-09-12T03:36:03.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.207+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc88c06e540 con 0x7fc88c1520a0 2024-09-12T03:36:03.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.894+0000 7fc883fff640 1 -- 172.21.15.73:0/2903219450 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) ==== 172+0+0 (secure 0 0 0) 0x7fc874055cc0 con 0x7fc88c1520a0 2024-09-12T03:36:03.899 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 7 and data pool 8 2024-09-12T03:36:03.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.906+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8700678c0 msgr2=0x7fc870069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:03.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.906+0000 7fc8921de640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8700678c0 0x7fc870069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc8840075b0 tx=0x7fc884007540 comp rx=0 tx=0).stop 2024-09-12T03:36:03.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.906+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c1520a0 msgr2=0x7fc88c14e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:03.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.906+0000 7fc8921de640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c1520a0 0x7fc88c14e0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b410 tx=0x7fc87400b8d0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 shutdown_connections 2024-09-12T03:36:03.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8700678c0 0x7fc870069d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc88c1520a0 0x7fc88c14e0d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc88c15f3a0 0x7fc88c14bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 --2- 172.21.15.73:0/2903219450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc88c06fe50 0x7fc88c13d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:03.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 >> 172.21.15.73:0/2903219450 conn(0x7fc88c0b1f90 msgr2=0x7fc88c0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:03.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 shutdown_connections 2024-09-12T03:36:03.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:03.910+0000 7fc8921de640 1 -- 172.21.15.73:0/2903219450 wait complete. 2024-09-12T03:36:03.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:04.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.050+0000 7f1abc977640 1 Processor -- start 2024-09-12T03:36:04.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1abc977640 1 -- start start 2024-09-12T03:36:04.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1abc977640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab81587a0 0x7f1ab80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1abc977640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ab80b37d0 0x7f1ab806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1abc977640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab806ec60 con 0x7f1ab806e4b0 2024-09-12T03:36:04.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1abc977640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab806f870 con 0x7f1ab80b37d0 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1abc977640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab80b3c10 con 0x7f1ab81587a0 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab5d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ab80b37d0 0x7f1ab806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab5d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ab80b37d0 0x7f1ab806df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56904/0 (socket says 172.21.15.73:56904) 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab5d9b640 1 -- 172.21.15.73:0/3067236837 learned_addr learned my addr 172.21.15.73:0/3067236837 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab659c640 1 --2- 172.21.15.73:0/3067236837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab81587a0 0x7f1ab80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab5d9b640 1 -- 172.21.15.73:0/3067236837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab81587a0 msgr2=0x7f1ab80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab5d9b640 1 --2- 172.21.15.73:0/3067236837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab81587a0 0x7f1ab80b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab5d9b640 1 -- 172.21.15.73:0/3067236837 >> v1:172.21.15.73:6789/0 conn(0x7f1ab806e4b0 legacy=0x7f1ab8161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab559a640 1 -- 172.21.15.73:0/3067236837 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508665791 0 0) 0x7f1ab806ec60 con 0x7f1ab806e4b0 2024-09-12T03:36:04.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.054+0000 7f1ab5d9b640 1 -- 172.21.15.73:0/3067236837 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab806ef40 con 0x7f1ab80b37d0 2024-09-12T03:36:04.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab5d9b640 1 --2- 172.21.15.73:0/3067236837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80b37d0 0x7f1ab806df70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009e50 tx=0x7f1ab001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b824d5a193fa2f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab559a640 1 -- 172.21.15.73:0/3067236837 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a57e0 con 0x7f1ab80b37d0 2024-09-12T03:36:04.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab559a640 1 -- 172.21.15.73:0/3067236837 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab00a5980 con 0x7f1ab80b37d0 2024-09-12T03:36:04.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab559a640 1 -- 172.21.15.73:0/3067236837 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5d50 con 0x7f1ab80b37d0 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- 172.21.15.73:0/3067236837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80b37d0 msgr2=0x7f1ab806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 --2- 172.21.15.73:0/3067236837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80b37d0 0x7f1ab806df70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009e50 tx=0x7f1ab001ca00 comp rx=0 tx=0).stop 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- 172.21.15.73:0/3067236837 shutdown_connections 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 --2- 172.21.15.73:0/3067236837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab80b37d0 0x7f1ab806df70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 --2- 172.21.15.73:0/3067236837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab81587a0 0x7f1ab80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- 172.21.15.73:0/3067236837 >> 172.21.15.73:0/3067236837 conn(0x7f1ab80b1f90 msgr2=0x7f1ab80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- 172.21.15.73:0/3067236837 shutdown_connections 2024-09-12T03:36:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- 172.21.15.73:0/3067236837 wait complete. 2024-09-12T03:36:04.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 Processor -- start 2024-09-12T03:36:04.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- start start 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab806e4b0 0x7f1ab8152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab80b37d0 0x7f1ab8152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab81587a0 0x7f1ab8153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab8158b80 con 0x7f1ab806e4b0 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab8073170 con 0x7f1ab81587a0 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab809d540 con 0x7f1ab80b37d0 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab806e4b0 0x7f1ab8152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab806e4b0 0x7f1ab8152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56916/0 (socket says 172.21.15.73:56916) 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 -- 172.21.15.73:0/2010533639 learned_addr learned my addr 172.21.15.73:0/2010533639 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab5d9b640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab80b37d0 0x7f1ab8152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab6d9d640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab81587a0 0x7f1ab8153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 -- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab80b37d0 msgr2=0x7f1ab8152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab80b37d0 0x7f1ab8152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 -- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab81587a0 msgr2=0x7f1ab8153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab81587a0 0x7f1ab8153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 -- 172.21.15.73:0/2010533639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab809d820 con 0x7f1ab806e4b0 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab5d9b640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab80b37d0 0x7f1ab8152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1ab659c640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab806e4b0 0x7f1ab8152670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800d5f0 tx=0x7f1aa800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1aaeffd640 1 -- 172.21.15.73:0/2010533639 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80125f0 con 0x7f1ab806e4b0 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1aaeffd640 1 -- 172.21.15.73:0/2010533639 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa8019070 con 0x7f1ab806e4b0 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1aaeffd640 1 -- 172.21.15.73:0/2010533639 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80129d0 con 0x7f1ab806e4b0 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab809db00 con 0x7f1ab806e4b0 2024-09-12T03:36:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.058+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab809e0c0 con 0x7f1ab806e4b0 2024-09-12T03:36:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.062+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab8070080 con 0x7f1ab806e4b0 2024-09-12T03:36:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.062+0000 7f1aaeffd640 1 -- 172.21.15.73:0/2010533639 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1aa8012b70 con 0x7f1ab806e4b0 2024-09-12T03:36:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.062+0000 7f1aaeffd640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1a980678c0 0x7f1a98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.062+0000 7f1aaeffd640 1 -- 172.21.15.73:0/2010533639 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f1aa80862f0 con 0x7f1ab806e4b0 2024-09-12T03:36:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.062+0000 7f1ab5d9b640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1a980678c0 0x7f1a98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.062+0000 7f1ab5d9b640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1a980678c0 0x7f1a98069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00ae000 tx=0x7f1ab00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.066+0000 7f1aaeffd640 1 -- 172.21.15.73:0/2010533639 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1aa8056ca0 con 0x7f1ab806e4b0 2024-09-12T03:36:04.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.234+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ab80af210 con 0x7f1ab806e4b0 2024-09-12T03:36:04.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.234+0000 7f1aaeffd640 1 -- 172.21.15.73:0/2010533639 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+17027 (secure 0 0 0) 0x7f1aa80565a0 con 0x7f1ab806e4b0 2024-09-12T03:36:04.238 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:04.238 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":50,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:03.211695+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:00.869276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:02.196347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1a980678c0 msgr2=0x7f1a98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1a980678c0 0x7f1a98069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00ae000 tx=0x7f1ab00a7070 comp rx=0 tx=0).stop 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab806e4b0 msgr2=0x7f1ab8152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab806e4b0 0x7f1ab8152670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800d5f0 tx=0x7f1aa800dab0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 shutdown_connections 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1a980678c0 0x7f1a98069d80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ab81587a0 0x7f1ab8153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1ab80b37d0 0x7f1ab8152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 --2- 172.21.15.73:0/2010533639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ab806e4b0 0x7f1ab8152670 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 >> 172.21.15.73:0/2010533639 conn(0x7f1ab80b1f90 msgr2=0x7f1ab80d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 shutdown_connections 2024-09-12T03:36:04.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.238+0000 7f1abc977640 1 -- 172.21.15.73:0/2010533639 wait complete. 2024-09-12T03:36:04.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:04.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.374+0000 7f9c277e1640 1 Processor -- start 2024-09-12T03:36:04.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.374+0000 7f9c277e1640 1 -- start start 2024-09-12T03:36:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c277e1640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9c2015c2a0 0x7f9c200aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c277e1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c200af2a0 0x7f9c2006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c277e1640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c200b3290 con 0x7f9c2015bec0 2024-09-12T03:36:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c277e1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9c200b3570 con 0x7f9c200af2a0 2024-09-12T03:36:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c277e1640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9c200b3850 con 0x7f9c2015c2a0 2024-09-12T03:36:04.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c200af2a0 0x7f9c2006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c200af2a0 0x7f9c2006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56926/0 (socket says 172.21.15.73:56926) 2024-09-12T03:36:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 -- 172.21.15.73:0/3331925895 learned_addr learned my addr 172.21.15.73:0/3331925895 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c24d7c640 1 --2- 172.21.15.73:0/3331925895 >> v2:172.21.15.150:3300/0 conn(0x7f9c2015c2a0 0x7f9c200aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 -- 172.21.15.73:0/3331925895 >> v2:172.21.15.150:3300/0 conn(0x7f9c2015c2a0 msgr2=0x7f9c200aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 --2- 172.21.15.73:0/3331925895 >> v2:172.21.15.150:3300/0 conn(0x7f9c2015c2a0 0x7f9c200aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 -- 172.21.15.73:0/3331925895 >> v1:172.21.15.150:6789/0 conn(0x7f9c2015bec0 legacy=0x7f9c200ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:04.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 -- 172.21.15.73:0/3331925895 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200b3b30 con 0x7f9c200af2a0 2024-09-12T03:36:04.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c25d7e640 1 --2- 172.21.15.73:0/3331925895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2006e000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ae510 tx=0x7f9c1801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4695c5800b5ce600 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c1ffff640 1 -- 172.21.15.73:0/3331925895 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180aa650 con 0x7f9c200af2a0 2024-09-12T03:36:04.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c1ffff640 1 -- 172.21.15.73:0/3331925895 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c180af070 con 0x7f9c200af2a0 2024-09-12T03:36:04.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.378+0000 7f9c1ffff640 1 -- 172.21.15.73:0/3331925895 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180aaa10 con 0x7f9c200af2a0 2024-09-12T03:36:04.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/3331925895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 msgr2=0x7f9c2006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 --2- 172.21.15.73:0/3331925895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2006e000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c200ae510 tx=0x7f9c1801c4f0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/3331925895 shutdown_connections 2024-09-12T03:36:04.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 --2- 172.21.15.73:0/3331925895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2006e000 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 --2- 172.21.15.73:0/3331925895 >> v2:172.21.15.150:3300/0 conn(0x7f9c2015c2a0 0x7f9c200aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/3331925895 >> 172.21.15.73:0/3331925895 conn(0x7f9c200b1f90 msgr2=0x7f9c200b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:04.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/3331925895 shutdown_connections 2024-09-12T03:36:04.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/3331925895 wait complete. 2024-09-12T03:36:04.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 Processor -- start 2024-09-12T03:36:04.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- start start 2024-09-12T03:36:04.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c2015bec0 0x7f9c20157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c2015c2a0 0x7f9c20157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2006ed50 con 0x7f9c200af2a0 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200af710 con 0x7f9c2015c2a0 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2006eed0 con 0x7f9c2015bec0 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56928/0 (socket says 172.21.15.73:56928) 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 -- 172.21.15.73:0/712458405 learned_addr learned my addr 172.21.15.73:0/712458405 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c24d7c640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c2015bec0 0x7f9c20157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c25d7e640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c2015c2a0 0x7f9c20157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 -- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c2015bec0 msgr2=0x7f9c20157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c2015bec0 0x7f9c20157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 -- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c2015c2a0 msgr2=0x7f9c20157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c2015c2a0 0x7f9c20157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 -- 172.21.15.73:0/712458405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2015ca10 con 0x7f9c200af2a0 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c24d7c640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c2015bec0 0x7f9c20157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c25d7e640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c2015c2a0 0x7f9c20157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c2557d640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2015ad20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c7c0 tx=0x7f9c1000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c1dffb640 1 -- 172.21.15.73:0/712458405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10016020 con 0x7f9c200af2a0 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c1dffb640 1 -- 172.21.15.73:0/712458405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c10006d60 con 0x7f9c200af2a0 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c20155f40 con 0x7f9c200af2a0 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c1dffb640 1 -- 172.21.15.73:0/712458405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c10003bc0 con 0x7f9c200af2a0 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c20156500 con 0x7f9c200af2a0 2024-09-12T03:36:04.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.382+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2006f260 con 0x7f9c200af2a0 2024-09-12T03:36:04.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.386+0000 7f9c1dffb640 1 -- 172.21.15.73:0/712458405 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c1000a850 con 0x7f9c200af2a0 2024-09-12T03:36:04.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.386+0000 7f9c1dffb640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c0c0678c0 0x7f9c0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.386+0000 7f9c1dffb640 1 -- 172.21.15.73:0/712458405 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f9c10085ac0 con 0x7f9c200af2a0 2024-09-12T03:36:04.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.386+0000 7f9c24d7c640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c0c0678c0 0x7f9c0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.386+0000 7f9c24d7c640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c0c0678c0 0x7f9c0c069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c2015b680 tx=0x7f9c14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.390+0000 7f9c1dffb640 1 -- 172.21.15.73:0/712458405 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9c10020020 con 0x7f9c200af2a0 2024-09-12T03:36:04.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.550+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c2006fcd0 con 0x7f9c200af2a0 2024-09-12T03:36:04.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c1dffb640 1 -- 172.21.15.73:0/712458405 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+17027 (secure 0 0 0) 0x7f9c10019310 con 0x7f9c200af2a0 2024-09-12T03:36:04.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:04.556 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":50,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:03.211695+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:00.869276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:02.196347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c0c0678c0 msgr2=0x7f9c0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c0c0678c0 0x7f9c0c069d80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c2015b680 tx=0x7f9c14008040 comp rx=0 tx=0).stop 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 msgr2=0x7f9c2015ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2015ad20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c7c0 tx=0x7f9c1000cc80 comp rx=0 tx=0).stop 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 shutdown_connections 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c0c0678c0 0x7f9c0c069d80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c2015c2a0 0x7f9c20157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c2015bec0 0x7f9c20157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 --2- 172.21.15.73:0/712458405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c200af2a0 0x7f9c2015ad20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 >> 172.21.15.73:0/712458405 conn(0x7f9c200b1f90 msgr2=0x7f9c201599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:04.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 shutdown_connections 2024-09-12T03:36:04.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.554+0000 7f9c277e1640 1 -- 172.21.15.73:0/712458405 wait complete. 2024-09-12T03:36:04.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T03:36:04.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 Processor -- start 2024-09-12T03:36:04.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 -- start start 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc15bec0 0x7f9cdc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9cdc15c2a0 0x7f9cdc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9cdc0af2a0 0x7f9cdc15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9cdc0b3290 con 0x7f9cdc15c2a0 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f9cdc0b3570 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9ce1f00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc0b3850 con 0x7f9cdc15bec0 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9cdc15c2a0 0x7f9cdc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9cdc15c2a0 0x7f9cdc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56932/0 (socket says 172.21.15.73:56932) 2024-09-12T03:36:04.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 -- 172.21.15.73:0/298621256 learned_addr learned my addr 172.21.15.73:0/298621256 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:04.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cdb7fe640 1 --2- 172.21.15.73:0/298621256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc15bec0 0x7f9cdc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cdbfff640 1 --2- 172.21.15.73:0/298621256 >> v2:172.21.15.150:3300/0 conn(0x7f9cdc0af2a0 0x7f9cdc15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 -- 172.21.15.73:0/298621256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc15bec0 msgr2=0x7f9cdc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:04.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 --2- 172.21.15.73:0/298621256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc15bec0 0x7f9cdc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 -- 172.21.15.73:0/298621256 >> v2:172.21.15.150:3300/0 conn(0x7f9cdc0af2a0 msgr2=0x7f9cdc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:04.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 --2- 172.21.15.73:0/298621256 >> v2:172.21.15.150:3300/0 conn(0x7f9cdc0af2a0 0x7f9cdc15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.694+0000 7f9cd2ffd640 1 -- 172.21.15.73:0/298621256 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc0b3b30 con 0x7f9cdc15c2a0 2024-09-12T03:36:04.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cd2ffd640 1 --2- 172.21.15.73:0/298621256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc15c2a0 0x7f9cdc0aed60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ada40 tx=0x7f9cc401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17ee7a07f397d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdaffd640 1 -- 172.21.15.73:0/298621256 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40b0070 con 0x7f9cdc15c2a0 2024-09-12T03:36:04.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdaffd640 1 -- 172.21.15.73:0/298621256 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc40ab600 con 0x7f9cdc15c2a0 2024-09-12T03:36:04.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdaffd640 1 -- 172.21.15.73:0/298621256 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40ab9d0 con 0x7f9cdc15c2a0 2024-09-12T03:36:04.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- 172.21.15.73:0/298621256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc15c2a0 msgr2=0x7f9cdc0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/298621256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc15c2a0 0x7f9cdc0aed60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ada40 tx=0x7f9cc401c230 comp rx=0 tx=0).stop 2024-09-12T03:36:04.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- 172.21.15.73:0/298621256 shutdown_connections 2024-09-12T03:36:04.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/298621256 >> v2:172.21.15.150:3300/0 conn(0x7f9cdc0af2a0 0x7f9cdc15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/298621256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc15c2a0 0x7f9cdc0aed60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/298621256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc15bec0 0x7f9cdc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- 172.21.15.73:0/298621256 >> 172.21.15.73:0/298621256 conn(0x7f9cdc0b1f90 msgr2=0x7f9cdc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:04.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- 172.21.15.73:0/298621256 shutdown_connections 2024-09-12T03:36:04.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- 172.21.15.73:0/298621256 wait complete. 2024-09-12T03:36:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 Processor -- start 2024-09-12T03:36:04.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- start start 2024-09-12T03:36:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc0af2a0 0x7f9cdc145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cdc15bec0 0x7f9cdc06e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc06f500 0x7f9cdc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc0af6b0 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9cdc0ad740 con 0x7f9cdc15bec0 2024-09-12T03:36:04.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9cdc06e000 con 0x7f9cdc06f500 2024-09-12T03:36:04.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc0af2a0 0x7f9cdc145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc0af2a0 0x7f9cdc145550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56946/0 (socket says 172.21.15.73:56946) 2024-09-12T03:36:04.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 -- 172.21.15.73:0/1285398207 learned_addr learned my addr 172.21.15.73:0/1285398207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:04.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cd2ffd640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cdc15bec0 0x7f9cdc06e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdbfff640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc06f500 0x7f9cdc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 -- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc06f500 msgr2=0x7f9cdc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc06f500 0x7f9cdc06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 -- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cdc15bec0 msgr2=0x7f9cdc06e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:04.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cdc15bec0 0x7f9cdc06e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:04.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 -- 172.21.15.73:0/1285398207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cdc1652d0 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cdb7fe640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc0af2a0 0x7f9cdc145550 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00d5f0 tx=0x7f9ccc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cd8ff9640 1 -- 172.21.15.73:0/1285398207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc0125f0 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cd8ff9640 1 -- 172.21.15.73:0/1285398207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc019070 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cdc1655b0 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9cd8ff9640 1 -- 172.21.15.73:0/1285398207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc0129b0 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.698+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cdc165b70 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.702+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cdc15fc60 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.702+0000 7f9cd8ff9640 1 -- 172.21.15.73:0/1285398207 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ccc012b50 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.702+0000 7f9cd8ff9640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9cc00678c0 0x7f9cc0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:04.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.702+0000 7f9cd2ffd640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9cc00678c0 0x7f9cc0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:04.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.702+0000 7f9cd8ff9640 1 -- 172.21.15.73:0/1285398207 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f9ccc0861f0 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.702+0000 7f9cd2ffd640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9cc00678c0 0x7f9cc0069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40ad000 tx=0x7f9cc40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:04.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.706+0000 7f9cd8ff9640 1 -- 172.21.15.73:0/1285398207 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ccc056ba0 con 0x7f9cdc0af2a0 2024-09-12T03:36:04.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:04.910+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9cdc06fcd0 con 0x7f9cdc0af2a0 2024-09-12T03:36:05.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9cd8ff9640 1 -- 172.21.15.73:0/1285398207 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f9ccc0564a0 con 0x7f9cdc0af2a0 2024-09-12T03:36:05.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9cc00678c0 msgr2=0x7f9cc0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:05.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9cc00678c0 0x7f9cc0069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40ad000 tx=0x7f9cc40a6000 comp rx=0 tx=0).stop 2024-09-12T03:36:05.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc0af2a0 msgr2=0x7f9cdc145550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc0af2a0 0x7f9cdc145550 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00d5f0 tx=0x7f9ccc00dab0 comp rx=0 tx=0).stop 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 shutdown_connections 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9cc00678c0 0x7f9cc0069d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cdc06f500 0x7f9cdc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cdc15bec0 0x7f9cdc06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 --2- 172.21.15.73:0/1285398207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cdc0af2a0 0x7f9cdc145550 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 >> 172.21.15.73:0/1285398207 conn(0x7f9cdc0b1f90 msgr2=0x7f9cdc0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 shutdown_connections 2024-09-12T03:36:05.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:05.878+0000 7f9ce1f00640 1 -- 172.21.15.73:0/1285398207 wait complete. 2024-09-12T03:36:05.902 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T03:36:05.902 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T03:36:06.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f31226eb640 1 Processor -- start 2024-09-12T03:36:06.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f31226eb640 1 -- start start 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f31226eb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 0x7f311c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f31226eb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311c070250 con 0x7f311c15f3a0 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f31226eb640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f311c0aede0 con 0x7f311c06fe50 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f31226eb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f311c152480 con 0x7f311c1520a0 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f311c15f3a0 0x7f311c0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44902/0 (socket says 172.21.15.73:44902) 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 -- 172.21.15.73:0/856093287 learned_addr learned my addr 172.21.15.73:0/856093287 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311bfff640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 0x7f311c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3653541607 0 0) 0x7f311c070250 con 0x7f311c15f3a0 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3104003530 con 0x7f311c15f3a0 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3287628974 0 0) 0x7f3104003530 con 0x7f311c15f3a0 2024-09-12T03:36:06.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 msgr2=0x7f311c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 0x7f311c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 >> v1:172.21.15.150:6789/0 conn(0x7f311c06fe50 legacy=0x7f311c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c15fa10 con 0x7f311c15f3a0 2024-09-12T03:36:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f3114001a00 con 0x7f311c15f3a0 2024-09-12T03:36:06.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 >> v1:172.21.15.73:6789/0 conn(0x7f311c15f3a0 legacy=0x7f311c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:06.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31040039f0 0x7f3104003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 0x7f3104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f31040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f310400bb60 con 0x7f3104004d50 2024-09-12T03:36:06.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f310400bce0 con 0x7f31040039f0 2024-09-12T03:36:06.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f310400beb0 con 0x7f311c1520a0 2024-09-12T03:36:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f31040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311bfff640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31040039f0 0x7f3104003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311b7fe640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 0x7f3104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 -- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 msgr2=0x7f3104004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 0x7f3104004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 -- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31040039f0 msgr2=0x7f3104003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:06.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31040039f0 0x7f3104003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f3120c88640 1 -- 172.21.15.73:0/856093287 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3104003530 con 0x7f3104004d50 2024-09-12T03:36:06.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.030+0000 7f311b7fe640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c1520a0 0x7f3104004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f3120c88640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f31040051d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f311400a870 tx=0x7f311401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05c17b79ac58a3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311400a460 con 0x7f3104004d50 2024-09-12T03:36:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31140ad650 con 0x7f3104004d50 2024-09-12T03:36:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f311affd640 1 -- 172.21.15.73:0/856093287 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31140ada40 con 0x7f3104004d50 2024-09-12T03:36:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- 172.21.15.73:0/856093287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 msgr2=0x7f31040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 --2- 172.21.15.73:0/856093287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f31040051d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f311400a870 tx=0x7f311401d360 comp rx=0 tx=0).stop 2024-09-12T03:36:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f3120c88640 1 -- 172.21.15.73:0/856093287 reap_dead start 2024-09-12T03:36:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- 172.21.15.73:0/856093287 shutdown_connections 2024-09-12T03:36:06.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- 172.21.15.73:0/856093287 >> 172.21.15.73:0/856093287 conn(0x7f311c0b1f90 msgr2=0x7f311c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- 172.21.15.73:0/856093287 shutdown_connections 2024-09-12T03:36:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- 172.21.15.73:0/856093287 wait complete. 2024-09-12T03:36:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 Processor -- start 2024-09-12T03:36:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- start start 2024-09-12T03:36:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f311c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15a220 0x7f311c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15a6a0 0x7f311c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f311c073770 con 0x7f3104004d50 2024-09-12T03:36:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f311c073490 con 0x7f311c15a220 2024-09-12T03:36:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.034+0000 7f31226eb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f311c073a50 con 0x7f311c15a6a0 2024-09-12T03:36:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f311c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f311c15cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59716/0 (socket says 172.21.15.73:59716) 2024-09-12T03:36:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 -- 172.21.15.73:0/2570612507 learned_addr learned my addr 172.21.15.73:0/2570612507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311b7fe640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15a220 0x7f311c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f3120c88640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15a6a0 0x7f311c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 -- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15a6a0 msgr2=0x7f311c154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15a6a0 0x7f311c154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 -- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15a220 msgr2=0x7f311c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15a220 0x7f311c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 -- 172.21.15.73:0/2570612507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c1f46e0 con 0x7f3104004d50 2024-09-12T03:36:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311b7fe640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15a220 0x7f311c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311bfff640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f311c15cf40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f310c00f580 tx=0x7f310c00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f3118ff9640 1 -- 172.21.15.73:0/2570612507 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c019020 con 0x7f3104004d50 2024-09-12T03:36:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f3118ff9640 1 -- 172.21.15.73:0/2570612507 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c014870 con 0x7f3104004d50 2024-09-12T03:36:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1f49c0 con 0x7f3104004d50 2024-09-12T03:36:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f3118ff9640 1 -- 172.21.15.73:0/2570612507 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c014c40 con 0x7f3104004d50 2024-09-12T03:36:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1f4f80 con 0x7f3104004d50 2024-09-12T03:36:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311c073d30 con 0x7f3104004d50 2024-09-12T03:36:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f3118ff9640 1 -- 172.21.15.73:0/2570612507 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f310c01c020 con 0x7f3104004d50 2024-09-12T03:36:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f3118ff9640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f3118ff9640 1 -- 172.21.15.73:0/2570612507 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f310c086690 con 0x7f3104004d50 2024-09-12T03:36:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311b7fe640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.038+0000 7f311b7fe640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f311c0b4080 tx=0x7f3110009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.042+0000 7f3118ff9640 1 -- 172.21.15.73:0/2570612507 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f310c023020 con 0x7f3104004d50 2024-09-12T03:36:06.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.238+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f311c06e540 con 0x7f3104004d50 2024-09-12T03:36:06.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.878+0000 7f3118ff9640 1 -- 172.21.15.73:0/2570612507 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f310c057050 con 0x7f3104004d50 2024-09-12T03:36:06.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 msgr2=0x7f3108069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:06.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f311c0b4080 tx=0x7f3110009040 comp rx=0 tx=0).stop 2024-09-12T03:36:06.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 msgr2=0x7f311c15cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:06.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f311c15cf40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f310c00f580 tx=0x7f310c00fa40 comp rx=0 tx=0).stop 2024-09-12T03:36:06.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 shutdown_connections 2024-09-12T03:36:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15a6a0 0x7f311c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15a220 0x7f311c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 --2- 172.21.15.73:0/2570612507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3104004d50 0x7f311c15cf40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 >> 172.21.15.73:0/2570612507 conn(0x7f311c0b1f90 msgr2=0x7f311c0d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 shutdown_connections 2024-09-12T03:36:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:06.882+0000 7f31226eb640 1 -- 172.21.15.73:0/2570612507 wait complete. 2024-09-12T03:36:06.907 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T03:36:06.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:07.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210cc52640 1 Processor -- start 2024-09-12T03:36:07.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210cc52640 1 -- start start 2024-09-12T03:36:07.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210cc52640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f210815bec0 0x7f21080ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210cc52640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21080af470 0x7f210806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210cc52640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21080b3290 con 0x7f210815c2a0 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210cc52640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f21080b3570 con 0x7f21080af470 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210cc52640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f21080b3850 con 0x7f210815bec0 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f2106d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21080af470 0x7f210806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f2106d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21080af470 0x7f210806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59728/0 (socket says 172.21.15.73:59728) 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f2106d9d640 1 -- 172.21.15.73:0/2604753625 learned_addr learned my addr 172.21.15.73:0/2604753625 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:07.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f210659c640 1 --2- 172.21.15.73:0/2604753625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f210815bec0 0x7f21080ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f2106d9d640 1 -- 172.21.15.73:0/2604753625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f210815bec0 msgr2=0x7f21080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:07.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f2106d9d640 1 --2- 172.21.15.73:0/2604753625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f210815bec0 0x7f21080ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f2106d9d640 1 -- 172.21.15.73:0/2604753625 >> v1:172.21.15.150:6789/0 conn(0x7f210815c2a0 legacy=0x7f21080aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.030+0000 7f2106d9d640 1 -- 172.21.15.73:0/2604753625 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21080b3b30 con 0x7f21080af470 2024-09-12T03:36:07.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f2106d9d640 1 --2- 172.21.15.73:0/2604753625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21080af470 0x7f210806e000 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2100009e50 tx=0x7f210001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc03cc27ea94dd52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210559a640 1 -- 172.21.15.73:0/2604753625 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21000a58d0 con 0x7f21080af470 2024-09-12T03:36:07.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210559a640 1 -- 172.21.15.73:0/2604753625 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21000a5a70 con 0x7f21080af470 2024-09-12T03:36:07.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210559a640 1 -- 172.21.15.73:0/2604753625 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21000a5e40 con 0x7f21080af470 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- 172.21.15.73:0/2604753625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21080af470 msgr2=0x7f210806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 --2- 172.21.15.73:0/2604753625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21080af470 0x7f210806e000 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2100009e50 tx=0x7f210001ca00 comp rx=0 tx=0).stop 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- 172.21.15.73:0/2604753625 shutdown_connections 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 --2- 172.21.15.73:0/2604753625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21080af470 0x7f210806e000 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 --2- 172.21.15.73:0/2604753625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f210815bec0 0x7f21080ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- 172.21.15.73:0/2604753625 >> 172.21.15.73:0/2604753625 conn(0x7f21080b1f90 msgr2=0x7f21080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- 172.21.15.73:0/2604753625 shutdown_connections 2024-09-12T03:36:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- 172.21.15.73:0/2604753625 wait complete. 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 Processor -- start 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- start start 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21080af470 0x7f210814a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210815bec0 0x7f21080aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210815c2a0 0x7f21080b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f210806ed50 con 0x7f210815bec0 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21080ad740 con 0x7f210815c2a0 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f210cc52640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f210806eed0 con 0x7f21080af470 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.034+0000 7f2105d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210815bec0 0x7f21080aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210815bec0 0x7f21080aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59734/0 (socket says 172.21.15.73:59734) 2024-09-12T03:36:07.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 -- 172.21.15.73:0/1435475776 learned_addr learned my addr 172.21.15.73:0/1435475776 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f210659c640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21080af470 0x7f210814a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 -- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21080af470 msgr2=0x7f210814a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2106d9d640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210815c2a0 0x7f21080b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21080af470 0x7f210814a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 -- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210815c2a0 msgr2=0x7f21080b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210815c2a0 0x7f21080b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 -- 172.21.15.73:0/1435475776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21081562b0 con 0x7f210815bec0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f2105d9b640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210815bec0 0x7f21080aff00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c340 tx=0x7f20f800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f20f6ffd640 1 -- 172.21.15.73:0/1435475776 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f80052d0 con 0x7f210815bec0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f20f6ffd640 1 -- 172.21.15.73:0/1435475776 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f8005470 con 0x7f210815bec0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2108156590 con 0x7f210815bec0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f20f6ffd640 1 -- 172.21.15.73:0/1435475776 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8007260 con 0x7f210815bec0 2024-09-12T03:36:07.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2108156b50 con 0x7f210815bec0 2024-09-12T03:36:07.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210806f220 con 0x7f210815bec0 2024-09-12T03:36:07.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f20f6ffd640 1 -- 172.21.15.73:0/1435475776 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20f8007400 con 0x7f210815bec0 2024-09-12T03:36:07.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f20f6ffd640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20e80678c0 0x7f20e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f210659c640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20e80678c0 0x7f20e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f20f6ffd640 1 -- 172.21.15.73:0/1435475776 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f20f80857e0 con 0x7f210815bec0 2024-09-12T03:36:07.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.038+0000 7f210659c640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20e80678c0 0x7f20e8069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009a30 tx=0x7f20fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.042+0000 7f20f6ffd640 1 -- 172.21.15.73:0/1435475776 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f20f8056170 con 0x7f210815bec0 2024-09-12T03:36:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.238+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f210806fcd0 con 0x7f210815bec0 2024-09-12T03:36:07.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f20f6ffd640 1 -- 172.21.15.73:0/1435475776 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5223 (secure 0 0 0) 0x7f20f8055a70 con 0x7f210815bec0 2024-09-12T03:36:07.245 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:07.245 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-12T03:36:06:880174+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4068395780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4068395780},{"type":"v1","addr":"172.21.15.150:6833","nonce":4068395780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/801266996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":801266996},{"type":"v1","addr":"172.21.15.150:6835","nonce":801266996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/204856876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":204856876},{"type":"v1","addr":"172.21.15.73:6835","nonce":204856876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:03.212172+0000","modified":"2024-09-12T03:36:06.243489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5220":{"gid":5220,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3307908616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3307908616},{"type":"v1","addr":"172.21.15.73:6837","nonce":3307908616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5220,"qdb_cluster":[5220]},"id":3}]} 2024-09-12T03:36:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-12T03:36:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20e80678c0 msgr2=0x7f20e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20e80678c0 0x7f20e8069d80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009a30 tx=0x7f20fc008040 comp rx=0 tx=0).stop 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210815bec0 msgr2=0x7f21080aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210815bec0 0x7f21080aff00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f20f800c340 tx=0x7f20f800c800 comp rx=0 tx=0).stop 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 shutdown_connections 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20e80678c0 0x7f20e8069d80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210815bec0 0x7f21080aff00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f210815c2a0 0x7f21080b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 --2- 172.21.15.73:0/1435475776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21080af470 0x7f210814a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 >> 172.21.15.73:0/1435475776 conn(0x7f21080b1f90 msgr2=0x7f2108075170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 shutdown_connections 2024-09-12T03:36:07.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.242+0000 7f210cc52640 1 -- 172.21.15.73:0/1435475776 wait complete. 2024-09-12T03:36:07.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.378+0000 7fc01ae7f640 1 Processor -- start 2024-09-12T03:36:07.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.378+0000 7fc01ae7f640 1 -- start start 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01ae7f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415bec0 0x7fc0140ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01ae7f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc01415c2a0 0x7fc0140aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01ae7f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc0140af2a0 0x7fc01415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01ae7f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc0140b3290 con 0x7fc01415c2a0 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01ae7f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc0140b3570 con 0x7fc0140af2a0 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01ae7f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc0140b3850 con 0x7fc01415bec0 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc01415c2a0 0x7fc0140aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc01415c2a0 0x7fc0140aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59750/0 (socket says 172.21.15.73:59750) 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 -- 172.21.15.73:0/2719795062 learned_addr learned my addr 172.21.15.73:0/2719795062 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:07.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01941c640 1 --2- 172.21.15.73:0/2719795062 >> v2:172.21.15.150:3300/0 conn(0x7fc0140af2a0 0x7fc01415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc018c1b640 1 --2- 172.21.15.73:0/2719795062 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415bec0 0x7fc0140ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 -- 172.21.15.73:0/2719795062 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415bec0 msgr2=0x7fc0140ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 --2- 172.21.15.73:0/2719795062 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415bec0 0x7fc0140ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 -- 172.21.15.73:0/2719795062 >> v2:172.21.15.150:3300/0 conn(0x7fc0140af2a0 msgr2=0x7fc01415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 --2- 172.21.15.73:0/2719795062 >> v2:172.21.15.150:3300/0 conn(0x7fc0140af2a0 0x7fc01415fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 -- 172.21.15.73:0/2719795062 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0140b3b30 con 0x7fc01415c2a0 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc018c1b640 1 --2- 172.21.15.73:0/2719795062 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415bec0 0x7fc0140ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:07.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc01941c640 1 --2- 172.21.15.73:0/2719795062 >> v2:172.21.15.150:3300/0 conn(0x7fc0140af2a0 0x7fc01415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc013fff640 1 --2- 172.21.15.73:0/2719795062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415c2a0 0x7fc0140aed60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ada40 tx=0x7fbffc01c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42224f882c9edfbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc0137fe640 1 -- 172.21.15.73:0/2719795062 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a5580 con 0x7fc01415c2a0 2024-09-12T03:36:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc0137fe640 1 -- 172.21.15.73:0/2719795062 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc0a5720 con 0x7fc01415c2a0 2024-09-12T03:36:07.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.382+0000 7fc0137fe640 1 -- 172.21.15.73:0/2719795062 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a5af0 con 0x7fc01415c2a0 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- 172.21.15.73:0/2719795062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415c2a0 msgr2=0x7fc0140aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/2719795062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415c2a0 0x7fc0140aed60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ada40 tx=0x7fbffc01c700 comp rx=0 tx=0).stop 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- 172.21.15.73:0/2719795062 shutdown_connections 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/2719795062 >> v2:172.21.15.150:3300/0 conn(0x7fc0140af2a0 0x7fc01415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/2719795062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415c2a0 0x7fc0140aed60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/2719795062 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415bec0 0x7fc0140ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- 172.21.15.73:0/2719795062 >> 172.21.15.73:0/2719795062 conn(0x7fc0140b1f90 msgr2=0x7fc0140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- 172.21.15.73:0/2719795062 shutdown_connections 2024-09-12T03:36:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- 172.21.15.73:0/2719795062 wait complete. 2024-09-12T03:36:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 Processor -- start 2024-09-12T03:36:07.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- start start 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0140af2a0 0x7fc014166990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415bec0 0x7fc014165800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415c2a0 0x7fc014159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc0140af6b0 con 0x7fc01415bec0 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc0140ad740 con 0x7fc0140af2a0 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc01406e000 con 0x7fc01415c2a0 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415bec0 0x7fc014165800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415bec0 0x7fc014165800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59754/0 (socket says 172.21.15.73:59754) 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 -- 172.21.15.73:0/3898352480 learned_addr learned my addr 172.21.15.73:0/3898352480 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:07.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc018c1b640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0140af2a0 0x7fc014166990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01941c640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415c2a0 0x7fc014159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 -- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415c2a0 msgr2=0x7fc014159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415c2a0 0x7fc014159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 -- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0140af2a0 msgr2=0x7fc014166990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0140af2a0 0x7fc014166990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 -- 172.21.15.73:0/3898352480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0140733b0 con 0x7fc01415bec0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc013fff640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415bec0 0x7fc014165800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0af040 tx=0x7fbffc0194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc0117fa640 1 -- 172.21.15.73:0/3898352480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0bc070 con 0x7fc01415bec0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc0117fa640 1 -- 172.21.15.73:0/3898352480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc0b8640 con 0x7fc01415bec0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc014073690 con 0x7fc01415bec0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc0117fa640 1 -- 172.21.15.73:0/3898352480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0b8a30 con 0x7fc01415bec0 2024-09-12T03:36:07.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.386+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc014073c50 con 0x7fc01415bec0 2024-09-12T03:36:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.390+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0140ad200 con 0x7fc01415bec0 2024-09-12T03:36:07.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.390+0000 7fc0117fa640 1 -- 172.21.15.73:0/3898352480 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbffc0b8bd0 con 0x7fc01415bec0 2024-09-12T03:36:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.390+0000 7fc0117fa640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbff80678c0 0x7fbff8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.390+0000 7fc0117fa640 1 -- 172.21.15.73:0/3898352480 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fbffc120a80 con 0x7fc01415bec0 2024-09-12T03:36:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.390+0000 7fc018c1b640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbff80678c0 0x7fbff8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.390+0000 7fc018c1b640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbff80678c0 0x7fbff8069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b820 tx=0x7fc00c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.394+0000 7fc0117fa640 1 -- 172.21.15.73:0/3898352480 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbffc0165e0 con 0x7fc01415bec0 2024-09-12T03:36:07.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:36:07.451 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:36:07.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.554+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc01415d8f0 con 0x7fc01415bec0 2024-09-12T03:36:07.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.554+0000 7fc0117fa640 1 -- 172.21.15.73:0/3898352480 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17014 (secure 0 0 0) 0x7fbffc0f15a0 con 0x7fc01415bec0 2024-09-12T03:36:07.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:07.557 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":51,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:04.863501+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:00.869276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:02.196347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbff80678c0 msgr2=0x7fbff8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbff80678c0 0x7fbff8069d80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b820 tx=0x7fc00c008040 comp rx=0 tx=0).stop 2024-09-12T03:36:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415bec0 msgr2=0x7fc014165800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415bec0 0x7fc014165800 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0af040 tx=0x7fbffc0194a0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 shutdown_connections 2024-09-12T03:36:07.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbff80678c0 0x7fbff8069d80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc01415bec0 0x7fc014165800 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc01415c2a0 0x7fc014159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 --2- 172.21.15.73:0/3898352480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc0140af2a0 0x7fc014166990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 >> 172.21.15.73:0/3898352480 conn(0x7fc0140b1f90 msgr2=0x7fc014155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 shutdown_connections 2024-09-12T03:36:07.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.558+0000 7fc01ae7f640 1 -- 172.21.15.73:0/3898352480 wait complete. 2024-09-12T03:36:07.574 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:36:07.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:07.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78c1ec3640 1 Processor -- start 2024-09-12T03:36:07.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78c1ec3640 1 -- start start 2024-09-12T03:36:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78c1ec3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f78bc15bec0 0x7f78bc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78c1ec3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78bc15c2a0 0x7f78bc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78c1ec3640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78bc0b3290 con 0x7f78bc0af2a0 2024-09-12T03:36:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78c1ec3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f78bc0b3570 con 0x7f78bc15c2a0 2024-09-12T03:36:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78c1ec3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f78bc0b3850 con 0x7f78bc15bec0 2024-09-12T03:36:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78bc15c2a0 0x7f78bc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78bc15c2a0 0x7f78bc0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59770/0 (socket says 172.21.15.73:59770) 2024-09-12T03:36:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 -- 172.21.15.73:0/1437863698 learned_addr learned my addr 172.21.15.73:0/1437863698 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 -- 172.21.15.73:0/1437863698 >> v2:172.21.15.150:3300/0 conn(0x7f78bc15bec0 msgr2=0x7f78bc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 --2- 172.21.15.73:0/1437863698 >> v2:172.21.15.150:3300/0 conn(0x7f78bc15bec0 0x7f78bc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 -- 172.21.15.73:0/1437863698 >> v1:172.21.15.150:6789/0 conn(0x7f78bc0af2a0 legacy=0x7f78bc15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 -- 172.21.15.73:0/1437863698 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc0b3b30 con 0x7f78bc15c2a0 2024-09-12T03:36:07.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78baffd640 1 --2- 172.21.15.73:0/1437863698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc0aed60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f78bc071710 tx=0x7f78b001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c61cb6f3f7a6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78ba7fc640 1 -- 172.21.15.73:0/1437863698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00aa610 con 0x7f78bc15c2a0 2024-09-12T03:36:07.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78ba7fc640 1 -- 172.21.15.73:0/1437863698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b00af070 con 0x7f78bc15c2a0 2024-09-12T03:36:07.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.690+0000 7f78ba7fc640 1 -- 172.21.15.73:0/1437863698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b00aa9d0 con 0x7f78bc15c2a0 2024-09-12T03:36:07.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- 172.21.15.73:0/1437863698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 msgr2=0x7f78bc0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/1437863698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc0aed60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f78bc071710 tx=0x7f78b001c4b0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- 172.21.15.73:0/1437863698 shutdown_connections 2024-09-12T03:36:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/1437863698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc0aed60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/1437863698 >> v2:172.21.15.150:3300/0 conn(0x7f78bc15bec0 0x7f78bc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- 172.21.15.73:0/1437863698 >> 172.21.15.73:0/1437863698 conn(0x7f78bc0b1f90 msgr2=0x7f78bc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- 172.21.15.73:0/1437863698 shutdown_connections 2024-09-12T03:36:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- 172.21.15.73:0/1437863698 wait complete. 2024-09-12T03:36:07.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 Processor -- start 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- start start 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78bc0af2a0 0x7f78bc15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78bc15bec0 0x7f78bc1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc09da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc0ad740 con 0x7f78bc15c2a0 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc0af710 con 0x7f78bc0af2a0 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc169000 con 0x7f78bc15bec0 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc09da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc09da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59786/0 (socket says 172.21.15.73:59786) 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 -- 172.21.15.73:0/921989738 learned_addr learned my addr 172.21.15.73:0/921989738 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 -- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78bc15bec0 msgr2=0x7f78bc1435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78baffd640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78bc15bec0 0x7f78bc1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bb7fe640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78bc0af2a0 0x7f78bc15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78bc15bec0 0x7f78bc1435d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 -- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78bc0af2a0 msgr2=0x7f78bc15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78bc0af2a0 0x7f78bc15dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 -- 172.21.15.73:0/921989738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc15e110 con 0x7f78bc15c2a0 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78bbfff640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc09da40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c780 tx=0x7f78b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78a3fff640 1 -- 172.21.15.73:0/921989738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4017070 con 0x7f78bc15c2a0 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78a3fff640 1 -- 172.21.15.73:0/921989738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78b4003db0 con 0x7f78bc15c2a0 2024-09-12T03:36:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78bc143b10 con 0x7f78bc15c2a0 2024-09-12T03:36:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78a3fff640 1 -- 172.21.15.73:0/921989738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b40052b0 con 0x7f78bc15c2a0 2024-09-12T03:36:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.694+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc09b460 con 0x7f78bc15c2a0 2024-09-12T03:36:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.698+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78bc0ad200 con 0x7f78bc15c2a0 2024-09-12T03:36:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.698+0000 7f78a3fff640 1 -- 172.21.15.73:0/921989738 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f78b401a070 con 0x7f78bc15c2a0 2024-09-12T03:36:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.698+0000 7f78a3fff640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f78a80678c0 0x7f78a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.698+0000 7f78bb7fe640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f78a80678c0 0x7f78a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.698+0000 7f78a3fff640 1 -- 172.21.15.73:0/921989738 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f78b40854b0 con 0x7f78bc15c2a0 2024-09-12T03:36:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.698+0000 7f78bb7fe640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f78a80678c0 0x7f78a8069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00a830 tx=0x7f78ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:07.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.702+0000 7f78a3fff640 1 -- 172.21.15.73:0/921989738 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f78b4055e60 con 0x7f78bc15c2a0 2024-09-12T03:36:07.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.858+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78bc06fcd0 con 0x7f78a80678c0 2024-09-12T03:36:07.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.874+0000 7f78a3fff640 1 -- 172.21.15.73:0/921989738 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244543 (secure 0 0 0) 0x7f78bc06fcd0 con 0x7f78a80678c0 2024-09-12T03:36:07.881 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:07.883 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:07.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f78a80678c0 msgr2=0x7f78a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f78a80678c0 0x7f78a8069d80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00a830 tx=0x7f78ac008040 comp rx=0 tx=0).stop 2024-09-12T03:36:07.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 msgr2=0x7f78bc09da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:07.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc09da40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c780 tx=0x7f78b400cc40 comp rx=0 tx=0).stop 2024-09-12T03:36:07.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 shutdown_connections 2024-09-12T03:36:07.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f78a80678c0 0x7f78a8069d80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc15c2a0 0x7f78bc09da40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f78bc15bec0 0x7f78bc1435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 --2- 172.21.15.73:0/921989738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78bc0af2a0 0x7f78bc15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:07.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 >> 172.21.15.73:0/921989738 conn(0x7f78bc0b1f90 msgr2=0x7f78bc0b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:07.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 shutdown_connections 2024-09-12T03:36:07.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:07.882+0000 7f78c1ec3640 1 -- 172.21.15.73:0/921989738 wait complete. 2024-09-12T03:36:07.902 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-12T03:36:07.816136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230176,"kb_used_data":5620,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744544,"statfs":{"total":773094113280,"available":772858413056,"internally_reserved":0,"allocated":5754880,"data_stored":3172076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994352"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896935+0000","last_change":"2024-09-12T03:36:03.912625+0000","last_active":"2024-09-12T03:36:04.896935+0000","last_peered":"2024-09-12T03:36:04.896935+0000","last_clean":"2024-09-12T03:36:04.896935+0000","last_became_active":"2024-09-12T03:36:03.912339+0000","last_became_peered":"2024-09-12T03:36:03.912339+0000","last_unstale":"2024-09-12T03:36:04.896935+0000","last_undegraded":"2024-09-12T03:36:04.896935+0000","last_fullsized":"2024-09-12T03:36:04.896935+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:10.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894961+0000","last_change":"2024-09-12T03:36:03.911435+0000","last_active":"2024-09-12T03:36:04.894961+0000","last_peered":"2024-09-12T03:36:04.894961+0000","last_clean":"2024-09-12T03:36:04.894961+0000","last_became_active":"2024-09-12T03:36:03.910991+0000","last_became_peered":"2024-09-12T03:36:03.910991+0000","last_unstale":"2024-09-12T03:36:04.894961+0000","last_undegraded":"2024-09-12T03:36:04.894961+0000","last_fullsized":"2024-09-12T03:36:04.894961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.096820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896356+0000","last_change":"2024-09-12T03:36:03.912139+0000","last_active":"2024-09-12T03:36:04.896356+0000","last_peered":"2024-09-12T03:36:04.896356+0000","last_clean":"2024-09-12T03:36:04.896356+0000","last_became_active":"2024-09-12T03:36:03.911811+0000","last_became_peered":"2024-09-12T03:36:03.911811+0000","last_unstale":"2024-09-12T03:36:04.896356+0000","last_undegraded":"2024-09-12T03:36:04.896356+0000","last_fullsized":"2024-09-12T03:36:04.896356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.113309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897522+0000","last_change":"2024-09-12T03:36:03.917123+0000","last_active":"2024-09-12T03:36:04.897522+0000","last_peered":"2024-09-12T03:36:04.897522+0000","last_clean":"2024-09-12T03:36:04.897522+0000","last_became_active":"2024-09-12T03:36:03.915633+0000","last_became_peered":"2024-09-12T03:36:03.915633+0000","last_unstale":"2024-09-12T03:36:04.897522+0000","last_undegraded":"2024-09-12T03:36:04.897522+0000","last_fullsized":"2024-09-12T03:36:04.897522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:53.759154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896952+0000","last_change":"2024-09-12T03:36:03.911853+0000","last_active":"2024-09-12T03:36:04.896952+0000","last_peered":"2024-09-12T03:36:04.896952+0000","last_clean":"2024-09-12T03:36:04.896952+0000","last_became_active":"2024-09-12T03:36:03.904691+0000","last_became_peered":"2024-09-12T03:36:03.904691+0000","last_unstale":"2024-09-12T03:36:04.896952+0000","last_undegraded":"2024-09-12T03:36:04.896952+0000","last_fullsized":"2024-09-12T03:36:04.896952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:20.217205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898061+0000","last_change":"2024-09-12T03:36:03.902332+0000","last_active":"2024-09-12T03:36:04.898061+0000","last_peered":"2024-09-12T03:36:04.898061+0000","last_clean":"2024-09-12T03:36:04.898061+0000","last_became_active":"2024-09-12T03:36:03.901422+0000","last_became_peered":"2024-09-12T03:36:03.901422+0000","last_unstale":"2024-09-12T03:36:04.898061+0000","last_undegraded":"2024-09-12T03:36:04.898061+0000","last_fullsized":"2024-09-12T03:36:04.898061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:02.675165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897722+0000","last_change":"2024-09-12T03:36:03.909565+0000","last_active":"2024-09-12T03:36:04.897722+0000","last_peered":"2024-09-12T03:36:04.897722+0000","last_clean":"2024-09-12T03:36:04.897722+0000","last_became_active":"2024-09-12T03:36:03.908839+0000","last_became_peered":"2024-09-12T03:36:03.908839+0000","last_unstale":"2024-09-12T03:36:04.897722+0000","last_undegraded":"2024-09-12T03:36:04.897722+0000","last_fullsized":"2024-09-12T03:36:04.897722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:36.362384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895452+0000","last_change":"2024-09-12T03:36:03.903927+0000","last_active":"2024-09-12T03:36:04.895452+0000","last_peered":"2024-09-12T03:36:04.895452+0000","last_clean":"2024-09-12T03:36:04.895452+0000","last_became_active":"2024-09-12T03:36:03.903618+0000","last_became_peered":"2024-09-12T03:36:03.903618+0000","last_unstale":"2024-09-12T03:36:04.895452+0000","last_undegraded":"2024-09-12T03:36:04.895452+0000","last_fullsized":"2024-09-12T03:36:04.895452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:55.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897703+0000","last_change":"2024-09-12T03:36:03.913879+0000","last_active":"2024-09-12T03:36:04.897703+0000","last_peered":"2024-09-12T03:36:04.897703+0000","last_clean":"2024-09-12T03:36:04.897703+0000","last_became_active":"2024-09-12T03:36:03.912933+0000","last_became_peered":"2024-09-12T03:36:03.912933+0000","last_unstale":"2024-09-12T03:36:04.897703+0000","last_undegraded":"2024-09-12T03:36:04.897703+0000","last_fullsized":"2024-09-12T03:36:04.897703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.053830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898130+0000","last_change":"2024-09-12T03:36:03.887658+0000","last_active":"2024-09-12T03:36:04.898130+0000","last_peered":"2024-09-12T03:36:04.898130+0000","last_clean":"2024-09-12T03:36:04.898130+0000","last_became_active":"2024-09-12T03:36:03.887122+0000","last_became_peered":"2024-09-12T03:36:03.887122+0000","last_unstale":"2024-09-12T03:36:04.898130+0000","last_undegraded":"2024-09-12T03:36:04.898130+0000","last_fullsized":"2024-09-12T03:36:04.898130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:46.597582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:03.897707+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:03.897352+0000","last_became_peered":"2024-09-12T03:36:03.897352+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:59.269360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895148+0000","last_change":"2024-09-12T03:36:03.904039+0000","last_active":"2024-09-12T03:36:04.895148+0000","last_peered":"2024-09-12T03:36:04.895148+0000","last_clean":"2024-09-12T03:36:04.895148+0000","last_became_active":"2024-09-12T03:36:03.903728+0000","last_became_peered":"2024-09-12T03:36:03.903728+0000","last_unstale":"2024-09-12T03:36:04.895148+0000","last_undegraded":"2024-09-12T03:36:04.895148+0000","last_fullsized":"2024-09-12T03:36:04.895148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.126212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.834509+0000","last_change":"2024-09-12T03:36:02.834509+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.834509+0000","last_undegraded":"2024-09-12T03:36:02.834509+0000","last_fullsized":"2024-09-12T03:36:02.834509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898212+0000","last_change":"2024-09-12T03:36:02.870540+0000","last_active":"2024-09-12T03:36:04.898212+0000","last_peered":"2024-09-12T03:36:04.898212+0000","last_clean":"2024-09-12T03:36:04.898212+0000","last_became_active":"2024-09-12T03:36:02.869934+0000","last_became_peered":"2024-09-12T03:36:02.869934+0000","last_unstale":"2024-09-12T03:36:04.898212+0000","last_undegraded":"2024-09-12T03:36:04.898212+0000","last_fullsized":"2024-09-12T03:36:04.898212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831107+0000","last_change":"2024-09-12T03:36:02.831107+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831107+0000","last_undegraded":"2024-09-12T03:36:02.831107+0000","last_fullsized":"2024-09-12T03:36:02.831107+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827830+0000","last_change":"2024-09-12T03:36:01.827830+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827830+0000","last_undegraded":"2024-09-12T03:36:01.827830+0000","last_fullsized":"2024-09-12T03:36:01.827830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898376+0000","last_change":"2024-09-12T03:36:03.921518+0000","last_active":"2024-09-12T03:36:04.898376+0000","last_peered":"2024-09-12T03:36:04.898376+0000","last_clean":"2024-09-12T03:36:04.898376+0000","last_became_active":"2024-09-12T03:36:03.920792+0000","last_became_peered":"2024-09-12T03:36:03.920792+0000","last_unstale":"2024-09-12T03:36:04.898376+0000","last_undegraded":"2024-09-12T03:36:04.898376+0000","last_fullsized":"2024-09-12T03:36:04.898376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:53.679647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827860+0000","last_change":"2024-09-12T03:36:01.827860+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827860+0000","last_undegraded":"2024-09-12T03:36:01.827860+0000","last_fullsized":"2024-09-12T03:36:01.827860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830966+0000","last_change":"2024-09-12T03:36:02.830966+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830966+0000","last_undegraded":"2024-09-12T03:36:02.830966+0000","last_fullsized":"2024-09-12T03:36:02.830966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896690+0000","last_change":"2024-09-12T03:36:02.864842+0000","last_active":"2024-09-12T03:36:04.896690+0000","last_peered":"2024-09-12T03:36:04.896690+0000","last_clean":"2024-09-12T03:36:04.896690+0000","last_became_active":"2024-09-12T03:36:02.855818+0000","last_became_peered":"2024-09-12T03:36:02.855818+0000","last_unstale":"2024-09-12T03:36:04.896690+0000","last_undegraded":"2024-09-12T03:36:04.896690+0000","last_fullsized":"2024-09-12T03:36:04.896690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:13.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838792+0000","last_change":"2024-09-12T03:36:01.838792+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838792+0000","last_undegraded":"2024-09-12T03:36:01.838792+0000","last_fullsized":"2024-09-12T03:36:01.838792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897507+0000","last_change":"2024-09-12T03:36:02.867448+0000","last_active":"2024-09-12T03:36:04.897507+0000","last_peered":"2024-09-12T03:36:04.897507+0000","last_clean":"2024-09-12T03:36:04.897507+0000","last_became_active":"2024-09-12T03:36:02.862234+0000","last_became_peered":"2024-09-12T03:36:02.862234+0000","last_unstale":"2024-09-12T03:36:04.897507+0000","last_undegraded":"2024-09-12T03:36:04.897507+0000","last_fullsized":"2024-09-12T03:36:04.897507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:07.176981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894751+0000","last_change":"2024-09-12T03:36:02.866621+0000","last_active":"2024-09-12T03:36:04.894751+0000","last_peered":"2024-09-12T03:36:04.894751+0000","last_clean":"2024-09-12T03:36:04.894751+0000","last_became_active":"2024-09-12T03:36:02.864796+0000","last_became_peered":"2024-09-12T03:36:02.864796+0000","last_unstale":"2024-09-12T03:36:04.894751+0000","last_undegraded":"2024-09-12T03:36:04.894751+0000","last_fullsized":"2024-09-12T03:36:04.894751+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:01.671371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.834020+0000","last_change":"2024-09-12T03:36:01.834020+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.834020+0000","last_undegraded":"2024-09-12T03:36:01.834020+0000","last_fullsized":"2024-09-12T03:36:01.834020+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833780+0000","last_change":"2024-09-12T03:36:02.833780+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833780+0000","last_undegraded":"2024-09-12T03:36:02.833780+0000","last_fullsized":"2024-09-12T03:36:02.833780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838800+0000","last_change":"2024-09-12T03:36:01.838800+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838800+0000","last_undegraded":"2024-09-12T03:36:01.838800+0000","last_fullsized":"2024-09-12T03:36:01.838800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896296+0000","last_change":"2024-09-12T03:36:03.912046+0000","last_active":"2024-09-12T03:36:04.896296+0000","last_peered":"2024-09-12T03:36:04.896296+0000","last_clean":"2024-09-12T03:36:04.896296+0000","last_became_active":"2024-09-12T03:36:03.911470+0000","last_became_peered":"2024-09-12T03:36:03.911470+0000","last_unstale":"2024-09-12T03:36:04.896296+0000","last_undegraded":"2024-09-12T03:36:04.896296+0000","last_fullsized":"2024-09-12T03:36:04.896296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:40.902220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.832811+0000","last_change":"2024-09-12T03:36:01.832811+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.832811+0000","last_undegraded":"2024-09-12T03:36:01.832811+0000","last_fullsized":"2024-09-12T03:36:01.832811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825594+0000","last_change":"2024-09-12T03:36:01.825594+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825594+0000","last_undegraded":"2024-09-12T03:36:01.825594+0000","last_fullsized":"2024-09-12T03:36:01.825594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833175+0000","last_change":"2024-09-12T03:36:02.833175+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833175+0000","last_undegraded":"2024-09-12T03:36:02.833175+0000","last_fullsized":"2024-09-12T03:36:02.833175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896859+0000","last_change":"2024-09-12T03:36:02.867468+0000","last_active":"2024-09-12T03:36:04.896859+0000","last_peered":"2024-09-12T03:36:04.896859+0000","last_clean":"2024-09-12T03:36:04.896859+0000","last_became_active":"2024-09-12T03:36:02.864801+0000","last_became_peered":"2024-09-12T03:36:02.864801+0000","last_unstale":"2024-09-12T03:36:04.896859+0000","last_undegraded":"2024-09-12T03:36:04.896859+0000","last_fullsized":"2024-09-12T03:36:04.896859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:35.358589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897206+0000","last_change":"2024-09-12T03:36:03.904404+0000","last_active":"2024-09-12T03:36:04.897206+0000","last_peered":"2024-09-12T03:36:04.897206+0000","last_clean":"2024-09-12T03:36:04.897206+0000","last_became_active":"2024-09-12T03:36:03.903495+0000","last_became_peered":"2024-09-12T03:36:03.903495+0000","last_unstale":"2024-09-12T03:36:04.897206+0000","last_undegraded":"2024-09-12T03:36:04.897206+0000","last_fullsized":"2024-09-12T03:36:04.897206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:35.872184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898786+0000","last_change":"2024-09-12T03:36:02.875568+0000","last_active":"2024-09-12T03:36:04.898786+0000","last_peered":"2024-09-12T03:36:04.898786+0000","last_clean":"2024-09-12T03:36:04.898786+0000","last_became_active":"2024-09-12T03:36:02.874690+0000","last_became_peered":"2024-09-12T03:36:02.874690+0000","last_unstale":"2024-09-12T03:36:04.898786+0000","last_undegraded":"2024-09-12T03:36:04.898786+0000","last_fullsized":"2024-09-12T03:36:04.898786+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:57.098241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831446+0000","last_change":"2024-09-12T03:36:01.831446+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831446+0000","last_undegraded":"2024-09-12T03:36:01.831446+0000","last_fullsized":"2024-09-12T03:36:01.831446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896812+0000","last_change":"2024-09-12T03:36:03.917437+0000","last_active":"2024-09-12T03:36:04.896812+0000","last_peered":"2024-09-12T03:36:04.896812+0000","last_clean":"2024-09-12T03:36:04.896812+0000","last_became_active":"2024-09-12T03:36:03.916030+0000","last_became_peered":"2024-09-12T03:36:03.916030+0000","last_unstale":"2024-09-12T03:36:04.896812+0000","last_undegraded":"2024-09-12T03:36:04.896812+0000","last_fullsized":"2024-09-12T03:36:04.896812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:24.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824746+0000","last_change":"2024-09-12T03:36:01.824746+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824746+0000","last_undegraded":"2024-09-12T03:36:01.824746+0000","last_fullsized":"2024-09-12T03:36:01.824746+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897903+0000","last_change":"2024-09-12T03:36:02.864500+0000","last_active":"2024-09-12T03:36:04.897903+0000","last_peered":"2024-09-12T03:36:04.897903+0000","last_clean":"2024-09-12T03:36:04.897903+0000","last_became_active":"2024-09-12T03:36:02.864098+0000","last_became_peered":"2024-09-12T03:36:02.864098+0000","last_unstale":"2024-09-12T03:36:04.897903+0000","last_undegraded":"2024-09-12T03:36:04.897903+0000","last_fullsized":"2024-09-12T03:36:04.897903+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:52.675853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827376+0000","last_change":"2024-09-12T03:36:01.827376+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827376+0000","last_undegraded":"2024-09-12T03:36:01.827376+0000","last_fullsized":"2024-09-12T03:36:01.827376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897772+0000","last_change":"2024-09-12T03:36:02.868716+0000","last_active":"2024-09-12T03:36:04.897772+0000","last_peered":"2024-09-12T03:36:04.897772+0000","last_clean":"2024-09-12T03:36:04.897772+0000","last_became_active":"2024-09-12T03:36:02.868058+0000","last_became_peered":"2024-09-12T03:36:02.868058+0000","last_unstale":"2024-09-12T03:36:04.897772+0000","last_undegraded":"2024-09-12T03:36:04.897772+0000","last_fullsized":"2024-09-12T03:36:04.897772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:10.145215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898301+0000","last_change":"2024-09-12T03:36:02.862920+0000","last_active":"2024-09-12T03:36:04.898301+0000","last_peered":"2024-09-12T03:36:04.898301+0000","last_clean":"2024-09-12T03:36:04.898301+0000","last_became_active":"2024-09-12T03:36:02.862192+0000","last_became_peered":"2024-09-12T03:36:02.862192+0000","last_unstale":"2024-09-12T03:36:04.898301+0000","last_undegraded":"2024-09-12T03:36:04.898301+0000","last_fullsized":"2024-09-12T03:36:04.898301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:35.622000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831963+0000","last_change":"2024-09-12T03:36:02.831963+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831963+0000","last_undegraded":"2024-09-12T03:36:02.831963+0000","last_fullsized":"2024-09-12T03:36:02.831963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827707+0000","last_change":"2024-09-12T03:36:01.827707+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827707+0000","last_undegraded":"2024-09-12T03:36:01.827707+0000","last_fullsized":"2024-09-12T03:36:01.827707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897556+0000","last_change":"2024-09-12T03:36:03.902298+0000","last_active":"2024-09-12T03:36:04.897556+0000","last_peered":"2024-09-12T03:36:04.897556+0000","last_clean":"2024-09-12T03:36:04.897556+0000","last_became_active":"2024-09-12T03:36:03.901486+0000","last_became_peered":"2024-09-12T03:36:03.901486+0000","last_unstale":"2024-09-12T03:36:04.897556+0000","last_undegraded":"2024-09-12T03:36:04.897556+0000","last_fullsized":"2024-09-12T03:36:04.897556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:28.142929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825532+0000","last_change":"2024-09-12T03:36:01.825532+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825532+0000","last_undegraded":"2024-09-12T03:36:01.825532+0000","last_fullsized":"2024-09-12T03:36:01.825532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897094+0000","last_change":"2024-09-12T03:36:03.898701+0000","last_active":"2024-09-12T03:36:04.897094+0000","last_peered":"2024-09-12T03:36:04.897094+0000","last_clean":"2024-09-12T03:36:04.897094+0000","last_became_active":"2024-09-12T03:36:03.897480+0000","last_became_peered":"2024-09-12T03:36:03.897480+0000","last_unstale":"2024-09-12T03:36:04.897094+0000","last_undegraded":"2024-09-12T03:36:04.897094+0000","last_fullsized":"2024-09-12T03:36:04.897094+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.199100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895131+0000","last_change":"2024-09-12T03:36:02.867140+0000","last_active":"2024-09-12T03:36:04.895131+0000","last_peered":"2024-09-12T03:36:04.895131+0000","last_clean":"2024-09-12T03:36:04.895131+0000","last_became_active":"2024-09-12T03:36:02.866870+0000","last_became_peered":"2024-09-12T03:36:02.866870+0000","last_unstale":"2024-09-12T03:36:04.895131+0000","last_undegraded":"2024-09-12T03:36:04.895131+0000","last_fullsized":"2024-09-12T03:36:04.895131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:27.139135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827560+0000","last_change":"2024-09-12T03:36:01.827560+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827560+0000","last_undegraded":"2024-09-12T03:36:01.827560+0000","last_fullsized":"2024-09-12T03:36:01.827560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831683+0000","last_change":"2024-09-12T03:36:02.831683+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831683+0000","last_undegraded":"2024-09-12T03:36:02.831683+0000","last_fullsized":"2024-09-12T03:36:02.831683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898367+0000","last_change":"2024-09-12T03:36:02.874416+0000","last_active":"2024-09-12T03:36:04.898367+0000","last_peered":"2024-09-12T03:36:04.898367+0000","last_clean":"2024-09-12T03:36:04.898367+0000","last_became_active":"2024-09-12T03:36:02.870685+0000","last_became_peered":"2024-09-12T03:36:02.870685+0000","last_unstale":"2024-09-12T03:36:04.898367+0000","last_undegraded":"2024-09-12T03:36:04.898367+0000","last_fullsized":"2024-09-12T03:36:04.898367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:09.686766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831677+0000","last_change":"2024-09-12T03:36:01.831677+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831677+0000","last_undegraded":"2024-09-12T03:36:01.831677+0000","last_fullsized":"2024-09-12T03:36:01.831677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:02.867072+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:02.866508+0000","last_became_peered":"2024-09-12T03:36:02.866508+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.096929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896348+0000","last_change":"2024-09-12T03:36:03.911599+0000","last_active":"2024-09-12T03:36:04.896348+0000","last_peered":"2024-09-12T03:36:04.896348+0000","last_clean":"2024-09-12T03:36:04.896348+0000","last_became_active":"2024-09-12T03:36:03.910939+0000","last_became_peered":"2024-09-12T03:36:03.910939+0000","last_unstale":"2024-09-12T03:36:04.896348+0000","last_undegraded":"2024-09-12T03:36:04.896348+0000","last_fullsized":"2024-09-12T03:36:04.896348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.976584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825242+0000","last_change":"2024-09-12T03:36:01.825242+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825242+0000","last_undegraded":"2024-09-12T03:36:01.825242+0000","last_fullsized":"2024-09-12T03:36:01.825242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831927+0000","last_change":"2024-09-12T03:36:02.831927+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831927+0000","last_undegraded":"2024-09-12T03:36:02.831927+0000","last_fullsized":"2024-09-12T03:36:02.831927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824938+0000","last_change":"2024-09-12T03:36:01.824938+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824938+0000","last_undegraded":"2024-09-12T03:36:01.824938+0000","last_fullsized":"2024-09-12T03:36:01.824938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896742+0000","last_change":"2024-09-12T03:36:03.911211+0000","last_active":"2024-09-12T03:36:04.896742+0000","last_peered":"2024-09-12T03:36:04.896742+0000","last_clean":"2024-09-12T03:36:04.896742+0000","last_became_active":"2024-09-12T03:36:03.903532+0000","last_became_peered":"2024-09-12T03:36:03.903532+0000","last_unstale":"2024-09-12T03:36:04.896742+0000","last_undegraded":"2024-09-12T03:36:04.896742+0000","last_fullsized":"2024-09-12T03:36:04.896742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:14.499501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838585+0000","last_change":"2024-09-12T03:36:01.838585+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838585+0000","last_undegraded":"2024-09-12T03:36:01.838585+0000","last_fullsized":"2024-09-12T03:36:01.838585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830894+0000","last_change":"2024-09-12T03:36:02.830894+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830894+0000","last_undegraded":"2024-09-12T03:36:02.830894+0000","last_fullsized":"2024-09-12T03:36:02.830894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897060+0000","last_change":"2024-09-12T03:36:03.896708+0000","last_active":"2024-09-12T03:36:04.897060+0000","last_peered":"2024-09-12T03:36:04.897060+0000","last_clean":"2024-09-12T03:36:04.897060+0000","last_became_active":"2024-09-12T03:36:03.895171+0000","last_became_peered":"2024-09-12T03:36:03.895171+0000","last_unstale":"2024-09-12T03:36:04.897060+0000","last_undegraded":"2024-09-12T03:36:04.897060+0000","last_fullsized":"2024-09-12T03:36:04.897060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:14.320878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.900762+0000","last_change":"2024-09-12T03:36:02.867071+0000","last_active":"2024-09-12T03:36:04.900762+0000","last_peered":"2024-09-12T03:36:04.900762+0000","last_clean":"2024-09-12T03:36:04.900762+0000","last_became_active":"2024-09-12T03:36:02.864950+0000","last_became_peered":"2024-09-12T03:36:02.864950+0000","last_unstale":"2024-09-12T03:36:04.900762+0000","last_undegraded":"2024-09-12T03:36:04.900762+0000","last_fullsized":"2024-09-12T03:36:04.900762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:07.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-12T03:36:01.834832+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:01.834832+0000","last_peered":"2024-09-12T03:36:01.834832+0000","last_clean":"2024-09-12T03:36:01.834832+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:01.834832+0000","last_undegraded":"2024-09-12T03:36:01.834832+0000","last_fullsized":"2024-09-12T03:36:01.834832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":834902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1187840,"data_stored":848792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:07.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.062+0000 7fa18a2a3640 1 Processor -- start 2024-09-12T03:36:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.062+0000 7fa18a2a3640 1 -- start start 2024-09-12T03:36:08.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa18a2a3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa18415c2a0 0x7fa1840aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa18a2a3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1840b3290 con 0x7fa1840af2a0 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa18a2a3640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1840b3570 con 0x7fa18415bec0 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa18a2a3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa1840b3850 con 0x7fa18415c2a0 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa1840af2a0 0x7fa18406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44916/0 (socket says 172.21.15.73:44916) 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 -- 172.21.15.73:0/158251600 learned_addr learned my addr 172.21.15.73:0/158251600 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539916707 0 0) 0x7fa1840b3290 con 0x7fa1840af2a0 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa1837fe640 1 --2- 172.21.15.73:0/158251600 >> v2:172.21.15.150:3300/0 conn(0x7fa18415c2a0 0x7fa1840aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa16c003530 con 0x7fa1840af2a0 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 460563721 0 0) 0x7fa16c003530 con 0x7fa1840af2a0 2024-09-12T03:36:08.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 >> v2:172.21.15.150:3300/0 conn(0x7fa18415c2a0 msgr2=0x7fa1840aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 --2- 172.21.15.73:0/158251600 >> v2:172.21.15.150:3300/0 conn(0x7fa18415c2a0 0x7fa1840aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 >> v1:172.21.15.150:6789/0 conn(0x7fa18415bec0 legacy=0x7fa1840ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1840b3b30 con 0x7fa1840af2a0 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fa174001680 con 0x7fa1840af2a0 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 >> v1:172.21.15.73:6789/0 conn(0x7fa1840af2a0 legacy=0x7fa18406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa16c0039c0 0x7fa16c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c004810 0x7fa16c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa16c0051d0 0x7fa16c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1840b3850 con 0x7fa16c0051d0 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c00c070 con 0x7fa16c004810 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa16c00c270 con 0x7fa16c0039c0 2024-09-12T03:36:08.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa16c0051d0 0x7fa16c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa183fff640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa16c0039c0 0x7fa16c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 -- 172.21.15.73:0/158251600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa16c0039c0 msgr2=0x7fa16c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa16c0039c0 0x7fa16c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 -- 172.21.15.73:0/158251600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c004810 msgr2=0x7fa16c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c004810 0x7fa16c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 -- 172.21.15.73:0/158251600 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c003530 con 0x7fa16c0051d0 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 -- 172.21.15.73:0/158251600 reap_dead start 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa188840640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa16c0051d0 0x7fa16c00b9d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c1c0 tx=0x7fa17401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1ee134b82da508 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174007d00 con 0x7fa16c0051d0 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1740a9070 con 0x7fa16c0051d0 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.066+0000 7fa182ffd640 1 -- 172.21.15.73:0/158251600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1740a5dc0 con 0x7fa16c0051d0 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- 172.21.15.73:0/158251600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa16c0051d0 msgr2=0x7fa16c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa16c0051d0 0x7fa16c00b9d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa17400c1c0 tx=0x7fa17401cc60 comp rx=0 tx=0).stop 2024-09-12T03:36:08.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- 172.21.15.73:0/158251600 shutdown_connections 2024-09-12T03:36:08.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/158251600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa16c0051d0 0x7fa16c00b9d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- 172.21.15.73:0/158251600 >> 172.21.15.73:0/158251600 conn(0x7fa1840b1f90 msgr2=0x7fa1840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:08.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- 172.21.15.73:0/158251600 shutdown_connections 2024-09-12T03:36:08.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- 172.21.15.73:0/158251600 wait complete. 2024-09-12T03:36:08.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 Processor -- start 2024-09-12T03:36:08.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- start start 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c0051d0 0x7fa1841f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa18409d590 0x7fa18409da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa18409a520 0x7fa18409a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1840afc90 con 0x7fa18409d590 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa1840b40f0 con 0x7fa16c0051d0 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa1840af710 con 0x7fa18409a520 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa18409d590 0x7fa18409da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa18409d590 0x7fa18409da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59794/0 (socket says 172.21.15.73:59794) 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 -- 172.21.15.73:0/1765406700 learned_addr learned my addr 172.21.15.73:0/1765406700 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 -- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa18409a520 msgr2=0x7fa18409a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa18409a520 0x7fa18409a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 -- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c0051d0 msgr2=0x7fa1841f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa183fff640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c0051d0 0x7fa1841f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c0051d0 0x7fa1841f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 -- 172.21.15.73:0/1765406700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1841f1e60 con 0x7fa18409d590 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa183fff640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c0051d0 0x7fa1841f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa1837fe640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa18409d590 0x7fa18409da10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa17800e7c0 tx=0x7fa17800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa180ff9640 1 -- 172.21.15.73:0/1765406700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178017070 con 0x7fa18409d590 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa180ff9640 1 -- 172.21.15.73:0/1765406700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17800ee70 con 0x7fa18409d590 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa180ff9640 1 -- 172.21.15.73:0/1765406700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17800cb40 con 0x7fa18409d590 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18409b270 con 0x7fa18409d590 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.070+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18409b830 con 0x7fa18409d590 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.074+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1840aed60 con 0x7fa18409d590 2024-09-12T03:36:08.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.074+0000 7fa180ff9640 1 -- 172.21.15.73:0/1765406700 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa17801a070 con 0x7fa18409d590 2024-09-12T03:36:08.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.074+0000 7fa180ff9640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa1700678c0 0x7fa170069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.074+0000 7fa183fff640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa1700678c0 0x7fa170069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.074+0000 7fa180ff9640 1 -- 172.21.15.73:0/1765406700 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fa178085f90 con 0x7fa18409d590 2024-09-12T03:36:08.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.074+0000 7fa183fff640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa1700678c0 0x7fa170069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa18415af10 tx=0x7fa17c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.078+0000 7fa180ff9640 1 -- 172.21.15.73:0/1765406700 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa1780569d0 con 0x7fa18409d590 2024-09-12T03:36:08.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.234+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1840d0c20 con 0x7fa1700678c0 2024-09-12T03:36:08.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.250+0000 7fa180ff9640 1 -- 172.21.15.73:0/1765406700 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244543 (secure 0 0 0) 0x7fa1840d0c20 con 0x7fa1700678c0 2024-09-12T03:36:08.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:08.256 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:08.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa1700678c0 msgr2=0x7fa170069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa1700678c0 0x7fa170069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa18415af10 tx=0x7fa17c009040 comp rx=0 tx=0).stop 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa18409d590 msgr2=0x7fa18409da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa18409d590 0x7fa18409da10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa17800e7c0 tx=0x7fa17800ec80 comp rx=0 tx=0).stop 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 shutdown_connections 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa1700678c0 0x7fa170069d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa18409d590 0x7fa18409da10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa18409a520 0x7fa18409a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 --2- 172.21.15.73:0/1765406700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa16c0051d0 0x7fa1841f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 >> 172.21.15.73:0/1765406700 conn(0x7fa1840b1f90 msgr2=0x7fa18415a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 shutdown_connections 2024-09-12T03:36:08.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.254+0000 7fa18a2a3640 1 -- 172.21.15.73:0/1765406700 wait complete. 2024-09-12T03:36:08.272 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-12T03:36:07.816136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230176,"kb_used_data":5620,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744544,"statfs":{"total":773094113280,"available":772858413056,"internally_reserved":0,"allocated":5754880,"data_stored":3172076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994352"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896935+0000","last_change":"2024-09-12T03:36:03.912625+0000","last_active":"2024-09-12T03:36:04.896935+0000","last_peered":"2024-09-12T03:36:04.896935+0000","last_clean":"2024-09-12T03:36:04.896935+0000","last_became_active":"2024-09-12T03:36:03.912339+0000","last_became_peered":"2024-09-12T03:36:03.912339+0000","last_unstale":"2024-09-12T03:36:04.896935+0000","last_undegraded":"2024-09-12T03:36:04.896935+0000","last_fullsized":"2024-09-12T03:36:04.896935+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:10.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894961+0000","last_change":"2024-09-12T03:36:03.911435+0000","last_active":"2024-09-12T03:36:04.894961+0000","last_peered":"2024-09-12T03:36:04.894961+0000","last_clean":"2024-09-12T03:36:04.894961+0000","last_became_active":"2024-09-12T03:36:03.910991+0000","last_became_peered":"2024-09-12T03:36:03.910991+0000","last_unstale":"2024-09-12T03:36:04.894961+0000","last_undegraded":"2024-09-12T03:36:04.894961+0000","last_fullsized":"2024-09-12T03:36:04.894961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.096820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896356+0000","last_change":"2024-09-12T03:36:03.912139+0000","last_active":"2024-09-12T03:36:04.896356+0000","last_peered":"2024-09-12T03:36:04.896356+0000","last_clean":"2024-09-12T03:36:04.896356+0000","last_became_active":"2024-09-12T03:36:03.911811+0000","last_became_peered":"2024-09-12T03:36:03.911811+0000","last_unstale":"2024-09-12T03:36:04.896356+0000","last_undegraded":"2024-09-12T03:36:04.896356+0000","last_fullsized":"2024-09-12T03:36:04.896356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.113309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897522+0000","last_change":"2024-09-12T03:36:03.917123+0000","last_active":"2024-09-12T03:36:04.897522+0000","last_peered":"2024-09-12T03:36:04.897522+0000","last_clean":"2024-09-12T03:36:04.897522+0000","last_became_active":"2024-09-12T03:36:03.915633+0000","last_became_peered":"2024-09-12T03:36:03.915633+0000","last_unstale":"2024-09-12T03:36:04.897522+0000","last_undegraded":"2024-09-12T03:36:04.897522+0000","last_fullsized":"2024-09-12T03:36:04.897522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:53.759154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896952+0000","last_change":"2024-09-12T03:36:03.911853+0000","last_active":"2024-09-12T03:36:04.896952+0000","last_peered":"2024-09-12T03:36:04.896952+0000","last_clean":"2024-09-12T03:36:04.896952+0000","last_became_active":"2024-09-12T03:36:03.904691+0000","last_became_peered":"2024-09-12T03:36:03.904691+0000","last_unstale":"2024-09-12T03:36:04.896952+0000","last_undegraded":"2024-09-12T03:36:04.896952+0000","last_fullsized":"2024-09-12T03:36:04.896952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:20.217205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898061+0000","last_change":"2024-09-12T03:36:03.902332+0000","last_active":"2024-09-12T03:36:04.898061+0000","last_peered":"2024-09-12T03:36:04.898061+0000","last_clean":"2024-09-12T03:36:04.898061+0000","last_became_active":"2024-09-12T03:36:03.901422+0000","last_became_peered":"2024-09-12T03:36:03.901422+0000","last_unstale":"2024-09-12T03:36:04.898061+0000","last_undegraded":"2024-09-12T03:36:04.898061+0000","last_fullsized":"2024-09-12T03:36:04.898061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:02.675165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897722+0000","last_change":"2024-09-12T03:36:03.909565+0000","last_active":"2024-09-12T03:36:04.897722+0000","last_peered":"2024-09-12T03:36:04.897722+0000","last_clean":"2024-09-12T03:36:04.897722+0000","last_became_active":"2024-09-12T03:36:03.908839+0000","last_became_peered":"2024-09-12T03:36:03.908839+0000","last_unstale":"2024-09-12T03:36:04.897722+0000","last_undegraded":"2024-09-12T03:36:04.897722+0000","last_fullsized":"2024-09-12T03:36:04.897722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:36.362384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895452+0000","last_change":"2024-09-12T03:36:03.903927+0000","last_active":"2024-09-12T03:36:04.895452+0000","last_peered":"2024-09-12T03:36:04.895452+0000","last_clean":"2024-09-12T03:36:04.895452+0000","last_became_active":"2024-09-12T03:36:03.903618+0000","last_became_peered":"2024-09-12T03:36:03.903618+0000","last_unstale":"2024-09-12T03:36:04.895452+0000","last_undegraded":"2024-09-12T03:36:04.895452+0000","last_fullsized":"2024-09-12T03:36:04.895452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:55.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897703+0000","last_change":"2024-09-12T03:36:03.913879+0000","last_active":"2024-09-12T03:36:04.897703+0000","last_peered":"2024-09-12T03:36:04.897703+0000","last_clean":"2024-09-12T03:36:04.897703+0000","last_became_active":"2024-09-12T03:36:03.912933+0000","last_became_peered":"2024-09-12T03:36:03.912933+0000","last_unstale":"2024-09-12T03:36:04.897703+0000","last_undegraded":"2024-09-12T03:36:04.897703+0000","last_fullsized":"2024-09-12T03:36:04.897703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.053830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898130+0000","last_change":"2024-09-12T03:36:03.887658+0000","last_active":"2024-09-12T03:36:04.898130+0000","last_peered":"2024-09-12T03:36:04.898130+0000","last_clean":"2024-09-12T03:36:04.898130+0000","last_became_active":"2024-09-12T03:36:03.887122+0000","last_became_peered":"2024-09-12T03:36:03.887122+0000","last_unstale":"2024-09-12T03:36:04.898130+0000","last_undegraded":"2024-09-12T03:36:04.898130+0000","last_fullsized":"2024-09-12T03:36:04.898130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:46.597582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:03.897707+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:03.897352+0000","last_became_peered":"2024-09-12T03:36:03.897352+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:59.269360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895148+0000","last_change":"2024-09-12T03:36:03.904039+0000","last_active":"2024-09-12T03:36:04.895148+0000","last_peered":"2024-09-12T03:36:04.895148+0000","last_clean":"2024-09-12T03:36:04.895148+0000","last_became_active":"2024-09-12T03:36:03.903728+0000","last_became_peered":"2024-09-12T03:36:03.903728+0000","last_unstale":"2024-09-12T03:36:04.895148+0000","last_undegraded":"2024-09-12T03:36:04.895148+0000","last_fullsized":"2024-09-12T03:36:04.895148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.126212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.834509+0000","last_change":"2024-09-12T03:36:02.834509+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.834509+0000","last_undegraded":"2024-09-12T03:36:02.834509+0000","last_fullsized":"2024-09-12T03:36:02.834509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898212+0000","last_change":"2024-09-12T03:36:02.870540+0000","last_active":"2024-09-12T03:36:04.898212+0000","last_peered":"2024-09-12T03:36:04.898212+0000","last_clean":"2024-09-12T03:36:04.898212+0000","last_became_active":"2024-09-12T03:36:02.869934+0000","last_became_peered":"2024-09-12T03:36:02.869934+0000","last_unstale":"2024-09-12T03:36:04.898212+0000","last_undegraded":"2024-09-12T03:36:04.898212+0000","last_fullsized":"2024-09-12T03:36:04.898212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831107+0000","last_change":"2024-09-12T03:36:02.831107+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831107+0000","last_undegraded":"2024-09-12T03:36:02.831107+0000","last_fullsized":"2024-09-12T03:36:02.831107+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827830+0000","last_change":"2024-09-12T03:36:01.827830+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827830+0000","last_undegraded":"2024-09-12T03:36:01.827830+0000","last_fullsized":"2024-09-12T03:36:01.827830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898376+0000","last_change":"2024-09-12T03:36:03.921518+0000","last_active":"2024-09-12T03:36:04.898376+0000","last_peered":"2024-09-12T03:36:04.898376+0000","last_clean":"2024-09-12T03:36:04.898376+0000","last_became_active":"2024-09-12T03:36:03.920792+0000","last_became_peered":"2024-09-12T03:36:03.920792+0000","last_unstale":"2024-09-12T03:36:04.898376+0000","last_undegraded":"2024-09-12T03:36:04.898376+0000","last_fullsized":"2024-09-12T03:36:04.898376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:53.679647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827860+0000","last_change":"2024-09-12T03:36:01.827860+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827860+0000","last_undegraded":"2024-09-12T03:36:01.827860+0000","last_fullsized":"2024-09-12T03:36:01.827860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830966+0000","last_change":"2024-09-12T03:36:02.830966+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830966+0000","last_undegraded":"2024-09-12T03:36:02.830966+0000","last_fullsized":"2024-09-12T03:36:02.830966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896690+0000","last_change":"2024-09-12T03:36:02.864842+0000","last_active":"2024-09-12T03:36:04.896690+0000","last_peered":"2024-09-12T03:36:04.896690+0000","last_clean":"2024-09-12T03:36:04.896690+0000","last_became_active":"2024-09-12T03:36:02.855818+0000","last_became_peered":"2024-09-12T03:36:02.855818+0000","last_unstale":"2024-09-12T03:36:04.896690+0000","last_undegraded":"2024-09-12T03:36:04.896690+0000","last_fullsized":"2024-09-12T03:36:04.896690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:13.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838792+0000","last_change":"2024-09-12T03:36:01.838792+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838792+0000","last_undegraded":"2024-09-12T03:36:01.838792+0000","last_fullsized":"2024-09-12T03:36:01.838792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897507+0000","last_change":"2024-09-12T03:36:02.867448+0000","last_active":"2024-09-12T03:36:04.897507+0000","last_peered":"2024-09-12T03:36:04.897507+0000","last_clean":"2024-09-12T03:36:04.897507+0000","last_became_active":"2024-09-12T03:36:02.862234+0000","last_became_peered":"2024-09-12T03:36:02.862234+0000","last_unstale":"2024-09-12T03:36:04.897507+0000","last_undegraded":"2024-09-12T03:36:04.897507+0000","last_fullsized":"2024-09-12T03:36:04.897507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:07.176981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894751+0000","last_change":"2024-09-12T03:36:02.866621+0000","last_active":"2024-09-12T03:36:04.894751+0000","last_peered":"2024-09-12T03:36:04.894751+0000","last_clean":"2024-09-12T03:36:04.894751+0000","last_became_active":"2024-09-12T03:36:02.864796+0000","last_became_peered":"2024-09-12T03:36:02.864796+0000","last_unstale":"2024-09-12T03:36:04.894751+0000","last_undegraded":"2024-09-12T03:36:04.894751+0000","last_fullsized":"2024-09-12T03:36:04.894751+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:01.671371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.834020+0000","last_change":"2024-09-12T03:36:01.834020+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.834020+0000","last_undegraded":"2024-09-12T03:36:01.834020+0000","last_fullsized":"2024-09-12T03:36:01.834020+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833780+0000","last_change":"2024-09-12T03:36:02.833780+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833780+0000","last_undegraded":"2024-09-12T03:36:02.833780+0000","last_fullsized":"2024-09-12T03:36:02.833780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838800+0000","last_change":"2024-09-12T03:36:01.838800+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838800+0000","last_undegraded":"2024-09-12T03:36:01.838800+0000","last_fullsized":"2024-09-12T03:36:01.838800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896296+0000","last_change":"2024-09-12T03:36:03.912046+0000","last_active":"2024-09-12T03:36:04.896296+0000","last_peered":"2024-09-12T03:36:04.896296+0000","last_clean":"2024-09-12T03:36:04.896296+0000","last_became_active":"2024-09-12T03:36:03.911470+0000","last_became_peered":"2024-09-12T03:36:03.911470+0000","last_unstale":"2024-09-12T03:36:04.896296+0000","last_undegraded":"2024-09-12T03:36:04.896296+0000","last_fullsized":"2024-09-12T03:36:04.896296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:40.902220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.832811+0000","last_change":"2024-09-12T03:36:01.832811+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.832811+0000","last_undegraded":"2024-09-12T03:36:01.832811+0000","last_fullsized":"2024-09-12T03:36:01.832811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825594+0000","last_change":"2024-09-12T03:36:01.825594+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825594+0000","last_undegraded":"2024-09-12T03:36:01.825594+0000","last_fullsized":"2024-09-12T03:36:01.825594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833175+0000","last_change":"2024-09-12T03:36:02.833175+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833175+0000","last_undegraded":"2024-09-12T03:36:02.833175+0000","last_fullsized":"2024-09-12T03:36:02.833175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896859+0000","last_change":"2024-09-12T03:36:02.867468+0000","last_active":"2024-09-12T03:36:04.896859+0000","last_peered":"2024-09-12T03:36:04.896859+0000","last_clean":"2024-09-12T03:36:04.896859+0000","last_became_active":"2024-09-12T03:36:02.864801+0000","last_became_peered":"2024-09-12T03:36:02.864801+0000","last_unstale":"2024-09-12T03:36:04.896859+0000","last_undegraded":"2024-09-12T03:36:04.896859+0000","last_fullsized":"2024-09-12T03:36:04.896859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:35.358589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897206+0000","last_change":"2024-09-12T03:36:03.904404+0000","last_active":"2024-09-12T03:36:04.897206+0000","last_peered":"2024-09-12T03:36:04.897206+0000","last_clean":"2024-09-12T03:36:04.897206+0000","last_became_active":"2024-09-12T03:36:03.903495+0000","last_became_peered":"2024-09-12T03:36:03.903495+0000","last_unstale":"2024-09-12T03:36:04.897206+0000","last_undegraded":"2024-09-12T03:36:04.897206+0000","last_fullsized":"2024-09-12T03:36:04.897206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:35.872184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898786+0000","last_change":"2024-09-12T03:36:02.875568+0000","last_active":"2024-09-12T03:36:04.898786+0000","last_peered":"2024-09-12T03:36:04.898786+0000","last_clean":"2024-09-12T03:36:04.898786+0000","last_became_active":"2024-09-12T03:36:02.874690+0000","last_became_peered":"2024-09-12T03:36:02.874690+0000","last_unstale":"2024-09-12T03:36:04.898786+0000","last_undegraded":"2024-09-12T03:36:04.898786+0000","last_fullsized":"2024-09-12T03:36:04.898786+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:57.098241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831446+0000","last_change":"2024-09-12T03:36:01.831446+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831446+0000","last_undegraded":"2024-09-12T03:36:01.831446+0000","last_fullsized":"2024-09-12T03:36:01.831446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896812+0000","last_change":"2024-09-12T03:36:03.917437+0000","last_active":"2024-09-12T03:36:04.896812+0000","last_peered":"2024-09-12T03:36:04.896812+0000","last_clean":"2024-09-12T03:36:04.896812+0000","last_became_active":"2024-09-12T03:36:03.916030+0000","last_became_peered":"2024-09-12T03:36:03.916030+0000","last_unstale":"2024-09-12T03:36:04.896812+0000","last_undegraded":"2024-09-12T03:36:04.896812+0000","last_fullsized":"2024-09-12T03:36:04.896812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:24.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824746+0000","last_change":"2024-09-12T03:36:01.824746+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824746+0000","last_undegraded":"2024-09-12T03:36:01.824746+0000","last_fullsized":"2024-09-12T03:36:01.824746+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897903+0000","last_change":"2024-09-12T03:36:02.864500+0000","last_active":"2024-09-12T03:36:04.897903+0000","last_peered":"2024-09-12T03:36:04.897903+0000","last_clean":"2024-09-12T03:36:04.897903+0000","last_became_active":"2024-09-12T03:36:02.864098+0000","last_became_peered":"2024-09-12T03:36:02.864098+0000","last_unstale":"2024-09-12T03:36:04.897903+0000","last_undegraded":"2024-09-12T03:36:04.897903+0000","last_fullsized":"2024-09-12T03:36:04.897903+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:52.675853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827376+0000","last_change":"2024-09-12T03:36:01.827376+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827376+0000","last_undegraded":"2024-09-12T03:36:01.827376+0000","last_fullsized":"2024-09-12T03:36:01.827376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897772+0000","last_change":"2024-09-12T03:36:02.868716+0000","last_active":"2024-09-12T03:36:04.897772+0000","last_peered":"2024-09-12T03:36:04.897772+0000","last_clean":"2024-09-12T03:36:04.897772+0000","last_became_active":"2024-09-12T03:36:02.868058+0000","last_became_peered":"2024-09-12T03:36:02.868058+0000","last_unstale":"2024-09-12T03:36:04.897772+0000","last_undegraded":"2024-09-12T03:36:04.897772+0000","last_fullsized":"2024-09-12T03:36:04.897772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:10.145215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898301+0000","last_change":"2024-09-12T03:36:02.862920+0000","last_active":"2024-09-12T03:36:04.898301+0000","last_peered":"2024-09-12T03:36:04.898301+0000","last_clean":"2024-09-12T03:36:04.898301+0000","last_became_active":"2024-09-12T03:36:02.862192+0000","last_became_peered":"2024-09-12T03:36:02.862192+0000","last_unstale":"2024-09-12T03:36:04.898301+0000","last_undegraded":"2024-09-12T03:36:04.898301+0000","last_fullsized":"2024-09-12T03:36:04.898301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:35.622000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831963+0000","last_change":"2024-09-12T03:36:02.831963+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831963+0000","last_undegraded":"2024-09-12T03:36:02.831963+0000","last_fullsized":"2024-09-12T03:36:02.831963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827707+0000","last_change":"2024-09-12T03:36:01.827707+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827707+0000","last_undegraded":"2024-09-12T03:36:01.827707+0000","last_fullsized":"2024-09-12T03:36:01.827707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897556+0000","last_change":"2024-09-12T03:36:03.902298+0000","last_active":"2024-09-12T03:36:04.897556+0000","last_peered":"2024-09-12T03:36:04.897556+0000","last_clean":"2024-09-12T03:36:04.897556+0000","last_became_active":"2024-09-12T03:36:03.901486+0000","last_became_peered":"2024-09-12T03:36:03.901486+0000","last_unstale":"2024-09-12T03:36:04.897556+0000","last_undegraded":"2024-09-12T03:36:04.897556+0000","last_fullsized":"2024-09-12T03:36:04.897556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:28.142929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825532+0000","last_change":"2024-09-12T03:36:01.825532+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825532+0000","last_undegraded":"2024-09-12T03:36:01.825532+0000","last_fullsized":"2024-09-12T03:36:01.825532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897094+0000","last_change":"2024-09-12T03:36:03.898701+0000","last_active":"2024-09-12T03:36:04.897094+0000","last_peered":"2024-09-12T03:36:04.897094+0000","last_clean":"2024-09-12T03:36:04.897094+0000","last_became_active":"2024-09-12T03:36:03.897480+0000","last_became_peered":"2024-09-12T03:36:03.897480+0000","last_unstale":"2024-09-12T03:36:04.897094+0000","last_undegraded":"2024-09-12T03:36:04.897094+0000","last_fullsized":"2024-09-12T03:36:04.897094+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.199100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895131+0000","last_change":"2024-09-12T03:36:02.867140+0000","last_active":"2024-09-12T03:36:04.895131+0000","last_peered":"2024-09-12T03:36:04.895131+0000","last_clean":"2024-09-12T03:36:04.895131+0000","last_became_active":"2024-09-12T03:36:02.866870+0000","last_became_peered":"2024-09-12T03:36:02.866870+0000","last_unstale":"2024-09-12T03:36:04.895131+0000","last_undegraded":"2024-09-12T03:36:04.895131+0000","last_fullsized":"2024-09-12T03:36:04.895131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:27.139135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827560+0000","last_change":"2024-09-12T03:36:01.827560+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827560+0000","last_undegraded":"2024-09-12T03:36:01.827560+0000","last_fullsized":"2024-09-12T03:36:01.827560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831683+0000","last_change":"2024-09-12T03:36:02.831683+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831683+0000","last_undegraded":"2024-09-12T03:36:02.831683+0000","last_fullsized":"2024-09-12T03:36:02.831683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898367+0000","last_change":"2024-09-12T03:36:02.874416+0000","last_active":"2024-09-12T03:36:04.898367+0000","last_peered":"2024-09-12T03:36:04.898367+0000","last_clean":"2024-09-12T03:36:04.898367+0000","last_became_active":"2024-09-12T03:36:02.870685+0000","last_became_peered":"2024-09-12T03:36:02.870685+0000","last_unstale":"2024-09-12T03:36:04.898367+0000","last_undegraded":"2024-09-12T03:36:04.898367+0000","last_fullsized":"2024-09-12T03:36:04.898367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:09.686766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831677+0000","last_change":"2024-09-12T03:36:01.831677+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831677+0000","last_undegraded":"2024-09-12T03:36:01.831677+0000","last_fullsized":"2024-09-12T03:36:01.831677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:02.867072+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:02.866508+0000","last_became_peered":"2024-09-12T03:36:02.866508+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.096929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896348+0000","last_change":"2024-09-12T03:36:03.911599+0000","last_active":"2024-09-12T03:36:04.896348+0000","last_peered":"2024-09-12T03:36:04.896348+0000","last_clean":"2024-09-12T03:36:04.896348+0000","last_became_active":"2024-09-12T03:36:03.910939+0000","last_became_peered":"2024-09-12T03:36:03.910939+0000","last_unstale":"2024-09-12T03:36:04.896348+0000","last_undegraded":"2024-09-12T03:36:04.896348+0000","last_fullsized":"2024-09-12T03:36:04.896348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.976584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825242+0000","last_change":"2024-09-12T03:36:01.825242+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825242+0000","last_undegraded":"2024-09-12T03:36:01.825242+0000","last_fullsized":"2024-09-12T03:36:01.825242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831927+0000","last_change":"2024-09-12T03:36:02.831927+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831927+0000","last_undegraded":"2024-09-12T03:36:02.831927+0000","last_fullsized":"2024-09-12T03:36:02.831927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824938+0000","last_change":"2024-09-12T03:36:01.824938+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824938+0000","last_undegraded":"2024-09-12T03:36:01.824938+0000","last_fullsized":"2024-09-12T03:36:01.824938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896742+0000","last_change":"2024-09-12T03:36:03.911211+0000","last_active":"2024-09-12T03:36:04.896742+0000","last_peered":"2024-09-12T03:36:04.896742+0000","last_clean":"2024-09-12T03:36:04.896742+0000","last_became_active":"2024-09-12T03:36:03.903532+0000","last_became_peered":"2024-09-12T03:36:03.903532+0000","last_unstale":"2024-09-12T03:36:04.896742+0000","last_undegraded":"2024-09-12T03:36:04.896742+0000","last_fullsized":"2024-09-12T03:36:04.896742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:14.499501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838585+0000","last_change":"2024-09-12T03:36:01.838585+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838585+0000","last_undegraded":"2024-09-12T03:36:01.838585+0000","last_fullsized":"2024-09-12T03:36:01.838585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830894+0000","last_change":"2024-09-12T03:36:02.830894+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830894+0000","last_undegraded":"2024-09-12T03:36:02.830894+0000","last_fullsized":"2024-09-12T03:36:02.830894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897060+0000","last_change":"2024-09-12T03:36:03.896708+0000","last_active":"2024-09-12T03:36:04.897060+0000","last_peered":"2024-09-12T03:36:04.897060+0000","last_clean":"2024-09-12T03:36:04.897060+0000","last_became_active":"2024-09-12T03:36:03.895171+0000","last_became_peered":"2024-09-12T03:36:03.895171+0000","last_unstale":"2024-09-12T03:36:04.897060+0000","last_undegraded":"2024-09-12T03:36:04.897060+0000","last_fullsized":"2024-09-12T03:36:04.897060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:14.320878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.900762+0000","last_change":"2024-09-12T03:36:02.867071+0000","last_active":"2024-09-12T03:36:04.900762+0000","last_peered":"2024-09-12T03:36:04.900762+0000","last_clean":"2024-09-12T03:36:04.900762+0000","last_became_active":"2024-09-12T03:36:02.864950+0000","last_became_peered":"2024-09-12T03:36:02.864950+0000","last_unstale":"2024-09-12T03:36:04.900762+0000","last_undegraded":"2024-09-12T03:36:04.900762+0000","last_fullsized":"2024-09-12T03:36:04.900762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:07.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-12T03:36:01.834832+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:01.834832+0000","last_peered":"2024-09-12T03:36:01.834832+0000","last_clean":"2024-09-12T03:36:01.834832+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:01.834832+0000","last_undegraded":"2024-09-12T03:36:01.834832+0000","last_fullsized":"2024-09-12T03:36:01.834832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":834902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1187840,"data_stored":848792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:08.276 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:08.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7351388640 1 Processor -- start 2024-09-12T03:36:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7351388640 1 -- start start 2024-09-12T03:36:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7351388640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c15bec0 0x7f734c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7351388640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f734c0af470 0x7f734c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7351388640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c0b3290 con 0x7f734c15c2a0 2024-09-12T03:36:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7351388640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f734c0b3570 con 0x7f734c0af470 2024-09-12T03:36:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7351388640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f734c0b3850 con 0x7f734c15bec0 2024-09-12T03:36:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f734c0af470 0x7f734c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734a7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f734c15c2a0 0x7f734c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44926/0 (socket says 172.21.15.73:44926) 2024-09-12T03:36:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734a7fc640 1 -- 172.21.15.73:0/2042973296 learned_addr learned my addr 172.21.15.73:0/2042973296 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734affd640 1 --2- 172.21.15.73:0/2042973296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c15bec0 0x7f734c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734b7fe640 1 -- 172.21.15.73:0/2042973296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c15bec0 msgr2=0x7f734c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734b7fe640 1 --2- 172.21.15.73:0/2042973296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c15bec0 0x7f734c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734b7fe640 1 -- 172.21.15.73:0/2042973296 >> v1:172.21.15.73:6789/0 conn(0x7f734c15c2a0 legacy=0x7f734c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f734b7fe640 1 -- 172.21.15.73:0/2042973296 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c0b3b30 con 0x7f734c0af470 2024-09-12T03:36:08.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.426+0000 7f7349ffb640 1 -- 172.21.15.73:0/2042973296 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220603566 0 0) 0x7f734c0b3290 con 0x7f734c15c2a0 2024-09-12T03:36:08.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f734b7fe640 1 --2- 172.21.15.73:0/2042973296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c0af470 0x7f734c06e000 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7344009d90 tx=0x7f734401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a10b95877af2fa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7349ffb640 1 -- 172.21.15.73:0/2042973296 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440b2070 con 0x7f734c0af470 2024-09-12T03:36:08.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7349ffb640 1 -- 172.21.15.73:0/2042973296 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73440a5a00 con 0x7f734c0af470 2024-09-12T03:36:08.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7349ffb640 1 -- 172.21.15.73:0/2042973296 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440a5dd0 con 0x7f734c0af470 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 -- 172.21.15.73:0/2042973296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c0af470 msgr2=0x7f734c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 --2- 172.21.15.73:0/2042973296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c0af470 0x7f734c06e000 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7344009d90 tx=0x7f734401c940 comp rx=0 tx=0).stop 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 -- 172.21.15.73:0/2042973296 shutdown_connections 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 --2- 172.21.15.73:0/2042973296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c0af470 0x7f734c06e000 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 --2- 172.21.15.73:0/2042973296 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c15bec0 0x7f734c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 -- 172.21.15.73:0/2042973296 >> 172.21.15.73:0/2042973296 conn(0x7f734c0b1f90 msgr2=0x7f734c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 -- 172.21.15.73:0/2042973296 shutdown_connections 2024-09-12T03:36:08.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 -- 172.21.15.73:0/2042973296 wait complete. 2024-09-12T03:36:08.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 Processor -- start 2024-09-12T03:36:08.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.430+0000 7f7351388640 1 -- start start 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c0af470 0x7f734c1f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734c15bec0 0x7f734c1f9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c15c2a0 0x7f734c1fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f734c06ed50 con 0x7f734c15c2a0 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f734c0ad740 con 0x7f734c15bec0 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f734c06eed0 con 0x7f734c0af470 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c15c2a0 0x7f734c1fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c15c2a0 0x7f734c1fa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59810/0 (socket says 172.21.15.73:59810) 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 -- 172.21.15.73:0/1761259656 learned_addr learned my addr 172.21.15.73:0/1761259656 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734affd640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c0af470 0x7f734c1f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734a7fc640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734c15bec0 0x7f734c1f9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 -- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c0af470 msgr2=0x7f734c1f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c0af470 0x7f734c1f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 -- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734c15bec0 msgr2=0x7f734c1f9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734c15bec0 0x7f734c1f9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 -- 172.21.15.73:0/1761259656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c14f840 con 0x7f734c15c2a0 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734a7fc640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734c15bec0 0x7f734c1f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734b7fe640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c15c2a0 0x7f734c1fa470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f73440b0040 tx=0x7f73440196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f73337fe640 1 -- 172.21.15.73:0/1761259656 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440b2050 con 0x7f734c15c2a0 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f73337fe640 1 -- 172.21.15.73:0/1761259656 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73440b3040 con 0x7f734c15c2a0 2024-09-12T03:36:08.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c14fb20 con 0x7f734c15c2a0 2024-09-12T03:36:08.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f73337fe640 1 -- 172.21.15.73:0/1761259656 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73440ada50 con 0x7f734c15c2a0 2024-09-12T03:36:08.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c1500e0 con 0x7f734c15c2a0 2024-09-12T03:36:08.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c06f250 con 0x7f734c15c2a0 2024-09-12T03:36:08.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f73337fe640 1 -- 172.21.15.73:0/1761259656 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73440c0020 con 0x7f734c15c2a0 2024-09-12T03:36:08.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f73337fe640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73380678c0 0x7f7338069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734affd640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73380678c0 0x7f7338069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f73337fe640 1 -- 172.21.15.73:0/1761259656 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f7344120cd0 con 0x7f734c15c2a0 2024-09-12T03:36:08.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.434+0000 7f734affd640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73380678c0 0x7f7338069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f734000b800 tx=0x7f7340008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.438+0000 7f73337fe640 1 -- 172.21.15.73:0/1761259656 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7344016560 con 0x7f734c15c2a0 2024-09-12T03:36:08.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.586+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f734c06fcd0 con 0x7f73380678c0 2024-09-12T03:36:08.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.602+0000 7f73337fe640 1 -- 172.21.15.73:0/1761259656 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244543 (secure 0 0 0) 0x7f734c06fcd0 con 0x7f73380678c0 2024-09-12T03:36:08.606 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:08.607 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:08.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73380678c0 msgr2=0x7f7338069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73380678c0 0x7f7338069d80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f734000b800 tx=0x7f7340008040 comp rx=0 tx=0).stop 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c15c2a0 msgr2=0x7f734c1fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c15c2a0 0x7f734c1fa470 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f73440b0040 tx=0x7f73440196e0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 shutdown_connections 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73380678c0 0x7f7338069d80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734c15c2a0 0x7f734c1fa470 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734c15bec0 0x7f734c1f9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 --2- 172.21.15.73:0/1761259656 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f734c0af470 0x7f734c1f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 >> 172.21.15.73:0/1761259656 conn(0x7f734c0b1f90 msgr2=0x7f734c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 shutdown_connections 2024-09-12T03:36:08.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.606+0000 7f7351388640 1 -- 172.21.15.73:0/1761259656 wait complete. 2024-09-12T03:36:08.622 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-12T03:36:07.816136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230176,"kb_used_data":5620,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744544,"statfs":{"total":773094113280,"available":772858413056,"internally_reserved":0,"allocated":5754880,"data_stored":3172076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994352"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896935+0000","last_change":"2024-09-12T03:36:03.912625+0000","last_active":"2024-09-12T03:36:04.896935+0000","last_peered":"2024-09-12T03:36:04.896935+0000","last_clean":"2024-09-12T03:36:04.896935+0000","last_became_active":"2024-09-12T03:36:03.912339+0000","last_became_peered":"2024-09-12T03:36:03.912339+0000","last_unstale":"2024-09-12T03:36:04.896935+0000","last_undegraded":"2024-09-12T03:36:04.896935+0000","last_fullsized":"2024-09-12T03:36:04.896935+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:10.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894961+0000","last_change":"2024-09-12T03:36:03.911435+0000","last_active":"2024-09-12T03:36:04.894961+0000","last_peered":"2024-09-12T03:36:04.894961+0000","last_clean":"2024-09-12T03:36:04.894961+0000","last_became_active":"2024-09-12T03:36:03.910991+0000","last_became_peered":"2024-09-12T03:36:03.910991+0000","last_unstale":"2024-09-12T03:36:04.894961+0000","last_undegraded":"2024-09-12T03:36:04.894961+0000","last_fullsized":"2024-09-12T03:36:04.894961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.096820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896356+0000","last_change":"2024-09-12T03:36:03.912139+0000","last_active":"2024-09-12T03:36:04.896356+0000","last_peered":"2024-09-12T03:36:04.896356+0000","last_clean":"2024-09-12T03:36:04.896356+0000","last_became_active":"2024-09-12T03:36:03.911811+0000","last_became_peered":"2024-09-12T03:36:03.911811+0000","last_unstale":"2024-09-12T03:36:04.896356+0000","last_undegraded":"2024-09-12T03:36:04.896356+0000","last_fullsized":"2024-09-12T03:36:04.896356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.113309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897522+0000","last_change":"2024-09-12T03:36:03.917123+0000","last_active":"2024-09-12T03:36:04.897522+0000","last_peered":"2024-09-12T03:36:04.897522+0000","last_clean":"2024-09-12T03:36:04.897522+0000","last_became_active":"2024-09-12T03:36:03.915633+0000","last_became_peered":"2024-09-12T03:36:03.915633+0000","last_unstale":"2024-09-12T03:36:04.897522+0000","last_undegraded":"2024-09-12T03:36:04.897522+0000","last_fullsized":"2024-09-12T03:36:04.897522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:53.759154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896952+0000","last_change":"2024-09-12T03:36:03.911853+0000","last_active":"2024-09-12T03:36:04.896952+0000","last_peered":"2024-09-12T03:36:04.896952+0000","last_clean":"2024-09-12T03:36:04.896952+0000","last_became_active":"2024-09-12T03:36:03.904691+0000","last_became_peered":"2024-09-12T03:36:03.904691+0000","last_unstale":"2024-09-12T03:36:04.896952+0000","last_undegraded":"2024-09-12T03:36:04.896952+0000","last_fullsized":"2024-09-12T03:36:04.896952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:20.217205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898061+0000","last_change":"2024-09-12T03:36:03.902332+0000","last_active":"2024-09-12T03:36:04.898061+0000","last_peered":"2024-09-12T03:36:04.898061+0000","last_clean":"2024-09-12T03:36:04.898061+0000","last_became_active":"2024-09-12T03:36:03.901422+0000","last_became_peered":"2024-09-12T03:36:03.901422+0000","last_unstale":"2024-09-12T03:36:04.898061+0000","last_undegraded":"2024-09-12T03:36:04.898061+0000","last_fullsized":"2024-09-12T03:36:04.898061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:02.675165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897722+0000","last_change":"2024-09-12T03:36:03.909565+0000","last_active":"2024-09-12T03:36:04.897722+0000","last_peered":"2024-09-12T03:36:04.897722+0000","last_clean":"2024-09-12T03:36:04.897722+0000","last_became_active":"2024-09-12T03:36:03.908839+0000","last_became_peered":"2024-09-12T03:36:03.908839+0000","last_unstale":"2024-09-12T03:36:04.897722+0000","last_undegraded":"2024-09-12T03:36:04.897722+0000","last_fullsized":"2024-09-12T03:36:04.897722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:36.362384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895452+0000","last_change":"2024-09-12T03:36:03.903927+0000","last_active":"2024-09-12T03:36:04.895452+0000","last_peered":"2024-09-12T03:36:04.895452+0000","last_clean":"2024-09-12T03:36:04.895452+0000","last_became_active":"2024-09-12T03:36:03.903618+0000","last_became_peered":"2024-09-12T03:36:03.903618+0000","last_unstale":"2024-09-12T03:36:04.895452+0000","last_undegraded":"2024-09-12T03:36:04.895452+0000","last_fullsized":"2024-09-12T03:36:04.895452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:55.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897703+0000","last_change":"2024-09-12T03:36:03.913879+0000","last_active":"2024-09-12T03:36:04.897703+0000","last_peered":"2024-09-12T03:36:04.897703+0000","last_clean":"2024-09-12T03:36:04.897703+0000","last_became_active":"2024-09-12T03:36:03.912933+0000","last_became_peered":"2024-09-12T03:36:03.912933+0000","last_unstale":"2024-09-12T03:36:04.897703+0000","last_undegraded":"2024-09-12T03:36:04.897703+0000","last_fullsized":"2024-09-12T03:36:04.897703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.053830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898130+0000","last_change":"2024-09-12T03:36:03.887658+0000","last_active":"2024-09-12T03:36:04.898130+0000","last_peered":"2024-09-12T03:36:04.898130+0000","last_clean":"2024-09-12T03:36:04.898130+0000","last_became_active":"2024-09-12T03:36:03.887122+0000","last_became_peered":"2024-09-12T03:36:03.887122+0000","last_unstale":"2024-09-12T03:36:04.898130+0000","last_undegraded":"2024-09-12T03:36:04.898130+0000","last_fullsized":"2024-09-12T03:36:04.898130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:46.597582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:03.897707+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:03.897352+0000","last_became_peered":"2024-09-12T03:36:03.897352+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:59.269360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895148+0000","last_change":"2024-09-12T03:36:03.904039+0000","last_active":"2024-09-12T03:36:04.895148+0000","last_peered":"2024-09-12T03:36:04.895148+0000","last_clean":"2024-09-12T03:36:04.895148+0000","last_became_active":"2024-09-12T03:36:03.903728+0000","last_became_peered":"2024-09-12T03:36:03.903728+0000","last_unstale":"2024-09-12T03:36:04.895148+0000","last_undegraded":"2024-09-12T03:36:04.895148+0000","last_fullsized":"2024-09-12T03:36:04.895148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.126212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.834509+0000","last_change":"2024-09-12T03:36:02.834509+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.834509+0000","last_undegraded":"2024-09-12T03:36:02.834509+0000","last_fullsized":"2024-09-12T03:36:02.834509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898212+0000","last_change":"2024-09-12T03:36:02.870540+0000","last_active":"2024-09-12T03:36:04.898212+0000","last_peered":"2024-09-12T03:36:04.898212+0000","last_clean":"2024-09-12T03:36:04.898212+0000","last_became_active":"2024-09-12T03:36:02.869934+0000","last_became_peered":"2024-09-12T03:36:02.869934+0000","last_unstale":"2024-09-12T03:36:04.898212+0000","last_undegraded":"2024-09-12T03:36:04.898212+0000","last_fullsized":"2024-09-12T03:36:04.898212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831107+0000","last_change":"2024-09-12T03:36:02.831107+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831107+0000","last_undegraded":"2024-09-12T03:36:02.831107+0000","last_fullsized":"2024-09-12T03:36:02.831107+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827830+0000","last_change":"2024-09-12T03:36:01.827830+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827830+0000","last_undegraded":"2024-09-12T03:36:01.827830+0000","last_fullsized":"2024-09-12T03:36:01.827830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898376+0000","last_change":"2024-09-12T03:36:03.921518+0000","last_active":"2024-09-12T03:36:04.898376+0000","last_peered":"2024-09-12T03:36:04.898376+0000","last_clean":"2024-09-12T03:36:04.898376+0000","last_became_active":"2024-09-12T03:36:03.920792+0000","last_became_peered":"2024-09-12T03:36:03.920792+0000","last_unstale":"2024-09-12T03:36:04.898376+0000","last_undegraded":"2024-09-12T03:36:04.898376+0000","last_fullsized":"2024-09-12T03:36:04.898376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:53.679647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827860+0000","last_change":"2024-09-12T03:36:01.827860+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827860+0000","last_undegraded":"2024-09-12T03:36:01.827860+0000","last_fullsized":"2024-09-12T03:36:01.827860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830966+0000","last_change":"2024-09-12T03:36:02.830966+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830966+0000","last_undegraded":"2024-09-12T03:36:02.830966+0000","last_fullsized":"2024-09-12T03:36:02.830966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896690+0000","last_change":"2024-09-12T03:36:02.864842+0000","last_active":"2024-09-12T03:36:04.896690+0000","last_peered":"2024-09-12T03:36:04.896690+0000","last_clean":"2024-09-12T03:36:04.896690+0000","last_became_active":"2024-09-12T03:36:02.855818+0000","last_became_peered":"2024-09-12T03:36:02.855818+0000","last_unstale":"2024-09-12T03:36:04.896690+0000","last_undegraded":"2024-09-12T03:36:04.896690+0000","last_fullsized":"2024-09-12T03:36:04.896690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:13.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838792+0000","last_change":"2024-09-12T03:36:01.838792+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838792+0000","last_undegraded":"2024-09-12T03:36:01.838792+0000","last_fullsized":"2024-09-12T03:36:01.838792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897507+0000","last_change":"2024-09-12T03:36:02.867448+0000","last_active":"2024-09-12T03:36:04.897507+0000","last_peered":"2024-09-12T03:36:04.897507+0000","last_clean":"2024-09-12T03:36:04.897507+0000","last_became_active":"2024-09-12T03:36:02.862234+0000","last_became_peered":"2024-09-12T03:36:02.862234+0000","last_unstale":"2024-09-12T03:36:04.897507+0000","last_undegraded":"2024-09-12T03:36:04.897507+0000","last_fullsized":"2024-09-12T03:36:04.897507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:07.176981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894751+0000","last_change":"2024-09-12T03:36:02.866621+0000","last_active":"2024-09-12T03:36:04.894751+0000","last_peered":"2024-09-12T03:36:04.894751+0000","last_clean":"2024-09-12T03:36:04.894751+0000","last_became_active":"2024-09-12T03:36:02.864796+0000","last_became_peered":"2024-09-12T03:36:02.864796+0000","last_unstale":"2024-09-12T03:36:04.894751+0000","last_undegraded":"2024-09-12T03:36:04.894751+0000","last_fullsized":"2024-09-12T03:36:04.894751+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:01.671371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.834020+0000","last_change":"2024-09-12T03:36:01.834020+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.834020+0000","last_undegraded":"2024-09-12T03:36:01.834020+0000","last_fullsized":"2024-09-12T03:36:01.834020+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833780+0000","last_change":"2024-09-12T03:36:02.833780+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833780+0000","last_undegraded":"2024-09-12T03:36:02.833780+0000","last_fullsized":"2024-09-12T03:36:02.833780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838800+0000","last_change":"2024-09-12T03:36:01.838800+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838800+0000","last_undegraded":"2024-09-12T03:36:01.838800+0000","last_fullsized":"2024-09-12T03:36:01.838800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896296+0000","last_change":"2024-09-12T03:36:03.912046+0000","last_active":"2024-09-12T03:36:04.896296+0000","last_peered":"2024-09-12T03:36:04.896296+0000","last_clean":"2024-09-12T03:36:04.896296+0000","last_became_active":"2024-09-12T03:36:03.911470+0000","last_became_peered":"2024-09-12T03:36:03.911470+0000","last_unstale":"2024-09-12T03:36:04.896296+0000","last_undegraded":"2024-09-12T03:36:04.896296+0000","last_fullsized":"2024-09-12T03:36:04.896296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:40.902220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.832811+0000","last_change":"2024-09-12T03:36:01.832811+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.832811+0000","last_undegraded":"2024-09-12T03:36:01.832811+0000","last_fullsized":"2024-09-12T03:36:01.832811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825594+0000","last_change":"2024-09-12T03:36:01.825594+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825594+0000","last_undegraded":"2024-09-12T03:36:01.825594+0000","last_fullsized":"2024-09-12T03:36:01.825594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833175+0000","last_change":"2024-09-12T03:36:02.833175+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833175+0000","last_undegraded":"2024-09-12T03:36:02.833175+0000","last_fullsized":"2024-09-12T03:36:02.833175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896859+0000","last_change":"2024-09-12T03:36:02.867468+0000","last_active":"2024-09-12T03:36:04.896859+0000","last_peered":"2024-09-12T03:36:04.896859+0000","last_clean":"2024-09-12T03:36:04.896859+0000","last_became_active":"2024-09-12T03:36:02.864801+0000","last_became_peered":"2024-09-12T03:36:02.864801+0000","last_unstale":"2024-09-12T03:36:04.896859+0000","last_undegraded":"2024-09-12T03:36:04.896859+0000","last_fullsized":"2024-09-12T03:36:04.896859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:35.358589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897206+0000","last_change":"2024-09-12T03:36:03.904404+0000","last_active":"2024-09-12T03:36:04.897206+0000","last_peered":"2024-09-12T03:36:04.897206+0000","last_clean":"2024-09-12T03:36:04.897206+0000","last_became_active":"2024-09-12T03:36:03.903495+0000","last_became_peered":"2024-09-12T03:36:03.903495+0000","last_unstale":"2024-09-12T03:36:04.897206+0000","last_undegraded":"2024-09-12T03:36:04.897206+0000","last_fullsized":"2024-09-12T03:36:04.897206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:35.872184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898786+0000","last_change":"2024-09-12T03:36:02.875568+0000","last_active":"2024-09-12T03:36:04.898786+0000","last_peered":"2024-09-12T03:36:04.898786+0000","last_clean":"2024-09-12T03:36:04.898786+0000","last_became_active":"2024-09-12T03:36:02.874690+0000","last_became_peered":"2024-09-12T03:36:02.874690+0000","last_unstale":"2024-09-12T03:36:04.898786+0000","last_undegraded":"2024-09-12T03:36:04.898786+0000","last_fullsized":"2024-09-12T03:36:04.898786+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:57.098241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831446+0000","last_change":"2024-09-12T03:36:01.831446+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831446+0000","last_undegraded":"2024-09-12T03:36:01.831446+0000","last_fullsized":"2024-09-12T03:36:01.831446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896812+0000","last_change":"2024-09-12T03:36:03.917437+0000","last_active":"2024-09-12T03:36:04.896812+0000","last_peered":"2024-09-12T03:36:04.896812+0000","last_clean":"2024-09-12T03:36:04.896812+0000","last_became_active":"2024-09-12T03:36:03.916030+0000","last_became_peered":"2024-09-12T03:36:03.916030+0000","last_unstale":"2024-09-12T03:36:04.896812+0000","last_undegraded":"2024-09-12T03:36:04.896812+0000","last_fullsized":"2024-09-12T03:36:04.896812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:24.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824746+0000","last_change":"2024-09-12T03:36:01.824746+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824746+0000","last_undegraded":"2024-09-12T03:36:01.824746+0000","last_fullsized":"2024-09-12T03:36:01.824746+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897903+0000","last_change":"2024-09-12T03:36:02.864500+0000","last_active":"2024-09-12T03:36:04.897903+0000","last_peered":"2024-09-12T03:36:04.897903+0000","last_clean":"2024-09-12T03:36:04.897903+0000","last_became_active":"2024-09-12T03:36:02.864098+0000","last_became_peered":"2024-09-12T03:36:02.864098+0000","last_unstale":"2024-09-12T03:36:04.897903+0000","last_undegraded":"2024-09-12T03:36:04.897903+0000","last_fullsized":"2024-09-12T03:36:04.897903+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:52.675853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827376+0000","last_change":"2024-09-12T03:36:01.827376+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827376+0000","last_undegraded":"2024-09-12T03:36:01.827376+0000","last_fullsized":"2024-09-12T03:36:01.827376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897772+0000","last_change":"2024-09-12T03:36:02.868716+0000","last_active":"2024-09-12T03:36:04.897772+0000","last_peered":"2024-09-12T03:36:04.897772+0000","last_clean":"2024-09-12T03:36:04.897772+0000","last_became_active":"2024-09-12T03:36:02.868058+0000","last_became_peered":"2024-09-12T03:36:02.868058+0000","last_unstale":"2024-09-12T03:36:04.897772+0000","last_undegraded":"2024-09-12T03:36:04.897772+0000","last_fullsized":"2024-09-12T03:36:04.897772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:10.145215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898301+0000","last_change":"2024-09-12T03:36:02.862920+0000","last_active":"2024-09-12T03:36:04.898301+0000","last_peered":"2024-09-12T03:36:04.898301+0000","last_clean":"2024-09-12T03:36:04.898301+0000","last_became_active":"2024-09-12T03:36:02.862192+0000","last_became_peered":"2024-09-12T03:36:02.862192+0000","last_unstale":"2024-09-12T03:36:04.898301+0000","last_undegraded":"2024-09-12T03:36:04.898301+0000","last_fullsized":"2024-09-12T03:36:04.898301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:35.622000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831963+0000","last_change":"2024-09-12T03:36:02.831963+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831963+0000","last_undegraded":"2024-09-12T03:36:02.831963+0000","last_fullsized":"2024-09-12T03:36:02.831963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827707+0000","last_change":"2024-09-12T03:36:01.827707+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827707+0000","last_undegraded":"2024-09-12T03:36:01.827707+0000","last_fullsized":"2024-09-12T03:36:01.827707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897556+0000","last_change":"2024-09-12T03:36:03.902298+0000","last_active":"2024-09-12T03:36:04.897556+0000","last_peered":"2024-09-12T03:36:04.897556+0000","last_clean":"2024-09-12T03:36:04.897556+0000","last_became_active":"2024-09-12T03:36:03.901486+0000","last_became_peered":"2024-09-12T03:36:03.901486+0000","last_unstale":"2024-09-12T03:36:04.897556+0000","last_undegraded":"2024-09-12T03:36:04.897556+0000","last_fullsized":"2024-09-12T03:36:04.897556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:28.142929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825532+0000","last_change":"2024-09-12T03:36:01.825532+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825532+0000","last_undegraded":"2024-09-12T03:36:01.825532+0000","last_fullsized":"2024-09-12T03:36:01.825532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897094+0000","last_change":"2024-09-12T03:36:03.898701+0000","last_active":"2024-09-12T03:36:04.897094+0000","last_peered":"2024-09-12T03:36:04.897094+0000","last_clean":"2024-09-12T03:36:04.897094+0000","last_became_active":"2024-09-12T03:36:03.897480+0000","last_became_peered":"2024-09-12T03:36:03.897480+0000","last_unstale":"2024-09-12T03:36:04.897094+0000","last_undegraded":"2024-09-12T03:36:04.897094+0000","last_fullsized":"2024-09-12T03:36:04.897094+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.199100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895131+0000","last_change":"2024-09-12T03:36:02.867140+0000","last_active":"2024-09-12T03:36:04.895131+0000","last_peered":"2024-09-12T03:36:04.895131+0000","last_clean":"2024-09-12T03:36:04.895131+0000","last_became_active":"2024-09-12T03:36:02.866870+0000","last_became_peered":"2024-09-12T03:36:02.866870+0000","last_unstale":"2024-09-12T03:36:04.895131+0000","last_undegraded":"2024-09-12T03:36:04.895131+0000","last_fullsized":"2024-09-12T03:36:04.895131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:27.139135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827560+0000","last_change":"2024-09-12T03:36:01.827560+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827560+0000","last_undegraded":"2024-09-12T03:36:01.827560+0000","last_fullsized":"2024-09-12T03:36:01.827560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831683+0000","last_change":"2024-09-12T03:36:02.831683+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831683+0000","last_undegraded":"2024-09-12T03:36:02.831683+0000","last_fullsized":"2024-09-12T03:36:02.831683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898367+0000","last_change":"2024-09-12T03:36:02.874416+0000","last_active":"2024-09-12T03:36:04.898367+0000","last_peered":"2024-09-12T03:36:04.898367+0000","last_clean":"2024-09-12T03:36:04.898367+0000","last_became_active":"2024-09-12T03:36:02.870685+0000","last_became_peered":"2024-09-12T03:36:02.870685+0000","last_unstale":"2024-09-12T03:36:04.898367+0000","last_undegraded":"2024-09-12T03:36:04.898367+0000","last_fullsized":"2024-09-12T03:36:04.898367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:09.686766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831677+0000","last_change":"2024-09-12T03:36:01.831677+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831677+0000","last_undegraded":"2024-09-12T03:36:01.831677+0000","last_fullsized":"2024-09-12T03:36:01.831677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:02.867072+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:02.866508+0000","last_became_peered":"2024-09-12T03:36:02.866508+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.096929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896348+0000","last_change":"2024-09-12T03:36:03.911599+0000","last_active":"2024-09-12T03:36:04.896348+0000","last_peered":"2024-09-12T03:36:04.896348+0000","last_clean":"2024-09-12T03:36:04.896348+0000","last_became_active":"2024-09-12T03:36:03.910939+0000","last_became_peered":"2024-09-12T03:36:03.910939+0000","last_unstale":"2024-09-12T03:36:04.896348+0000","last_undegraded":"2024-09-12T03:36:04.896348+0000","last_fullsized":"2024-09-12T03:36:04.896348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.976584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825242+0000","last_change":"2024-09-12T03:36:01.825242+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825242+0000","last_undegraded":"2024-09-12T03:36:01.825242+0000","last_fullsized":"2024-09-12T03:36:01.825242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831927+0000","last_change":"2024-09-12T03:36:02.831927+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831927+0000","last_undegraded":"2024-09-12T03:36:02.831927+0000","last_fullsized":"2024-09-12T03:36:02.831927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824938+0000","last_change":"2024-09-12T03:36:01.824938+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824938+0000","last_undegraded":"2024-09-12T03:36:01.824938+0000","last_fullsized":"2024-09-12T03:36:01.824938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896742+0000","last_change":"2024-09-12T03:36:03.911211+0000","last_active":"2024-09-12T03:36:04.896742+0000","last_peered":"2024-09-12T03:36:04.896742+0000","last_clean":"2024-09-12T03:36:04.896742+0000","last_became_active":"2024-09-12T03:36:03.903532+0000","last_became_peered":"2024-09-12T03:36:03.903532+0000","last_unstale":"2024-09-12T03:36:04.896742+0000","last_undegraded":"2024-09-12T03:36:04.896742+0000","last_fullsized":"2024-09-12T03:36:04.896742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:14.499501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838585+0000","last_change":"2024-09-12T03:36:01.838585+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838585+0000","last_undegraded":"2024-09-12T03:36:01.838585+0000","last_fullsized":"2024-09-12T03:36:01.838585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830894+0000","last_change":"2024-09-12T03:36:02.830894+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830894+0000","last_undegraded":"2024-09-12T03:36:02.830894+0000","last_fullsized":"2024-09-12T03:36:02.830894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897060+0000","last_change":"2024-09-12T03:36:03.896708+0000","last_active":"2024-09-12T03:36:04.897060+0000","last_peered":"2024-09-12T03:36:04.897060+0000","last_clean":"2024-09-12T03:36:04.897060+0000","last_became_active":"2024-09-12T03:36:03.895171+0000","last_became_peered":"2024-09-12T03:36:03.895171+0000","last_unstale":"2024-09-12T03:36:04.897060+0000","last_undegraded":"2024-09-12T03:36:04.897060+0000","last_fullsized":"2024-09-12T03:36:04.897060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:14.320878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.900762+0000","last_change":"2024-09-12T03:36:02.867071+0000","last_active":"2024-09-12T03:36:04.900762+0000","last_peered":"2024-09-12T03:36:04.900762+0000","last_clean":"2024-09-12T03:36:04.900762+0000","last_became_active":"2024-09-12T03:36:02.864950+0000","last_became_peered":"2024-09-12T03:36:02.864950+0000","last_unstale":"2024-09-12T03:36:04.900762+0000","last_undegraded":"2024-09-12T03:36:04.900762+0000","last_fullsized":"2024-09-12T03:36:04.900762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:07.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-12T03:36:01.834832+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:01.834832+0000","last_peered":"2024-09-12T03:36:01.834832+0000","last_clean":"2024-09-12T03:36:01.834832+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:01.834832+0000","last_undegraded":"2024-09-12T03:36:01.834832+0000","last_fullsized":"2024-09-12T03:36:01.834832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":834902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1187840,"data_stored":848792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:08.626 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-12T03:36:08.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.626 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-12T03:36:08.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.626 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-09-12T03:36:08.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-12T03:36:08.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-12T03:36:08.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:02.834509+0000', 'last_change': '2024-09-12T03:36:02.834509+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.834509+0000', 'last_undegraded': '2024-09-12T03:36:02.834509+0000', 'last_fullsized': '2024-09-12T03:36:02.834509+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:02.831107+0000', 'last_change': '2024-09-12T03:36:02.831107+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.831107+0000', 'last_undegraded': '2024-09-12T03:36:02.831107+0000', 'last_fullsized': '2024-09-12T03:36:02.831107+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.827830+0000', 'last_change': '2024-09-12T03:36:01.827830+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.827830+0000', 'last_undegraded': '2024-09-12T03:36:01.827830+0000', 'last_fullsized': '2024-09-12T03:36:01.827830+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-12T03:36:08.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.827860+0000', 'last_change': '2024-09-12T03:36:01.827860+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.827860+0000', 'last_undegraded': '2024-09-12T03:36:01.827860+0000', 'last_fullsized': '2024-09-12T03:36:01.827860+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 49, 'state': 'creating+activating', 'last_fresh': '2024-09-12T03:36:02.830966+0000', 'last_change': '2024-09-12T03:36:02.830966+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.830966+0000', 'last_undegraded': '2024-09-12T03:36:02.830966+0000', 'last_fullsized': '2024-09-12T03:36:02.830966+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-12T03:36:08.631 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.838792+0000', 'last_change': '2024-09-12T03:36:01.838792+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.838792+0000', 'last_undegraded': '2024-09-12T03:36:01.838792+0000', 'last_fullsized': '2024-09-12T03:36:01.838792+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.834020+0000', 'last_change': '2024-09-12T03:36:01.834020+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.834020+0000', 'last_undegraded': '2024-09-12T03:36:01.834020+0000', 'last_fullsized': '2024-09-12T03:36:01.834020+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:02.833780+0000', 'last_change': '2024-09-12T03:36:02.833780+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.833780+0000', 'last_undegraded': '2024-09-12T03:36:02.833780+0000', 'last_fullsized': '2024-09-12T03:36:02.833780+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-12T03:36:08.632 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.838800+0000', 'last_change': '2024-09-12T03:36:01.838800+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.838800+0000', 'last_undegraded': '2024-09-12T03:36:01.838800+0000', 'last_fullsized': '2024-09-12T03:36:01.838800+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.832811+0000', 'last_change': '2024-09-12T03:36:01.832811+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.832811+0000', 'last_undegraded': '2024-09-12T03:36:01.832811+0000', 'last_fullsized': '2024-09-12T03:36:01.832811+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.825594+0000', 'last_change': '2024-09-12T03:36:01.825594+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.825594+0000', 'last_undegraded': '2024-09-12T03:36:01.825594+0000', 'last_fullsized': '2024-09-12T03:36:01.825594+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:02.833175+0000', 'last_change': '2024-09-12T03:36:02.833175+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.833175+0000', 'last_undegraded': '2024-09-12T03:36:02.833175+0000', 'last_fullsized': '2024-09-12T03:36:02.833175+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.633 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.831446+0000', 'last_change': '2024-09-12T03:36:01.831446+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.831446+0000', 'last_undegraded': '2024-09-12T03:36:01.831446+0000', 'last_fullsized': '2024-09-12T03:36:01.831446+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.824746+0000', 'last_change': '2024-09-12T03:36:01.824746+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.824746+0000', 'last_undegraded': '2024-09-12T03:36:01.824746+0000', 'last_fullsized': '2024-09-12T03:36:01.824746+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.827376+0000', 'last_change': '2024-09-12T03:36:01.827376+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.827376+0000', 'last_undegraded': '2024-09-12T03:36:01.827376+0000', 'last_fullsized': '2024-09-12T03:36:01.827376+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-12T03:36:08.634 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:02.831963+0000', 'last_change': '2024-09-12T03:36:02.831963+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.831963+0000', 'last_undegraded': '2024-09-12T03:36:02.831963+0000', 'last_fullsized': '2024-09-12T03:36:02.831963+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.827707+0000', 'last_change': '2024-09-12T03:36:01.827707+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.827707+0000', 'last_undegraded': '2024-09-12T03:36:01.827707+0000', 'last_fullsized': '2024-09-12T03:36:01.827707+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.825532+0000', 'last_change': '2024-09-12T03:36:01.825532+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.825532+0000', 'last_undegraded': '2024-09-12T03:36:01.825532+0000', 'last_fullsized': '2024-09-12T03:36:01.825532+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-12T03:36:08.635 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.827560+0000', 'last_change': '2024-09-12T03:36:01.827560+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.827560+0000', 'last_undegraded': '2024-09-12T03:36:01.827560+0000', 'last_fullsized': '2024-09-12T03:36:01.827560+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:02.831683+0000', 'last_change': '2024-09-12T03:36:02.831683+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.831683+0000', 'last_undegraded': '2024-09-12T03:36:02.831683+0000', 'last_fullsized': '2024-09-12T03:36:02.831683+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.831677+0000', 'last_change': '2024-09-12T03:36:01.831677+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.831677+0000', 'last_undegraded': '2024-09-12T03:36:01.831677+0000', 'last_fullsized': '2024-09-12T03:36:01.831677+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-12T03:36:08.636 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.825242+0000', 'last_change': '2024-09-12T03:36:01.825242+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.825242+0000', 'last_undegraded': '2024-09-12T03:36:01.825242+0000', 'last_fullsized': '2024-09-12T03:36:01.825242+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:02.831927+0000', 'last_change': '2024-09-12T03:36:02.831927+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.831927+0000', 'last_undegraded': '2024-09-12T03:36:02.831927+0000', 'last_fullsized': '2024-09-12T03:36:02.831927+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.824938+0000', 'last_change': '2024-09-12T03:36:01.824938+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.824938+0000', 'last_undegraded': '2024-09-12T03:36:01.824938+0000', 'last_fullsized': '2024-09-12T03:36:01.824938+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 48, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:01.838585+0000', 'last_change': '2024-09-12T03:36:01.838585+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:01.838585+0000', 'last_undegraded': '2024-09-12T03:36:01.838585+0000', 'last_fullsized': '2024-09-12T03:36:01.838585+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:02.820414+0000', 'last_change': '2024-09-12T03:36:02.820414+0000', 'last_active': '2024-09-12T03:36:02.820414+0000', 'last_peered': '2024-09-12T03:36:02.820414+0000', 'last_clean': '2024-09-12T03:36:02.820414+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.820414+0000', 'last_undegraded': '2024-09-12T03:36:02.820414+0000', 'last_fullsized': '2024-09-12T03:36:02.820414+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:02.820414+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-12T03:36:08.637 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 49, 'state': 'creating+activating', 'last_fresh': '2024-09-12T03:36:02.830894+0000', 'last_change': '2024-09-12T03:36:02.830894+0000', 'last_active': '2024-09-12T03:36:01.816620+0000', 'last_peered': '2024-09-12T03:36:01.816620+0000', 'last_clean': '2024-09-12T03:36:01.816620+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:02.830894+0000', 'last_undegraded': '2024-09-12T03:36:02.830894+0000', 'last_fullsized': '2024-09-12T03:36:02.830894+0000', 'mapping_epoch': 48, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 48, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:01.816620+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:08.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T03:36:08.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.774+0000 7f686a861640 1 Processor -- start 2024-09-12T03:36:08.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.774+0000 7f686a861640 1 -- start start 2024-09-12T03:36:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68641587a0 0x7f68640b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68640b37d0 0x7f686406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f686406e4b0 0x7f6864161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f686406f870 con 0x7f68641587a0 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f68640b3c10 con 0x7f686406e4b0 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f686406ec60 con 0x7f68640b37d0 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68641587a0 0x7f68640b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68641587a0 0x7f68640b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59824/0 (socket says 172.21.15.73:59824) 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 -- 172.21.15.73:0/39973770 learned_addr learned my addr 172.21.15.73:0/39973770 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6868dfe640 1 --2- 172.21.15.73:0/39973770 >> v2:172.21.15.150:3300/0 conn(0x7f686406e4b0 0x7f6864161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f68637fe640 1 --2- 172.21.15.73:0/39973770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68640b37d0 0x7f686406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 -- 172.21.15.73:0/39973770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68640b37d0 msgr2=0x7f686406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 --2- 172.21.15.73:0/39973770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68640b37d0 0x7f686406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 -- 172.21.15.73:0/39973770 >> v2:172.21.15.150:3300/0 conn(0x7f686406e4b0 msgr2=0x7f6864161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:08.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 --2- 172.21.15.73:0/39973770 >> v2:172.21.15.150:3300/0 conn(0x7f686406e4b0 0x7f6864161e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 -- 172.21.15.73:0/39973770 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686406ef40 con 0x7f68641587a0 2024-09-12T03:36:08.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6863fff640 1 --2- 172.21.15.73:0/39973770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f68640b3290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f686406da30 tx=0x7f685401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab843c93bf3bba42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6862ffd640 1 -- 172.21.15.73:0/39973770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540b0070 con 0x7f68641587a0 2024-09-12T03:36:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6862ffd640 1 -- 172.21.15.73:0/39973770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68540ab600 con 0x7f68641587a0 2024-09-12T03:36:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f6862ffd640 1 -- 172.21.15.73:0/39973770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68540ab9d0 con 0x7f68641587a0 2024-09-12T03:36:08.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- 172.21.15.73:0/39973770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 msgr2=0x7f68640b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 --2- 172.21.15.73:0/39973770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f68640b3290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f686406da30 tx=0x7f685401c230 comp rx=0 tx=0).stop 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- 172.21.15.73:0/39973770 shutdown_connections 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 --2- 172.21.15.73:0/39973770 >> v2:172.21.15.150:3300/0 conn(0x7f686406e4b0 0x7f6864161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 --2- 172.21.15.73:0/39973770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68640b37d0 0x7f686406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 --2- 172.21.15.73:0/39973770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f68640b3290 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- 172.21.15.73:0/39973770 >> 172.21.15.73:0/39973770 conn(0x7f68640b1f90 msgr2=0x7f68640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- 172.21.15.73:0/39973770 shutdown_connections 2024-09-12T03:36:08.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.778+0000 7f686a861640 1 -- 172.21.15.73:0/39973770 wait complete. 2024-09-12T03:36:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 Processor -- start 2024-09-12T03:36:08.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 -- start start 2024-09-12T03:36:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f686406e4b0 0x7f686414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68640b37d0 0x7f686414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f6864151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6864158b80 con 0x7f68641587a0 2024-09-12T03:36:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6864072160 con 0x7f68640b37d0 2024-09-12T03:36:08.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f686414eab0 con 0x7f686406e4b0 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f6864151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f6864151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59834/0 (socket says 172.21.15.73:59834) 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 -- 172.21.15.73:0/1250208165 learned_addr learned my addr 172.21.15.73:0/1250208165 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f68637fe640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68640b37d0 0x7f686414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6863fff640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f686406e4b0 0x7f686414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 -- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f686406e4b0 msgr2=0x7f686414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f686406e4b0 0x7f686414c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 -- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68640b37d0 msgr2=0x7f686414d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68640b37d0 0x7f686414d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 -- 172.21.15.73:0/1250208165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686414ed90 con 0x7f68641587a0 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6868dfe640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f6864151050 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f685c00eed0 tx=0x7f685c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6860ff9640 1 -- 172.21.15.73:0/1250208165 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c018020 con 0x7f68641587a0 2024-09-12T03:36:08.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6860ff9640 1 -- 172.21.15.73:0/1250208165 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c014400 con 0x7f68641587a0 2024-09-12T03:36:08.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686414f070 con 0x7f68641587a0 2024-09-12T03:36:08.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f6860ff9640 1 -- 172.21.15.73:0/1250208165 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0147f0 con 0x7f68641587a0 2024-09-12T03:36:08.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686414cca0 con 0x7f68641587a0 2024-09-12T03:36:08.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.782+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6864147c20 con 0x7f68641587a0 2024-09-12T03:36:08.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.786+0000 7f6860ff9640 1 -- 172.21.15.73:0/1250208165 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f685c01b020 con 0x7f68641587a0 2024-09-12T03:36:08.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.786+0000 7f6860ff9640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68500678c0 0x7f6850069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:08.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.786+0000 7f6860ff9640 1 -- 172.21.15.73:0/1250208165 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f685c086820 con 0x7f68641587a0 2024-09-12T03:36:08.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.786+0000 7f6863fff640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68500678c0 0x7f6850069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:08.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.786+0000 7f6863fff640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68500678c0 0x7f6850069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f68540ad000 tx=0x7f6854008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:08.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.790+0000 7f6860ff9640 1 -- 172.21.15.73:0/1250208165 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f685c022030 con 0x7f68641587a0 2024-09-12T03:36:08.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.994+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6864070080 con 0x7f68641587a0 2024-09-12T03:36:08.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f6860ff9640 1 -- 172.21.15.73:0/1250208165 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1682 (secure 0 0 0) 0x7f685c0571d0 con 0x7f68641587a0 2024-09-12T03:36:08.999 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:08.999 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1726112066,"num_in_osds":8,"osd_in_since":1726112057,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":36},{"state_name":"active+clean","count":35},{"state_name":"creating+peering","count":24},{"state_name":"creating+activating","count":2}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":591076,"bytes_used":235700224,"bytes_avail":772858413056,"bytes_total":773094113280,"unknown_pgs_ratio":0.37113401293754578,"inactive_pgs_ratio":0.2680412232875824,"write_bytes_sec":1708,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":24,"btime":"2024-09-12T03:36:06:880174+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5220}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-12T03:35:51.811984+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T03:36:09.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68500678c0 msgr2=0x7f6850069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68500678c0 0x7f6850069d80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f68540ad000 tx=0x7f6854008040 comp rx=0 tx=0).stop 2024-09-12T03:36:09.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 msgr2=0x7f6864151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f6864151050 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f685c00eed0 tx=0x7f685c00b480 comp rx=0 tx=0).stop 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 shutdown_connections 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68500678c0 0x7f6850069d80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68641587a0 0x7f6864151050 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68640b37d0 0x7f686414d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 --2- 172.21.15.73:0/1250208165 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f686406e4b0 0x7f686414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 >> 172.21.15.73:0/1250208165 conn(0x7f68640b1f90 msgr2=0x7f68640b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 shutdown_connections 2024-09-12T03:36:09.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:08.998+0000 7f686a861640 1 -- 172.21.15.73:0/1250208165 wait complete. 2024-09-12T03:36:09.017 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T03:36:09.017 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:09.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.118+0000 7f76f3371640 1 Processor -- start 2024-09-12T03:36:09.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.118+0000 7f76f3371640 1 -- start start 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f3371640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec0d3060 0x7f76ec0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f3371640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec0d0300 con 0x7f76ec161a60 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f3371640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76ec0b0f60 con 0x7f76ec0cf450 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f3371640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec0cfd40 con 0x7f76ec0d3060 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f110d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f76ec161a60 0x7f76ec0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44928/0 (socket says 172.21.15.73:44928) 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f110d640 1 -- 172.21.15.73:0/753590774 learned_addr learned my addr 172.21.15.73:0/753590774 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f090c640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec0d3060 0x7f76ec0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718868806 0 0) 0x7f76e8001120 con 0x7f76ec161a60 2024-09-12T03:36:09.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d8003530 con 0x7f76ec161a60 2024-09-12T03:36:09.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2387961087 0 0) 0x7f76d8003530 con 0x7f76ec161a60 2024-09-12T03:36:09.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec0d3060 msgr2=0x7f76ec0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:09.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec0d3060 0x7f76ec0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 >> v1:172.21.15.150:6789/0 conn(0x7f76ec0cf450 legacy=0x7f76ec06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec0d0020 con 0x7f76ec161a60 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f76e8001850 con 0x7f76ec161a60 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 >> v1:172.21.15.73:6789/0 conn(0x7f76ec161a60 legacy=0x7f76ec0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d80039f0 0x7f76d8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec0d3060 0x7f76d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76d8004d50 0x7f76d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec0cfd40 con 0x7f76d8004d50 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f76d800bb00 con 0x7f76d80039f0 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f76d800bd00 con 0x7f76ec0d3060 2024-09-12T03:36:09.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f190e640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76d8004d50 0x7f76d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:09.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f110d640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d80039f0 0x7f76d8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:09.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f190e640 1 -- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec0d3060 msgr2=0x7f76d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:09.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f190e640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec0d3060 0x7f76d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f190e640 1 -- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d80039f0 msgr2=0x7f76d8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:09.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f190e640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d80039f0 0x7f76d8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.122+0000 7f76f190e640 1 -- 172.21.15.73:0/753590774 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d8003530 con 0x7f76d8004d50 2024-09-12T03:36:09.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f190e640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76d8004d50 0x7f76d80051d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f76e4001e70 tx=0x7f76e401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e7ed016f53a399 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4001a90 con 0x7f76d8004d50 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e4003b80 con 0x7f76d8004d50 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76e3fff640 1 -- 172.21.15.73:0/753590774 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e4005080 con 0x7f76d8004d50 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- 172.21.15.73:0/753590774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76d8004d50 msgr2=0x7f76d80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 --2- 172.21.15.73:0/753590774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76d8004d50 0x7f76d80051d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f76e4001e70 tx=0x7f76e401c780 comp rx=0 tx=0).stop 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f190e640 1 -- 172.21.15.73:0/753590774 reap_dead start 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- 172.21.15.73:0/753590774 shutdown_connections 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- 172.21.15.73:0/753590774 >> 172.21.15.73:0/753590774 conn(0x7f76ec08bf90 msgr2=0x7f76ec09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:09.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- 172.21.15.73:0/753590774 shutdown_connections 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- 172.21.15.73:0/753590774 wait complete. 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 Processor -- start 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- start start 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d8004d50 0x7f76ec0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76ec158710 0x7f76ec15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec158b90 0x7f76ec15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec0cf8e0 con 0x7f76ec158710 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec06d190 con 0x7f76d8004d50 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f76ec0cfa60 con 0x7f76ec158b90 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76ec158710 0x7f76ec15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76ec158710 0x7f76ec15a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59846/0 (socket says 172.21.15.73:59846) 2024-09-12T03:36:09.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 -- 172.21.15.73:0/1698716631 learned_addr learned my addr 172.21.15.73:0/1698716631 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f110d640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d8004d50 0x7f76ec0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f190e640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec158b90 0x7f76ec15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 -- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec158b90 msgr2=0x7f76ec15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec158b90 0x7f76ec15aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 -- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d8004d50 msgr2=0x7f76ec0cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d8004d50 0x7f76ec0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 -- 172.21.15.73:0/1698716631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec15ecd0 con 0x7f76ec158710 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f090c640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76ec158710 0x7f76ec15a4d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00e7c0 tx=0x7f76dc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76e1ffb640 1 -- 172.21.15.73:0/1698716631 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc017070 con 0x7f76ec158710 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76e1ffb640 1 -- 172.21.15.73:0/1698716631 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc00c8c0 con 0x7f76ec158710 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec0b7510 con 0x7f76ec158710 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76e1ffb640 1 -- 172.21.15.73:0/1698716631 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00cc90 con 0x7f76ec158710 2024-09-12T03:36:09.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.126+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec0b7ad0 con 0x7f76ec158710 2024-09-12T03:36:09.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.130+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ec0cef10 con 0x7f76ec158710 2024-09-12T03:36:09.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.130+0000 7f76e1ffb640 1 -- 172.21.15.73:0/1698716631 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f76dc01a070 con 0x7f76ec158710 2024-09-12T03:36:09.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.130+0000 7f76e1ffb640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f76d00678f0 0x7f76d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:09.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.130+0000 7f76e1ffb640 1 -- 172.21.15.73:0/1698716631 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f76dc0860c0 con 0x7f76ec158710 2024-09-12T03:36:09.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.130+0000 7f76f110d640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f76d00678f0 0x7f76d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:09.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.130+0000 7f76f110d640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f76d00678f0 0x7f76d0069db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f76e8004880 tx=0x7f76e80047f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:09.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.134+0000 7f76e1ffb640 1 -- 172.21.15.73:0/1698716631 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f76dc0569e0 con 0x7f76ec158710 2024-09-12T03:36:09.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.282+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76ec06d930 con 0x7f76d00678f0 2024-09-12T03:36:09.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.290+0000 7f76e1ffb640 1 -- 172.21.15.73:0/1698716631 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244543 (secure 0 0 0) 0x7f76ec06d930 con 0x7f76d00678f0 2024-09-12T03:36:09.295 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:09.296 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:09.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f76d00678f0 msgr2=0x7f76d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f76d00678f0 0x7f76d0069db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f76e8004880 tx=0x7f76e80047f0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76ec158710 msgr2=0x7f76ec15a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76ec158710 0x7f76ec15a4d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00e7c0 tx=0x7f76dc00ec80 comp rx=0 tx=0).stop 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 shutdown_connections 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f76d00678f0 0x7f76d0069db0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76ec158710 0x7f76ec15a4d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f76ec158b90 0x7f76ec15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 --2- 172.21.15.73:0/1698716631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76d8004d50 0x7f76ec0cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 >> 172.21.15.73:0/1698716631 conn(0x7f76ec08bf90 msgr2=0x7f76ec0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 shutdown_connections 2024-09-12T03:36:09.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:09.294+0000 7f76f3371640 1 -- 172.21.15.73:0/1698716631 wait complete. 2024-09-12T03:36:09.311 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-12T03:36:07.816136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591076,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230176,"kb_used_data":5620,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744544,"statfs":{"total":773094113280,"available":772858413056,"internally_reserved":0,"allocated":5754880,"data_stored":3172076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994352"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896935+0000","last_change":"2024-09-12T03:36:03.912625+0000","last_active":"2024-09-12T03:36:04.896935+0000","last_peered":"2024-09-12T03:36:04.896935+0000","last_clean":"2024-09-12T03:36:04.896935+0000","last_became_active":"2024-09-12T03:36:03.912339+0000","last_became_peered":"2024-09-12T03:36:03.912339+0000","last_unstale":"2024-09-12T03:36:04.896935+0000","last_undegraded":"2024-09-12T03:36:04.896935+0000","last_fullsized":"2024-09-12T03:36:04.896935+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:10.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894961+0000","last_change":"2024-09-12T03:36:03.911435+0000","last_active":"2024-09-12T03:36:04.894961+0000","last_peered":"2024-09-12T03:36:04.894961+0000","last_clean":"2024-09-12T03:36:04.894961+0000","last_became_active":"2024-09-12T03:36:03.910991+0000","last_became_peered":"2024-09-12T03:36:03.910991+0000","last_unstale":"2024-09-12T03:36:04.894961+0000","last_undegraded":"2024-09-12T03:36:04.894961+0000","last_fullsized":"2024-09-12T03:36:04.894961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.096820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896356+0000","last_change":"2024-09-12T03:36:03.912139+0000","last_active":"2024-09-12T03:36:04.896356+0000","last_peered":"2024-09-12T03:36:04.896356+0000","last_clean":"2024-09-12T03:36:04.896356+0000","last_became_active":"2024-09-12T03:36:03.911811+0000","last_became_peered":"2024-09-12T03:36:03.911811+0000","last_unstale":"2024-09-12T03:36:04.896356+0000","last_undegraded":"2024-09-12T03:36:04.896356+0000","last_fullsized":"2024-09-12T03:36:04.896356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.113309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897522+0000","last_change":"2024-09-12T03:36:03.917123+0000","last_active":"2024-09-12T03:36:04.897522+0000","last_peered":"2024-09-12T03:36:04.897522+0000","last_clean":"2024-09-12T03:36:04.897522+0000","last_became_active":"2024-09-12T03:36:03.915633+0000","last_became_peered":"2024-09-12T03:36:03.915633+0000","last_unstale":"2024-09-12T03:36:04.897522+0000","last_undegraded":"2024-09-12T03:36:04.897522+0000","last_fullsized":"2024-09-12T03:36:04.897522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:53.759154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896952+0000","last_change":"2024-09-12T03:36:03.911853+0000","last_active":"2024-09-12T03:36:04.896952+0000","last_peered":"2024-09-12T03:36:04.896952+0000","last_clean":"2024-09-12T03:36:04.896952+0000","last_became_active":"2024-09-12T03:36:03.904691+0000","last_became_peered":"2024-09-12T03:36:03.904691+0000","last_unstale":"2024-09-12T03:36:04.896952+0000","last_undegraded":"2024-09-12T03:36:04.896952+0000","last_fullsized":"2024-09-12T03:36:04.896952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:20.217205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898061+0000","last_change":"2024-09-12T03:36:03.902332+0000","last_active":"2024-09-12T03:36:04.898061+0000","last_peered":"2024-09-12T03:36:04.898061+0000","last_clean":"2024-09-12T03:36:04.898061+0000","last_became_active":"2024-09-12T03:36:03.901422+0000","last_became_peered":"2024-09-12T03:36:03.901422+0000","last_unstale":"2024-09-12T03:36:04.898061+0000","last_undegraded":"2024-09-12T03:36:04.898061+0000","last_fullsized":"2024-09-12T03:36:04.898061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:02.675165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897722+0000","last_change":"2024-09-12T03:36:03.909565+0000","last_active":"2024-09-12T03:36:04.897722+0000","last_peered":"2024-09-12T03:36:04.897722+0000","last_clean":"2024-09-12T03:36:04.897722+0000","last_became_active":"2024-09-12T03:36:03.908839+0000","last_became_peered":"2024-09-12T03:36:03.908839+0000","last_unstale":"2024-09-12T03:36:04.897722+0000","last_undegraded":"2024-09-12T03:36:04.897722+0000","last_fullsized":"2024-09-12T03:36:04.897722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:36.362384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895452+0000","last_change":"2024-09-12T03:36:03.903927+0000","last_active":"2024-09-12T03:36:04.895452+0000","last_peered":"2024-09-12T03:36:04.895452+0000","last_clean":"2024-09-12T03:36:04.895452+0000","last_became_active":"2024-09-12T03:36:03.903618+0000","last_became_peered":"2024-09-12T03:36:03.903618+0000","last_unstale":"2024-09-12T03:36:04.895452+0000","last_undegraded":"2024-09-12T03:36:04.895452+0000","last_fullsized":"2024-09-12T03:36:04.895452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:55.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897703+0000","last_change":"2024-09-12T03:36:03.913879+0000","last_active":"2024-09-12T03:36:04.897703+0000","last_peered":"2024-09-12T03:36:04.897703+0000","last_clean":"2024-09-12T03:36:04.897703+0000","last_became_active":"2024-09-12T03:36:03.912933+0000","last_became_peered":"2024-09-12T03:36:03.912933+0000","last_unstale":"2024-09-12T03:36:04.897703+0000","last_undegraded":"2024-09-12T03:36:04.897703+0000","last_fullsized":"2024-09-12T03:36:04.897703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.053830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898130+0000","last_change":"2024-09-12T03:36:03.887658+0000","last_active":"2024-09-12T03:36:04.898130+0000","last_peered":"2024-09-12T03:36:04.898130+0000","last_clean":"2024-09-12T03:36:04.898130+0000","last_became_active":"2024-09-12T03:36:03.887122+0000","last_became_peered":"2024-09-12T03:36:03.887122+0000","last_unstale":"2024-09-12T03:36:04.898130+0000","last_undegraded":"2024-09-12T03:36:04.898130+0000","last_fullsized":"2024-09-12T03:36:04.898130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:46.597582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:03.897707+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:03.897352+0000","last_became_peered":"2024-09-12T03:36:03.897352+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:59.269360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895148+0000","last_change":"2024-09-12T03:36:03.904039+0000","last_active":"2024-09-12T03:36:04.895148+0000","last_peered":"2024-09-12T03:36:04.895148+0000","last_clean":"2024-09-12T03:36:04.895148+0000","last_became_active":"2024-09-12T03:36:03.903728+0000","last_became_peered":"2024-09-12T03:36:03.903728+0000","last_unstale":"2024-09-12T03:36:04.895148+0000","last_undegraded":"2024-09-12T03:36:04.895148+0000","last_fullsized":"2024-09-12T03:36:04.895148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.126212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.834509+0000","last_change":"2024-09-12T03:36:02.834509+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.834509+0000","last_undegraded":"2024-09-12T03:36:02.834509+0000","last_fullsized":"2024-09-12T03:36:02.834509+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898212+0000","last_change":"2024-09-12T03:36:02.870540+0000","last_active":"2024-09-12T03:36:04.898212+0000","last_peered":"2024-09-12T03:36:04.898212+0000","last_clean":"2024-09-12T03:36:04.898212+0000","last_became_active":"2024-09-12T03:36:02.869934+0000","last_became_peered":"2024-09-12T03:36:02.869934+0000","last_unstale":"2024-09-12T03:36:04.898212+0000","last_undegraded":"2024-09-12T03:36:04.898212+0000","last_fullsized":"2024-09-12T03:36:04.898212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831107+0000","last_change":"2024-09-12T03:36:02.831107+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831107+0000","last_undegraded":"2024-09-12T03:36:02.831107+0000","last_fullsized":"2024-09-12T03:36:02.831107+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827830+0000","last_change":"2024-09-12T03:36:01.827830+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827830+0000","last_undegraded":"2024-09-12T03:36:01.827830+0000","last_fullsized":"2024-09-12T03:36:01.827830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898376+0000","last_change":"2024-09-12T03:36:03.921518+0000","last_active":"2024-09-12T03:36:04.898376+0000","last_peered":"2024-09-12T03:36:04.898376+0000","last_clean":"2024-09-12T03:36:04.898376+0000","last_became_active":"2024-09-12T03:36:03.920792+0000","last_became_peered":"2024-09-12T03:36:03.920792+0000","last_unstale":"2024-09-12T03:36:04.898376+0000","last_undegraded":"2024-09-12T03:36:04.898376+0000","last_fullsized":"2024-09-12T03:36:04.898376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:53.679647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827860+0000","last_change":"2024-09-12T03:36:01.827860+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827860+0000","last_undegraded":"2024-09-12T03:36:01.827860+0000","last_fullsized":"2024-09-12T03:36:01.827860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830966+0000","last_change":"2024-09-12T03:36:02.830966+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830966+0000","last_undegraded":"2024-09-12T03:36:02.830966+0000","last_fullsized":"2024-09-12T03:36:02.830966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896690+0000","last_change":"2024-09-12T03:36:02.864842+0000","last_active":"2024-09-12T03:36:04.896690+0000","last_peered":"2024-09-12T03:36:04.896690+0000","last_clean":"2024-09-12T03:36:04.896690+0000","last_became_active":"2024-09-12T03:36:02.855818+0000","last_became_peered":"2024-09-12T03:36:02.855818+0000","last_unstale":"2024-09-12T03:36:04.896690+0000","last_undegraded":"2024-09-12T03:36:04.896690+0000","last_fullsized":"2024-09-12T03:36:04.896690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:13.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838792+0000","last_change":"2024-09-12T03:36:01.838792+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838792+0000","last_undegraded":"2024-09-12T03:36:01.838792+0000","last_fullsized":"2024-09-12T03:36:01.838792+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897507+0000","last_change":"2024-09-12T03:36:02.867448+0000","last_active":"2024-09-12T03:36:04.897507+0000","last_peered":"2024-09-12T03:36:04.897507+0000","last_clean":"2024-09-12T03:36:04.897507+0000","last_became_active":"2024-09-12T03:36:02.862234+0000","last_became_peered":"2024-09-12T03:36:02.862234+0000","last_unstale":"2024-09-12T03:36:04.897507+0000","last_undegraded":"2024-09-12T03:36:04.897507+0000","last_fullsized":"2024-09-12T03:36:04.897507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:07.176981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894751+0000","last_change":"2024-09-12T03:36:02.866621+0000","last_active":"2024-09-12T03:36:04.894751+0000","last_peered":"2024-09-12T03:36:04.894751+0000","last_clean":"2024-09-12T03:36:04.894751+0000","last_became_active":"2024-09-12T03:36:02.864796+0000","last_became_peered":"2024-09-12T03:36:02.864796+0000","last_unstale":"2024-09-12T03:36:04.894751+0000","last_undegraded":"2024-09-12T03:36:04.894751+0000","last_fullsized":"2024-09-12T03:36:04.894751+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:01.671371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.834020+0000","last_change":"2024-09-12T03:36:01.834020+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.834020+0000","last_undegraded":"2024-09-12T03:36:01.834020+0000","last_fullsized":"2024-09-12T03:36:01.834020+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833780+0000","last_change":"2024-09-12T03:36:02.833780+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833780+0000","last_undegraded":"2024-09-12T03:36:02.833780+0000","last_fullsized":"2024-09-12T03:36:02.833780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838800+0000","last_change":"2024-09-12T03:36:01.838800+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838800+0000","last_undegraded":"2024-09-12T03:36:01.838800+0000","last_fullsized":"2024-09-12T03:36:01.838800+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896296+0000","last_change":"2024-09-12T03:36:03.912046+0000","last_active":"2024-09-12T03:36:04.896296+0000","last_peered":"2024-09-12T03:36:04.896296+0000","last_clean":"2024-09-12T03:36:04.896296+0000","last_became_active":"2024-09-12T03:36:03.911470+0000","last_became_peered":"2024-09-12T03:36:03.911470+0000","last_unstale":"2024-09-12T03:36:04.896296+0000","last_undegraded":"2024-09-12T03:36:04.896296+0000","last_fullsized":"2024-09-12T03:36:04.896296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:40.902220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.832811+0000","last_change":"2024-09-12T03:36:01.832811+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.832811+0000","last_undegraded":"2024-09-12T03:36:01.832811+0000","last_fullsized":"2024-09-12T03:36:01.832811+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825594+0000","last_change":"2024-09-12T03:36:01.825594+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825594+0000","last_undegraded":"2024-09-12T03:36:01.825594+0000","last_fullsized":"2024-09-12T03:36:01.825594+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.833175+0000","last_change":"2024-09-12T03:36:02.833175+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.833175+0000","last_undegraded":"2024-09-12T03:36:02.833175+0000","last_fullsized":"2024-09-12T03:36:02.833175+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896859+0000","last_change":"2024-09-12T03:36:02.867468+0000","last_active":"2024-09-12T03:36:04.896859+0000","last_peered":"2024-09-12T03:36:04.896859+0000","last_clean":"2024-09-12T03:36:04.896859+0000","last_became_active":"2024-09-12T03:36:02.864801+0000","last_became_peered":"2024-09-12T03:36:02.864801+0000","last_unstale":"2024-09-12T03:36:04.896859+0000","last_undegraded":"2024-09-12T03:36:04.896859+0000","last_fullsized":"2024-09-12T03:36:04.896859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:35.358589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897206+0000","last_change":"2024-09-12T03:36:03.904404+0000","last_active":"2024-09-12T03:36:04.897206+0000","last_peered":"2024-09-12T03:36:04.897206+0000","last_clean":"2024-09-12T03:36:04.897206+0000","last_became_active":"2024-09-12T03:36:03.903495+0000","last_became_peered":"2024-09-12T03:36:03.903495+0000","last_unstale":"2024-09-12T03:36:04.897206+0000","last_undegraded":"2024-09-12T03:36:04.897206+0000","last_fullsized":"2024-09-12T03:36:04.897206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:35.872184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898786+0000","last_change":"2024-09-12T03:36:02.875568+0000","last_active":"2024-09-12T03:36:04.898786+0000","last_peered":"2024-09-12T03:36:04.898786+0000","last_clean":"2024-09-12T03:36:04.898786+0000","last_became_active":"2024-09-12T03:36:02.874690+0000","last_became_peered":"2024-09-12T03:36:02.874690+0000","last_unstale":"2024-09-12T03:36:04.898786+0000","last_undegraded":"2024-09-12T03:36:04.898786+0000","last_fullsized":"2024-09-12T03:36:04.898786+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:57.098241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831446+0000","last_change":"2024-09-12T03:36:01.831446+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831446+0000","last_undegraded":"2024-09-12T03:36:01.831446+0000","last_fullsized":"2024-09-12T03:36:01.831446+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896812+0000","last_change":"2024-09-12T03:36:03.917437+0000","last_active":"2024-09-12T03:36:04.896812+0000","last_peered":"2024-09-12T03:36:04.896812+0000","last_clean":"2024-09-12T03:36:04.896812+0000","last_became_active":"2024-09-12T03:36:03.916030+0000","last_became_peered":"2024-09-12T03:36:03.916030+0000","last_unstale":"2024-09-12T03:36:04.896812+0000","last_undegraded":"2024-09-12T03:36:04.896812+0000","last_fullsized":"2024-09-12T03:36:04.896812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:24.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824746+0000","last_change":"2024-09-12T03:36:01.824746+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824746+0000","last_undegraded":"2024-09-12T03:36:01.824746+0000","last_fullsized":"2024-09-12T03:36:01.824746+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897903+0000","last_change":"2024-09-12T03:36:02.864500+0000","last_active":"2024-09-12T03:36:04.897903+0000","last_peered":"2024-09-12T03:36:04.897903+0000","last_clean":"2024-09-12T03:36:04.897903+0000","last_became_active":"2024-09-12T03:36:02.864098+0000","last_became_peered":"2024-09-12T03:36:02.864098+0000","last_unstale":"2024-09-12T03:36:04.897903+0000","last_undegraded":"2024-09-12T03:36:04.897903+0000","last_fullsized":"2024-09-12T03:36:04.897903+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:52.675853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827376+0000","last_change":"2024-09-12T03:36:01.827376+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827376+0000","last_undegraded":"2024-09-12T03:36:01.827376+0000","last_fullsized":"2024-09-12T03:36:01.827376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897772+0000","last_change":"2024-09-12T03:36:02.868716+0000","last_active":"2024-09-12T03:36:04.897772+0000","last_peered":"2024-09-12T03:36:04.897772+0000","last_clean":"2024-09-12T03:36:04.897772+0000","last_became_active":"2024-09-12T03:36:02.868058+0000","last_became_peered":"2024-09-12T03:36:02.868058+0000","last_unstale":"2024-09-12T03:36:04.897772+0000","last_undegraded":"2024-09-12T03:36:04.897772+0000","last_fullsized":"2024-09-12T03:36:04.897772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:10.145215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898301+0000","last_change":"2024-09-12T03:36:02.862920+0000","last_active":"2024-09-12T03:36:04.898301+0000","last_peered":"2024-09-12T03:36:04.898301+0000","last_clean":"2024-09-12T03:36:04.898301+0000","last_became_active":"2024-09-12T03:36:02.862192+0000","last_became_peered":"2024-09-12T03:36:02.862192+0000","last_unstale":"2024-09-12T03:36:04.898301+0000","last_undegraded":"2024-09-12T03:36:04.898301+0000","last_fullsized":"2024-09-12T03:36:04.898301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:35.622000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831963+0000","last_change":"2024-09-12T03:36:02.831963+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831963+0000","last_undegraded":"2024-09-12T03:36:02.831963+0000","last_fullsized":"2024-09-12T03:36:02.831963+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827707+0000","last_change":"2024-09-12T03:36:01.827707+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827707+0000","last_undegraded":"2024-09-12T03:36:01.827707+0000","last_fullsized":"2024-09-12T03:36:01.827707+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897556+0000","last_change":"2024-09-12T03:36:03.902298+0000","last_active":"2024-09-12T03:36:04.897556+0000","last_peered":"2024-09-12T03:36:04.897556+0000","last_clean":"2024-09-12T03:36:04.897556+0000","last_became_active":"2024-09-12T03:36:03.901486+0000","last_became_peered":"2024-09-12T03:36:03.901486+0000","last_unstale":"2024-09-12T03:36:04.897556+0000","last_undegraded":"2024-09-12T03:36:04.897556+0000","last_fullsized":"2024-09-12T03:36:04.897556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:28.142929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825532+0000","last_change":"2024-09-12T03:36:01.825532+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825532+0000","last_undegraded":"2024-09-12T03:36:01.825532+0000","last_fullsized":"2024-09-12T03:36:01.825532+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897094+0000","last_change":"2024-09-12T03:36:03.898701+0000","last_active":"2024-09-12T03:36:04.897094+0000","last_peered":"2024-09-12T03:36:04.897094+0000","last_clean":"2024-09-12T03:36:04.897094+0000","last_became_active":"2024-09-12T03:36:03.897480+0000","last_became_peered":"2024-09-12T03:36:03.897480+0000","last_unstale":"2024-09-12T03:36:04.897094+0000","last_undegraded":"2024-09-12T03:36:04.897094+0000","last_fullsized":"2024-09-12T03:36:04.897094+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.199100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895131+0000","last_change":"2024-09-12T03:36:02.867140+0000","last_active":"2024-09-12T03:36:04.895131+0000","last_peered":"2024-09-12T03:36:04.895131+0000","last_clean":"2024-09-12T03:36:04.895131+0000","last_became_active":"2024-09-12T03:36:02.866870+0000","last_became_peered":"2024-09-12T03:36:02.866870+0000","last_unstale":"2024-09-12T03:36:04.895131+0000","last_undegraded":"2024-09-12T03:36:04.895131+0000","last_fullsized":"2024-09-12T03:36:04.895131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:27.139135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.827560+0000","last_change":"2024-09-12T03:36:01.827560+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.827560+0000","last_undegraded":"2024-09-12T03:36:01.827560+0000","last_fullsized":"2024-09-12T03:36:01.827560+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831683+0000","last_change":"2024-09-12T03:36:02.831683+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831683+0000","last_undegraded":"2024-09-12T03:36:02.831683+0000","last_fullsized":"2024-09-12T03:36:02.831683+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898367+0000","last_change":"2024-09-12T03:36:02.874416+0000","last_active":"2024-09-12T03:36:04.898367+0000","last_peered":"2024-09-12T03:36:04.898367+0000","last_clean":"2024-09-12T03:36:04.898367+0000","last_became_active":"2024-09-12T03:36:02.870685+0000","last_became_peered":"2024-09-12T03:36:02.870685+0000","last_unstale":"2024-09-12T03:36:04.898367+0000","last_undegraded":"2024-09-12T03:36:04.898367+0000","last_fullsized":"2024-09-12T03:36:04.898367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:09.686766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.831677+0000","last_change":"2024-09-12T03:36:01.831677+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.831677+0000","last_undegraded":"2024-09-12T03:36:01.831677+0000","last_fullsized":"2024-09-12T03:36:01.831677+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:02.867072+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:02.866508+0000","last_became_peered":"2024-09-12T03:36:02.866508+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.096929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896348+0000","last_change":"2024-09-12T03:36:03.911599+0000","last_active":"2024-09-12T03:36:04.896348+0000","last_peered":"2024-09-12T03:36:04.896348+0000","last_clean":"2024-09-12T03:36:04.896348+0000","last_became_active":"2024-09-12T03:36:03.910939+0000","last_became_peered":"2024-09-12T03:36:03.910939+0000","last_unstale":"2024-09-12T03:36:04.896348+0000","last_undegraded":"2024-09-12T03:36:04.896348+0000","last_fullsized":"2024-09-12T03:36:04.896348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.976584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.825242+0000","last_change":"2024-09-12T03:36:01.825242+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.825242+0000","last_undegraded":"2024-09-12T03:36:01.825242+0000","last_fullsized":"2024-09-12T03:36:01.825242+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-09-12T03:36:02.831927+0000","last_change":"2024-09-12T03:36:02.831927+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.831927+0000","last_undegraded":"2024-09-12T03:36:02.831927+0000","last_fullsized":"2024-09-12T03:36:02.831927+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.824938+0000","last_change":"2024-09-12T03:36:01.824938+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.824938+0000","last_undegraded":"2024-09-12T03:36:01.824938+0000","last_fullsized":"2024-09-12T03:36:01.824938+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896742+0000","last_change":"2024-09-12T03:36:03.911211+0000","last_active":"2024-09-12T03:36:04.896742+0000","last_peered":"2024-09-12T03:36:04.896742+0000","last_clean":"2024-09-12T03:36:04.896742+0000","last_became_active":"2024-09-12T03:36:03.903532+0000","last_became_peered":"2024-09-12T03:36:03.903532+0000","last_unstale":"2024-09-12T03:36:04.896742+0000","last_undegraded":"2024-09-12T03:36:04.896742+0000","last_fullsized":"2024-09-12T03:36:04.896742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:14.499501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":48,"state":"creating+peering","last_fresh":"2024-09-12T03:36:01.838585+0000","last_change":"2024-09-12T03:36:01.838585+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:01.838585+0000","last_undegraded":"2024-09-12T03:36:01.838585+0000","last_fullsized":"2024-09-12T03:36:01.838585+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:02.820414+0000","last_change":"2024-09-12T03:36:02.820414+0000","last_active":"2024-09-12T03:36:02.820414+0000","last_peered":"2024-09-12T03:36:02.820414+0000","last_clean":"2024-09-12T03:36:02.820414+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.820414+0000","last_undegraded":"2024-09-12T03:36:02.820414+0000","last_fullsized":"2024-09-12T03:36:02.820414+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":3,"reported_epoch":49,"state":"creating+activating","last_fresh":"2024-09-12T03:36:02.830894+0000","last_change":"2024-09-12T03:36:02.830894+0000","last_active":"2024-09-12T03:36:01.816620+0000","last_peered":"2024-09-12T03:36:01.816620+0000","last_clean":"2024-09-12T03:36:01.816620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:02.830894+0000","last_undegraded":"2024-09-12T03:36:02.830894+0000","last_fullsized":"2024-09-12T03:36:02.830894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897060+0000","last_change":"2024-09-12T03:36:03.896708+0000","last_active":"2024-09-12T03:36:04.897060+0000","last_peered":"2024-09-12T03:36:04.897060+0000","last_clean":"2024-09-12T03:36:04.897060+0000","last_became_active":"2024-09-12T03:36:03.895171+0000","last_became_peered":"2024-09-12T03:36:03.895171+0000","last_unstale":"2024-09-12T03:36:04.897060+0000","last_undegraded":"2024-09-12T03:36:04.897060+0000","last_fullsized":"2024-09-12T03:36:04.897060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:14.320878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.900762+0000","last_change":"2024-09-12T03:36:02.867071+0000","last_active":"2024-09-12T03:36:04.900762+0000","last_peered":"2024-09-12T03:36:04.900762+0000","last_clean":"2024-09-12T03:36:04.900762+0000","last_became_active":"2024-09-12T03:36:02.864950+0000","last_became_peered":"2024-09-12T03:36:02.864950+0000","last_unstale":"2024-09-12T03:36:04.900762+0000","last_undegraded":"2024-09-12T03:36:04.900762+0000","last_fullsized":"2024-09-12T03:36:04.900762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:07.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":215,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-12T03:36:01.834832+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:01.834832+0000","last_peered":"2024-09-12T03:36:01.834832+0000","last_clean":"2024-09-12T03:36:01.834832+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:01.834832+0000","last_undegraded":"2024-09-12T03:36:01.834832+0000","last_fullsized":"2024-09-12T03:36:01.834832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":708,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28156,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343684,"statfs":{"total":96636764160,"available":96607932416,"internally_reserved":0,"allocated":1155072,"data_stored":834902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509464,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27576,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344264,"statfs":{"total":96636764160,"available":96608526336,"internally_reserved":0,"allocated":561152,"data_stored":244534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1187840,"data_stored":848792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:09.479 INFO:tasks.ceph.mds.c.smithi073.stderr:2024-09-12T03:36:09.478+0000 7ff81470e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:36:12.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f462df640 1 Processor -- start 2024-09-12T03:36:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f462df640 1 -- start start 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f462df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 0x7f8f400ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f462df640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8f400af470 0x7f8f4006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f462df640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f400b3290 con 0x7f8f4015c2a0 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f462df640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8f400b3570 con 0x7f8f400af470 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f462df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8f400b3850 con 0x7f8f4015bec0 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f3f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8f4015c2a0 0x7f8f400aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44930/0 (socket says 172.21.15.73:44930) 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f3f7fe640 1 -- 172.21.15.73:0/3850590281 learned_addr learned my addr 172.21.15.73:0/3850590281 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 0x7f8f400ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f4487c640 1 --2- 172.21.15.73:0/3850590281 >> v2:172.21.15.150:3300/0 conn(0x7f8f400af470 0x7f8f4006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376886921 0 0) 0x7f8f400b3290 con 0x7f8f4015c2a0 2024-09-12T03:36:12.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.446+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f28003530 con 0x7f8f4015c2a0 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2139588035 0 0) 0x7f8f28003530 con 0x7f8f4015c2a0 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 msgr2=0x7f8f400ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 0x7f8f400ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 >> v2:172.21.15.150:3300/0 conn(0x7f8f400af470 msgr2=0x7f8f4006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 --2- 172.21.15.73:0/3850590281 >> v2:172.21.15.150:3300/0 conn(0x7f8f400af470 0x7f8f4006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f400b3b30 con 0x7f8f4015c2a0 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f8f34001680 con 0x7f8f4015c2a0 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 >> v1:172.21.15.73:6789/0 conn(0x7f8f4015c2a0 legacy=0x7f8f400aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f28004810 0x7f8f28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 0x7f8f280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400b3570 con 0x7f8f280039c0 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400b3850 con 0x7f8f28004810 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2800b9d0 con 0x7f8f4015bec0 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3f7fe640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f28004810 0x7f8f28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f4487c640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 0x7f8f280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3ffff640 1 -- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 msgr2=0x7f8f280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f4015bec0 0x7f8f280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3ffff640 1 -- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f28004810 msgr2=0x7f8f28004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f28004810 0x7f8f28004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3ffff640 1 -- 172.21.15.73:0/3850590281 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f28003530 con 0x7f8f280039c0 2024-09-12T03:36:12.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f28003de0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009ae0 tx=0x7f8f3001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63262e0cb29b630f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300b2070 con 0x7f8f280039c0 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f300a5530 con 0x7f8f280039c0 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f3effd640 1 -- 172.21.15.73:0/3850590281 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300096b0 con 0x7f8f280039c0 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f462df640 1 -- 172.21.15.73:0/3850590281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 msgr2=0x7f8f28003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f462df640 1 --2- 172.21.15.73:0/3850590281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f28003de0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009ae0 tx=0x7f8f3001ca40 comp rx=0 tx=0).stop 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f4487c640 1 -- 172.21.15.73:0/3850590281 reap_dead start 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f462df640 1 -- 172.21.15.73:0/3850590281 shutdown_connections 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f462df640 1 -- 172.21.15.73:0/3850590281 >> 172.21.15.73:0/3850590281 conn(0x7f8f400b1f90 msgr2=0x7f8f400b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f462df640 1 -- 172.21.15.73:0/3850590281 shutdown_connections 2024-09-12T03:36:12.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.450+0000 7f8f462df640 1 -- 172.21.15.73:0/3850590281 wait complete. 2024-09-12T03:36:12.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 Processor -- start 2024-09-12T03:36:12.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 -- start start 2024-09-12T03:36:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f400998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f401e8460 0x7f8f401e88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f401f51c0 0x7f8f401f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400ad790 con 0x7f8f280039c0 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8f400ad610 con 0x7f8f401f51c0 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4006ed50 con 0x7f8f401e8460 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f400998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f400998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59864/0 (socket says 172.21.15.73:59864) 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 -- 172.21.15.73:0/1774644789 learned_addr learned my addr 172.21.15.73:0/1774644789 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3f7fe640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f401e8460 0x7f8f401e88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f4487c640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f401f51c0 0x7f8f401f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 -- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f401e8460 msgr2=0x7f8f401e88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f401e8460 0x7f8f401e88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 -- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f401f51c0 msgr2=0x7f8f401f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f401f51c0 0x7f8f401f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 -- 172.21.15.73:0/1774644789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4009ac90 con 0x7f8f280039c0 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f4487c640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f401f51c0 0x7f8f401f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3ffff640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f400998d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8f3001c870 tx=0x7f8f28005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3cff9640 1 -- 172.21.15.73:0/1774644789 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300b2040 con 0x7f8f280039c0 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3cff9640 1 -- 172.21.15.73:0/1774644789 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f3000f000 con 0x7f8f280039c0 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4009af30 con 0x7f8f280039c0 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f3cff9640 1 -- 172.21.15.73:0/1774644789 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30004220 con 0x7f8f280039c0 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4009b4f0 con 0x7f8f280039c0 2024-09-12T03:36:12.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.454+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4006f130 con 0x7f8f280039c0 2024-09-12T03:36:12.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.458+0000 7f8f3cff9640 1 -- 172.21.15.73:0/1774644789 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f30003620 con 0x7f8f280039c0 2024-09-12T03:36:12.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.458+0000 7f8f3cff9640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f2c0678c0 0x7f8f2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.458+0000 7f8f3f7fe640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f2c0678c0 0x7f8f2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.458+0000 7f8f3cff9640 1 -- 172.21.15.73:0/1774644789 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f8f3011f600 con 0x7f8f280039c0 2024-09-12T03:36:12.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.458+0000 7f8f3f7fe640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f2c0678c0 0x7f8f2c069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f34001870 tx=0x7f8f34007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.462+0000 7f8f3cff9640 1 -- 172.21.15.73:0/1774644789 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f30016780 con 0x7f8f280039c0 2024-09-12T03:36:12.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.618+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f4006fcd0 con 0x7f8f2c0678c0 2024-09-12T03:36:12.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.634+0000 7f8f3cff9640 1 -- 172.21.15.73:0/1774644789 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251952 (secure 0 0 0) 0x7f8f4006fcd0 con 0x7f8f2c0678c0 2024-09-12T03:36:12.641 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:12.643 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f2c0678c0 msgr2=0x7f8f2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f2c0678c0 0x7f8f2c069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8f34001870 tx=0x7f8f34007040 comp rx=0 tx=0).stop 2024-09-12T03:36:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 msgr2=0x7f8f400998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f400998d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8f3001c870 tx=0x7f8f28005840 comp rx=0 tx=0).stop 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 shutdown_connections 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f2c0678c0 0x7f8f2c069d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8f401f51c0 0x7f8f401f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8f401e8460 0x7f8f401e88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 --2- 172.21.15.73:0/1774644789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f280039c0 0x7f8f400998d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 >> 172.21.15.73:0/1774644789 conn(0x7f8f400b1f90 msgr2=0x7f8f400aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 shutdown_connections 2024-09-12T03:36:12.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.642+0000 7f8f462df640 1 -- 172.21.15.73:0/1774644789 wait complete. 2024-09-12T03:36:12.660 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-12T03:36:11.817639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230472,"kb_used_data":5896,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744248,"statfs":{"total":773094113280,"available":772858109952,"internally_reserved":0,"allocated":6037504,"data_stored":3306036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002812"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.878234+0000","last_change":"2024-09-12T03:36:03.876771+0000","last_active":"2024-09-12T03:36:04.878234+0000","last_peered":"2024-09-12T03:36:04.878234+0000","last_clean":"2024-09-12T03:36:04.878234+0000","last_became_active":"2024-09-12T03:36:03.875888+0000","last_became_peered":"2024-09-12T03:36:03.875888+0000","last_unstale":"2024-09-12T03:36:04.878234+0000","last_undegraded":"2024-09-12T03:36:04.878234+0000","last_fullsized":"2024-09-12T03:36:04.878234+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:37.619416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896659+0000","last_change":"2024-09-12T03:36:03.932181+0000","last_active":"2024-09-12T03:36:04.896659+0000","last_peered":"2024-09-12T03:36:04.896659+0000","last_clean":"2024-09-12T03:36:04.896659+0000","last_became_active":"2024-09-12T03:36:03.931594+0000","last_became_peered":"2024-09-12T03:36:03.931594+0000","last_unstale":"2024-09-12T03:36:04.896659+0000","last_undegraded":"2024-09-12T03:36:04.896659+0000","last_fullsized":"2024-09-12T03:36:04.896659+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:06.914423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896935+0000","last_change":"2024-09-12T03:36:03.912625+0000","last_active":"2024-09-12T03:36:04.896935+0000","last_peered":"2024-09-12T03:36:04.896935+0000","last_clean":"2024-09-12T03:36:04.896935+0000","last_became_active":"2024-09-12T03:36:03.912339+0000","last_became_peered":"2024-09-12T03:36:03.912339+0000","last_unstale":"2024-09-12T03:36:04.896935+0000","last_undegraded":"2024-09-12T03:36:04.896935+0000","last_fullsized":"2024-09-12T03:36:04.896935+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:10.549669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896638+0000","last_change":"2024-09-12T03:36:03.931957+0000","last_active":"2024-09-12T03:36:04.896638+0000","last_peered":"2024-09-12T03:36:04.896638+0000","last_clean":"2024-09-12T03:36:04.896638+0000","last_became_active":"2024-09-12T03:36:03.931207+0000","last_became_peered":"2024-09-12T03:36:03.931207+0000","last_unstale":"2024-09-12T03:36:04.896638+0000","last_undegraded":"2024-09-12T03:36:04.896638+0000","last_fullsized":"2024-09-12T03:36:04.896638+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:28.220373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897466+0000","last_change":"2024-09-12T03:36:03.894784+0000","last_active":"2024-09-12T03:36:04.897466+0000","last_peered":"2024-09-12T03:36:04.897466+0000","last_clean":"2024-09-12T03:36:04.897466+0000","last_became_active":"2024-09-12T03:36:03.891193+0000","last_became_peered":"2024-09-12T03:36:03.891193+0000","last_unstale":"2024-09-12T03:36:04.897466+0000","last_undegraded":"2024-09-12T03:36:04.897466+0000","last_fullsized":"2024-09-12T03:36:04.897466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:27.228613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.874637+0000","last_change":"2024-09-12T03:36:03.907489+0000","last_active":"2024-09-12T03:36:04.874637+0000","last_peered":"2024-09-12T03:36:04.874637+0000","last_clean":"2024-09-12T03:36:04.874637+0000","last_became_active":"2024-09-12T03:36:03.907013+0000","last_became_peered":"2024-09-12T03:36:03.907013+0000","last_unstale":"2024-09-12T03:36:04.874637+0000","last_undegraded":"2024-09-12T03:36:04.874637+0000","last_fullsized":"2024-09-12T03:36:04.874637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:17.104028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894961+0000","last_change":"2024-09-12T03:36:03.911435+0000","last_active":"2024-09-12T03:36:04.894961+0000","last_peered":"2024-09-12T03:36:04.894961+0000","last_clean":"2024-09-12T03:36:04.894961+0000","last_became_active":"2024-09-12T03:36:03.910991+0000","last_became_peered":"2024-09-12T03:36:03.910991+0000","last_unstale":"2024-09-12T03:36:04.894961+0000","last_undegraded":"2024-09-12T03:36:04.894961+0000","last_fullsized":"2024-09-12T03:36:04.894961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.096820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.876629+0000","last_change":"2024-09-12T03:36:03.893980+0000","last_active":"2024-09-12T03:36:04.876629+0000","last_peered":"2024-09-12T03:36:04.876629+0000","last_clean":"2024-09-12T03:36:04.876629+0000","last_became_active":"2024-09-12T03:36:03.893170+0000","last_became_peered":"2024-09-12T03:36:03.893170+0000","last_unstale":"2024-09-12T03:36:04.876629+0000","last_undegraded":"2024-09-12T03:36:04.876629+0000","last_fullsized":"2024-09-12T03:36:04.876629+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:25.215565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875758+0000","last_change":"2024-09-12T03:36:03.914856+0000","last_active":"2024-09-12T03:36:04.875758+0000","last_peered":"2024-09-12T03:36:04.875758+0000","last_clean":"2024-09-12T03:36:04.875758+0000","last_became_active":"2024-09-12T03:36:03.914413+0000","last_became_peered":"2024-09-12T03:36:03.914413+0000","last_unstale":"2024-09-12T03:36:04.875758+0000","last_undegraded":"2024-09-12T03:36:04.875758+0000","last_fullsized":"2024-09-12T03:36:04.875758+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:46.523773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.878235+0000","last_change":"2024-09-12T03:36:03.895956+0000","last_active":"2024-09-12T03:36:04.878235+0000","last_peered":"2024-09-12T03:36:04.878235+0000","last_clean":"2024-09-12T03:36:04.878235+0000","last_became_active":"2024-09-12T03:36:03.895503+0000","last_became_peered":"2024-09-12T03:36:03.895503+0000","last_unstale":"2024-09-12T03:36:04.878235+0000","last_undegraded":"2024-09-12T03:36:04.878235+0000","last_fullsized":"2024-09-12T03:36:04.878235+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:48.712462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895889+0000","last_change":"2024-09-12T03:36:03.928021+0000","last_active":"2024-09-12T03:36:04.895889+0000","last_peered":"2024-09-12T03:36:04.895889+0000","last_clean":"2024-09-12T03:36:04.895889+0000","last_became_active":"2024-09-12T03:36:03.927752+0000","last_became_peered":"2024-09-12T03:36:03.927752+0000","last_unstale":"2024-09-12T03:36:04.895889+0000","last_undegraded":"2024-09-12T03:36:04.895889+0000","last_fullsized":"2024-09-12T03:36:04.895889+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:04:16.190059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875919+0000","last_change":"2024-09-12T03:36:03.895568+0000","last_active":"2024-09-12T03:36:04.875919+0000","last_peered":"2024-09-12T03:36:04.875919+0000","last_clean":"2024-09-12T03:36:04.875919+0000","last_became_active":"2024-09-12T03:36:03.895263+0000","last_became_peered":"2024-09-12T03:36:03.895263+0000","last_unstale":"2024-09-12T03:36:04.875919+0000","last_undegraded":"2024-09-12T03:36:04.875919+0000","last_fullsized":"2024-09-12T03:36:04.875919+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:31.273753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.878761+0000","last_change":"2024-09-12T03:36:03.898746+0000","last_active":"2024-09-12T03:36:04.878761+0000","last_peered":"2024-09-12T03:36:04.878761+0000","last_clean":"2024-09-12T03:36:04.878761+0000","last_became_active":"2024-09-12T03:36:03.898464+0000","last_became_peered":"2024-09-12T03:36:03.898464+0000","last_unstale":"2024-09-12T03:36:04.878761+0000","last_undegraded":"2024-09-12T03:36:04.878761+0000","last_fullsized":"2024-09-12T03:36:04.878761+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:42.646085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896356+0000","last_change":"2024-09-12T03:36:03.912139+0000","last_active":"2024-09-12T03:36:04.896356+0000","last_peered":"2024-09-12T03:36:04.896356+0000","last_clean":"2024-09-12T03:36:04.896356+0000","last_became_active":"2024-09-12T03:36:03.911811+0000","last_became_peered":"2024-09-12T03:36:03.911811+0000","last_unstale":"2024-09-12T03:36:04.896356+0000","last_undegraded":"2024-09-12T03:36:04.896356+0000","last_fullsized":"2024-09-12T03:36:04.896356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:59.113309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896514+0000","last_change":"2024-09-12T03:36:03.920824+0000","last_active":"2024-09-12T03:36:04.896514+0000","last_peered":"2024-09-12T03:36:04.896514+0000","last_clean":"2024-09-12T03:36:04.896514+0000","last_became_active":"2024-09-12T03:36:03.919995+0000","last_became_peered":"2024-09-12T03:36:03.919995+0000","last_unstale":"2024-09-12T03:36:04.896514+0000","last_undegraded":"2024-09-12T03:36:04.896514+0000","last_fullsized":"2024-09-12T03:36:04.896514+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:51.832946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.874376+0000","last_change":"2024-09-12T03:36:03.893277+0000","last_active":"2024-09-12T03:36:04.874376+0000","last_peered":"2024-09-12T03:36:04.874376+0000","last_clean":"2024-09-12T03:36:04.874376+0000","last_became_active":"2024-09-12T03:36:03.892562+0000","last_became_peered":"2024-09-12T03:36:03.892562+0000","last_unstale":"2024-09-12T03:36:04.874376+0000","last_undegraded":"2024-09-12T03:36:04.874376+0000","last_fullsized":"2024-09-12T03:36:04.874376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:52.073648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897522+0000","last_change":"2024-09-12T03:36:03.917123+0000","last_active":"2024-09-12T03:36:04.897522+0000","last_peered":"2024-09-12T03:36:04.897522+0000","last_clean":"2024-09-12T03:36:04.897522+0000","last_became_active":"2024-09-12T03:36:03.915633+0000","last_became_peered":"2024-09-12T03:36:03.915633+0000","last_unstale":"2024-09-12T03:36:04.897522+0000","last_undegraded":"2024-09-12T03:36:04.897522+0000","last_fullsized":"2024-09-12T03:36:04.897522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:53.759154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897054+0000","last_change":"2024-09-12T03:36:03.933127+0000","last_active":"2024-09-12T03:36:04.897054+0000","last_peered":"2024-09-12T03:36:04.897054+0000","last_clean":"2024-09-12T03:36:04.897054+0000","last_became_active":"2024-09-12T03:36:03.932667+0000","last_became_peered":"2024-09-12T03:36:03.932667+0000","last_unstale":"2024-09-12T03:36:04.897054+0000","last_undegraded":"2024-09-12T03:36:04.897054+0000","last_fullsized":"2024-09-12T03:36:04.897054+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:43.964609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896952+0000","last_change":"2024-09-12T03:36:03.911853+0000","last_active":"2024-09-12T03:36:04.896952+0000","last_peered":"2024-09-12T03:36:04.896952+0000","last_clean":"2024-09-12T03:36:04.896952+0000","last_became_active":"2024-09-12T03:36:03.904691+0000","last_became_peered":"2024-09-12T03:36:03.904691+0000","last_unstale":"2024-09-12T03:36:04.896952+0000","last_undegraded":"2024-09-12T03:36:04.896952+0000","last_fullsized":"2024-09-12T03:36:04.896952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:20.217205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898061+0000","last_change":"2024-09-12T03:36:03.902332+0000","last_active":"2024-09-12T03:36:04.898061+0000","last_peered":"2024-09-12T03:36:04.898061+0000","last_clean":"2024-09-12T03:36:04.898061+0000","last_became_active":"2024-09-12T03:36:03.901422+0000","last_became_peered":"2024-09-12T03:36:03.901422+0000","last_unstale":"2024-09-12T03:36:04.898061+0000","last_undegraded":"2024-09-12T03:36:04.898061+0000","last_fullsized":"2024-09-12T03:36:04.898061+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:02.675165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897722+0000","last_change":"2024-09-12T03:36:03.909565+0000","last_active":"2024-09-12T03:36:04.897722+0000","last_peered":"2024-09-12T03:36:04.897722+0000","last_clean":"2024-09-12T03:36:04.897722+0000","last_became_active":"2024-09-12T03:36:03.908839+0000","last_became_peered":"2024-09-12T03:36:03.908839+0000","last_unstale":"2024-09-12T03:36:04.897722+0000","last_undegraded":"2024-09-12T03:36:04.897722+0000","last_fullsized":"2024-09-12T03:36:04.897722+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:36.362384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875005+0000","last_change":"2024-09-12T03:36:03.914918+0000","last_active":"2024-09-12T03:36:04.875005+0000","last_peered":"2024-09-12T03:36:04.875005+0000","last_clean":"2024-09-12T03:36:04.875005+0000","last_became_active":"2024-09-12T03:36:03.914601+0000","last_became_peered":"2024-09-12T03:36:03.914601+0000","last_unstale":"2024-09-12T03:36:04.875005+0000","last_undegraded":"2024-09-12T03:36:04.875005+0000","last_fullsized":"2024-09-12T03:36:04.875005+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:00.168631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894909+0000","last_change":"2024-09-12T03:36:03.906619+0000","last_active":"2024-09-12T03:36:04.894909+0000","last_peered":"2024-09-12T03:36:04.894909+0000","last_clean":"2024-09-12T03:36:04.894909+0000","last_became_active":"2024-09-12T03:36:03.906298+0000","last_became_peered":"2024-09-12T03:36:03.906298+0000","last_unstale":"2024-09-12T03:36:04.894909+0000","last_undegraded":"2024-09-12T03:36:04.894909+0000","last_fullsized":"2024-09-12T03:36:04.894909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:23.335803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895452+0000","last_change":"2024-09-12T03:36:03.903927+0000","last_active":"2024-09-12T03:36:04.895452+0000","last_peered":"2024-09-12T03:36:04.895452+0000","last_clean":"2024-09-12T03:36:04.895452+0000","last_became_active":"2024-09-12T03:36:03.903618+0000","last_became_peered":"2024-09-12T03:36:03.903618+0000","last_unstale":"2024-09-12T03:36:04.895452+0000","last_undegraded":"2024-09-12T03:36:04.895452+0000","last_fullsized":"2024-09-12T03:36:04.895452+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:55.845826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897703+0000","last_change":"2024-09-12T03:36:03.913879+0000","last_active":"2024-09-12T03:36:04.897703+0000","last_peered":"2024-09-12T03:36:04.897703+0000","last_clean":"2024-09-12T03:36:04.897703+0000","last_became_active":"2024-09-12T03:36:03.912933+0000","last_became_peered":"2024-09-12T03:36:03.912933+0000","last_unstale":"2024-09-12T03:36:04.897703+0000","last_undegraded":"2024-09-12T03:36:04.897703+0000","last_fullsized":"2024-09-12T03:36:04.897703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:36.053830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875589+0000","last_change":"2024-09-12T03:36:03.903350+0000","last_active":"2024-09-12T03:36:04.875589+0000","last_peered":"2024-09-12T03:36:04.875589+0000","last_clean":"2024-09-12T03:36:04.875589+0000","last_became_active":"2024-09-12T03:36:03.901884+0000","last_became_peered":"2024-09-12T03:36:03.901884+0000","last_unstale":"2024-09-12T03:36:04.875589+0000","last_undegraded":"2024-09-12T03:36:04.875589+0000","last_fullsized":"2024-09-12T03:36:04.875589+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:08.376805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.878646+0000","last_change":"2024-09-12T03:36:03.905603+0000","last_active":"2024-09-12T03:36:04.878646+0000","last_peered":"2024-09-12T03:36:04.878646+0000","last_clean":"2024-09-12T03:36:04.878646+0000","last_became_active":"2024-09-12T03:36:03.905292+0000","last_became_peered":"2024-09-12T03:36:03.905292+0000","last_unstale":"2024-09-12T03:36:04.878646+0000","last_undegraded":"2024-09-12T03:36:04.878646+0000","last_fullsized":"2024-09-12T03:36:04.878646+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:33.176007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898130+0000","last_change":"2024-09-12T03:36:03.887658+0000","last_active":"2024-09-12T03:36:04.898130+0000","last_peered":"2024-09-12T03:36:04.898130+0000","last_clean":"2024-09-12T03:36:04.898130+0000","last_became_active":"2024-09-12T03:36:03.887122+0000","last_became_peered":"2024-09-12T03:36:03.887122+0000","last_unstale":"2024-09-12T03:36:04.898130+0000","last_undegraded":"2024-09-12T03:36:04.898130+0000","last_fullsized":"2024-09-12T03:36:04.898130+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:46.597582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:03.897707+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:03.897352+0000","last_became_peered":"2024-09-12T03:36:03.897352+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:59.269360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895843+0000","last_change":"2024-09-12T03:36:03.933135+0000","last_active":"2024-09-12T03:36:04.895843+0000","last_peered":"2024-09-12T03:36:04.895843+0000","last_clean":"2024-09-12T03:36:04.895843+0000","last_became_active":"2024-09-12T03:36:03.932380+0000","last_became_peered":"2024-09-12T03:36:03.932380+0000","last_unstale":"2024-09-12T03:36:04.895843+0000","last_undegraded":"2024-09-12T03:36:04.895843+0000","last_fullsized":"2024-09-12T03:36:04.895843+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:09.168937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895148+0000","last_change":"2024-09-12T03:36:03.904039+0000","last_active":"2024-09-12T03:36:04.895148+0000","last_peered":"2024-09-12T03:36:04.895148+0000","last_clean":"2024-09-12T03:36:04.895148+0000","last_became_active":"2024-09-12T03:36:03.903728+0000","last_became_peered":"2024-09-12T03:36:03.903728+0000","last_unstale":"2024-09-12T03:36:04.895148+0000","last_undegraded":"2024-09-12T03:36:04.895148+0000","last_fullsized":"2024-09-12T03:36:04.895148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:52.126212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875231+0000","last_change":"2024-09-12T03:36:03.881653+0000","last_active":"2024-09-12T03:36:04.875231+0000","last_peered":"2024-09-12T03:36:04.875231+0000","last_clean":"2024-09-12T03:36:04.875231+0000","last_became_active":"2024-09-12T03:36:03.880727+0000","last_became_peered":"2024-09-12T03:36:03.880727+0000","last_unstale":"2024-09-12T03:36:04.875231+0000","last_undegraded":"2024-09-12T03:36:04.875231+0000","last_fullsized":"2024-09-12T03:36:04.875231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:51.832946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895625+0000","last_change":"2024-09-12T03:36:03.928365+0000","last_active":"2024-09-12T03:36:04.895625+0000","last_peered":"2024-09-12T03:36:04.895625+0000","last_clean":"2024-09-12T03:36:04.895625+0000","last_became_active":"2024-09-12T03:36:03.927125+0000","last_became_peered":"2024-09-12T03:36:03.927125+0000","last_unstale":"2024-09-12T03:36:04.895625+0000","last_undegraded":"2024-09-12T03:36:04.895625+0000","last_fullsized":"2024-09-12T03:36:04.895625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:51.255218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898212+0000","last_change":"2024-09-12T03:36:02.870540+0000","last_active":"2024-09-12T03:36:04.898212+0000","last_peered":"2024-09-12T03:36:04.898212+0000","last_clean":"2024-09-12T03:36:04.898212+0000","last_became_active":"2024-09-12T03:36:02.869934+0000","last_became_peered":"2024-09-12T03:36:02.869934+0000","last_unstale":"2024-09-12T03:36:04.898212+0000","last_undegraded":"2024-09-12T03:36:04.898212+0000","last_fullsized":"2024-09-12T03:36:04.898212+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:10.985835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875413+0000","last_change":"2024-09-12T03:36:03.909175+0000","last_active":"2024-09-12T03:36:04.875413+0000","last_peered":"2024-09-12T03:36:04.875413+0000","last_clean":"2024-09-12T03:36:04.875413+0000","last_became_active":"2024-09-12T03:36:03.908427+0000","last_became_peered":"2024-09-12T03:36:03.908427+0000","last_unstale":"2024-09-12T03:36:04.875413+0000","last_undegraded":"2024-09-12T03:36:04.875413+0000","last_fullsized":"2024-09-12T03:36:04.875413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:43.964609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.877752+0000","last_change":"2024-09-12T03:36:02.848564+0000","last_active":"2024-09-12T03:36:04.877752+0000","last_peered":"2024-09-12T03:36:04.877752+0000","last_clean":"2024-09-12T03:36:04.877752+0000","last_became_active":"2024-09-12T03:36:02.848305+0000","last_became_peered":"2024-09-12T03:36:02.848305+0000","last_unstale":"2024-09-12T03:36:04.877752+0000","last_undegraded":"2024-09-12T03:36:04.877752+0000","last_fullsized":"2024-09-12T03:36:04.877752+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:20.058461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898376+0000","last_change":"2024-09-12T03:36:03.921518+0000","last_active":"2024-09-12T03:36:04.898376+0000","last_peered":"2024-09-12T03:36:04.898376+0000","last_clean":"2024-09-12T03:36:04.898376+0000","last_became_active":"2024-09-12T03:36:03.920792+0000","last_became_peered":"2024-09-12T03:36:03.920792+0000","last_unstale":"2024-09-12T03:36:04.898376+0000","last_undegraded":"2024-09-12T03:36:04.898376+0000","last_fullsized":"2024-09-12T03:36:04.898376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:53.679647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.878566+0000","last_change":"2024-09-12T03:36:02.860391+0000","last_active":"2024-09-12T03:36:04.878566+0000","last_peered":"2024-09-12T03:36:04.878566+0000","last_clean":"2024-09-12T03:36:04.878566+0000","last_became_active":"2024-09-12T03:36:02.860061+0000","last_became_peered":"2024-09-12T03:36:02.860061+0000","last_unstale":"2024-09-12T03:36:04.878566+0000","last_undegraded":"2024-09-12T03:36:04.878566+0000","last_fullsized":"2024-09-12T03:36:04.878566+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:43.603614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875905+0000","last_change":"2024-09-12T03:36:03.901935+0000","last_active":"2024-09-12T03:36:04.875905+0000","last_peered":"2024-09-12T03:36:04.875905+0000","last_clean":"2024-09-12T03:36:04.875905+0000","last_became_active":"2024-09-12T03:36:03.901448+0000","last_became_peered":"2024-09-12T03:36:03.901448+0000","last_unstale":"2024-09-12T03:36:04.875905+0000","last_undegraded":"2024-09-12T03:36:04.875905+0000","last_fullsized":"2024-09-12T03:36:04.875905+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:10.931972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875665+0000","last_change":"2024-09-12T03:36:02.849167+0000","last_active":"2024-09-12T03:36:04.875665+0000","last_peered":"2024-09-12T03:36:04.875665+0000","last_clean":"2024-09-12T03:36:04.875665+0000","last_became_active":"2024-09-12T03:36:02.848443+0000","last_became_peered":"2024-09-12T03:36:02.848443+0000","last_unstale":"2024-09-12T03:36:04.875665+0000","last_undegraded":"2024-09-12T03:36:04.875665+0000","last_fullsized":"2024-09-12T03:36:04.875665+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:34.339043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.899058+0000","last_change":"2024-09-12T03:36:03.925130+0000","last_active":"2024-09-12T03:36:04.899058+0000","last_peered":"2024-09-12T03:36:04.899058+0000","last_clean":"2024-09-12T03:36:04.899058+0000","last_became_active":"2024-09-12T03:36:03.924515+0000","last_became_peered":"2024-09-12T03:36:03.924515+0000","last_unstale":"2024-09-12T03:36:04.899058+0000","last_undegraded":"2024-09-12T03:36:04.899058+0000","last_fullsized":"2024-09-12T03:36:04.899058+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:42.760230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896690+0000","last_change":"2024-09-12T03:36:02.864842+0000","last_active":"2024-09-12T03:36:04.896690+0000","last_peered":"2024-09-12T03:36:04.896690+0000","last_clean":"2024-09-12T03:36:04.896690+0000","last_became_active":"2024-09-12T03:36:02.855818+0000","last_became_peered":"2024-09-12T03:36:02.855818+0000","last_unstale":"2024-09-12T03:36:04.896690+0000","last_undegraded":"2024-09-12T03:36:04.896690+0000","last_fullsized":"2024-09-12T03:36:04.896690+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:13.317084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898091+0000","last_change":"2024-09-12T03:36:03.931604+0000","last_active":"2024-09-12T03:36:04.898091+0000","last_peered":"2024-09-12T03:36:04.898091+0000","last_clean":"2024-09-12T03:36:04.898091+0000","last_became_active":"2024-09-12T03:36:03.931123+0000","last_became_peered":"2024-09-12T03:36:03.931123+0000","last_unstale":"2024-09-12T03:36:04.898091+0000","last_undegraded":"2024-09-12T03:36:04.898091+0000","last_fullsized":"2024-09-12T03:36:04.898091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:48.701417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896477+0000","last_change":"2024-09-12T03:36:02.870900+0000","last_active":"2024-09-12T03:36:04.896477+0000","last_peered":"2024-09-12T03:36:04.896477+0000","last_clean":"2024-09-12T03:36:04.896477+0000","last_became_active":"2024-09-12T03:36:02.870077+0000","last_became_peered":"2024-09-12T03:36:02.870077+0000","last_unstale":"2024-09-12T03:36:04.896477+0000","last_undegraded":"2024-09-12T03:36:04.896477+0000","last_fullsized":"2024-09-12T03:36:04.896477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:10.152513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875754+0000","last_change":"2024-09-12T03:36:03.901553+0000","last_active":"2024-09-12T03:36:04.875754+0000","last_peered":"2024-09-12T03:36:04.875754+0000","last_clean":"2024-09-12T03:36:04.875754+0000","last_became_active":"2024-09-12T03:36:03.901257+0000","last_became_peered":"2024-09-12T03:36:03.901257+0000","last_unstale":"2024-09-12T03:36:04.875754+0000","last_undegraded":"2024-09-12T03:36:04.875754+0000","last_fullsized":"2024-09-12T03:36:04.875754+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:58.187233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897507+0000","last_change":"2024-09-12T03:36:02.867448+0000","last_active":"2024-09-12T03:36:04.897507+0000","last_peered":"2024-09-12T03:36:04.897507+0000","last_clean":"2024-09-12T03:36:04.897507+0000","last_became_active":"2024-09-12T03:36:02.862234+0000","last_became_peered":"2024-09-12T03:36:02.862234+0000","last_unstale":"2024-09-12T03:36:04.897507+0000","last_undegraded":"2024-09-12T03:36:04.897507+0000","last_fullsized":"2024-09-12T03:36:04.897507+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:28:07.176981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897056+0000","last_change":"2024-09-12T03:36:03.933324+0000","last_active":"2024-09-12T03:36:04.897056+0000","last_peered":"2024-09-12T03:36:04.897056+0000","last_clean":"2024-09-12T03:36:04.897056+0000","last_became_active":"2024-09-12T03:36:03.932392+0000","last_became_peered":"2024-09-12T03:36:03.932392+0000","last_unstale":"2024-09-12T03:36:04.897056+0000","last_undegraded":"2024-09-12T03:36:04.897056+0000","last_fullsized":"2024-09-12T03:36:04.897056+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:10.762846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.894751+0000","last_change":"2024-09-12T03:36:02.866621+0000","last_active":"2024-09-12T03:36:04.894751+0000","last_peered":"2024-09-12T03:36:04.894751+0000","last_clean":"2024-09-12T03:36:04.894751+0000","last_became_active":"2024-09-12T03:36:02.864796+0000","last_became_peered":"2024-09-12T03:36:02.864796+0000","last_unstale":"2024-09-12T03:36:04.894751+0000","last_undegraded":"2024-09-12T03:36:04.894751+0000","last_fullsized":"2024-09-12T03:36:04.894751+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:01.671371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896378+0000","last_change":"2024-09-12T03:36:03.907435+0000","last_active":"2024-09-12T03:36:04.896378+0000","last_peered":"2024-09-12T03:36:04.896378+0000","last_clean":"2024-09-12T03:36:04.896378+0000","last_became_active":"2024-09-12T03:36:03.906761+0000","last_became_peered":"2024-09-12T03:36:03.906761+0000","last_unstale":"2024-09-12T03:36:04.896378+0000","last_undegraded":"2024-09-12T03:36:04.896378+0000","last_fullsized":"2024-09-12T03:36:04.896378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:32.289297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897064+0000","last_change":"2024-09-12T03:36:02.853082+0000","last_active":"2024-09-12T03:36:04.897064+0000","last_peered":"2024-09-12T03:36:04.897064+0000","last_clean":"2024-09-12T03:36:04.897064+0000","last_became_active":"2024-09-12T03:36:02.852354+0000","last_became_peered":"2024-09-12T03:36:02.852354+0000","last_unstale":"2024-09-12T03:36:04.897064+0000","last_undegraded":"2024-09-12T03:36:04.897064+0000","last_fullsized":"2024-09-12T03:36:04.897064+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:41.756435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875217+0000","last_change":"2024-09-12T03:36:03.900561+0000","last_active":"2024-09-12T03:36:04.875217+0000","last_peered":"2024-09-12T03:36:04.875217+0000","last_clean":"2024-09-12T03:36:04.875217+0000","last_became_active":"2024-09-12T03:36:03.899762+0000","last_became_peered":"2024-09-12T03:36:03.899762+0000","last_unstale":"2024-09-12T03:36:04.875217+0000","last_undegraded":"2024-09-12T03:36:04.875217+0000","last_fullsized":"2024-09-12T03:36:04.875217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:09.168937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898850+0000","last_change":"2024-09-12T03:36:02.859364+0000","last_active":"2024-09-12T03:36:04.898850+0000","last_peered":"2024-09-12T03:36:04.898850+0000","last_clean":"2024-09-12T03:36:04.898850+0000","last_became_active":"2024-09-12T03:36:02.858487+0000","last_became_peered":"2024-09-12T03:36:02.858487+0000","last_unstale":"2024-09-12T03:36:04.898850+0000","last_undegraded":"2024-09-12T03:36:04.898850+0000","last_fullsized":"2024-09-12T03:36:04.898850+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:30.991504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896296+0000","last_change":"2024-09-12T03:36:03.912046+0000","last_active":"2024-09-12T03:36:04.896296+0000","last_peered":"2024-09-12T03:36:04.896296+0000","last_clean":"2024-09-12T03:36:04.896296+0000","last_became_active":"2024-09-12T03:36:03.911470+0000","last_became_peered":"2024-09-12T03:36:03.911470+0000","last_unstale":"2024-09-12T03:36:04.896296+0000","last_undegraded":"2024-09-12T03:36:04.896296+0000","last_fullsized":"2024-09-12T03:36:04.896296+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:29:40.902220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898420+0000","last_change":"2024-09-12T03:36:02.860952+0000","last_active":"2024-09-12T03:36:04.898420+0000","last_peered":"2024-09-12T03:36:04.898420+0000","last_clean":"2024-09-12T03:36:04.898420+0000","last_became_active":"2024-09-12T03:36:02.860202+0000","last_became_peered":"2024-09-12T03:36:02.860202+0000","last_unstale":"2024-09-12T03:36:04.898420+0000","last_undegraded":"2024-09-12T03:36:04.898420+0000","last_fullsized":"2024-09-12T03:36:04.898420+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:26.224818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897842+0000","last_change":"2024-09-12T03:36:03.899048+0000","last_active":"2024-09-12T03:36:04.897842+0000","last_peered":"2024-09-12T03:36:04.897842+0000","last_clean":"2024-09-12T03:36:04.897842+0000","last_became_active":"2024-09-12T03:36:03.898068+0000","last_became_peered":"2024-09-12T03:36:03.898068+0000","last_unstale":"2024-09-12T03:36:04.897842+0000","last_undegraded":"2024-09-12T03:36:04.897842+0000","last_fullsized":"2024-09-12T03:36:04.897842+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:52.073648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875975+0000","last_change":"2024-09-12T03:36:02.850958+0000","last_active":"2024-09-12T03:36:04.875975+0000","last_peered":"2024-09-12T03:36:04.875975+0000","last_clean":"2024-09-12T03:36:04.875975+0000","last_became_active":"2024-09-12T03:36:02.850669+0000","last_became_peered":"2024-09-12T03:36:02.850669+0000","last_unstale":"2024-09-12T03:36:04.875975+0000","last_undegraded":"2024-09-12T03:36:04.875975+0000","last_fullsized":"2024-09-12T03:36:04.875975+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:59.392828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875265+0000","last_change":"2024-09-12T03:36:03.911036+0000","last_active":"2024-09-12T03:36:04.875265+0000","last_peered":"2024-09-12T03:36:04.875265+0000","last_clean":"2024-09-12T03:36:04.875265+0000","last_became_active":"2024-09-12T03:36:03.910098+0000","last_became_peered":"2024-09-12T03:36:03.910098+0000","last_unstale":"2024-09-12T03:36:04.875265+0000","last_undegraded":"2024-09-12T03:36:04.875265+0000","last_fullsized":"2024-09-12T03:36:04.875265+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:28.220373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896859+0000","last_change":"2024-09-12T03:36:02.867468+0000","last_active":"2024-09-12T03:36:04.896859+0000","last_peered":"2024-09-12T03:36:04.896859+0000","last_clean":"2024-09-12T03:36:04.896859+0000","last_became_active":"2024-09-12T03:36:02.864801+0000","last_became_peered":"2024-09-12T03:36:02.864801+0000","last_unstale":"2024-09-12T03:36:04.896859+0000","last_undegraded":"2024-09-12T03:36:04.896859+0000","last_fullsized":"2024-09-12T03:36:04.896859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:09:35.358589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897206+0000","last_change":"2024-09-12T03:36:03.904404+0000","last_active":"2024-09-12T03:36:04.897206+0000","last_peered":"2024-09-12T03:36:04.897206+0000","last_clean":"2024-09-12T03:36:04.897206+0000","last_became_active":"2024-09-12T03:36:03.903495+0000","last_became_peered":"2024-09-12T03:36:03.903495+0000","last_unstale":"2024-09-12T03:36:04.897206+0000","last_undegraded":"2024-09-12T03:36:04.897206+0000","last_fullsized":"2024-09-12T03:36:04.897206+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:35.872184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898786+0000","last_change":"2024-09-12T03:36:02.875568+0000","last_active":"2024-09-12T03:36:04.898786+0000","last_peered":"2024-09-12T03:36:04.898786+0000","last_clean":"2024-09-12T03:36:04.898786+0000","last_became_active":"2024-09-12T03:36:02.874690+0000","last_became_peered":"2024-09-12T03:36:02.874690+0000","last_unstale":"2024-09-12T03:36:04.898786+0000","last_undegraded":"2024-09-12T03:36:04.898786+0000","last_fullsized":"2024-09-12T03:36:04.898786+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:57.098241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875630+0000","last_change":"2024-09-12T03:36:03.901757+0000","last_active":"2024-09-12T03:36:04.875630+0000","last_peered":"2024-09-12T03:36:04.875630+0000","last_clean":"2024-09-12T03:36:04.875630+0000","last_became_active":"2024-09-12T03:36:03.901428+0000","last_became_peered":"2024-09-12T03:36:03.901428+0000","last_unstale":"2024-09-12T03:36:04.875630+0000","last_undegraded":"2024-09-12T03:36:04.875630+0000","last_fullsized":"2024-09-12T03:36:04.875630+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:28.718371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896655+0000","last_change":"2024-09-12T03:36:02.863553+0000","last_active":"2024-09-12T03:36:04.896655+0000","last_peered":"2024-09-12T03:36:04.896655+0000","last_clean":"2024-09-12T03:36:04.896655+0000","last_became_active":"2024-09-12T03:36:02.862766+0000","last_became_peered":"2024-09-12T03:36:02.862766+0000","last_unstale":"2024-09-12T03:36:04.896655+0000","last_undegraded":"2024-09-12T03:36:04.896655+0000","last_fullsized":"2024-09-12T03:36:04.896655+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:31.285502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896812+0000","last_change":"2024-09-12T03:36:03.917437+0000","last_active":"2024-09-12T03:36:04.896812+0000","last_peered":"2024-09-12T03:36:04.896812+0000","last_clean":"2024-09-12T03:36:04.896812+0000","last_became_active":"2024-09-12T03:36:03.916030+0000","last_became_peered":"2024-09-12T03:36:03.916030+0000","last_unstale":"2024-09-12T03:36:04.896812+0000","last_undegraded":"2024-09-12T03:36:04.896812+0000","last_fullsized":"2024-09-12T03:36:04.896812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:24.698636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.874909+0000","last_change":"2024-09-12T03:36:02.852445+0000","last_active":"2024-09-12T03:36:04.874909+0000","last_peered":"2024-09-12T03:36:04.874909+0000","last_clean":"2024-09-12T03:36:04.874909+0000","last_became_active":"2024-09-12T03:36:02.851656+0000","last_became_peered":"2024-09-12T03:36:02.851656+0000","last_unstale":"2024-09-12T03:36:04.874909+0000","last_undegraded":"2024-09-12T03:36:04.874909+0000","last_fullsized":"2024-09-12T03:36:04.874909+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:41.642291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.874854+0000","last_change":"2024-09-12T03:36:03.878328+0000","last_active":"2024-09-12T03:36:04.874854+0000","last_peered":"2024-09-12T03:36:04.874854+0000","last_clean":"2024-09-12T03:36:04.874854+0000","last_became_active":"2024-09-12T03:36:03.877026+0000","last_became_peered":"2024-09-12T03:36:03.877026+0000","last_unstale":"2024-09-12T03:36:04.874854+0000","last_undegraded":"2024-09-12T03:36:04.874854+0000","last_fullsized":"2024-09-12T03:36:04.874854+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:43.315142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897903+0000","last_change":"2024-09-12T03:36:02.864500+0000","last_active":"2024-09-12T03:36:04.897903+0000","last_peered":"2024-09-12T03:36:04.897903+0000","last_clean":"2024-09-12T03:36:04.897903+0000","last_became_active":"2024-09-12T03:36:02.864098+0000","last_became_peered":"2024-09-12T03:36:02.864098+0000","last_unstale":"2024-09-12T03:36:04.897903+0000","last_undegraded":"2024-09-12T03:36:04.897903+0000","last_fullsized":"2024-09-12T03:36:04.897903+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:52.675853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.874458+0000","last_change":"2024-09-12T03:36:03.904980+0000","last_active":"2024-09-12T03:36:04.874458+0000","last_peered":"2024-09-12T03:36:04.874458+0000","last_clean":"2024-09-12T03:36:04.874458+0000","last_became_active":"2024-09-12T03:36:03.904674+0000","last_became_peered":"2024-09-12T03:36:03.904674+0000","last_unstale":"2024-09-12T03:36:04.874458+0000","last_undegraded":"2024-09-12T03:36:04.874458+0000","last_fullsized":"2024-09-12T03:36:04.874458+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:42.760230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895088+0000","last_change":"2024-09-12T03:36:02.850323+0000","last_active":"2024-09-12T03:36:04.895088+0000","last_peered":"2024-09-12T03:36:04.895088+0000","last_clean":"2024-09-12T03:36:04.895088+0000","last_became_active":"2024-09-12T03:36:02.850058+0000","last_became_peered":"2024-09-12T03:36:02.850058+0000","last_unstale":"2024-09-12T03:36:04.895088+0000","last_undegraded":"2024-09-12T03:36:04.895088+0000","last_fullsized":"2024-09-12T03:36:04.895088+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:51.692034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896334+0000","last_change":"2024-09-12T03:36:03.926431+0000","last_active":"2024-09-12T03:36:04.896334+0000","last_peered":"2024-09-12T03:36:04.896334+0000","last_clean":"2024-09-12T03:36:04.896334+0000","last_became_active":"2024-09-12T03:36:03.925831+0000","last_became_peered":"2024-09-12T03:36:03.925831+0000","last_unstale":"2024-09-12T03:36:04.896334+0000","last_undegraded":"2024-09-12T03:36:04.896334+0000","last_fullsized":"2024-09-12T03:36:04.896334+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:36.464108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897772+0000","last_change":"2024-09-12T03:36:02.868716+0000","last_active":"2024-09-12T03:36:04.897772+0000","last_peered":"2024-09-12T03:36:04.897772+0000","last_clean":"2024-09-12T03:36:04.897772+0000","last_became_active":"2024-09-12T03:36:02.868058+0000","last_became_peered":"2024-09-12T03:36:02.868058+0000","last_unstale":"2024-09-12T03:36:04.897772+0000","last_undegraded":"2024-09-12T03:36:04.897772+0000","last_fullsized":"2024-09-12T03:36:04.897772+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:10.145215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.877644+0000","last_change":"2024-09-12T03:36:03.890009+0000","last_active":"2024-09-12T03:36:04.877644+0000","last_peered":"2024-09-12T03:36:04.877644+0000","last_clean":"2024-09-12T03:36:04.877644+0000","last_became_active":"2024-09-12T03:36:03.889320+0000","last_became_peered":"2024-09-12T03:36:03.889320+0000","last_unstale":"2024-09-12T03:36:04.877644+0000","last_undegraded":"2024-09-12T03:36:04.877644+0000","last_fullsized":"2024-09-12T03:36:04.877644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:41.473966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898301+0000","last_change":"2024-09-12T03:36:02.862920+0000","last_active":"2024-09-12T03:36:04.898301+0000","last_peered":"2024-09-12T03:36:04.898301+0000","last_clean":"2024-09-12T03:36:04.898301+0000","last_became_active":"2024-09-12T03:36:02.862192+0000","last_became_peered":"2024-09-12T03:36:02.862192+0000","last_unstale":"2024-09-12T03:36:04.898301+0000","last_undegraded":"2024-09-12T03:36:04.898301+0000","last_fullsized":"2024-09-12T03:36:04.898301+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:35.622000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875748+0000","last_change":"2024-09-12T03:36:03.898538+0000","last_active":"2024-09-12T03:36:04.875748+0000","last_peered":"2024-09-12T03:36:04.875748+0000","last_clean":"2024-09-12T03:36:04.875748+0000","last_became_active":"2024-09-12T03:36:03.897432+0000","last_became_peered":"2024-09-12T03:36:03.897432+0000","last_unstale":"2024-09-12T03:36:04.875748+0000","last_undegraded":"2024-09-12T03:36:04.875748+0000","last_fullsized":"2024-09-12T03:36:04.875748+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:10.762846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.877768+0000","last_change":"2024-09-12T03:36:02.856456+0000","last_active":"2024-09-12T03:36:04.877768+0000","last_peered":"2024-09-12T03:36:04.877768+0000","last_clean":"2024-09-12T03:36:04.877768+0000","last_became_active":"2024-09-12T03:36:02.850656+0000","last_became_peered":"2024-09-12T03:36:02.850656+0000","last_unstale":"2024-09-12T03:36:04.877768+0000","last_undegraded":"2024-09-12T03:36:04.877768+0000","last_fullsized":"2024-09-12T03:36:04.877768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:10.152513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897556+0000","last_change":"2024-09-12T03:36:03.902298+0000","last_active":"2024-09-12T03:36:04.897556+0000","last_peered":"2024-09-12T03:36:04.897556+0000","last_clean":"2024-09-12T03:36:04.897556+0000","last_became_active":"2024-09-12T03:36:03.901486+0000","last_became_peered":"2024-09-12T03:36:03.901486+0000","last_unstale":"2024-09-12T03:36:04.897556+0000","last_undegraded":"2024-09-12T03:36:04.897556+0000","last_fullsized":"2024-09-12T03:36:04.897556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:28.142929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875154+0000","last_change":"2024-09-12T03:36:02.851294+0000","last_active":"2024-09-12T03:36:04.875154+0000","last_peered":"2024-09-12T03:36:04.875154+0000","last_clean":"2024-09-12T03:36:04.875154+0000","last_became_active":"2024-09-12T03:36:02.850755+0000","last_became_peered":"2024-09-12T03:36:02.850755+0000","last_unstale":"2024-09-12T03:36:04.875154+0000","last_undegraded":"2024-09-12T03:36:04.875154+0000","last_fullsized":"2024-09-12T03:36:04.875154+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:47.708668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897094+0000","last_change":"2024-09-12T03:36:03.898701+0000","last_active":"2024-09-12T03:36:04.897094+0000","last_peered":"2024-09-12T03:36:04.897094+0000","last_clean":"2024-09-12T03:36:04.897094+0000","last_became_active":"2024-09-12T03:36:03.897480+0000","last_became_peered":"2024-09-12T03:36:03.897480+0000","last_unstale":"2024-09-12T03:36:04.897094+0000","last_undegraded":"2024-09-12T03:36:04.897094+0000","last_fullsized":"2024-09-12T03:36:04.897094+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:36.199100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895131+0000","last_change":"2024-09-12T03:36:02.867140+0000","last_active":"2024-09-12T03:36:04.895131+0000","last_peered":"2024-09-12T03:36:04.895131+0000","last_clean":"2024-09-12T03:36:04.895131+0000","last_became_active":"2024-09-12T03:36:02.866870+0000","last_became_peered":"2024-09-12T03:36:02.866870+0000","last_unstale":"2024-09-12T03:36:04.895131+0000","last_undegraded":"2024-09-12T03:36:04.895131+0000","last_fullsized":"2024-09-12T03:36:04.895131+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:27.139135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.878469+0000","last_change":"2024-09-12T03:36:03.879296+0000","last_active":"2024-09-12T03:36:04.878469+0000","last_peered":"2024-09-12T03:36:04.878469+0000","last_clean":"2024-09-12T03:36:04.878469+0000","last_became_active":"2024-09-12T03:36:03.878463+0000","last_became_peered":"2024-09-12T03:36:03.878463+0000","last_unstale":"2024-09-12T03:36:04.878469+0000","last_undegraded":"2024-09-12T03:36:04.878469+0000","last_fullsized":"2024-09-12T03:36:04.878469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:07.845581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.893991+0000","last_change":"2024-09-12T03:36:02.859919+0000","last_active":"2024-09-12T03:36:04.893991+0000","last_peered":"2024-09-12T03:36:04.893991+0000","last_clean":"2024-09-12T03:36:04.893991+0000","last_became_active":"2024-09-12T03:36:02.859079+0000","last_became_peered":"2024-09-12T03:36:02.859079+0000","last_unstale":"2024-09-12T03:36:04.893991+0000","last_undegraded":"2024-09-12T03:36:04.893991+0000","last_fullsized":"2024-09-12T03:36:04.893991+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:12.287553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875291+0000","last_change":"2024-09-12T03:36:03.878943+0000","last_active":"2024-09-12T03:36:04.875291+0000","last_peered":"2024-09-12T03:36:04.875291+0000","last_clean":"2024-09-12T03:36:04.875291+0000","last_became_active":"2024-09-12T03:36:03.877660+0000","last_became_peered":"2024-09-12T03:36:03.877660+0000","last_unstale":"2024-09-12T03:36:04.875291+0000","last_undegraded":"2024-09-12T03:36:04.875291+0000","last_fullsized":"2024-09-12T03:36:04.875291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:06.914423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898367+0000","last_change":"2024-09-12T03:36:02.874416+0000","last_active":"2024-09-12T03:36:04.898367+0000","last_peered":"2024-09-12T03:36:04.898367+0000","last_clean":"2024-09-12T03:36:04.898367+0000","last_became_active":"2024-09-12T03:36:02.870685+0000","last_became_peered":"2024-09-12T03:36:02.870685+0000","last_unstale":"2024-09-12T03:36:04.898367+0000","last_undegraded":"2024-09-12T03:36:04.898367+0000","last_fullsized":"2024-09-12T03:36:04.898367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:09.686766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.874994+0000","last_change":"2024-09-12T03:36:03.893833+0000","last_active":"2024-09-12T03:36:04.874994+0000","last_peered":"2024-09-12T03:36:04.874994+0000","last_clean":"2024-09-12T03:36:04.874994+0000","last_became_active":"2024-09-12T03:36:03.893057+0000","last_became_peered":"2024-09-12T03:36:03.893057+0000","last_unstale":"2024-09-12T03:36:04.874994+0000","last_undegraded":"2024-09-12T03:36:04.874994+0000","last_fullsized":"2024-09-12T03:36:04.874994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:35.342838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.898536+0000","last_change":"2024-09-12T03:36:02.855536+0000","last_active":"2024-09-12T03:36:04.898536+0000","last_peered":"2024-09-12T03:36:04.898536+0000","last_clean":"2024-09-12T03:36:04.898536+0000","last_became_active":"2024-09-12T03:36:02.854828+0000","last_became_peered":"2024-09-12T03:36:02.854828+0000","last_unstale":"2024-09-12T03:36:04.898536+0000","last_undegraded":"2024-09-12T03:36:04.898536+0000","last_fullsized":"2024-09-12T03:36:04.898536+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:51.069854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.876242+0000","last_change":"2024-09-12T03:36:03.898125+0000","last_active":"2024-09-12T03:36:04.876242+0000","last_peered":"2024-09-12T03:36:04.876242+0000","last_clean":"2024-09-12T03:36:04.876242+0000","last_became_active":"2024-09-12T03:36:03.897809+0000","last_became_peered":"2024-09-12T03:36:03.897809+0000","last_unstale":"2024-09-12T03:36:04.876242+0000","last_undegraded":"2024-09-12T03:36:04.876242+0000","last_fullsized":"2024-09-12T03:36:04.876242+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:38.127048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896454+0000","last_change":"2024-09-12T03:36:02.867072+0000","last_active":"2024-09-12T03:36:04.896454+0000","last_peered":"2024-09-12T03:36:04.896454+0000","last_clean":"2024-09-12T03:36:04.896454+0000","last_became_active":"2024-09-12T03:36:02.866508+0000","last_became_peered":"2024-09-12T03:36:02.866508+0000","last_unstale":"2024-09-12T03:36:04.896454+0000","last_undegraded":"2024-09-12T03:36:04.896454+0000","last_fullsized":"2024-09-12T03:36:04.896454+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.096929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896348+0000","last_change":"2024-09-12T03:36:03.911599+0000","last_active":"2024-09-12T03:36:04.896348+0000","last_peered":"2024-09-12T03:36:04.896348+0000","last_clean":"2024-09-12T03:36:04.896348+0000","last_became_active":"2024-09-12T03:36:03.910939+0000","last_became_peered":"2024-09-12T03:36:03.910939+0000","last_unstale":"2024-09-12T03:36:04.896348+0000","last_undegraded":"2024-09-12T03:36:04.896348+0000","last_fullsized":"2024-09-12T03:36:04.896348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:55.976584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.876355+0000","last_change":"2024-09-12T03:36:02.852803+0000","last_active":"2024-09-12T03:36:04.876355+0000","last_peered":"2024-09-12T03:36:04.876355+0000","last_clean":"2024-09-12T03:36:04.876355+0000","last_became_active":"2024-09-12T03:36:02.851008+0000","last_became_peered":"2024-09-12T03:36:02.851008+0000","last_unstale":"2024-09-12T03:36:04.876355+0000","last_undegraded":"2024-09-12T03:36:04.876355+0000","last_fullsized":"2024-09-12T03:36:04.876355+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:32.172212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875911+0000","last_change":"2024-09-12T03:36:03.909631+0000","last_active":"2024-09-12T03:36:04.875911+0000","last_peered":"2024-09-12T03:36:04.875911+0000","last_clean":"2024-09-12T03:36:04.875911+0000","last_became_active":"2024-09-12T03:36:03.908881+0000","last_became_peered":"2024-09-12T03:36:03.908881+0000","last_unstale":"2024-09-12T03:36:04.875911+0000","last_undegraded":"2024-09-12T03:36:04.875911+0000","last_fullsized":"2024-09-12T03:36:04.875911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:48.701417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875418+0000","last_change":"2024-09-12T03:36:02.843975+0000","last_active":"2024-09-12T03:36:04.875418+0000","last_peered":"2024-09-12T03:36:04.875418+0000","last_clean":"2024-09-12T03:36:04.875418+0000","last_became_active":"2024-09-12T03:36:02.843709+0000","last_became_peered":"2024-09-12T03:36:02.843709+0000","last_unstale":"2024-09-12T03:36:04.875418+0000","last_undegraded":"2024-09-12T03:36:04.875418+0000","last_fullsized":"2024-09-12T03:36:04.875418+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:06.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896742+0000","last_change":"2024-09-12T03:36:03.911211+0000","last_active":"2024-09-12T03:36:04.896742+0000","last_peered":"2024-09-12T03:36:04.896742+0000","last_clean":"2024-09-12T03:36:04.896742+0000","last_became_active":"2024-09-12T03:36:03.903532+0000","last_became_peered":"2024-09-12T03:36:03.903532+0000","last_unstale":"2024-09-12T03:36:04.896742+0000","last_undegraded":"2024-09-12T03:36:04.896742+0000","last_fullsized":"2024-09-12T03:36:04.896742+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:14.499501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.896770+0000","last_change":"2024-09-12T03:36:02.848314+0000","last_active":"2024-09-12T03:36:04.896770+0000","last_peered":"2024-09-12T03:36:04.896770+0000","last_clean":"2024-09-12T03:36:04.896770+0000","last_became_active":"2024-09-12T03:36:02.847585+0000","last_became_peered":"2024-09-12T03:36:02.847585+0000","last_unstale":"2024-09-12T03:36:04.896770+0000","last_undegraded":"2024-09-12T03:36:04.896770+0000","last_fullsized":"2024-09-12T03:36:04.896770+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:05.736635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875749+0000","last_change":"2024-09-12T03:36:03.902136+0000","last_active":"2024-09-12T03:36:04.875749+0000","last_peered":"2024-09-12T03:36:04.875749+0000","last_clean":"2024-09-12T03:36:04.875749+0000","last_became_active":"2024-09-12T03:36:03.901825+0000","last_became_peered":"2024-09-12T03:36:03.901825+0000","last_unstale":"2024-09-12T03:36:04.875749+0000","last_undegraded":"2024-09-12T03:36:04.875749+0000","last_fullsized":"2024-09-12T03:36:04.875749+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:42.020499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.875506+0000","last_change":"2024-09-12T03:36:02.839610+0000","last_active":"2024-09-12T03:36:04.875506+0000","last_peered":"2024-09-12T03:36:04.875506+0000","last_clean":"2024-09-12T03:36:04.875506+0000","last_became_active":"2024-09-12T03:36:02.838878+0000","last_became_peered":"2024-09-12T03:36:02.838878+0000","last_unstale":"2024-09-12T03:36:04.875506+0000","last_undegraded":"2024-09-12T03:36:04.875506+0000","last_fullsized":"2024-09-12T03:36:04.875506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:16.100233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.897060+0000","last_change":"2024-09-12T03:36:03.896708+0000","last_active":"2024-09-12T03:36:04.897060+0000","last_peered":"2024-09-12T03:36:04.897060+0000","last_clean":"2024-09-12T03:36:04.897060+0000","last_became_active":"2024-09-12T03:36:03.895171+0000","last_became_peered":"2024-09-12T03:36:03.895171+0000","last_unstale":"2024-09-12T03:36:04.897060+0000","last_undegraded":"2024-09-12T03:36:04.897060+0000","last_fullsized":"2024-09-12T03:36:04.897060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:02.820414+0000","last_clean_scrub_stamp":"2024-09-12T03:36:02.820414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:14.320878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"51'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.900762+0000","last_change":"2024-09-12T03:36:02.867071+0000","last_active":"2024-09-12T03:36:04.900762+0000","last_peered":"2024-09-12T03:36:04.900762+0000","last_clean":"2024-09-12T03:36:04.900762+0000","last_became_active":"2024-09-12T03:36:02.864950+0000","last_became_peered":"2024-09-12T03:36:02.864950+0000","last_unstale":"2024-09-12T03:36:04.900762+0000","last_undegraded":"2024-09-12T03:36:04.900762+0000","last_fullsized":"2024-09-12T03:36:04.900762+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:01.816620+0000","last_clean_scrub_stamp":"2024-09-12T03:36:01.816620+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:07.534303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":221,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-12T03:36:04.895414+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:04.895414+0000","last_peered":"2024-09-12T03:36:04.895414+0000","last_clean":"2024-09-12T03:36:04.895414+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:04.895414+0000","last_undegraded":"2024-09-12T03:36:04.895414+0000","last_fullsized":"2024-09-12T03:36:04.895414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28204,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343636,"statfs":{"total":96636764160,"available":96607883264,"internally_reserved":0,"allocated":1200128,"data_stored":855552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":598016,"data_stored":265060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":602112,"data_stored":265642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":614400,"data_stored":266694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":610304,"data_stored":266672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":606208,"data_stored":265220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":606208,"data_stored":265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1200128,"data_stored":855484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:12.665 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:36:12.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T03:36:12.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f995b04a640 1 Processor -- start 2024-09-12T03:36:12.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f995b04a640 1 -- start start 2024-09-12T03:36:12.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f995b04a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 0x7f99540cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f995b04a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99540ce8d0 con 0x7f99540cdfd0 2024-09-12T03:36:12.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f995b04a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99540cebb0 con 0x7f9954073100 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f995b04a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f99540cee90 con 0x7f99540cc870 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f99595e7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f99540cdfd0 0x7f995406de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44944/0 (socket says 172.21.15.73:44944) 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.834+0000 7f99595e7640 1 -- 172.21.15.73:0/1997409420 learned_addr learned my addr 172.21.15.73:0/1997409420 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9958de6640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 0x7f99540cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699437095 0 0) 0x7f99540ce8d0 con 0x7f99540cdfd0 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9944003530 con 0x7f99540cdfd0 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3973820722 0 0) 0x7f9944003530 con 0x7f99540cdfd0 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 msgr2=0x7f99540cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 0x7f99540cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 >> v1:172.21.15.150:6789/0 conn(0x7f9954073100 legacy=0x7f99540ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99540cf170 con 0x7f99540cdfd0 2024-09-12T03:36:12.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f994c001a00 con 0x7f99540cdfd0 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 >> v1:172.21.15.73:6789/0 conn(0x7f99540cdfd0 legacy=0x7f995406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99440039f0 0x7f9944003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9944004810 0x7f9944004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 0x7f99440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f99540cee90 con 0x7f9944004810 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f994400ba80 con 0x7f99440039f0 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f994400bc80 con 0x7f99540cc870 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9953fff640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9944004810 0x7f9944004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9958de6640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99440039f0 0x7f9944003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99595e7640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 0x7f99440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9953fff640 1 -- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 msgr2=0x7f99440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:12.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9953fff640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 0x7f99440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9953fff640 1 -- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99440039f0 msgr2=0x7f9944003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9953fff640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99440039f0 0x7f9944003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9953fff640 1 -- 172.21.15.73:0/1997409420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9944003530 con 0x7f9944004810 2024-09-12T03:36:12.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99595e7640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99540cc870 0x7f99440051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f9953fff640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9944004810 0x7f9944004c90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f995406cd10 tx=0x7f994801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255b045edf8c486e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99480013a0 con 0x7f9944004810 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99480052f0 con 0x7f9944004810 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.838+0000 7f99537fe640 1 -- 172.21.15.73:0/1997409420 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948003840 con 0x7f9944004810 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1997409420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9944004810 msgr2=0x7f9944004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 --2- 172.21.15.73:0/1997409420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9944004810 0x7f9944004c90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f995406cd10 tx=0x7f994801c360 comp rx=0 tx=0).stop 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 -- 172.21.15.73:0/1997409420 reap_dead start 2024-09-12T03:36:12.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1997409420 shutdown_connections 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1997409420 >> 172.21.15.73:0/1997409420 conn(0x7f99540b1c80 msgr2=0x7f99540b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1997409420 shutdown_connections 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1997409420 wait complete. 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 Processor -- start 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- start start 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9944004810 0x7f99540ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99540ae750 0x7f995415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995415ce60 0x7f9954142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9954145fd0 con 0x7f995415ce60 2024-09-12T03:36:12.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9954145e50 con 0x7f99540ae750 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f99540ce480 con 0x7f9944004810 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995415ce60 0x7f9954142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995415ce60 0x7f9954142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59880/0 (socket says 172.21.15.73:59880) 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 -- 172.21.15.73:0/1963688479 learned_addr learned my addr 172.21.15.73:0/1963688479 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f9958de6640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9944004810 0x7f99540ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f9953fff640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99540ae750 0x7f995415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 -- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9944004810 msgr2=0x7f99540ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9944004810 0x7f99540ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 -- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99540ae750 msgr2=0x7f995415c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99540ae750 0x7f995415c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:12.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 -- 172.21.15.73:0/1963688479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99541456d0 con 0x7f995415ce60 2024-09-12T03:36:12.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99595e7640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995415ce60 0x7f9954142a50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99540ce3b0 tx=0x7f994c010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:12.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99517fa640 1 -- 172.21.15.73:0/1963688479 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c01a070 con 0x7f995415ce60 2024-09-12T03:36:12.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99517fa640 1 -- 172.21.15.73:0/1963688479 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c011040 con 0x7f995415ce60 2024-09-12T03:36:12.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99540aef50 con 0x7f995415ce60 2024-09-12T03:36:12.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f99517fa640 1 -- 172.21.15.73:0/1963688479 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c00ece0 con 0x7f995415ce60 2024-09-12T03:36:12.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99540ada10 con 0x7f995415ce60 2024-09-12T03:36:12.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.842+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99540cf970 con 0x7f995415ce60 2024-09-12T03:36:12.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.846+0000 7f99517fa640 1 -- 172.21.15.73:0/1963688479 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f994c01d070 con 0x7f995415ce60 2024-09-12T03:36:12.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.846+0000 7f99517fa640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99380678f0 0x7f9938069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:12.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.846+0000 7f99517fa640 1 -- 172.21.15.73:0/1963688479 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f994c0885a0 con 0x7f995415ce60 2024-09-12T03:36:12.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.846+0000 7f9958de6640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99380678f0 0x7f9938069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:12.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.846+0000 7f9958de6640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99380678f0 0x7f9938069db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9954144890 tx=0x7f9940008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:12.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:12.850+0000 7f99517fa640 1 -- 172.21.15.73:0/1963688479 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f994c059010 con 0x7f995415ce60 2024-09-12T03:36:13.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.062+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f99540af8d0 con 0x7f995415ce60 2024-09-12T03:36:13.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.062+0000 7f99517fa640 1 -- 172.21.15.73:0/1963688479 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f994c058910 con 0x7f995415ce60 2024-09-12T03:36:13.067 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T03:36:13.067 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:36:13.067 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-09-12T03:36:13.067 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-09-12T03:36:13.067 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T03:36:13.067 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99380678f0 msgr2=0x7f9938069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99380678f0 0x7f9938069db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9954144890 tx=0x7f9940008040 comp rx=0 tx=0).stop 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995415ce60 msgr2=0x7f9954142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995415ce60 0x7f9954142a50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99540ce3b0 tx=0x7f994c010d70 comp rx=0 tx=0).stop 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 shutdown_connections 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99380678f0 0x7f9938069db0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f995415ce60 0x7f9954142a50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99540ae750 0x7f995415c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 --2- 172.21.15.73:0/1963688479 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9944004810 0x7f99540ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 >> 172.21.15.73:0/1963688479 conn(0x7f99540b1c80 msgr2=0x7f99540b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:13.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 shutdown_connections 2024-09-12T03:36:13.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.066+0000 7f995b04a640 1 -- 172.21.15.73:0/1963688479 wait complete. 2024-09-12T03:36:13.085 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 Processor -- start 2024-09-12T03:36:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 -- start start 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6d406fe50 0x7fd6d415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6d415f1d0 0x7fd6d4071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d4152480 con 0x7fd6d415f1d0 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd6d4070250 con 0x7fd6d406fe50 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6db5ff640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d40aede0 con 0x7fd6d41520a0 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6d415f1d0 0x7fd6d4071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6d415f1d0 0x7fd6d4071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59884/0 (socket says 172.21.15.73:59884) 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 -- 172.21.15.73:0/3355887807 learned_addr learned my addr 172.21.15.73:0/3355887807 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d939b640 1 --2- 172.21.15.73:0/3355887807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d8b9a640 1 --2- 172.21.15.73:0/3355887807 >> v2:172.21.15.150:3300/0 conn(0x7fd6d406fe50 0x7fd6d415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 -- 172.21.15.73:0/3355887807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 msgr2=0x7fd6d406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 --2- 172.21.15.73:0/3355887807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 -- 172.21.15.73:0/3355887807 >> v2:172.21.15.150:3300/0 conn(0x7fd6d406fe50 msgr2=0x7fd6d415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 --2- 172.21.15.73:0/3355887807 >> v2:172.21.15.150:3300/0 conn(0x7fd6d406fe50 0x7fd6d415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.198+0000 7fd6d9b9c640 1 -- 172.21.15.73:0/3355887807 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d415fa10 con 0x7fd6d415f1d0 2024-09-12T03:36:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d9b9c640 1 --2- 172.21.15.73:0/3355887807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d415f1d0 0x7fd6d4071f10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd6d406de20 tx=0x7fd6cc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72643c73dbea931d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d3fff640 1 -- 172.21.15.73:0/3355887807 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0b0070 con 0x7fd6d415f1d0 2024-09-12T03:36:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d3fff640 1 -- 172.21.15.73:0/3355887807 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0ab600 con 0x7fd6d415f1d0 2024-09-12T03:36:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d3fff640 1 -- 172.21.15.73:0/3355887807 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0ab9d0 con 0x7fd6d415f1d0 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- 172.21.15.73:0/3355887807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d415f1d0 msgr2=0x7fd6d4071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/3355887807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d415f1d0 0x7fd6d4071f10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd6d406de20 tx=0x7fd6cc01c240 comp rx=0 tx=0).stop 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- 172.21.15.73:0/3355887807 shutdown_connections 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/3355887807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d415f1d0 0x7fd6d4071f10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/3355887807 >> v2:172.21.15.150:3300/0 conn(0x7fd6d406fe50 0x7fd6d415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/3355887807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- 172.21.15.73:0/3355887807 >> 172.21.15.73:0/3355887807 conn(0x7fd6d40b1f90 msgr2=0x7fd6d40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- 172.21.15.73:0/3355887807 shutdown_connections 2024-09-12T03:36:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- 172.21.15.73:0/3355887807 wait complete. 2024-09-12T03:36:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 Processor -- start 2024-09-12T03:36:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- start start 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d406fe50 0x7fd6d4099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d414d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d415f1d0 0x7fd6d40cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4073d30 con 0x7fd6d406fe50 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d4073a50 con 0x7fd6d415f1d0 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6d415f680 con 0x7fd6d41520a0 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d406fe50 0x7fd6d4099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d406fe50 0x7fd6d4099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59894/0 (socket says 172.21.15.73:59894) 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 -- 172.21.15.73:0/19465566 learned_addr learned my addr 172.21.15.73:0/19465566 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d8b9a640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d414d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d9b9c640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d415f1d0 0x7fd6d40cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 -- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 msgr2=0x7fd6d414d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d414d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 -- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d415f1d0 msgr2=0x7fd6d40cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d415f1d0 0x7fd6d40cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 -- 172.21.15.73:0/19465566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d414daf0 con 0x7fd6d406fe50 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d9b9c640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d415f1d0 0x7fd6d40cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d939b640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d406fe50 0x7fd6d4099a40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400d830 tx=0x7fd6c400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d1ffb640 1 -- 172.21.15.73:0/19465566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400b6c0 con 0x7fd6d406fe50 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d1ffb640 1 -- 172.21.15.73:0/19465566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c4019070 con 0x7fd6d406fe50 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d414ddd0 con 0x7fd6d406fe50 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.202+0000 7fd6d1ffb640 1 -- 172.21.15.73:0/19465566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400ba60 con 0x7fd6d406fe50 2024-09-12T03:36:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.206+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d414e390 con 0x7fd6d406fe50 2024-09-12T03:36:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.206+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d406f910 con 0x7fd6d406fe50 2024-09-12T03:36:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.206+0000 7fd6d1ffb640 1 -- 172.21.15.73:0/19465566 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6c401e460 con 0x7fd6d406fe50 2024-09-12T03:36:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.206+0000 7fd6d1ffb640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6c00678c0 0x7fd6c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.206+0000 7fd6d1ffb640 1 -- 172.21.15.73:0/19465566 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd6c4086fc0 con 0x7fd6d406fe50 2024-09-12T03:36:13.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.206+0000 7fd6d8b9a640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6c00678c0 0x7fd6c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.206+0000 7fd6d8b9a640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6c00678c0 0x7fd6c0069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40cd220 tx=0x7fd6c800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.210+0000 7fd6d1ffb640 1 -- 172.21.15.73:0/19465566 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd6c4057a50 con 0x7fd6d406fe50 2024-09-12T03:36:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.398+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6d40b2b60 con 0x7fd6d406fe50 2024-09-12T03:36:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.398+0000 7fd6d1ffb640 1 -- 172.21.15.73:0/19465566 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5223 (secure 0 0 0) 0x7fd6c4057350 con 0x7fd6d406fe50 2024-09-12T03:36:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:13.401 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-12T03:36:06:880174+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4068395780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4068395780},{"type":"v1","addr":"172.21.15.150:6833","nonce":4068395780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/801266996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":801266996},{"type":"v1","addr":"172.21.15.150:6835","nonce":801266996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/204856876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":204856876},{"type":"v1","addr":"172.21.15.73:6835","nonce":204856876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:03.212172+0000","modified":"2024-09-12T03:36:06.243489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5220":{"gid":5220,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3307908616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3307908616},{"type":"v1","addr":"172.21.15.73:6837","nonce":3307908616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5220,"qdb_cluster":[5220]},"id":3}]} 2024-09-12T03:36:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-12T03:36:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6c00678c0 msgr2=0x7fd6c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6c00678c0 0x7fd6c0069d80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40cd220 tx=0x7fd6c800b040 comp rx=0 tx=0).stop 2024-09-12T03:36:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d406fe50 msgr2=0x7fd6d4099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d406fe50 0x7fd6d4099a40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400d830 tx=0x7fd6c400dcf0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 shutdown_connections 2024-09-12T03:36:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6c00678c0 0x7fd6c0069d80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6d415f1d0 0x7fd6d40cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6d41520a0 0x7fd6d414d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 --2- 172.21.15.73:0/19465566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d406fe50 0x7fd6d4099a40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 >> 172.21.15.73:0/19465566 conn(0x7fd6d40b1f90 msgr2=0x7fd6d40ae460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 shutdown_connections 2024-09-12T03:36:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.402+0000 7fd6db5ff640 1 -- 172.21.15.73:0/19465566 wait complete. 2024-09-12T03:36:13.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:36:03.212172+0000', 'modified': '2024-09-12T03:36:06.243489+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5220}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5220': {'gid': 5220, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/3307908616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3307908616}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3307908616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5220, 'qdb_cluster': [5220]} 2024-09-12T03:36:13.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:36:13.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T03:36:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe6736f0640 1 Processor -- start 2024-09-12T03:36:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe6736f0640 1 -- start start 2024-09-12T03:36:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe6736f0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe66c0d2ef0 0x7fe66c0d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe6736f0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66c0d1690 con 0x7fe66c0cf900 2024-09-12T03:36:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe6736f0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe66c0d1970 con 0x7fe66c0d4080 2024-09-12T03:36:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe6736f0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe66c0d1c50 con 0x7fe66c0d2ef0 2024-09-12T03:36:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe66c0cf900 0x7fe66c0cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44946/0 (socket says 172.21.15.73:44946) 2024-09-12T03:36:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 -- 172.21.15.73:0/3235480073 learned_addr learned my addr 172.21.15.73:0/3235480073 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe67148c640 1 --2- 172.21.15.73:0/3235480073 >> v2:172.21.15.150:3300/0 conn(0x7fe66c0d2ef0 0x7fe66c0d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980805355 0 0) 0x7fe66c0d1690 con 0x7fe66c0cf900 2024-09-12T03:36:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe658003530 con 0x7fe66c0cf900 2024-09-12T03:36:13.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3790847076 0 0) 0x7fe658003530 con 0x7fe66c0cf900 2024-09-12T03:36:13.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 >> v2:172.21.15.150:3300/0 conn(0x7fe66c0d2ef0 msgr2=0x7fe66c0d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 --2- 172.21.15.73:0/3235480073 >> v2:172.21.15.150:3300/0 conn(0x7fe66c0d2ef0 0x7fe66c0d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 >> v1:172.21.15.150:6789/0 conn(0x7fe66c0d4080 legacy=0x7fe66c0d44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c0cf100 con 0x7fe66c0cf900 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fe65c001680 con 0x7fe66c0cf900 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 >> v1:172.21.15.73:6789/0 conn(0x7fe66c0cf900 legacy=0x7fe66c0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6580039c0 0x7fe658003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe658004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6580051d0 0x7fe65800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c0d1c50 con 0x7fe658004810 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe65800c070 con 0x7fe6580051d0 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe65800c270 con 0x7fe6580039c0 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe658004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe67148c640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6580039c0 0x7fe658003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 -- 172.21.15.73:0/3235480073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6580039c0 msgr2=0x7fe658003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6580039c0 0x7fe658003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 -- 172.21.15.73:0/3235480073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6580051d0 msgr2=0x7fe65800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6580051d0 0x7fe65800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe671c8d640 1 -- 172.21.15.73:0/3235480073 reap_dead start 2024-09-12T03:36:13.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.954+0000 7fe670c8b640 1 -- 172.21.15.73:0/3235480073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe658003530 con 0x7fe658004810 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe658004c90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00c1c0 tx=0x7fe65c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c68eaf9a6ccd1c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c007d00 con 0x7fe658004810 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c005b00 con 0x7fe658004810 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe663fff640 1 -- 172.21.15.73:0/3235480073 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c007070 con 0x7fe658004810 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe6736f0640 1 -- 172.21.15.73:0/3235480073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 msgr2=0x7fe658004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe6736f0640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe658004c90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00c1c0 tx=0x7fe65c01f3d0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe6736f0640 1 -- 172.21.15.73:0/3235480073 shutdown_connections 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe6736f0640 1 --2- 172.21.15.73:0/3235480073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe658004c90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe6736f0640 1 -- 172.21.15.73:0/3235480073 >> 172.21.15.73:0/3235480073 conn(0x7fe66c09d710 msgr2=0x7fe66c08bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe6736f0640 1 -- 172.21.15.73:0/3235480073 shutdown_connections 2024-09-12T03:36:13.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.958+0000 7fe6736f0640 1 -- 172.21.15.73:0/3235480073 wait complete. 2024-09-12T03:36:13.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 Processor -- start 2024-09-12T03:36:13.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 -- start start 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe66c149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe66c14af70 0x7fe66c14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe66c14a6a0 0x7fe66c148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c0cfd50 con 0x7fe658004810 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c0cf470 con 0x7fe66c14a6a0 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c0cfed0 con 0x7fe66c14af70 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe66c149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe66c149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59922/0 (socket says 172.21.15.73:59922) 2024-09-12T03:36:13.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 -- 172.21.15.73:0/1861140818 learned_addr learned my addr 172.21.15.73:0/1861140818 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe671c8d640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe66c14a6a0 0x7fe66c148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe670c8b640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe66c14af70 0x7fe66c14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 -- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe66c14af70 msgr2=0x7fe66c14a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe66c14af70 0x7fe66c14a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 -- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe66c14a6a0 msgr2=0x7fe66c148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe66c14a6a0 0x7fe66c148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 -- 172.21.15.73:0/1861140818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c0cc030 con 0x7fe658004810 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe67148c640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe66c149c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe6680116c0 tx=0x7fe668011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe661ffb640 1 -- 172.21.15.73:0/1861140818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800f960 con 0x7fe658004810 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe661ffb640 1 -- 172.21.15.73:0/1861140818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66800fb00 con 0x7fe658004810 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe661ffb640 1 -- 172.21.15.73:0/1861140818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668015460 con 0x7fe658004810 2024-09-12T03:36:13.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c0cc310 con 0x7fe658004810 2024-09-12T03:36:13.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.962+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c0cc8d0 con 0x7fe658004810 2024-09-12T03:36:13.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe661ffb640 1 -- 172.21.15.73:0/1861140818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe668015600 con 0x7fe658004810 2024-09-12T03:36:13.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe661ffb640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe6500678c0 0x7fe650069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe670c8b640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe6500678c0 0x7fe650069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe661ffb640 1 -- 172.21.15.73:0/1861140818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe668086890 con 0x7fe658004810 2024-09-12T03:36:13.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe670c8b640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe6500678c0 0x7fe650069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0ae000 tx=0x7fe65c007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 Processor -- start 2024-09-12T03:36:13.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- start start 2024-09-12T03:36:13.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd3b20 0x557cddfd3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd4440 0x557cddf89d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddf8a290 0x557cddf8a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557cdde71b60 con 0x557cddf8a290 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557cdddd8c70 con 0x557cddfd4440 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x557cddd7eed0 con 0x557cddfd3b20 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddf8a290 0x557cddf8a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddf8a290 0x557cddf8a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59938/0 (socket says 172.21.15.73:59938) 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 -- 172.21.15.73:0/2249760259 learned_addr learned my addr 172.21.15.73:0/2249760259 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe670c8b640 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd4440 0x557cddf89d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe67148c640 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd3b20 0x557cddfd3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 -- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd3b20 msgr2=0x557cddfd3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd3b20 0x557cddfd3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 -- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd4440 msgr2=0x557cddf89d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd4440 0x557cddf89d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 -- 172.21.15.73:0/2249760259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cddd90e50 con 0x557cddf8a290 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe671c8d640 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddf8a290 0x557cddf8a670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0d0460 tx=0x7fe664001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0f89e2641099b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe64effd640 1 -- 172.21.15.73:0/2249760259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664018070 con 0x557cddf8a290 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe64effd640 1 -- 172.21.15.73:0/2249760259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe664005d60 con 0x557cddf8a290 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe64effd640 1 -- 172.21.15.73:0/2249760259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6640072d0 con 0x557cddf8a290 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- 172.21.15.73:0/2249760259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddf8a290 msgr2=0x557cddf8a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddf8a290 0x557cddf8a670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0d0460 tx=0x7fe664001d30 comp rx=0 tx=0).stop 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- 172.21.15.73:0/2249760259 shutdown_connections 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddf8a290 0x557cddf8a670 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd4440 0x557cddf89d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 --2- 172.21.15.73:0/2249760259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd3b20 0x557cddfd3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- 172.21.15.73:0/2249760259 >> 172.21.15.73:0/2249760259 conn(0x557cddf90600 msgr2=0x557cddf88630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:13.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- 172.21.15.73:0/2249760259 shutdown_connections 2024-09-12T03:36:13.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.966+0000 7fe6767ac000 1 -- 172.21.15.73:0/2249760259 wait complete. 2024-09-12T03:36:13.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- start start 2024-09-12T03:36:13.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 Processor -- start 2024-09-12T03:36:13.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddf8ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 0x557cddf94cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 0x557cddf95230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557cdde3ab00 con 0x557cddfd3b20 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557cdddb3360 con 0x557cddf8f390 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x557cdddb02d0 con 0x557cddfd4440 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 10 client.0 _ll_register_callbacks cb 0x557cddf75820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddf8ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddf8ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59952/0 (socket says 172.21.15.73:59952) 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 -- 172.21.15.73:0/3977280930 learned_addr learned my addr 172.21.15.73:0/3977280930 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 0x557cddf94cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe671c8d640 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 0x557cddf95230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 -- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 msgr2=0x557cddf94cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 0x557cddf94cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 -- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 msgr2=0x557cddf95230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 0x557cddf95230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 -- 172.21.15.73:0/3977280930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cddd7f120 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe67148c640 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddf8ee50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe668052f00 tx=0x7fe6680572e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679abe4d221e1bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 1 -- 172.21.15.73:0/3977280930 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668022040 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 1 -- 172.21.15.73:0/3977280930 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe66805f3f0 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe664005d60 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 1 -- 172.21.15.73:0/3977280930 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe66805f680 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 10 client.5376 fetch_fsmap learned FSMap version 24 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x557cddd78450 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 1 -- 172.21.15.73:0/3977280930 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe664005d60 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 1 -- 172.21.15.73:0/3977280930 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fe66805d0c0 con 0x557cddfd3b20 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 10 client.5376 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 10 client.5376 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 20 client.5376 populate_metadata read hostname 'smithi073' 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cddfe2280 0x557cddfe4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 4 client.5376 mds_command: new command op to 5220 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 --> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cddd72c00 con 0x557cddfe2280 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cddfe2280 0x557cddfe4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 10 client.5376 ms_handle_connect on v2:172.21.15.73:6836/3307908616 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cddfe2280 0x557cddfe4670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b5154a8841111a server_cookie=898f4c05975522bc in_seq=0 out_seq=0 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 1 -- 172.21.15.73:0/3977280930 <== mds.0 v2:172.21.15.73:6836/3307908616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cddd72c00 con 0x557cddfe2280 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe647fff640 10 client.5376 handle_command_reply: tid=0 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 client.5376 shutdown 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 msgr2=0x557cddf8ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.970+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddf8ee50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe668052f00 tx=0x7fe6680572e0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 shutdown_connections 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cddfe2280 0x557cddfe4670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 0x557cddf95230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 0x557cddf94cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe647fff640 0 client.5376 ms_handle_reset on v2:172.21.15.73:6836/3307908616 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3977280930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddf8ee50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 >> 172.21.15.73:0/3977280930 conn(0x557cddf8a290 msgr2=0x557cddf88d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 shutdown_connections 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 1 -- 172.21.15.73:0/3977280930 wait complete. 2024-09-12T03:36:13.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.974+0000 7fe6767ac000 20 client.5376 trim_cache size 0 max 16384 2024-09-12T03:36:13.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 Processor -- start 2024-09-12T03:36:13.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 -- start start 2024-09-12T03:36:13.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 0x557cddfd2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddfd31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 0x557cddfe4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c200630 con 0x557cddfd3b20 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c1ffb50 con 0x557cddf8f390 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe66c200040 con 0x557cddfd4440 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddfd31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddfd31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59958/0 (socket says 172.21.15.73:59958) 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 -- 172.21.15.73:0/657120180 learned_addr learned my addr 172.21.15.73:0/657120180 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 -- 172.21.15.73:0/657120180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 msgr2=0x557cddfe4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 --2- 172.21.15.73:0/657120180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 0x557cddfe4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 -- 172.21.15.73:0/657120180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 msgr2=0x557cddfd2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 --2- 172.21.15.73:0/657120180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 0x557cddfd2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 -- 172.21.15.73:0/657120180 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cddfd4270 con 0x557cddfd3b20 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe670c8b640 1 --2- 172.21.15.73:0/657120180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddfd31d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00c1c0 tx=0x7fe66c0d1b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6b54c777695b7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe64e7fc640 1 -- 172.21.15.73:0/657120180 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c007e60 con 0x557cddfd3b20 2024-09-12T03:36:13.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe64e7fc640 1 -- 172.21.15.73:0/657120180 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c007500 con 0x557cddfd3b20 2024-09-12T03:36:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.990+0000 7fe64e7fc640 1 -- 172.21.15.73:0/657120180 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0b1430 con 0x557cddfd3b20 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/657120180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 msgr2=0x557cddfd31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- 172.21.15.73:0/657120180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddfd31d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00c1c0 tx=0x7fe66c0d1b40 comp rx=0 tx=0).stop 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/657120180 shutdown_connections 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- 172.21.15.73:0/657120180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd3b20 0x557cddfd31d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- 172.21.15.73:0/657120180 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddfd4440 0x557cddfe4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- 172.21.15.73:0/657120180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddf8f390 0x557cddfd2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/657120180 >> 172.21.15.73:0/657120180 conn(0x557cddf8a290 msgr2=0x557cddf8e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/657120180 shutdown_connections 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/657120180 wait complete. 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- start start 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 Processor -- start 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddf8f390 0x557cddfe7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd3b20 0x557cde002960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd4440 0x557cde002ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557cdddd7f80 con 0x557cddfd4440 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x557cddd90ca0 con 0x557cddfd3b20 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x557cddddd2a0 con 0x557cddf8f390 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 10 client.0 _ll_register_callbacks cb 0x7fe66800feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd4440 0x557cde002ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd4440 0x557cde002ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59974/0 (socket says 172.21.15.73:59974) 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 -- 172.21.15.73:0/3380467641 learned_addr learned my addr 172.21.15.73:0/3380467641 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe67148c640 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddf8f390 0x557cddfe7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe670c8b640 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd3b20 0x557cde002960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 -- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddf8f390 msgr2=0x557cddfe7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddf8f390 0x557cddfe7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 -- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd3b20 msgr2=0x557cde002960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd3b20 0x557cde002960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 -- 172.21.15.73:0/3380467641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cddd5ffd0 con 0x557cddfd4440 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe671c8d640 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd4440 0x557cde002ea0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe664008000 tx=0x7fe664000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa44e5ea79c632a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 1 -- 172.21.15.73:0/3380467641 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664022070 con 0x557cddfd4440 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 1 -- 172.21.15.73:0/3380467641 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fe664007810 con 0x557cddfd4440 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe65c007500 con 0x557cddfd4440 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 1 -- 172.21.15.73:0/3380467641 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe66402d050 con 0x557cddfd4440 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 10 client.5382 fetch_fsmap learned FSMap version 24 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x557cdde5b750 con 0x557cddfd4440 2024-09-12T03:36:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 1 -- 172.21.15.73:0/3380467641 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe65c007500 con 0x557cddfd4440 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 1 -- 172.21.15.73:0/3380467641 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fe664030020 con 0x557cddfd4440 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 10 client.5382 fetch_fsmap finished waiting for FSMap version 24 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 10 client.5382 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 20 client.5382 populate_metadata read hostname 'smithi073' 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cde0033e0 0x557cde046f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 4 client.5382 mds_command: new command op to 5220 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 --> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] -- command(tid 0: {"prefix": "status"}) -- 0x557cddde63a0 con 0x557cde0033e0 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe67148c640 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cde0033e0 0x557cde046f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe67148c640 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cde0033e0 0x557cde046f30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d096bbd76dbdf2f server_cookie=c3ed5d429959562f in_seq=0 out_seq=0 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 10 client.5382 ms_handle_connect on v2:172.21.15.73:6836/3307908616 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 1 -- 172.21.15.73:0/3380467641 <== mds.0 v2:172.21.15.73:6836/3307908616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x557cddde63a0 con 0x557cde0033e0 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.994+0000 7fe647fff640 10 client.5382 handle_command_reply: tid=0 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 client.5382 shutdown 2024-09-12T03:36:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd4440 msgr2=0x557cde002ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd4440 0x557cde002ea0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe664008000 tx=0x7fe664000f50 comp rx=0 tx=0).stop 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 shutdown_connections 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:6836/3307908616,v1:172.21.15.73:6837/3307908616] conn(0x557cde0033e0 0x557cde046f30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557cddfd4440 0x557cde002ea0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557cddfd3b20 0x557cde002960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe647fff640 0 client.5382 ms_handle_reset on v2:172.21.15.73:6836/3307908616 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 --2- 172.21.15.73:0/3380467641 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557cddf8f390 0x557cddfe7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 >> 172.21.15.73:0/3380467641 conn(0x557cddf8a290 msgr2=0x557cddfd1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 shutdown_connections 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 1 -- 172.21.15.73:0/3380467641 wait complete. 2024-09-12T03:36:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6767ac000 20 client.5382 trim_cache size 0 max 16384 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5220, 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.104939498, 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 24, 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 51, 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 51, 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 15.498177594 2024-09-12T03:36:14.005 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:36:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe6500678c0 msgr2=0x7fe650069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe6500678c0 0x7fe650069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0ae000 tx=0x7fe65c007040 comp rx=0 tx=0).stop 2024-09-12T03:36:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 msgr2=0x7fe66c149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe66c149c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe6680116c0 tx=0x7fe668011b80 comp rx=0 tx=0).stop 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 shutdown_connections 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe6500678c0 0x7fe650069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe66c14a6a0 0x7fe66c148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe66c14af70 0x7fe66c14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 --2- 172.21.15.73:0/1861140818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe658004810 0x7fe66c149c20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 >> 172.21.15.73:0/1861140818 conn(0x7fe66c09d710 msgr2=0x7fe66c0b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 shutdown_connections 2024-09-12T03:36:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:13.998+0000 7fe6736f0640 1 -- 172.21.15.73:0/1861140818 wait complete. 2024-09-12T03:36:14.015 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:36:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.114+0000 7f017eac4640 1 Processor -- start 2024-09-12T03:36:14.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.114+0000 7f017eac4640 1 -- start start 2024-09-12T03:36:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.114+0000 7f017eac4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 0x7f01780ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017eac4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01780b3290 con 0x7f017815c2a0 2024-09-12T03:36:14.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017eac4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01780b3570 con 0x7f01780af470 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017eac4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f01780b3850 con 0x7f017815bec0 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f0177fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f017815c2a0 0x7f01780aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44958/0 (socket says 172.21.15.73:44958) 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f0177fff640 1 -- 172.21.15.73:0/2232200662 learned_addr learned my addr 172.21.15.73:0/2232200662 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496776582 0 0) 0x7f01780b3290 con 0x7f017815c2a0 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0160003530 con 0x7f017815c2a0 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017c860640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 0x7f01780ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2526843442 0 0) 0x7f0160003530 con 0x7f017815c2a0 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 msgr2=0x7f01780ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 0x7f01780ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 >> v1:172.21.15.150:6789/0 conn(0x7f01780af470 legacy=0x7f017806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01780b3b30 con 0x7f017815c2a0 2024-09-12T03:36:14.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f016c001680 con 0x7f017815c2a0 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 >> v1:172.21.15.73:6789/0 conn(0x7f017815c2a0 legacy=0x7f01780aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 0x7f01600039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0160004020 0x7f0160004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f01600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f01780b3850 con 0x7f0160004d50 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f016000bb90 con 0x7f0160004020 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f016000bd90 con 0x7f017815bec0 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f01600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017c860640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 0x7f01600039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f0177fff640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0160004020 0x7f0160004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 -- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 msgr2=0x7f01600039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f017815bec0 0x7f01600039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 -- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0160004020 msgr2=0x7f0160004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:14.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0160004020 0x7f0160004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 -- 172.21.15.73:0/2232200662 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0160003530 con 0x7f0160004d50 2024-09-12T03:36:14.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f0177fff640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0160004020 0x7f0160004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:14.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f01600051d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0170001e70 tx=0x7f017001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1741c445635e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170001a90 con 0x7f0160004d50 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0170003b80 con 0x7f0160004d50 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f01777fe640 1 -- 172.21.15.73:0/2232200662 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170005080 con 0x7f0160004d50 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017eac4640 1 -- 172.21.15.73:0/2232200662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 msgr2=0x7f01600051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017eac4640 1 --2- 172.21.15.73:0/2232200662 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f01600051d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0170001e70 tx=0x7f017001c780 comp rx=0 tx=0).stop 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.118+0000 7f017d061640 1 -- 172.21.15.73:0/2232200662 reap_dead start 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- 172.21.15.73:0/2232200662 shutdown_connections 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- 172.21.15.73:0/2232200662 >> 172.21.15.73:0/2232200662 conn(0x7f01780b1f90 msgr2=0x7f01780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- 172.21.15.73:0/2232200662 shutdown_connections 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- 172.21.15.73:0/2232200662 wait complete. 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 Processor -- start 2024-09-12T03:36:14.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- start start 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f0178147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0178155b70 0x7f01781f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0178071f10 0x7f0178072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f01780afc90 con 0x7f0160004d50 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f01780b40f0 con 0x7f0178071f10 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f01780ad200 con 0x7f0178155b70 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f0178147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f0178147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59996/0 (socket says 172.21.15.73:59996) 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 -- 172.21.15.73:0/1891599237 learned_addr learned my addr 172.21.15.73:0/1891599237 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017d061640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0178071f10 0x7f0178072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f0177fff640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0178155b70 0x7f01781f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 -- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0178155b70 msgr2=0x7f01781f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0178155b70 0x7f01781f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 -- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0178071f10 msgr2=0x7f0178072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0178071f10 0x7f0178072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 -- 172.21.15.73:0/1891599237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01781f8070 con 0x7f0160004d50 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017c860640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f0178147630 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f016800f680 tx=0x7f016800fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f01757fa640 1 -- 172.21.15.73:0/1891599237 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168019020 con 0x7f0160004d50 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f01757fa640 1 -- 172.21.15.73:0/1891599237 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016800d900 con 0x7f0160004d50 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01781f8350 con 0x7f0160004d50 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f01757fa640 1 -- 172.21.15.73:0/1891599237 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016800dcf0 con 0x7f0160004d50 2024-09-12T03:36:14.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01781e5c80 con 0x7f0160004d50 2024-09-12T03:36:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.122+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01780ad5e0 con 0x7f0160004d50 2024-09-12T03:36:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.126+0000 7f01757fa640 1 -- 172.21.15.73:0/1891599237 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f016801c020 con 0x7f0160004d50 2024-09-12T03:36:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.126+0000 7f01757fa640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01640678f0 0x7f0164069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.126+0000 7f01757fa640 1 -- 172.21.15.73:0/1891599237 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f0168086620 con 0x7f0160004d50 2024-09-12T03:36:14.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.126+0000 7f0177fff640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01640678f0 0x7f0164069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:14.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.126+0000 7f0177fff640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01640678f0 0x7f0164069db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f016c001210 tx=0x7f016c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:14.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.130+0000 7f01757fa640 1 -- 172.21.15.73:0/1891599237 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0168023020 con 0x7f0160004d50 2024-09-12T03:36:14.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.310+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f017806fcd0 con 0x7f0160004d50 2024-09-12T03:36:14.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.310+0000 7f01757fa640 1 -- 172.21.15.73:0/1891599237 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f0168056fd0 con 0x7f0160004d50 2024-09-12T03:36:14.314 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01640678f0 msgr2=0x7f0164069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01640678f0 0x7f0164069db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f016c001210 tx=0x7f016c009040 comp rx=0 tx=0).stop 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 msgr2=0x7f0178147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f0178147630 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f016800f680 tx=0x7f016800fb40 comp rx=0 tx=0).stop 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 shutdown_connections 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01640678f0 0x7f0164069db0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0178071f10 0x7f0178072390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0178155b70 0x7f01781f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 --2- 172.21.15.73:0/1891599237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160004d50 0x7f0178147630 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 >> 172.21.15.73:0/1891599237 conn(0x7f01780b1f90 msgr2=0x7f017815ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:14.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 shutdown_connections 2024-09-12T03:36:14.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14.314+0000 7f017eac4640 1 -- 172.21.15.73:0/1891599237 wait complete. 2024-09-12T03:36:14.331 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:36:14.331 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:36:14.331 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:36:14.331 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T03:36:14.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:14.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:36:14.332 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:36:14.332 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:36:14.332 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:36:14.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:14.332 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:14.338 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42394sec preferred_lft 42394sec 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:36:14.339 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:14.340 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:36:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.341 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:36:14.341 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:14.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:14.341 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:36:14.392 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:36:14.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:14.394 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:36:14.442 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:36:14.442 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:36:14.442 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:36:14.443 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:36:14.443 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:36:14.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:36:14.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:36:14.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:36:14.444 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:36:14.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:36:14.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:14.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:14.565 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:36:14.611 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T03:36:14.612 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:36:14.612 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:36:14.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:14.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:36:14.671 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T03:36:14.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:14.671 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:14.723 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:36:14.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:14.723 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:14.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:36:14.829 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:14.877 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:36:14.878 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:36:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:14.880 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:14.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:14.881 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:36:14.927 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:36:14.927 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T03:36:14.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:36:14.987 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:15.035 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:36:15.036 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:36:15.037 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:36:15.038 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:36:15.038 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:36:15.038 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:36:15.038 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:15.038 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:15.038 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:15.038 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:15.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:15.039 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:36:15.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-09-12T03:36:15.050+0000 7f48e69d5580 -1 init, newargv = 0x559f83e6ce70 newargc=15 2024-09-12T03:36:15.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[39153]: starting ceph client 2024-09-12T03:36:15.057 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[39153]: starting fuse 2024-09-12T03:36:16.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:36:16.173 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:36:16.221 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:36:16.222 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:16.223 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:16.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:16.224 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:36:16.271 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:36:16.272 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:36:16.272 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:36:16.273 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:36:16.274 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:36:16.274 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:16.274 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-09-12T03:36:16.274 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:36:16.396 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.39153.asok 2024-09-12T03:36:16.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:16.407 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39153.asok 2024-09-12T03:36:16.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:16.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39153.asok status 2024-09-12T03:36:16.561 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:36:16.561 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:36:16.561 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:36:16.561 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:36:16.561 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "39153", 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5394, 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5394 2024-09-12T03:36:16.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1392823403 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 1392823403 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5394 192.168.0.1:0/1392823403", 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/1392823403", 2024-09-12T03:36:16.563 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:36:16.564 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 24, 2024-09-12T03:36:16.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 51, 2024-09-12T03:36:16.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:36:16.564 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:36:16.564 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:36:16.564 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:36:16.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:16.575 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:36:16.575 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:16.581 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:36:16.581 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:16.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:16.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:16.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:36:16.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6afd8e9640 1 Processor -- start 2024-09-12T03:36:16.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6afd8e9640 1 -- start start 2024-09-12T03:36:16.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6afd8e9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6af815bec0 0x7f6af80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6afd8e9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6af815c2a0 0x7f6af80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6afd8e9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af80b3290 con 0x7f6af80af2a0 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6afd8e9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6af80b3570 con 0x7f6af815c2a0 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6afd8e9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6af80b3850 con 0x7f6af815bec0 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6aeffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6af815c2a0 0x7f6af80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6af77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6af80af2a0 0x7f6af815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38108/0 (socket says 172.21.15.73:38108) 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6aeffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6af815c2a0 0x7f6af80aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48772/0 (socket says 172.21.15.73:48772) 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6af77fe640 1 -- 172.21.15.73:0/2269891726 learned_addr learned my addr 172.21.15.73:0/2269891726 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6af6ffd640 1 --2- 172.21.15.73:0/2269891726 >> v2:172.21.15.150:3300/0 conn(0x7f6af815bec0 0x7f6af80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6aeffff640 1 -- 172.21.15.73:0/2269891726 >> v2:172.21.15.150:3300/0 conn(0x7f6af815bec0 msgr2=0x7f6af80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6aeffff640 1 --2- 172.21.15.73:0/2269891726 >> v2:172.21.15.150:3300/0 conn(0x7f6af815bec0 0x7f6af80ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:16.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6aeffff640 1 -- 172.21.15.73:0/2269891726 >> v1:172.21.15.73:6789/0 conn(0x7f6af80af2a0 legacy=0x7f6af815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:16.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6aeffff640 1 -- 172.21.15.73:0/2269891726 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af80b3b30 con 0x7f6af815c2a0 2024-09-12T03:36:16.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.798+0000 7f6af6ffd640 1 --2- 172.21.15.73:0/2269891726 >> v2:172.21.15.150:3300/0 conn(0x7f6af815bec0 0x7f6af80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:16.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6aeffff640 1 --2- 172.21.15.73:0/2269891726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af815c2a0 0x7f6af80aed60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6af8071710 tx=0x7f6ae001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9e212b90b23b73 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:16.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af67fc640 1 -- 172.21.15.73:0/2269891726 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00ab650 con 0x7f6af815c2a0 2024-09-12T03:36:16.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af67fc640 1 -- 172.21.15.73:0/2269891726 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae00b0070 con 0x7f6af815c2a0 2024-09-12T03:36:16.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af67fc640 1 -- 172.21.15.73:0/2269891726 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00aba10 con 0x7f6af815c2a0 2024-09-12T03:36:16.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- 172.21.15.73:0/2269891726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af815c2a0 msgr2=0x7f6af80aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/2269891726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af815c2a0 0x7f6af80aed60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6af8071710 tx=0x7f6ae001c450 comp rx=0 tx=0).stop 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- 172.21.15.73:0/2269891726 shutdown_connections 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/2269891726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af815c2a0 0x7f6af80aed60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/2269891726 >> v2:172.21.15.150:3300/0 conn(0x7f6af815bec0 0x7f6af80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- 172.21.15.73:0/2269891726 >> 172.21.15.73:0/2269891726 conn(0x7f6af80b1f90 msgr2=0x7f6af80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- 172.21.15.73:0/2269891726 shutdown_connections 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- 172.21.15.73:0/2269891726 wait complete. 2024-09-12T03:36:16.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 Processor -- start 2024-09-12T03:36:16.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- start start 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af80af2a0 0x7f6af814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af815bec0 0x7f6af814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6af815c2a0 0x7f6af8159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6af80af6b0 con 0x7f6af80af2a0 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6af80ad740 con 0x7f6af815bec0 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6af8169000 con 0x7f6af815c2a0 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af80af2a0 0x7f6af814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af80af2a0 0x7f6af814eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48784/0 (socket says 172.21.15.73:48784) 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 -- 172.21.15.73:0/1466372333 learned_addr learned my addr 172.21.15.73:0/1466372333 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af77fe640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6af815c2a0 0x7f6af8159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:16.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6aeffff640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af815bec0 0x7f6af814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 -- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6af815c2a0 msgr2=0x7f6af8159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6af815c2a0 0x7f6af8159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 -- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af815bec0 msgr2=0x7f6af814fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af815bec0 0x7f6af814fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 -- 172.21.15.73:0/1466372333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af815c850 con 0x7f6af80af2a0 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af6ffd640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af80af2a0 0x7f6af814eb10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800c7c0 tx=0x7f6ae800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af4ff9640 1 -- 172.21.15.73:0/1466372333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8007a30 con 0x7f6af80af2a0 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af4ff9640 1 -- 172.21.15.73:0/1466372333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae8007bd0 con 0x7f6af80af2a0 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af815cb30 con 0x7f6af80af2a0 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6af4ff9640 1 -- 172.21.15.73:0/1466372333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae80113f0 con 0x7f6af80af2a0 2024-09-12T03:36:16.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.802+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af815d0f0 con 0x7f6af80af2a0 2024-09-12T03:36:16.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.806+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af80ad200 con 0x7f6af80af2a0 2024-09-12T03:36:16.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.806+0000 7f6af4ff9640 1 -- 172.21.15.73:0/1466372333 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ae8011590 con 0x7f6af80af2a0 2024-09-12T03:36:16.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.806+0000 7f6af4ff9640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6ad80678c0 0x7f6ad8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:16.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.806+0000 7f6af4ff9640 1 -- 172.21.15.73:0/1466372333 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f6ae8086030 con 0x7f6af80af2a0 2024-09-12T03:36:16.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.806+0000 7f6aeffff640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6ad80678c0 0x7f6ad8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:16.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.806+0000 7f6aeffff640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6ad80678c0 0x7f6ad8069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00af000 tx=0x7f6ae00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:16.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:16.810+0000 7f6af4ff9640 1 -- 172.21.15.73:0/1466372333 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6ae8015020 con 0x7f6af80af2a0 2024-09-12T03:36:17.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.010+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6af806fcd0 con 0x7f6af80af2a0 2024-09-12T03:36:17.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.010+0000 7f6af4ff9640 1 -- 172.21.15.73:0/1466372333 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f6ae80569e0 con 0x7f6af80af2a0 2024-09-12T03:36:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:36:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6ad80678c0 msgr2=0x7f6ad8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6ad80678c0 0x7f6ad8069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00af000 tx=0x7f6ae00a7000 comp rx=0 tx=0).stop 2024-09-12T03:36:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af80af2a0 msgr2=0x7f6af814eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af80af2a0 0x7f6af814eb10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800c7c0 tx=0x7f6ae800cc80 comp rx=0 tx=0).stop 2024-09-12T03:36:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 shutdown_connections 2024-09-12T03:36:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6ad80678c0 0x7f6ad8069d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6af815c2a0 0x7f6af8159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6af815bec0 0x7f6af814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 --2- 172.21.15.73:0/1466372333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6af80af2a0 0x7f6af814eb10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 >> 172.21.15.73:0/1466372333 conn(0x7f6af80b1f90 msgr2=0x7f6af8157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 shutdown_connections 2024-09-12T03:36:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:17.014+0000 7f6afd8e9640 1 -- 172.21.15.73:0/1466372333 wait complete. 2024-09-12T03:36:17.032 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:36:17.032 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:36:17.032 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:36:17.032 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:36:17.032 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:17.032 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:36:17.032 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:36:17.033 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:36:17.033 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:36:17.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:17.033 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:36:17.040 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:36:17.040 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:36:17.040 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:17.041 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42403sec preferred_lft 42403sec 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:36:17.042 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:17.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:17.043 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:36:17.096 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:36:17.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:17.098 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:36:17.149 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:36:17.149 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:36:17.149 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:36:17.149 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:36:17.149 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:36:17.149 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:36:17.150 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:36:17.150 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:17.150 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:17.150 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:17.150 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:36:17.150 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:36:17.150 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:36:17.150 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:36:17.150 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:36:17.150 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:36:17.151 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:36:17.239 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:36:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:36:17.268 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:36:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:17.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:17.275 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:36:17.281 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:36:17.281 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:36:17.281 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:36:17.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:17.281 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:36:17.340 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:36:17.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:17.340 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:17.390 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:36:17.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:17.390 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:17.437 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:36:17.495 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:36:17.544 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:36:17.545 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:17.546 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:17.547 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:17.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:17.548 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:36:17.593 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:36:17.594 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T03:36:17.639 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:36:17.655 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:17.702 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:36:17.703 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:36:17.703 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:36:17.703 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:36:17.703 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:36:17.703 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:36:17.704 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:36:17.704 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:36:17.704 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:36:17.704 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:36:17.704 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:36:17.704 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:36:17.705 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:17.705 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:36:17.705 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:36:17.705 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:36:17.705 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:36:17.705 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:36:17.706 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:17.706 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:36:17.706 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:17.706 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:36:17.706 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:36:17.706 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:36:17.707 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:36:17.707 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:36:17.707 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:36:17.707 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:36:17.707 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:36:17.707 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:17.708 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:17.708 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:17.708 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:17.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:17.709 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:36:17.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:36:17.708+0000 7f48078fe580 -1 init, newargv = 0x5626358560d0 newargc=15 2024-09-12T03:36:17.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34902]: starting ceph client 2024-09-12T03:36:17.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34902]: starting fuse 2024-09-12T03:36:18.818 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:36:18.835 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:36:18.888 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:36:18.889 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:36:18.890 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:18.891 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:18.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:18.892 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:36:18.941 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:36:18.942 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:36:18.942 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:36:18.942 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:36:18.942 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:36:18.943 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:36:18.943 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:36:18.943 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:18.943 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:36:18.943 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:36:18.943 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:36:18.944 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:36:18.944 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:18.944 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:36:18.945 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:36:18.945 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:36:18.945 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:36:18.945 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:18.945 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:36:18.946 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:36:18.946 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:36:18.946 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:36:18.946 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:36:18.947 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:36:18.947 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:36:18.947 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:36:18.947 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:18.947 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:36:18.947 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:36:19.067 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.34902.asok 2024-09-12T03:36:19.071 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:19.080 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34902.asok 2024-09-12T03:36:19.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.080 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34902.asok status 2024-09-12T03:36:19.234 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:36:19.234 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:36:19.234 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:36:19.234 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:36:19.234 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:36:19.234 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:36:19.234 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "34902", 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4664, 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4664 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:19.235 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 276649429 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 276649429 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4664 192.168.0.1:0/276649429", 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/276649429", 2024-09-12T03:36:19.236 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:36:19.237 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 24, 2024-09-12T03:36:19.237 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 51, 2024-09-12T03:36:19.237 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:36:19.237 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:36:19.237 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:36:19.237 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:36:19.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.247 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:36:19.248 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:19.254 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:36:19.255 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:19.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.255 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:19.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.308 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T03:36:19.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.323 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10A ./subdir) 2024-09-12T03:36:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.376 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1y00Ki ./subdir) 2024-09-12T03:36:19.424 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.426 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v af00 ./subdir) 2024-09-12T03:36:19.472 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.474 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v G ./subdir) 2024-09-12T03:36:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.526 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v '' ./subdir) 2024-09-12T03:36:19.573 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.574 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v ' ' ./subdir) 2024-09-12T03:36:19.620 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.621 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v -1t ./subdir) 2024-09-12T03:36:19.669 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:19.670 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v -1 ./subdir) 2024-09-12T03:36:19.723 INFO:teuthology.orchestra.run.smithi073.stderr:setfattr: ./subdir: Invalid argument 2024-09-12T03:36:19.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:19.724 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:36:19.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:36:19.816 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:36:19.866 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:36:19.867 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:19.867 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:36:19.867 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:19.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:36:20.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8ffe6640 1 Processor -- start 2024-09-12T03:36:20.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8ffe6640 1 -- start start 2024-09-12T03:36:20.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8ffe6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e880aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8ffe6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e880af2a0 0x7f8e8806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8ffe6640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e880b3290 con 0x7f8e8815bec0 2024-09-12T03:36:20.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8ffe6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8e880b3570 con 0x7f8e880af2a0 2024-09-12T03:36:20.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8ffe6640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8e880b3850 con 0x7f8e8815c2a0 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8e583640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e880af2a0 0x7f8e8806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8e583640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e880af2a0 0x7f8e8806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48798/0 (socket says 172.21.15.73:48798) 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8e583640 1 -- 172.21.15.73:0/867002661 learned_addr learned my addr 172.21.15.73:0/867002661 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8d581640 1 --2- 172.21.15.73:0/867002661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e880aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8e583640 1 -- 172.21.15.73:0/867002661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 msgr2=0x7f8e880aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8e583640 1 --2- 172.21.15.73:0/867002661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e880aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8e583640 1 -- 172.21.15.73:0/867002661 >> v1:172.21.15.150:6789/0 conn(0x7f8e8815bec0 legacy=0x7f8e880ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.050+0000 7f8e8e583640 1 -- 172.21.15.73:0/867002661 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e880b3b30 con 0x7f8e880af2a0 2024-09-12T03:36:20.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8e583640 1 --2- 172.21.15.73:0/867002661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e880af2a0 0x7f8e8806e000 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009870 tx=0x7f8e8001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272e7eed1e64a2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:20.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8cd80640 1 -- 172.21.15.73:0/867002661 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e800a95f0 con 0x7f8e880af2a0 2024-09-12T03:36:20.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8cd80640 1 -- 172.21.15.73:0/867002661 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e800a9790 con 0x7f8e880af2a0 2024-09-12T03:36:20.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8cd80640 1 -- 172.21.15.73:0/867002661 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e800a9b60 con 0x7f8e880af2a0 2024-09-12T03:36:20.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/867002661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e880af2a0 msgr2=0x7f8e8806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/867002661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e880af2a0 0x7f8e8806e000 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009870 tx=0x7f8e8001c530 comp rx=0 tx=0).stop 2024-09-12T03:36:20.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/867002661 shutdown_connections 2024-09-12T03:36:20.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/867002661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e880af2a0 0x7f8e8806e000 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/867002661 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e880aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/867002661 >> 172.21.15.73:0/867002661 conn(0x7f8e880b1f90 msgr2=0x7f8e880b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:20.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/867002661 shutdown_connections 2024-09-12T03:36:20.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.054+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/867002661 wait complete. 2024-09-12T03:36:20.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 Processor -- start 2024-09-12T03:36:20.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 -- start start 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e880af2a0 0x7f8e8814a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8815bec0 0x7f8e88156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e881505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8806ed50 con 0x7f8e8815bec0 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8e880afc90 con 0x7f8e880af2a0 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8806eed0 con 0x7f8e8815c2a0 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8815bec0 0x7f8e88156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8815bec0 0x7f8e88156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48808/0 (socket says 172.21.15.73:48808) 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 -- 172.21.15.73:0/2999258568 learned_addr learned my addr 172.21.15.73:0/2999258568 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8dd82640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e880af2a0 0x7f8e8814a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8e583640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e881505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 -- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 msgr2=0x7f8e881505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e881505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 -- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e880af2a0 msgr2=0x7f8e8814a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e880af2a0 0x7f8e8814a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 -- 172.21.15.73:0/2999258568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e88157880 con 0x7f8e8815bec0 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8e583640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e881505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8d581640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8815bec0 0x7f8e88156950 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800d5f0 tx=0x7f8e7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e7e7fc640 1 -- 172.21.15.73:0/2999258568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e780125f0 con 0x7f8e8815bec0 2024-09-12T03:36:20.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e7e7fc640 1 -- 172.21.15.73:0/2999258568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e78019070 con 0x7f8e8815bec0 2024-09-12T03:36:20.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e881572c0 con 0x7f8e8815bec0 2024-09-12T03:36:20.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e7e7fc640 1 -- 172.21.15.73:0/2999258568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e780129d0 con 0x7f8e8815bec0 2024-09-12T03:36:20.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e880979a0 con 0x7f8e8815bec0 2024-09-12T03:36:20.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8806f280 con 0x7f8e8815bec0 2024-09-12T03:36:20.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e7e7fc640 1 -- 172.21.15.73:0/2999258568 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e78012b70 con 0x7f8e8815bec0 2024-09-12T03:36:20.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e7e7fc640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e6c0678c0 0x7f8e6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e8dd82640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e6c0678c0 0x7f8e6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.058+0000 7f8e7e7fc640 1 -- 172.21.15.73:0/2999258568 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f8e780862f0 con 0x7f8e8815bec0 2024-09-12T03:36:20.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.062+0000 7f8e8dd82640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e6c0678c0 0x7f8e6c069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e8815cd00 tx=0x7f8e84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:20.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.066+0000 7f8e7e7fc640 1 -- 172.21.15.73:0/2999258568 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e78056ca0 con 0x7f8e8815bec0 2024-09-12T03:36:20.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8e8806fcd0 con 0x7f8e8815bec0 2024-09-12T03:36:20.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e7e7fc640 1 -- 172.21.15.73:0/2999258568 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) ==== 80+0+0 (secure 0 0 0) 0x7f8e780565a0 con 0x7f8e8815bec0 2024-09-12T03:36:20.248 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:36:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e6c0678c0 msgr2=0x7f8e6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e6c0678c0 0x7f8e6c069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8e8815cd00 tx=0x7f8e84009040 comp rx=0 tx=0).stop 2024-09-12T03:36:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8815bec0 msgr2=0x7f8e88156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8815bec0 0x7f8e88156950 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8e7800d5f0 tx=0x7f8e7800dab0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 shutdown_connections 2024-09-12T03:36:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e6c0678c0 0x7f8e6c069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8815bec0 0x7f8e88156950 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8e8815c2a0 0x7f8e881505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 --2- 172.21.15.73:0/2999258568 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8e880af2a0 0x7f8e8814a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 >> 172.21.15.73:0/2999258568 conn(0x7f8e880b1f90 msgr2=0x7f8e880b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:20.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 shutdown_connections 2024-09-12T03:36:20.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.246+0000 7f8e8ffe6640 1 -- 172.21.15.73:0/2999258568 wait complete. 2024-09-12T03:36:20.265 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:36:20.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:20.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:20.276 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[39153]: fuse finished with error 0 and tester_r 0 2024-09-12T03:36:20.277 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:36:20.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:20.278 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:36:20.441 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:20.442 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:36:20.442 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:20.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:36:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.606+0000 7fa919fab640 1 Processor -- start 2024-09-12T03:36:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.606+0000 7fa919fab640 1 -- start start 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.606+0000 7fa919fab640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa914161a60 0x7fa9140d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.606+0000 7fa919fab640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9140d32b0 con 0x7fa9140cf620 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.606+0000 7fa919fab640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9140d0300 con 0x7fa9140d2e90 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.606+0000 7fa919fab640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa9140cfa90 con 0x7fa914161a60 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa9137fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa914161a60 0x7fa9140d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa9137fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa914161a60 0x7fa9140d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48822/0 (socket says 172.21.15.73:48822) 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa9137fe640 1 -- 172.21.15.73:0/37345334 learned_addr learned my addr 172.21.15.73:0/37345334 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa913fff640 1 --1- 172.21.15.73:0/37345334 >> v1:172.21.15.73:6789/0 conn(0x7fa9140cf620 0x7fa91406d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38112/0 (socket says 172.21.15.73:38112) 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa9137fe640 1 -- 172.21.15.73:0/37345334 >> v1:172.21.15.150:6789/0 conn(0x7fa9140d2e90 legacy=0x7fa9140cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa9137fe640 1 -- 172.21.15.73:0/37345334 >> v1:172.21.15.73:6789/0 conn(0x7fa9140cf620 legacy=0x7fa91406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa9137fe640 1 -- 172.21.15.73:0/37345334 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9140b0f60 con 0x7fa914161a60 2024-09-12T03:36:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa9137fe640 1 --2- 172.21.15.73:0/37345334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa914161a60 0x7fa9140d2950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa904009870 tx=0x7fa90401c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40602d7bd314a0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa912ffd640 1 -- 172.21.15.73:0/37345334 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040b0070 con 0x7fa914161a60 2024-09-12T03:36:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa912ffd640 1 -- 172.21.15.73:0/37345334 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9040ab600 con 0x7fa914161a60 2024-09-12T03:36:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa912ffd640 1 -- 172.21.15.73:0/37345334 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040ab9d0 con 0x7fa914161a60 2024-09-12T03:36:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa919fab640 1 -- 172.21.15.73:0/37345334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa914161a60 msgr2=0x7fa9140d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa919fab640 1 --2- 172.21.15.73:0/37345334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa914161a60 0x7fa9140d2950 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa904009870 tx=0x7fa90401c280 comp rx=0 tx=0).stop 2024-09-12T03:36:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa919fab640 1 -- 172.21.15.73:0/37345334 shutdown_connections 2024-09-12T03:36:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa919fab640 1 --2- 172.21.15.73:0/37345334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa914161a60 0x7fa9140d2950 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa919fab640 1 -- 172.21.15.73:0/37345334 >> 172.21.15.73:0/37345334 conn(0x7fa91408bf90 msgr2=0x7fa91409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa919fab640 1 -- 172.21.15.73:0/37345334 shutdown_connections 2024-09-12T03:36:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.610+0000 7fa919fab640 1 -- 172.21.15.73:0/37345334 wait complete. 2024-09-12T03:36:20.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 Processor -- start 2024-09-12T03:36:20.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 -- start start 2024-09-12T03:36:20.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9140cf620 0x7fa91414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9140d2e90 0x7fa914160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa914161a60 0x7fa91414f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa91416bf30 con 0x7fa9140d2e90 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa91406d190 con 0x7fa9140cf620 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa91416c0b0 con 0x7fa914161a60 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9140d2e90 0x7fa914160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9140d2e90 0x7fa914160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48834/0 (socket says 172.21.15.73:48834) 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 -- 172.21.15.73:0/2950526168 learned_addr learned my addr 172.21.15.73:0/2950526168 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 -- 172.21.15.73:0/2950526168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa914161a60 msgr2=0x7fa91414f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa914161a60 0x7fa91414f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 -- 172.21.15.73:0/2950526168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9140cf620 msgr2=0x7fa91414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa9137fe640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9140cf620 0x7fa91414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9140cf620 0x7fa91414e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 -- 172.21.15.73:0/2950526168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91413c850 con 0x7fa9140d2e90 2024-09-12T03:36:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa90bfff640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9140d2e90 0x7fa914160520 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c450 tx=0x7fa8fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa910ff9640 1 -- 172.21.15.73:0/2950526168 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc012830 con 0x7fa9140d2e90 2024-09-12T03:36:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa910ff9640 1 -- 172.21.15.73:0/2950526168 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc017070 con 0x7fa9140d2e90 2024-09-12T03:36:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa914160f20 con 0x7fa9140d2e90 2024-09-12T03:36:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa910ff9640 1 -- 172.21.15.73:0/2950526168 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc012c30 con 0x7fa9140d2e90 2024-09-12T03:36:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa914161200 con 0x7fa9140d2e90 2024-09-12T03:36:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9140b59c0 con 0x7fa9140d2e90 2024-09-12T03:36:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.614+0000 7fa910ff9640 1 -- 172.21.15.73:0/2950526168 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8fc01c460 con 0x7fa9140d2e90 2024-09-12T03:36:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.618+0000 7fa910ff9640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8f40678c0 0x7fa8f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.618+0000 7fa910ff9640 1 -- 172.21.15.73:0/2950526168 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6159+0+0 (secure 0 0 0) 0x7fa8fc085bd0 con 0x7fa9140d2e90 2024-09-12T03:36:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.618+0000 7fa9137fe640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8f40678c0 0x7fa8f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.618+0000 7fa9137fe640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8f40678c0 0x7fa8f4069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9040ad000 tx=0x7fa904008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:20.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.622+0000 7fa910ff9640 1 -- 172.21.15.73:0/2950526168 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa8fc056550 con 0x7fa9140d2e90 2024-09-12T03:36:20.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.794+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa91413cf40 con 0x7fa9140d2e90 2024-09-12T03:36:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.794+0000 7fa910ff9640 1 -- 172.21.15.73:0/2950526168 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v52) ==== 80+0+0 (secure 0 0 0) 0x7fa8fc055e50 con 0x7fa9140d2e90 2024-09-12T03:36:20.797 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8f40678c0 msgr2=0x7fa8f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8f40678c0 0x7fa8f4069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa9040ad000 tx=0x7fa904008040 comp rx=0 tx=0).stop 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9140d2e90 msgr2=0x7fa914160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9140d2e90 0x7fa914160520 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c450 tx=0x7fa8fc00c910 comp rx=0 tx=0).stop 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 shutdown_connections 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa8f40678c0 0x7fa8f4069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9140d2e90 0x7fa914160520 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa914161a60 0x7fa91414f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 --2- 172.21.15.73:0/2950526168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9140cf620 0x7fa91414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 >> 172.21.15.73:0/2950526168 conn(0x7fa91408bf90 msgr2=0x7fa9140d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 shutdown_connections 2024-09-12T03:36:20.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:20.798+0000 7fa919fab640 1 -- 172.21.15.73:0/2950526168 wait complete. 2024-09-12T03:36:20.816 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:36:20.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:20.816 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:20.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[34902]: fuse finished with error 0 and tester_r 0 2024-09-12T03:36:20.830 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:36:20.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:20.830 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:36:20.905 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:20.905 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:36:20.905 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:20.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:36:20.911 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:36:20.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:20.912 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T03:36:20.959 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T03:36:20.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:20.960 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:20.960 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:36:20.960 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:20.966 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:36:20.966 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:36:20.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:20.967 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T03:36:21.013 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T03:36:21.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:21.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:21.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff622451640 1 Processor -- start 2024-09-12T03:36:21.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff622451640 1 -- start start 2024-09-12T03:36:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff622451640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff61c15bec0 0x7ff61c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff622451640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c0b3290 con 0x7ff61c15c2a0 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff622451640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c0b3570 con 0x7ff61c0af470 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff622451640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff61c0b3850 con 0x7ff61c15bec0 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff61c15c2a0 0x7ff61c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38118/0 (socket says 172.21.15.73:38118) 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61b7fe640 1 -- 172.21.15.73:0/1454058089 learned_addr learned my addr 172.21.15.73:0/1454058089 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788077673 0 0) 0x7ff61c0b3290 con 0x7ff61c15c2a0 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff608003530 con 0x7ff61c15c2a0 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61bfff640 1 --2- 172.21.15.73:0/1454058089 >> v2:172.21.15.150:3300/0 conn(0x7ff61c15bec0 0x7ff61c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1711208328 0 0) 0x7ff608003530 con 0x7ff61c15c2a0 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 >> v2:172.21.15.150:3300/0 conn(0x7ff61c15bec0 msgr2=0x7ff61c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 --2- 172.21.15.73:0/1454058089 >> v2:172.21.15.150:3300/0 conn(0x7ff61c15bec0 0x7ff61c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 >> v1:172.21.15.150:6789/0 conn(0x7ff61c0af470 legacy=0x7ff61c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c0b3b30 con 0x7ff61c15c2a0 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7ff604001680 con 0x7ff61c15c2a0 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 >> v1:172.21.15.73:6789/0 conn(0x7ff61c15c2a0 legacy=0x7ff61c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6080039c0 0x7ff608003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.146+0000 7ff61affd640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff608004810 0x7ff608004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61affd640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6080051d0 0x7ff60800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0b3850 con 0x7ff608004810 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff60800c120 con 0x7ff6080051d0 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff60800c320 con 0x7ff6080039c0 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61b7fe640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff608004810 0x7ff608004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61bfff640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6080039c0 0x7ff608003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff6209ee640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6080051d0 0x7ff60800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61b7fe640 1 -- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6080039c0 msgr2=0x7ff608003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:21.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61b7fe640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6080039c0 0x7ff608003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61b7fe640 1 -- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6080051d0 msgr2=0x7ff60800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61b7fe640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6080051d0 0x7ff60800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61b7fe640 1 -- 172.21.15.73:0/1454058089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff608003530 con 0x7ff608004810 2024-09-12T03:36:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff6209ee640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6080051d0 0x7ff60800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:21.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff6209ee640 1 -- 172.21.15.73:0/1454058089 reap_dead start 2024-09-12T03:36:21.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61b7fe640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff608004810 0x7ff608004c90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c190 tx=0x7ff60401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b99cd170e6ec47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604007d00 con 0x7ff608004810 2024-09-12T03:36:21.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff604005b00 con 0x7ff608004810 2024-09-12T03:36:21.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff61affd640 1 -- 172.21.15.73:0/1454058089 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604007070 con 0x7ff608004810 2024-09-12T03:36:21.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff622451640 1 -- 172.21.15.73:0/1454058089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff608004810 msgr2=0x7ff608004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff622451640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff608004810 0x7ff608004c90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff60400c190 tx=0x7ff60401f390 comp rx=0 tx=0).stop 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff622451640 1 -- 172.21.15.73:0/1454058089 shutdown_connections 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff622451640 1 --2- 172.21.15.73:0/1454058089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff608004810 0x7ff608004c90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff622451640 1 -- 172.21.15.73:0/1454058089 >> 172.21.15.73:0/1454058089 conn(0x7ff61c0b1f90 msgr2=0x7ff61c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff622451640 1 -- 172.21.15.73:0/1454058089 shutdown_connections 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.150+0000 7ff622451640 1 -- 172.21.15.73:0/1454058089 wait complete. 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 Processor -- start 2024-09-12T03:36:21.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 -- start start 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff608004810 0x7ff61c154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff61c1514f0 0x7ff61c1e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff61c1e6870 0x7ff61c0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0afc90 con 0x7ff61c1514f0 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c0b40f0 con 0x7ff608004810 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c0aed60 con 0x7ff61c1e6870 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff61c1514f0 0x7ff61c1e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff61c1514f0 0x7ff61c1e5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48852/0 (socket says 172.21.15.73:48852) 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 -- 172.21.15.73:0/3258765110 learned_addr learned my addr 172.21.15.73:0/3258765110 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61bfff640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff608004810 0x7ff61c154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff6209ee640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff61c1e6870 0x7ff61c0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 -- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff61c1e6870 msgr2=0x7ff61c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff61c1e6870 0x7ff61c0b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 -- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff608004810 msgr2=0x7ff61c154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff608004810 0x7ff61c154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 -- 172.21.15.73:0/3258765110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c151970 con 0x7ff61c1514f0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff61b7fe640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff61c1514f0 0x7ff61c1e5480 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff604001980 tx=0x7ff608005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff618ff9640 1 -- 172.21.15.73:0/3258765110 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040047f0 con 0x7ff61c1514f0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff618ff9640 1 -- 172.21.15.73:0/3258765110 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff604004990 con 0x7ff61c1514f0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff618ff9640 1 -- 172.21.15.73:0/3258765110 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604004d40 con 0x7ff61c1514f0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c1e6fe0 con 0x7ff61c1514f0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c1e4c80 con 0x7ff61c1514f0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c0af0f0 con 0x7ff61c1514f0 2024-09-12T03:36:21.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.154+0000 7ff618ff9640 1 -- 172.21.15.73:0/3258765110 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff6040070e0 con 0x7ff61c1514f0 2024-09-12T03:36:21.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.158+0000 7ff618ff9640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff5fc0678f0 0x7ff5fc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.158+0000 7ff618ff9640 1 -- 172.21.15.73:0/3258765110 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7ff604123280 con 0x7ff61c1514f0 2024-09-12T03:36:21.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.158+0000 7ff61bfff640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff5fc0678f0 0x7ff5fc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.158+0000 7ff61bfff640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff5fc0678f0 0x7ff5fc069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0512d0 tx=0x7ff61400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.162+0000 7ff618ff9640 1 -- 172.21.15.73:0/3258765110 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff6040190a0 con 0x7ff61c1514f0 2024-09-12T03:36:21.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff61c06fcd0 con 0x7ff61c1514f0 2024-09-12T03:36:21.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff618ff9640 1 -- 172.21.15.73:0/3258765110 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5223 (secure 0 0 0) 0x7ff6040f3c00 con 0x7ff61c1514f0 2024-09-12T03:36:21.356 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:21.356 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-12T03:36:06:880174+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4068395780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4068395780},{"type":"v1","addr":"172.21.15.150:6833","nonce":4068395780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/801266996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":801266996},{"type":"v1","addr":"172.21.15.150:6835","nonce":801266996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/204856876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":204856876},{"type":"v1","addr":"172.21.15.73:6835","nonce":204856876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:03.212172+0000","modified":"2024-09-12T03:36:06.243489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5220":{"gid":5220,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3307908616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3307908616},{"type":"v1","addr":"172.21.15.73:6837","nonce":3307908616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5220,"qdb_cluster":[5220]},"id":3}]} 2024-09-12T03:36:21.356 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff5fc0678f0 msgr2=0x7ff5fc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff5fc0678f0 0x7ff5fc069db0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0512d0 tx=0x7ff61400b040 comp rx=0 tx=0).stop 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff61c1514f0 msgr2=0x7ff61c1e5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff61c1514f0 0x7ff61c1e5480 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff604001980 tx=0x7ff608005840 comp rx=0 tx=0).stop 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 shutdown_connections 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff5fc0678f0 0x7ff5fc069db0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff61c1514f0 0x7ff61c1e5480 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff61c1e6870 0x7ff61c0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 --2- 172.21.15.73:0/3258765110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff608004810 0x7ff61c154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 >> 172.21.15.73:0/3258765110 conn(0x7ff61c0b1f90 msgr2=0x7ff61c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 shutdown_connections 2024-09-12T03:36:21.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.354+0000 7ff622451640 1 -- 172.21.15.73:0/3258765110 wait complete. 2024-09-12T03:36:21.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 Processor -- start 2024-09-12T03:36:21.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 -- start start 2024-09-12T03:36:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7f08073e60 0x7f7f0806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0806fef0 0x7f7f0815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f080b3d50 0x7f7f080b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7f080b46a0 con 0x7f7f080b3d50 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f7f0815bda0 con 0x7f7f08073e60 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f0dc8d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0806ee50 con 0x7f7f0806fef0 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f080b3d50 0x7f7f080b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f080b3d50 0x7f7f080b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48854/0 (socket says 172.21.15.73:48854) 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 -- 172.21.15.73:0/2297459837 learned_addr learned my addr 172.21.15.73:0/2297459837 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f077fe640 1 --2- 172.21.15.73:0/2297459837 >> v2:172.21.15.150:3300/0 conn(0x7f7f08073e60 0x7f7f0806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f06ffd640 1 --2- 172.21.15.73:0/2297459837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0806fef0 0x7f7f0815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 -- 172.21.15.73:0/2297459837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0806fef0 msgr2=0x7f7f0815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 --2- 172.21.15.73:0/2297459837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0806fef0 0x7f7f0815b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 -- 172.21.15.73:0/2297459837 >> v2:172.21.15.150:3300/0 conn(0x7f7f08073e60 msgr2=0x7f7f0806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 --2- 172.21.15.73:0/2297459837 >> v2:172.21.15.150:3300/0 conn(0x7f7f08073e60 0x7f7f0806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.486+0000 7f7f07fff640 1 -- 172.21.15.73:0/2297459837 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0806f130 con 0x7f7f080b3d50 2024-09-12T03:36:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 --2- 172.21.15.73:0/2297459837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f080b4160 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7f08070340 tx=0x7f7f0001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dd92f5fe43c9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f067fc640 1 -- 172.21.15.73:0/2297459837 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000a5650 con 0x7f7f080b3d50 2024-09-12T03:36:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f067fc640 1 -- 172.21.15.73:0/2297459837 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f000a57f0 con 0x7f7f080b3d50 2024-09-12T03:36:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f067fc640 1 -- 172.21.15.73:0/2297459837 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000a5bc0 con 0x7f7f080b3d50 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/2297459837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 msgr2=0x7f7f080b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/2297459837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f080b4160 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7f08070340 tx=0x7f7f0001c960 comp rx=0 tx=0).stop 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/2297459837 shutdown_connections 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/2297459837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f080b4160 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/2297459837 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f0806fef0 0x7f7f0815b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/2297459837 >> v2:172.21.15.150:3300/0 conn(0x7f7f08073e60 0x7f7f0806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/2297459837 >> 172.21.15.73:0/2297459837 conn(0x7f7f080b1f90 msgr2=0x7f7f080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/2297459837 shutdown_connections 2024-09-12T03:36:21.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/2297459837 wait complete. 2024-09-12T03:36:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 Processor -- start 2024-09-12T03:36:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- start start 2024-09-12T03:36:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0806fef0 0x7f7f08153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f08073e60 0x7f7f08099940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f0814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0815e580 con 0x7f7f080b3d50 2024-09-12T03:36:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0815e400 con 0x7f7f0806fef0 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f0dc8d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0815e700 con 0x7f7f08073e60 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f0814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f0814fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48868/0 (socket says 172.21.15.73:48868) 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 -- 172.21.15.73:0/1836791898 learned_addr learned my addr 172.21.15.73:0/1836791898 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f06ffd640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f08073e60 0x7f7f08099940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f077fe640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0806fef0 0x7f7f08153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 -- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f08073e60 msgr2=0x7f7f08099940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f08073e60 0x7f7f08099940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 -- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0806fef0 msgr2=0x7f7f08153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0806fef0 0x7f7f08153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 -- 172.21.15.73:0/1836791898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f08099e80 con 0x7f7f080b3d50 2024-09-12T03:36:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7f07fff640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f0814fcb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7f0001b010 tx=0x7f7f00019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7eeffff640 1 -- 172.21.15.73:0/1836791898 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f000ba070 con 0x7f7f080b3d50 2024-09-12T03:36:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.490+0000 7f7eeffff640 1 -- 172.21.15.73:0/1836791898 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f000b4640 con 0x7f7f080b3d50 2024-09-12T03:36:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7eeffff640 1 -- 172.21.15.73:0/1836791898 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f00009510 con 0x7f7f080b3d50 2024-09-12T03:36:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0815c050 con 0x7f7f080b3d50 2024-09-12T03:36:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0815c2f0 con 0x7f7f080b3d50 2024-09-12T03:36:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f080723f0 con 0x7f7f080b3d50 2024-09-12T03:36:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7eeffff640 1 -- 172.21.15.73:0/1836791898 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7f000c5060 con 0x7f7f080b3d50 2024-09-12T03:36:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7eeffff640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ef40678c0 0x7f7ef4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7f077fe640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ef40678c0 0x7f7ef4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7eeffff640 1 -- 172.21.15.73:0/1836791898 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f7f00122140 con 0x7f7f080b3d50 2024-09-12T03:36:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.494+0000 7f7f077fe640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ef40678c0 0x7f7ef4069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800ba20 tx=0x7f7ef8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.498+0000 7f7eeffff640 1 -- 172.21.15.73:0/1836791898 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7f000165e0 con 0x7f7f080b3d50 2024-09-12T03:36:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.698+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f0814e860 con 0x7f7f080b3d50 2024-09-12T03:36:21.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7eeffff640 1 -- 172.21.15.73:0/1836791898 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5223 (secure 0 0 0) 0x7f7f000f2b50 con 0x7f7f080b3d50 2024-09-12T03:36:21.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:21.703 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-12T03:36:06:880174+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4068395780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4068395780},{"type":"v1","addr":"172.21.15.150:6833","nonce":4068395780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/801266996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":801266996},{"type":"v1","addr":"172.21.15.150:6835","nonce":801266996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/204856876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":204856876},{"type":"v1","addr":"172.21.15.73:6835","nonce":204856876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:03.212172+0000","modified":"2024-09-12T03:36:06.243489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5220":{"gid":5220,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3307908616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3307908616},{"type":"v1","addr":"172.21.15.73:6837","nonce":3307908616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5220,"qdb_cluster":[5220]},"id":3}]} 2024-09-12T03:36:21.704 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-12T03:36:21.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ef40678c0 msgr2=0x7f7ef4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ef40678c0 0x7f7ef4069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7ef800ba20 tx=0x7f7ef8008040 comp rx=0 tx=0).stop 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 msgr2=0x7f7f0814fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f0814fcb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7f0001b010 tx=0x7f7f00019700 comp rx=0 tx=0).stop 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 shutdown_connections 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ef40678c0 0x7f7ef4069d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f080b3d50 0x7f7f0814fcb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7f08073e60 0x7f7f08099940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 --2- 172.21.15.73:0/1836791898 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f0806fef0 0x7f7f08153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 >> 172.21.15.73:0/1836791898 conn(0x7f7f080b1f90 msgr2=0x7f7f08158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 shutdown_connections 2024-09-12T03:36:21.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.702+0000 7f7f0dc8d640 1 -- 172.21.15.73:0/1836791898 wait complete. 2024-09-12T03:36:21.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:21.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884428f640 1 Processor -- start 2024-09-12T03:36:21.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884428f640 1 -- start start 2024-09-12T03:36:21.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884428f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15bec0 0x7f883c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884428f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f883c0af470 0x7f883c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884428f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883c0b3290 con 0x7f883c15c2a0 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884428f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f883c0b3570 con 0x7f883c0af470 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884428f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f883c0b3850 con 0x7f883c15bec0 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884282c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f883c0af470 0x7f883c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884182a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f883c15c2a0 0x7f883c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38124/0 (socket says 172.21.15.73:38124) 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884182a640 1 -- 172.21.15.73:0/1714099785 learned_addr learned my addr 172.21.15.73:0/1714099785 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884282c640 1 -- 172.21.15.73:0/1714099785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15bec0 msgr2=0x7f883c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884202b640 1 --2- 172.21.15.73:0/1714099785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15bec0 0x7f883c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884282c640 1 --2- 172.21.15.73:0/1714099785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15bec0 0x7f883c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f8841029640 1 -- 172.21.15.73:0/1714099785 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754909934 0 0) 0x7f883c0b3290 con 0x7f883c15c2a0 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884282c640 1 -- 172.21.15.73:0/1714099785 >> v1:172.21.15.73:6789/0 conn(0x7f883c15c2a0 legacy=0x7f883c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884282c640 1 -- 172.21.15.73:0/1714099785 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c0b3b30 con 0x7f883c0af470 2024-09-12T03:36:21.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.842+0000 7f884202b640 1 --2- 172.21.15.73:0/1714099785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15bec0 0x7f883c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:21.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884282c640 1 --2- 172.21.15.73:0/1714099785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c0af470 0x7f883c06e000 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f88340097c0 tx=0x7f883401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50be97a8deb73bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f8841029640 1 -- 172.21.15.73:0/1714099785 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340a7070 con 0x7f883c0af470 2024-09-12T03:36:21.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f8841029640 1 -- 172.21.15.73:0/1714099785 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88340b0070 con 0x7f883c0af470 2024-09-12T03:36:21.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f8841029640 1 -- 172.21.15.73:0/1714099785 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340ab890 con 0x7f883c0af470 2024-09-12T03:36:21.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- 172.21.15.73:0/1714099785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c0af470 msgr2=0x7f883c06e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 --2- 172.21.15.73:0/1714099785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c0af470 0x7f883c06e000 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f88340097c0 tx=0x7f883401c470 comp rx=0 tx=0).stop 2024-09-12T03:36:21.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- 172.21.15.73:0/1714099785 shutdown_connections 2024-09-12T03:36:21.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 --2- 172.21.15.73:0/1714099785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c0af470 0x7f883c06e000 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 --2- 172.21.15.73:0/1714099785 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15bec0 0x7f883c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- 172.21.15.73:0/1714099785 >> 172.21.15.73:0/1714099785 conn(0x7f883c0b1f90 msgr2=0x7f883c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:21.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- 172.21.15.73:0/1714099785 shutdown_connections 2024-09-12T03:36:21.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- 172.21.15.73:0/1714099785 wait complete. 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 Processor -- start 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- start start 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f883c0af470 0x7f883c099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c15bec0 0x7f883c073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15c2a0 0x7f883c14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f883c06ed50 con 0x7f883c15bec0 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f883c0ad740 con 0x7f883c0af470 2024-09-12T03:36:21.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f883c06eed0 con 0x7f883c15c2a0 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c15bec0 0x7f883c073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c15bec0 0x7f883c073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48888/0 (socket says 172.21.15.73:48888) 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 -- 172.21.15.73:0/2212176439 learned_addr learned my addr 172.21.15.73:0/2212176439 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 -- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15c2a0 msgr2=0x7f883c14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884282c640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15c2a0 0x7f883c14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884202b640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f883c0af470 0x7f883c099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15c2a0 0x7f883c14a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 -- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f883c0af470 msgr2=0x7f883c099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f883c0af470 0x7f883c099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 -- 172.21.15.73:0/2212176439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c073cf0 con 0x7f883c15bec0 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884202b640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f883c0af470 0x7f883c099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:21.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884182a640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c15bec0 0x7f883c073230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c3e0 tx=0x7f882c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f8832ffd640 1 -- 172.21.15.73:0/2212176439 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0074e0 con 0x7f883c15bec0 2024-09-12T03:36:21.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f8832ffd640 1 -- 172.21.15.73:0/2212176439 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882c0047f0 con 0x7f883c15bec0 2024-09-12T03:36:21.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883c14b010 con 0x7f883c15bec0 2024-09-12T03:36:21.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.846+0000 7f8832ffd640 1 -- 172.21.15.73:0/2212176439 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c004be0 con 0x7f883c15bec0 2024-09-12T03:36:21.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.850+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f883c140900 con 0x7f883c15bec0 2024-09-12T03:36:21.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.850+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883c06f220 con 0x7f883c15bec0 2024-09-12T03:36:21.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.850+0000 7f8832ffd640 1 -- 172.21.15.73:0/2212176439 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f882c011070 con 0x7f883c15bec0 2024-09-12T03:36:21.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.850+0000 7f8832ffd640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88200678c0 0x7f8820069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:21.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.850+0000 7f8832ffd640 1 -- 172.21.15.73:0/2212176439 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f882c085ac0 con 0x7f883c15bec0 2024-09-12T03:36:21.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.850+0000 7f884202b640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88200678c0 0x7f8820069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:21.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.850+0000 7f884202b640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88200678c0 0x7f8820069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f883c149ca0 tx=0x7f8838007550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:21.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:21.854+0000 7f8832ffd640 1 -- 172.21.15.73:0/2212176439 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f882c00e280 con 0x7f883c15bec0 2024-09-12T03:36:22.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.018+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f883c0b2c60 con 0x7f883c15bec0 2024-09-12T03:36:22.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.018+0000 7f8832ffd640 1 -- 172.21.15.73:0/2212176439 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+17109 (secure 0 0 0) 0x7f882c056440 con 0x7f883c15bec0 2024-09-12T03:36:22.021 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:22.021 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":53,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:21.087087+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:00.869276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:02.196347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:22.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88200678c0 msgr2=0x7f8820069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88200678c0 0x7f8820069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f883c149ca0 tx=0x7f8838007550 comp rx=0 tx=0).stop 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c15bec0 msgr2=0x7f883c073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c15bec0 0x7f883c073230 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c3e0 tx=0x7f882c00c8a0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 shutdown_connections 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88200678c0 0x7f8820069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f883c15bec0 0x7f883c073230 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f883c15c2a0 0x7f883c14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 --2- 172.21.15.73:0/2212176439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f883c0af470 0x7f883c099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 >> 172.21.15.73:0/2212176439 conn(0x7f883c0b1f90 msgr2=0x7f883c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 shutdown_connections 2024-09-12T03:36:22.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.022+0000 7f884428f640 1 -- 172.21.15.73:0/2212176439 wait complete. 2024-09-12T03:36:22.041 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:36:22.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.154+0000 7f6c509d9640 1 Processor -- start 2024-09-12T03:36:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.154+0000 7f6c509d9640 1 -- start start 2024-09-12T03:36:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c509d9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c4c1587a0 0x7f6c4c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c509d9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4c06ec60 con 0x7f6c4c06e680 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c509d9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c4c06ef40 con 0x7f6c4c0b37d0 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c509d9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4c0b3c40 con 0x7f6c4c1587a0 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4ad9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6c4c06e680 0x7f6c4c072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38132/0 (socket says 172.21.15.73:38132) 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4ad9d640 1 -- 172.21.15.73:0/3229876705 learned_addr learned my addr 172.21.15.73:0/3229876705 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069646034 0 0) 0x7f6c4c06ec60 con 0x7f6c4c06e680 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c38003530 con 0x7f6c4c06e680 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4a59c640 1 --2- 172.21.15.73:0/3229876705 >> v2:172.21.15.150:3300/0 conn(0x7f6c4c1587a0 0x7f6c4c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2245193101 0 0) 0x7f6c38003530 con 0x7f6c4c06e680 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 >> v2:172.21.15.150:3300/0 conn(0x7f6c4c1587a0 msgr2=0x7f6c4c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 --2- 172.21.15.73:0/3229876705 >> v2:172.21.15.150:3300/0 conn(0x7f6c4c1587a0 0x7f6c4c0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 >> v1:172.21.15.150:6789/0 conn(0x7f6c4c0b37d0 legacy=0x7f6c4c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c06f220 con 0x7f6c4c06e680 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f6c44001680 con 0x7f6c4c06e680 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 >> v1:172.21.15.73:6789/0 conn(0x7f6c4c06e680 legacy=0x7f6c4c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c380039c0 0x7f6c38003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c38004810 0x7f6c38004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380051d0 0x7f6c3800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c0b3c40 con 0x7f6c38004810 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3800c120 con 0x7f6c380051d0 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3800c320 con 0x7f6c380039c0 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c49d9b640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c38004810 0x7f6c38004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4ad9d640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380051d0 0x7f6c3800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4a59c640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c380039c0 0x7f6c38003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c49d9b640 1 -- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c380039c0 msgr2=0x7f6c38003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c49d9b640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c380039c0 0x7f6c38003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c49d9b640 1 -- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380051d0 msgr2=0x7f6c3800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c49d9b640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c380051d0 0x7f6c3800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c49d9b640 1 -- 172.21.15.73:0/3229876705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c38003530 con 0x7f6c38004810 2024-09-12T03:36:22.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.158+0000 7f6c4ad9d640 1 -- 172.21.15.73:0/3229876705 reap_dead start 2024-09-12T03:36:22.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c38004810 0x7f6c38004c90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c001e70 tx=0x7f6c3c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0cde653189ac0c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c001a90 con 0x7f6c38004810 2024-09-12T03:36:22.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c003b80 con 0x7f6c38004810 2024-09-12T03:36:22.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c4959a640 1 -- 172.21.15.73:0/3229876705 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c005080 con 0x7f6c38004810 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- 172.21.15.73:0/3229876705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c38004810 msgr2=0x7f6c38004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c38004810 0x7f6c38004c90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c001e70 tx=0x7f6c3c01c760 comp rx=0 tx=0).stop 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- 172.21.15.73:0/3229876705 shutdown_connections 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3229876705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c38004810 0x7f6c38004c90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- 172.21.15.73:0/3229876705 >> 172.21.15.73:0/3229876705 conn(0x7f6c4c0b1f90 msgr2=0x7f6c4c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- 172.21.15.73:0/3229876705 shutdown_connections 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- 172.21.15.73:0/3229876705 wait complete. 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 Processor -- start 2024-09-12T03:36:22.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- start start 2024-09-12T03:36:22.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38004810 0x7f6c4c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c4c157b20 0x7f6c4c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c1475a0 0x7f6c4c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c158b80 con 0x7f6c4c157b20 2024-09-12T03:36:22.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c06f870 con 0x7f6c38004810 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c1578c0 con 0x7f6c4c1475a0 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c4c157b20 0x7f6c4c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c4c157b20 0x7f6c4c157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48910/0 (socket says 172.21.15.73:48910) 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 -- 172.21.15.73:0/3765146098 learned_addr learned my addr 172.21.15.73:0/3765146098 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c4a59c640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38004810 0x7f6c4c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c4ad9d640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c1475a0 0x7f6c4c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 -- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c1475a0 msgr2=0x7f6c4c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c1475a0 0x7f6c4c15d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 -- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38004810 msgr2=0x7f6c4c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38004810 0x7f6c4c15a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 -- 172.21.15.73:0/3765146098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c159200 con 0x7f6c4c157b20 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c49d9b640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c4c157b20 0x7f6c4c157380 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000f90 tx=0x7f6c38005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c42ffd640 1 -- 172.21.15.73:0/3765146098 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0b5070 con 0x7f6c4c157b20 2024-09-12T03:36:22.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c42ffd640 1 -- 172.21.15.73:0/3765146098 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c006b60 con 0x7f6c4c157b20 2024-09-12T03:36:22.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c1568a0 con 0x7f6c4c157b20 2024-09-12T03:36:22.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c42ffd640 1 -- 172.21.15.73:0/3765146098 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c007dc0 con 0x7f6c4c157b20 2024-09-12T03:36:22.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.162+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c1565a0 con 0x7f6c4c157b20 2024-09-12T03:36:22.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.166+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c4c0b3290 con 0x7f6c4c157b20 2024-09-12T03:36:22.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.166+0000 7f6c42ffd640 1 -- 172.21.15.73:0/3765146098 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c3c0c5480 con 0x7f6c4c157b20 2024-09-12T03:36:22.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.166+0000 7f6c42ffd640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c2c0678c0 0x7f6c2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.166+0000 7f6c42ffd640 1 -- 172.21.15.73:0/3765146098 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f6c3c120a00 con 0x7f6c4c157b20 2024-09-12T03:36:22.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.166+0000 7f6c4a59c640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c2c0678c0 0x7f6c2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.166+0000 7f6c4a59c640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c2c0678c0 0x7f6c2c069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c157ad0 tx=0x7f6c34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.170+0000 7f6c42ffd640 1 -- 172.21.15.73:0/3765146098 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c3c0ad020 con 0x7f6c4c157b20 2024-09-12T03:36:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.350+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c4c0aea20 con 0x7f6c4c157b20 2024-09-12T03:36:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.350+0000 7f6c42ffd640 1 -- 172.21.15.73:0/3765146098 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5223 (secure 0 0 0) 0x7f6c3c016470 con 0x7f6c4c157b20 2024-09-12T03:36:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:22.353 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-12T03:36:06:880174+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4068395780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4068395780},{"type":"v1","addr":"172.21.15.150:6833","nonce":4068395780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/801266996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":801266996},{"type":"v1","addr":"172.21.15.150:6835","nonce":801266996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/204856876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":204856876},{"type":"v1","addr":"172.21.15.73:6835","nonce":204856876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:03.212172+0000","modified":"2024-09-12T03:36:06.243489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5220":{"gid":5220,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3307908616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3307908616},{"type":"v1","addr":"172.21.15.73:6837","nonce":3307908616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5220,"qdb_cluster":[5220]},"id":3}]} 2024-09-12T03:36:22.353 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-12T03:36:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c2c0678c0 msgr2=0x7f6c2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c2c0678c0 0x7f6c2c069d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c157ad0 tx=0x7f6c34008040 comp rx=0 tx=0).stop 2024-09-12T03:36:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c4c157b20 msgr2=0x7f6c4c157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c4c157b20 0x7f6c4c157380 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c000f90 tx=0x7f6c38005840 comp rx=0 tx=0).stop 2024-09-12T03:36:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 shutdown_connections 2024-09-12T03:36:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c2c0678c0 0x7f6c2c069d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c4c157b20 0x7f6c4c157380 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c4c1475a0 0x7f6c4c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 --2- 172.21.15.73:0/3765146098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38004810 0x7f6c4c15a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 >> 172.21.15.73:0/3765146098 conn(0x7f6c4c0b1f90 msgr2=0x7f6c4c072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 shutdown_connections 2024-09-12T03:36:22.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.354+0000 7f6c509d9640 1 -- 172.21.15.73:0/3765146098 wait complete. 2024-09-12T03:36:22.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6fcbd640 1 Processor -- start 2024-09-12T03:36:22.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6fcbd640 1 -- start start 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6fcbd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5f68153010 0x7f5f6815d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6fcbd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 0x7f5f68073220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6fcbd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f681533f0 con 0x7f5f68072dd0 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6fcbd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5f68073850 con 0x7f5f68153010 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6fcbd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5f68073b30 con 0x7f5f680b3990 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6d258640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5f68072dd0 0x7f5f680b3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38134/0 (socket says 172.21.15.73:38134) 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6d258640 1 -- 172.21.15.73:0/3504715557 learned_addr learned my addr 172.21.15.73:0/3504715557 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6e25a640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 0x7f5f68073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6da59640 1 --2- 172.21.15.73:0/3504715557 >> v2:172.21.15.150:3300/0 conn(0x7f5f68153010 0x7f5f6815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900119589 0 0) 0x7f5f58001120 con 0x7f5f68072dd0 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f54003530 con 0x7f5f68072dd0 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3564381564 0 0) 0x7f5f54003530 con 0x7f5f68072dd0 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 msgr2=0x7f5f68073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 0x7f5f68073220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 >> v2:172.21.15.150:3300/0 conn(0x7f5f68153010 msgr2=0x7f5f6815d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 --2- 172.21.15.73:0/3504715557 >> v2:172.21.15.150:3300/0 conn(0x7f5f68153010 0x7f5f6815d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6815c890 con 0x7f5f68072dd0 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f5f58001850 con 0x7f5f68072dd0 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 >> v1:172.21.15.73:6789/0 conn(0x7f5f68072dd0 legacy=0x7f5f680b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 0x7f5f540039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54003f40 0x7f5f54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f54004d50 0x7f5f540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f68073850 con 0x7f5f54004d50 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f68073b30 con 0x7f5f54003f40 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5400b9d0 con 0x7f5f680b3990 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6e25a640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f54004d50 0x7f5f540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6da59640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 0x7f5f540039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6d258640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54003f40 0x7f5f54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6e25a640 1 -- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 msgr2=0x7f5f540039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6e25a640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f680b3990 0x7f5f540039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6e25a640 1 -- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54003f40 msgr2=0x7f5f54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6e25a640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54003f40 0x7f5f54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.490+0000 7f5f6e25a640 1 -- 172.21.15.73:0/3504715557 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f54003530 con 0x7f5f54004d50 2024-09-12T03:36:22.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6e25a640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f54004d50 0x7f5f540051d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009fc0 tx=0x7f5f6001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a1979b0f4be7c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f600b2070 con 0x7f5f54004d50 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f600a5c90 con 0x7f5f54004d50 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6ca57640 1 -- 172.21.15.73:0/3504715557 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60009c10 con 0x7f5f54004d50 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/3504715557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f54004d50 msgr2=0x7f5f540051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 --2- 172.21.15.73:0/3504715557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f54004d50 0x7f5f540051d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009fc0 tx=0x7f5f6001cc20 comp rx=0 tx=0).stop 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6e25a640 1 -- 172.21.15.73:0/3504715557 reap_dead start 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/3504715557 shutdown_connections 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/3504715557 >> 172.21.15.73:0/3504715557 conn(0x7f5f680b6870 msgr2=0x7f5f680b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/3504715557 shutdown_connections 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/3504715557 wait complete. 2024-09-12T03:36:22.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 Processor -- start 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.494+0000 7f5f6fcbd640 1 -- start start 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54004d50 0x7f5f68147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f681537e0 0x7f5f6815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f68153c60 0x7f5f6815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6806fe00 con 0x7f5f681537e0 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6815c540 con 0x7f5f54004d50 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5f68073220 con 0x7f5f68153c60 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f681537e0 0x7f5f6815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f681537e0 0x7f5f6815afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48928/0 (socket says 172.21.15.73:48928) 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 -- 172.21.15.73:0/768589290 learned_addr learned my addr 172.21.15.73:0/768589290 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6da59640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54004d50 0x7f5f68147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6e25a640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f68153c60 0x7f5f6815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 -- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f68153c60 msgr2=0x7f5f6815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f68153c60 0x7f5f6815b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 -- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54004d50 msgr2=0x7f5f68147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54004d50 0x7f5f68147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 -- 172.21.15.73:0/768589290 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f680b4a50 con 0x7f5f681537e0 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6d258640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f681537e0 0x7f5f6815afb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5f58007330 tx=0x7f5f58007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f5e7fc640 1 -- 172.21.15.73:0/768589290 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800e950 con 0x7f5f681537e0 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f5e7fc640 1 -- 172.21.15.73:0/768589290 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f58018070 con 0x7f5f681537e0 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f5e7fc640 1 -- 172.21.15.73:0/768589290 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800ed30 con 0x7f5f681537e0 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f680b4d30 con 0x7f5f681537e0 2024-09-12T03:36:22.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f680b52f0 con 0x7f5f681537e0 2024-09-12T03:36:22.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6815d090 con 0x7f5f681537e0 2024-09-12T03:36:22.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f5e7fc640 1 -- 172.21.15.73:0/768589290 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f58013420 con 0x7f5f681537e0 2024-09-12T03:36:22.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f5e7fc640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5f4c0678f0 0x7f5f4c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6da59640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5f4c0678f0 0x7f5f4c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f5e7fc640 1 -- 172.21.15.73:0/768589290 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f5f58085970 con 0x7f5f681537e0 2024-09-12T03:36:22.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.498+0000 7f5f6da59640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5f4c0678f0 0x7f5f4c069db0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f6815bdd0 tx=0x7f5f64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.502+0000 7f5f5e7fc640 1 -- 172.21.15.73:0/768589290 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f58087e20 con 0x7f5f681537e0 2024-09-12T03:36:22.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f680b1200 con 0x7f5f681537e0 2024-09-12T03:36:22.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f5e7fc640 1 -- 172.21.15.73:0/768589290 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5223 (secure 0 0 0) 0x7f5f681533f0 con 0x7f5f681537e0 2024-09-12T03:36:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:22.689 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"btime":"2024-09-12T03:36:06:880174+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4068395780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4068395780},{"type":"v1","addr":"172.21.15.150:6833","nonce":4068395780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/801266996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":801266996},{"type":"v1","addr":"172.21.15.150:6835","nonce":801266996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/204856876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":204856876},{"type":"v1","addr":"172.21.15.73:6835","nonce":204856876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:03.212172+0000","modified":"2024-09-12T03:36:06.243489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5220":{"gid":5220,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3307908616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3307908616},{"type":"v1","addr":"172.21.15.73:6837","nonce":3307908616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5220,"qdb_cluster":[5220]},"id":3}]} 2024-09-12T03:36:22.689 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2024-09-12T03:36:22.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5f4c0678f0 msgr2=0x7f5f4c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5f4c0678f0 0x7f5f4c069db0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f6815bdd0 tx=0x7f5f64008040 comp rx=0 tx=0).stop 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f681537e0 msgr2=0x7f5f6815afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f681537e0 0x7f5f6815afb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5f58007330 tx=0x7f5f58007730 comp rx=0 tx=0).stop 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 shutdown_connections 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5f4c0678f0 0x7f5f4c069db0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f681537e0 0x7f5f6815afb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5f68153c60 0x7f5f6815b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 --2- 172.21.15.73:0/768589290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5f54004d50 0x7f5f68147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.686+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 >> 172.21.15.73:0/768589290 conn(0x7f5f680b6870 msgr2=0x7f5f6814dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.690+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 shutdown_connections 2024-09-12T03:36:22.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.690+0000 7f5f6fcbd640 1 -- 172.21.15.73:0/768589290 wait complete. 2024-09-12T03:36:22.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:22.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.810+0000 7f903b5bb640 1 Processor -- start 2024-09-12T03:36:22.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f903b5bb640 1 -- start start 2024-09-12T03:36:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f903b5bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f903415c2a0 0x7f90340aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f903b5bb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90340af2a0 0x7f903406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f903b5bb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90340b3290 con 0x7f903415bec0 2024-09-12T03:36:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f903b5bb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f90340b3570 con 0x7f903415c2a0 2024-09-12T03:36:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f903b5bb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f90340b3850 con 0x7f90340af2a0 2024-09-12T03:36:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f903415c2a0 0x7f90340aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f903415c2a0 0x7f90340aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48942/0 (socket says 172.21.15.73:48942) 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9039357640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f903415bec0 0x7f90340ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38140/0 (socket says 172.21.15.73:38140) 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 -- 172.21.15.73:0/1102082535 learned_addr learned my addr 172.21.15.73:0/1102082535 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 -- 172.21.15.73:0/1102082535 >> v2:172.21.15.150:3300/0 conn(0x7f90340af2a0 msgr2=0x7f903406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9039b58640 1 --2- 172.21.15.73:0/1102082535 >> v2:172.21.15.150:3300/0 conn(0x7f90340af2a0 0x7f903406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f902bfff640 1 -- 172.21.15.73:0/1102082535 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458521134 0 0) 0x7f90340b3290 con 0x7f903415bec0 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 --2- 172.21.15.73:0/1102082535 >> v2:172.21.15.150:3300/0 conn(0x7f90340af2a0 0x7f903406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 -- 172.21.15.73:0/1102082535 >> v1:172.21.15.73:6789/0 conn(0x7f903415bec0 legacy=0x7f90340ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 -- 172.21.15.73:0/1102082535 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90340b3b30 con 0x7f903415c2a0 2024-09-12T03:36:22.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9039b58640 1 --2- 172.21.15.73:0/1102082535 >> v2:172.21.15.150:3300/0 conn(0x7f90340af2a0 0x7f903406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f9038b56640 1 --2- 172.21.15.73:0/1102082535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415c2a0 0x7f90340aed60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f90340b2fb0 tx=0x7f902401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e561b4e150a30a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f902bfff640 1 -- 172.21.15.73:0/1102082535 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240aa650 con 0x7f903415c2a0 2024-09-12T03:36:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f902bfff640 1 -- 172.21.15.73:0/1102082535 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90240af070 con 0x7f903415c2a0 2024-09-12T03:36:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.814+0000 7f902bfff640 1 -- 172.21.15.73:0/1102082535 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240aaa10 con 0x7f903415c2a0 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/1102082535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415c2a0 msgr2=0x7f90340aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 --2- 172.21.15.73:0/1102082535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415c2a0 0x7f90340aed60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f90340b2fb0 tx=0x7f902401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/1102082535 shutdown_connections 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 --2- 172.21.15.73:0/1102082535 >> v2:172.21.15.150:3300/0 conn(0x7f90340af2a0 0x7f903406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 --2- 172.21.15.73:0/1102082535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415c2a0 0x7f90340aed60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/1102082535 >> 172.21.15.73:0/1102082535 conn(0x7f90340b1f90 msgr2=0x7f90340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/1102082535 shutdown_connections 2024-09-12T03:36:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/1102082535 wait complete. 2024-09-12T03:36:22.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 Processor -- start 2024-09-12T03:36:22.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- start start 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90340af2a0 0x7f903414c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415bec0 0x7f903414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f903415c2a0 0x7f903414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f903406ed50 con 0x7f903415bec0 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f90340af6b0 con 0x7f90340af2a0 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f903406eed0 con 0x7f903415c2a0 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415bec0 0x7f903414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415bec0 0x7f903414e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48950/0 (socket says 172.21.15.73:48950) 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 -- 172.21.15.73:0/3029158943 learned_addr learned my addr 172.21.15.73:0/3029158943 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9039357640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90340af2a0 0x7f903414c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 -- 172.21.15.73:0/3029158943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f903415c2a0 msgr2=0x7f903414e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f903415c2a0 0x7f903414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 -- 172.21.15.73:0/3029158943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90340af2a0 msgr2=0x7f903414c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90340af2a0 0x7f903414c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 -- 172.21.15.73:0/3029158943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9034150a80 con 0x7f903415bec0 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9038b56640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415bec0 0x7f903414e090 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f90240ac040 tx=0x7f9024019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9029ffb640 1 -- 172.21.15.73:0/3029158943 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240aae60 con 0x7f903415bec0 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9029ffb640 1 -- 172.21.15.73:0/3029158943 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90240a6040 con 0x7f903415bec0 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f903415cc70 con 0x7f903415bec0 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f9029ffb640 1 -- 172.21.15.73:0/3029158943 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240b4a70 con 0x7f903415bec0 2024-09-12T03:36:22.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f903415d230 con 0x7f903415bec0 2024-09-12T03:36:22.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.818+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903406f1d0 con 0x7f903415bec0 2024-09-12T03:36:22.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.822+0000 7f9029ffb640 1 -- 172.21.15.73:0/3029158943 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f90240bc020 con 0x7f903415bec0 2024-09-12T03:36:22.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.822+0000 7f9029ffb640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f90180678c0 0x7f9018069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:22.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.822+0000 7f9039357640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f90180678c0 0x7f9018069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:22.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.822+0000 7f9029ffb640 1 -- 172.21.15.73:0/3029158943 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7f9024120520 con 0x7f903415bec0 2024-09-12T03:36:22.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.822+0000 7f9039357640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f90180678c0 0x7f9018069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9030000f70 tx=0x7f9030009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:22.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.826+0000 7f9029ffb640 1 -- 172.21.15.73:0/3029158943 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9024016110 con 0x7f903415bec0 2024-09-12T03:36:22.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.986+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f903406fcd0 con 0x7f903415bec0 2024-09-12T03:36:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.986+0000 7f9029ffb640 1 -- 172.21.15.73:0/3029158943 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+17109 (secure 0 0 0) 0x7f90240f0ea0 con 0x7f903415bec0 2024-09-12T03:36:22.991 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:22.991 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":53,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:21.087087+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:00.869276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:02.196347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:22.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f90180678c0 msgr2=0x7f9018069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f90180678c0 0x7f9018069d80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9030000f70 tx=0x7f9030009040 comp rx=0 tx=0).stop 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415bec0 msgr2=0x7f903414e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415bec0 0x7f903414e090 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f90240ac040 tx=0x7f9024019290 comp rx=0 tx=0).stop 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 shutdown_connections 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f90180678c0 0x7f9018069d80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f903415bec0 0x7f903414e090 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f903415c2a0 0x7f903414e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 --2- 172.21.15.73:0/3029158943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90340af2a0 0x7f903414c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 >> 172.21.15.73:0/3029158943 conn(0x7f90340b1f90 msgr2=0x7f90340b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 shutdown_connections 2024-09-12T03:36:22.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:22.990+0000 7f903b5bb640 1 -- 172.21.15.73:0/3029158943 wait complete. 2024-09-12T03:36:23.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:36:23.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.114+0000 7fc4be8c0640 1 Processor -- start 2024-09-12T03:36:23.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.114+0000 7fc4be8c0640 1 -- start start 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.114+0000 7fc4be8c0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4b809ac60 0x7fc4b809ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.114+0000 7fc4be8c0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4b809b040 0x7fc4b80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.114+0000 7fc4be8c0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b80afd80 con 0x7fc4b80b0e20 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.114+0000 7fc4be8c0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b80b0060 con 0x7fc4b809b040 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.114+0000 7fc4be8c0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b80b0340 con 0x7fc4b809ac60 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4b809b040 0x7fc4b80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4b809b040 0x7fc4b80af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48956/0 (socket says 172.21.15.73:48956) 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 -- 172.21.15.73:0/1038688224 learned_addr learned my addr 172.21.15.73:0/1038688224 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 -- 172.21.15.73:0/1038688224 >> v2:172.21.15.150:3300/0 conn(0x7fc4b809ac60 msgr2=0x7fc4b809ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b7fff640 1 --2- 172.21.15.73:0/1038688224 >> v2:172.21.15.150:3300/0 conn(0x7fc4b809ac60 0x7fc4b809ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 --2- 172.21.15.73:0/1038688224 >> v2:172.21.15.150:3300/0 conn(0x7fc4b809ac60 0x7fc4b809ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 -- 172.21.15.73:0/1038688224 >> v1:172.21.15.150:6789/0 conn(0x7fc4b80b0e20 legacy=0x7fc4b80b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:23.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 -- 172.21.15.73:0/1038688224 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b80b0620 con 0x7fc4b809b040 2024-09-12T03:36:23.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b77fe640 1 --2- 172.21.15.73:0/1038688224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809b040 0x7fc4b80af730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80b7d70 tx=0x7fc4ac01ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6462541955a1197 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:23.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b6ffd640 1 -- 172.21.15.73:0/1038688224 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0ab640 con 0x7fc4b809b040 2024-09-12T03:36:23.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b6ffd640 1 -- 172.21.15.73:0/1038688224 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ac0b0070 con 0x7fc4b809b040 2024-09-12T03:36:23.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4b6ffd640 1 -- 172.21.15.73:0/1038688224 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0aba00 con 0x7fc4b809b040 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1038688224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809b040 msgr2=0x7fc4b80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1038688224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809b040 0x7fc4b80af730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80b7d70 tx=0x7fc4ac01ce80 comp rx=0 tx=0).stop 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1038688224 shutdown_connections 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1038688224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809b040 0x7fc4b80af730 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1038688224 >> v2:172.21.15.150:3300/0 conn(0x7fc4b809ac60 0x7fc4b809ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1038688224 >> 172.21.15.73:0/1038688224 conn(0x7fc4b80b78d0 msgr2=0x7fc4b80b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1038688224 shutdown_connections 2024-09-12T03:36:23.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.118+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1038688224 wait complete. 2024-09-12T03:36:23.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 Processor -- start 2024-09-12T03:36:23.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 -- start start 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809ac60 0x7fc4b813eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4b809b040 0x7fc4b8151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4b80b0e20 0x7fc4b81523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b815d3e0 con 0x7fc4b809ac60 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b815d260 con 0x7fc4b80b0e20 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b815d560 con 0x7fc4b809b040 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809ac60 0x7fc4b813eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809ac60 0x7fc4b813eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48958/0 (socket says 172.21.15.73:48958) 2024-09-12T03:36:23.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 -- 172.21.15.73:0/1908878626 learned_addr learned my addr 172.21.15.73:0/1908878626 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4bce5d640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4b80b0e20 0x7fc4b81523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 -- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4b809b040 msgr2=0x7fc4b8151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4b809b040 0x7fc4b8151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 -- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4b80b0e20 msgr2=0x7fc4b81523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4b80b0e20 0x7fc4b81523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 -- 172.21.15.73:0/1908878626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b8157490 con 0x7fc4b809ac60 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4bce5d640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4b80b0e20 0x7fc4b81523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b7fff640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809ac60 0x7fc4b813eb60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c7f0 tx=0x7fc4a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b4ff9640 1 -- 172.21.15.73:0/1908878626 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8015070 con 0x7fc4b809ac60 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b4ff9640 1 -- 172.21.15.73:0/1908878626 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8004240 con 0x7fc4b809ac60 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b8157730 con 0x7fc4b809ac60 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b4ff9640 1 -- 172.21.15.73:0/1908878626 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8003620 con 0x7fc4b809ac60 2024-09-12T03:36:23.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b813f0a0 con 0x7fc4b809ac60 2024-09-12T03:36:23.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b815c8d0 con 0x7fc4b809ac60 2024-09-12T03:36:23.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b4ff9640 1 -- 172.21.15.73:0/1908878626 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4a80039d0 con 0x7fc4b809ac60 2024-09-12T03:36:23.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b4ff9640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4a40678c0 0x7fc4a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b4ff9640 1 -- 172.21.15.73:0/1908878626 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6159+0+0 (secure 0 0 0) 0x7fc4a8085e20 con 0x7fc4b809ac60 2024-09-12T03:36:23.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.122+0000 7fc4b77fe640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4a40678c0 0x7fc4a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.126+0000 7fc4b77fe640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4a40678c0 0x7fc4a4069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0af000 tx=0x7fc4ac0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:23.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.130+0000 7fc4b4ff9640 1 -- 172.21.15.73:0/1908878626 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4a8056830 con 0x7fc4b809ac60 2024-09-12T03:36:23.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.310+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc4b815c5f0 con 0x7fc4b809ac60 2024-09-12T03:36:23.312 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T03:36:23.310+0000 7fe1c1027640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:36:23.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4b4ff9640 1 -- 172.21.15.73:0/1908878626 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7fc4a8056130 con 0x7fc4b809ac60 2024-09-12T03:36:23.315 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:36:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4a40678c0 msgr2=0x7fc4a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4a40678c0 0x7fc4a4069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac0af000 tx=0x7fc4ac0046d0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809ac60 msgr2=0x7fc4b813eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809ac60 0x7fc4b813eb60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c7f0 tx=0x7fc4a800ccb0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 shutdown_connections 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4a40678c0 0x7fc4a4069d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4b80b0e20 0x7fc4b81523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4b809b040 0x7fc4b8151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 --2- 172.21.15.73:0/1908878626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b809ac60 0x7fc4b813eb60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 >> 172.21.15.73:0/1908878626 conn(0x7fc4b80b78d0 msgr2=0x7fc4b81560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 shutdown_connections 2024-09-12T03:36:23.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.314+0000 7fc4be8c0640 1 -- 172.21.15.73:0/1908878626 wait complete. 2024-09-12T03:36:23.327 INFO:tasks.ceph.mds.c.smithi073.stderr: -1557> 2024-09-12T03:36:09.478+0000 7ff81470e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:36:23.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:36:23.383 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:36:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.442+0000 7f0d0e79f640 1 Processor -- start 2024-09-12T03:36:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.442+0000 7f0d0e79f640 1 -- start start 2024-09-12T03:36:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0d0815e5f0 0x7f0d0806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d080cfaf0 0x7f0d080d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0806d9c0 con 0x7f0d080ce9d0 2024-09-12T03:36:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0806dca0 con 0x7f0d080cfaf0 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0d0806df80 con 0x7f0d0815e5f0 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d080cfaf0 0x7f0d080d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d080cfaf0 0x7f0d080d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48992/0 (socket says 172.21.15.73:48992) 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 -- 172.21.15.73:0/3005585002 learned_addr learned my addr 172.21.15.73:0/3005585002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d077fe640 1 --1- 172.21.15.73:0/3005585002 >> v1:172.21.15.73:6789/0 conn(0x7f0d080ce9d0 0x7f0d080cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38142/0 (socket says 172.21.15.73:38142) 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d07fff640 1 --2- 172.21.15.73:0/3005585002 >> v2:172.21.15.150:3300/0 conn(0x7f0d0815e5f0 0x7f0d0806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 -- 172.21.15.73:0/3005585002 >> v2:172.21.15.150:3300/0 conn(0x7f0d0815e5f0 msgr2=0x7f0d0806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 --2- 172.21.15.73:0/3005585002 >> v2:172.21.15.150:3300/0 conn(0x7f0d0815e5f0 0x7f0d0806d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 -- 172.21.15.73:0/3005585002 >> v1:172.21.15.73:6789/0 conn(0x7f0d080ce9d0 legacy=0x7f0d080cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 -- 172.21.15.73:0/3005585002 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0806e260 con 0x7f0d080cfaf0 2024-09-12T03:36:23.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0cd3c640 1 --2- 172.21.15.73:0/3005585002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d080d2b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d0808e380 tx=0x7f0d0001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ad5923a2bc4b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:23.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d06ffd640 1 -- 172.21.15.73:0/3005585002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000a57d0 con 0x7f0d080cfaf0 2024-09-12T03:36:23.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d06ffd640 1 -- 172.21.15.73:0/3005585002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d000a5970 con 0x7f0d080cfaf0 2024-09-12T03:36:23.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d06ffd640 1 -- 172.21.15.73:0/3005585002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000a5d40 con 0x7f0d080cfaf0 2024-09-12T03:36:23.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- 172.21.15.73:0/3005585002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 msgr2=0x7f0d080d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/3005585002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d080d2b60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0d0808e380 tx=0x7f0d0001c9f0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- 172.21.15.73:0/3005585002 shutdown_connections 2024-09-12T03:36:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/3005585002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d080d2b60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/3005585002 >> v2:172.21.15.150:3300/0 conn(0x7f0d0815e5f0 0x7f0d0806d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- 172.21.15.73:0/3005585002 >> 172.21.15.73:0/3005585002 conn(0x7f0d08074030 msgr2=0x7f0d0809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- 172.21.15.73:0/3005585002 shutdown_connections 2024-09-12T03:36:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.446+0000 7f0d0e79f640 1 -- 172.21.15.73:0/3005585002 wait complete. 2024-09-12T03:36:23.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 Processor -- start 2024-09-12T03:36:23.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 -- start start 2024-09-12T03:36:23.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d08154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d0815b030 0x7f0d08152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d081561b0 0x7f0d08156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d080d3c40 con 0x7f0d080cfaf0 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d080d3ac0 con 0x7f0d081561b0 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0816afa0 con 0x7f0d0815b030 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d08154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d08154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49000/0 (socket says 172.21.15.73:49000) 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 -- 172.21.15.73:0/993317477 learned_addr learned my addr 172.21.15.73:0/993317477 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 -- 172.21.15.73:0/993317477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d0815b030 msgr2=0x7f0d08152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d0815b030 0x7f0d08152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 -- 172.21.15.73:0/993317477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d081561b0 msgr2=0x7f0d08156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d081561b0 0x7f0d08156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 -- 172.21.15.73:0/993317477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d080c7eb0 con 0x7f0d080cfaf0 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d07fff640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d08154400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800d5f0 tx=0x7f0cf800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:23.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d04ff9640 1 -- 172.21.15.73:0/993317477 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80125f0 con 0x7f0d080cfaf0 2024-09-12T03:36:23.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d04ff9640 1 -- 172.21.15.73:0/993317477 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf8019070 con 0x7f0d080cfaf0 2024-09-12T03:36:23.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d08153b60 con 0x7f0d080cfaf0 2024-09-12T03:36:23.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d04ff9640 1 -- 172.21.15.73:0/993317477 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf80129b0 con 0x7f0d080cfaf0 2024-09-12T03:36:23.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d08154120 con 0x7f0d080cfaf0 2024-09-12T03:36:23.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d080d2b60 con 0x7f0d080cfaf0 2024-09-12T03:36:23.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.450+0000 7f0d04ff9640 1 -- 172.21.15.73:0/993317477 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cf8012b50 con 0x7f0d080cfaf0 2024-09-12T03:36:23.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.454+0000 7f0d04ff9640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0cf40678c0 0x7f0cf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:23.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.454+0000 7f0d04ff9640 1 -- 172.21.15.73:0/993317477 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6245+0+0 (secure 0 0 0) 0x7f0cf8086260 con 0x7f0d080cfaf0 2024-09-12T03:36:23.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.454+0000 7f0d077fe640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0cf40678c0 0x7f0cf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:23.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.454+0000 7f0d077fe640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0cf40678c0 0x7f0cf4069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc000f70 tx=0x7f0cfc007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:23.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.458+0000 7f0d04ff9640 1 -- 172.21.15.73:0/993317477 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0cf8056c10 con 0x7f0d080cfaf0 2024-09-12T03:36:23.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:23.646+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0d080c7c50 con 0x7f0d080cfaf0 2024-09-12T03:36:24.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.322+0000 7f0d04ff9640 1 -- 172.21.15.73:0/993317477 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) ==== 104+0+0 (secure 0 0 0) 0x7f0cf8056510 con 0x7f0d080cfaf0 2024-09-12T03:36:24.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0cf40678c0 msgr2=0x7f0cf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:24.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0cf40678c0 0x7f0cf4069d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc000f70 tx=0x7f0cfc007a10 comp rx=0 tx=0).stop 2024-09-12T03:36:24.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 msgr2=0x7f0d08154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:24.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d08154400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800d5f0 tx=0x7f0cf800dab0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 shutdown_connections 2024-09-12T03:36:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0cf40678c0 0x7f0cf4069d80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d081561b0 0x7f0d08156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d0815b030 0x7f0d08152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 --2- 172.21.15.73:0/993317477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d080cfaf0 0x7f0d08154400 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 >> 172.21.15.73:0/993317477 conn(0x7f0d080ce9d0 msgr2=0x7f0d080b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 shutdown_connections 2024-09-12T03:36:24.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.326+0000 7f0d0e79f640 1 -- 172.21.15.73:0/993317477 wait complete. 2024-09-12T03:36:24.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:36:24.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb346f94640 1 Processor -- start 2024-09-12T03:36:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb346f94640 1 -- start start 2024-09-12T03:36:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb346f94640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb3400d3060 0x7fb3400cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb346f94640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb34006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb346f94640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3400d0300 con 0x7fb340161a60 2024-09-12T03:36:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb346f94640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb3400b0f60 con 0x7fb3400d3060 2024-09-12T03:36:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb346f94640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb3400cfd40 con 0x7fb3400cf450 2024-09-12T03:36:24.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb345531640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb34006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:24.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb345531640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb34006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:43746/0 (socket says 172.21.15.73:43746) 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb345531640 1 -- 172.21.15.73:0/3183550922 learned_addr learned my addr 172.21.15.73:0/3183550922 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb344d30640 1 --1- 172.21.15.73:0/3183550922 >> v1:172.21.15.150:6789/0 conn(0x7fb340161a60 0x7fb3400d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44692/0 (socket says 172.21.15.73:44692) 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb33ffff640 1 --2- 172.21.15.73:0/3183550922 >> v2:172.21.15.150:3300/0 conn(0x7fb3400d3060 0x7fb3400cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb33f7fe640 1 -- 172.21.15.73:0/3183550922 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688387480 0 0) 0x7fb338001120 con 0x7fb340161a60 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb33f7fe640 1 -- 172.21.15.73:0/3183550922 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32c003530 con 0x7fb340161a60 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb345531640 1 -- 172.21.15.73:0/3183550922 >> v2:172.21.15.150:3300/0 conn(0x7fb3400d3060 msgr2=0x7fb3400cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb345531640 1 --2- 172.21.15.73:0/3183550922 >> v2:172.21.15.150:3300/0 conn(0x7fb3400d3060 0x7fb3400cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb345531640 1 -- 172.21.15.73:0/3183550922 >> v1:172.21.15.150:6789/0 conn(0x7fb340161a60 legacy=0x7fb3400d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:24.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.474+0000 7fb345531640 1 -- 172.21.15.73:0/3183550922 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3400d0020 con 0x7fb3400cf450 2024-09-12T03:36:24.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb345531640 1 --2- 172.21.15.73:0/3183550922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb34006d6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb330009e50 tx=0x7fb33001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=486a19a839cdb370 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb33f7fe640 1 -- 172.21.15.73:0/3183550922 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300a5830 con 0x7fb3400cf450 2024-09-12T03:36:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb33f7fe640 1 -- 172.21.15.73:0/3183550922 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3300a59d0 con 0x7fb3400cf450 2024-09-12T03:36:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb33f7fe640 1 -- 172.21.15.73:0/3183550922 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300a5d80 con 0x7fb3400cf450 2024-09-12T03:36:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 -- 172.21.15.73:0/3183550922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 msgr2=0x7fb34006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 --2- 172.21.15.73:0/3183550922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb34006d6b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb330009e50 tx=0x7fb33001c970 comp rx=0 tx=0).stop 2024-09-12T03:36:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 -- 172.21.15.73:0/3183550922 shutdown_connections 2024-09-12T03:36:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 --2- 172.21.15.73:0/3183550922 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb34006d6b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 --2- 172.21.15.73:0/3183550922 >> v2:172.21.15.150:3300/0 conn(0x7fb3400d3060 0x7fb3400cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 -- 172.21.15.73:0/3183550922 >> 172.21.15.73:0/3183550922 conn(0x7fb34008bf90 msgr2=0x7fb34009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 -- 172.21.15.73:0/3183550922 shutdown_connections 2024-09-12T03:36:24.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 -- 172.21.15.73:0/3183550922 wait complete. 2024-09-12T03:36:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 Processor -- start 2024-09-12T03:36:24.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.478+0000 7fb346f94640 1 -- start start 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb340160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3400d3060 0x7fb340152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb340161a60 0x7fb340152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb34006e580 con 0x7fb340161a60 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb34006e400 con 0x7fb3400d3060 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb34006e700 con 0x7fb3400cf450 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb340161a60 0x7fb340152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb340161a60 0x7fb340152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49006/0 (socket says 172.21.15.73:49006) 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 -- 172.21.15.73:0/3930854044 learned_addr learned my addr 172.21.15.73:0/3930854044 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:24.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb344d30640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb340160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb33ffff640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3400d3060 0x7fb340152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 -- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 msgr2=0x7fb340160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb340160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 -- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3400d3060 msgr2=0x7fb340152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3400d3060 0x7fb340152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 -- 172.21.15.73:0/3930854044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3400cca20 con 0x7fb340161a60 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb345531640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb340161a60 0x7fb340152d70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb3300af040 tx=0x7fb330019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb33d7fa640 1 -- 172.21.15.73:0/3930854044 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300bc020 con 0x7fb340161a60 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb33d7fa640 1 -- 172.21.15.73:0/3930854044 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb330003ba0 con 0x7fb340161a60 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3400cc180 con 0x7fb340161a60 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb33d7fa640 1 -- 172.21.15.73:0/3930854044 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330004040 con 0x7fb340161a60 2024-09-12T03:36:24.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3400cc740 con 0x7fb340161a60 2024-09-12T03:36:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34006d6b0 con 0x7fb340161a60 2024-09-12T03:36:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb33d7fa640 1 -- 172.21.15.73:0/3930854044 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb3300bf020 con 0x7fb340161a60 2024-09-12T03:36:24.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb33d7fa640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb3200678c0 0x7fb320069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:24.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb33d7fa640 1 -- 172.21.15.73:0/3930854044 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6245+0+0 (secure 0 0 0) 0x7fb3301215a0 con 0x7fb340161a60 2024-09-12T03:36:24.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb344d30640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb3200678c0 0x7fb320069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:24.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.482+0000 7fb344d30640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb3200678c0 0x7fb320069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb338007fd0 tx=0x7fb3380079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:24.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.486+0000 7fb33d7fa640 1 -- 172.21.15.73:0/3930854044 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb3300c6030 con 0x7fb340161a60 2024-09-12T03:36:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:24.650+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb34006bcc0 con 0x7fb340161a60 2024-09-12T03:36:25.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.326+0000 7fb33d7fa640 1 -- 172.21.15.73:0/3930854044 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) ==== 181+0+0 (secure 0 0 0) 0x7fb330016620 con 0x7fb340161a60 2024-09-12T03:36:25.328 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:36:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb3200678c0 msgr2=0x7fb320069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb3200678c0 0x7fb320069d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb338007fd0 tx=0x7fb3380079c0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb340161a60 msgr2=0x7fb340152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:25.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb340161a60 0x7fb340152d70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb3300af040 tx=0x7fb330019710 comp rx=0 tx=0).stop 2024-09-12T03:36:25.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 shutdown_connections 2024-09-12T03:36:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb3200678c0 0x7fb320069d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb340161a60 0x7fb340152d70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3400d3060 0x7fb340152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 --2- 172.21.15.73:0/3930854044 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb3400cf450 0x7fb340160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 >> 172.21.15.73:0/3930854044 conn(0x7fb34008bf90 msgr2=0x7fb3400d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:25.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 shutdown_connections 2024-09-12T03:36:25.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.330+0000 7fb346f94640 1 -- 172.21.15.73:0/3930854044 wait complete. 2024-09-12T03:36:25.356 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:36:25.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.482+0000 7f37cb607640 1 Processor -- start 2024-09-12T03:36:25.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.482+0000 7f37cb607640 1 -- start start 2024-09-12T03:36:25.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37c4145d90 0x7f37c40b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c406bcc0 0x7f37c406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f37c40d1050 0x7f37c40d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f37c406c640 con 0x7f37c4145d90 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f37c40d1d80 con 0x7f37c40d1050 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37c40afa20 con 0x7f37c406bcc0 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37c4145d90 0x7f37c40b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37c4145d90 0x7f37c40b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34364/0 (socket says 172.21.15.73:34364) 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 -- 172.21.15.73:0/3453246881 learned_addr learned my addr 172.21.15.73:0/3453246881 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c9ba4640 1 --2- 172.21.15.73:0/3453246881 >> v2:172.21.15.150:3300/0 conn(0x7f37c40d1050 0x7f37c40d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c8ba2640 1 --2- 172.21.15.73:0/3453246881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c406bcc0 0x7f37c406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 -- 172.21.15.73:0/3453246881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c406bcc0 msgr2=0x7f37c406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:25.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 --2- 172.21.15.73:0/3453246881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c406bcc0 0x7f37c406c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 -- 172.21.15.73:0/3453246881 >> v2:172.21.15.150:3300/0 conn(0x7f37c40d1050 msgr2=0x7f37c40d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:25.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 --2- 172.21.15.73:0/3453246881 >> v2:172.21.15.150:3300/0 conn(0x7f37c40d1050 0x7f37c40d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 -- 172.21.15.73:0/3453246881 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c40afd00 con 0x7f37c4145d90 2024-09-12T03:36:25.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c8ba2640 1 --2- 172.21.15.73:0/3453246881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c406bcc0 0x7f37c406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:25.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c9ba4640 1 --2- 172.21.15.73:0/3453246881 >> v2:172.21.15.150:3300/0 conn(0x7f37c40d1050 0x7f37c40d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:25.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37c93a3640 1 --2- 172.21.15.73:0/3453246881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c4145d90 0x7f37c40b0500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f37c4073230 tx=0x7f37c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f74047895e7a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:25.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37bbfff640 1 -- 172.21.15.73:0/3453246881 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00b2070 con 0x7f37c4145d90 2024-09-12T03:36:25.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37bbfff640 1 -- 172.21.15.73:0/3453246881 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00ad640 con 0x7f37c4145d90 2024-09-12T03:36:25.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37bbfff640 1 -- 172.21.15.73:0/3453246881 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00ada10 con 0x7f37c4145d90 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 -- 172.21.15.73:0/3453246881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c4145d90 msgr2=0x7f37c40b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.486+0000 7f37cb607640 1 --2- 172.21.15.73:0/3453246881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c4145d90 0x7f37c40b0500 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f37c4073230 tx=0x7f37c001c520 comp rx=0 tx=0).stop 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- 172.21.15.73:0/3453246881 shutdown_connections 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 --2- 172.21.15.73:0/3453246881 >> v2:172.21.15.150:3300/0 conn(0x7f37c40d1050 0x7f37c40d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 --2- 172.21.15.73:0/3453246881 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c406bcc0 0x7f37c406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 --2- 172.21.15.73:0/3453246881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c4145d90 0x7f37c40b0500 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- 172.21.15.73:0/3453246881 >> 172.21.15.73:0/3453246881 conn(0x7f37c409aa00 msgr2=0x7f37c40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- 172.21.15.73:0/3453246881 shutdown_connections 2024-09-12T03:36:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- 172.21.15.73:0/3453246881 wait complete. 2024-09-12T03:36:25.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 Processor -- start 2024-09-12T03:36:25.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- start start 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c406bcc0 0x7f37c4158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c40d1050 0x7f37c4159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c4145d90 0x7f37c4143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f37c40b48a0 con 0x7f37c40d1050 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f37c40d1a20 con 0x7f37c406bcc0 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f37c40b4a20 con 0x7f37c4145d90 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c40d1050 0x7f37c4159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c40d1050 0x7f37c4159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34378/0 (socket says 172.21.15.73:34378) 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 -- 172.21.15.73:0/2345387139 learned_addr learned my addr 172.21.15.73:0/2345387139 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c93a3640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c406bcc0 0x7f37c4158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c9ba4640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c4145d90 0x7f37c4143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:25.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 -- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c4145d90 msgr2=0x7f37c4143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c4145d90 0x7f37c4143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 -- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c406bcc0 msgr2=0x7f37c4158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c406bcc0 0x7f37c4158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 -- 172.21.15.73:0/2345387139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c413cd50 con 0x7f37c40d1050 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37c8ba2640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c40d1050 0x7f37c4159640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c7c0 tx=0x7f37b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37b9ffb640 1 -- 172.21.15.73:0/2345387139 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4015070 con 0x7f37c40d1050 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37b9ffb640 1 -- 172.21.15.73:0/2345387139 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b4007a30 con 0x7f37c40d1050 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c413d030 con 0x7f37c40d1050 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37b9ffb640 1 -- 172.21.15.73:0/2345387139 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4007e00 con 0x7f37c40d1050 2024-09-12T03:36:25.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.490+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c413d5f0 con 0x7f37c40d1050 2024-09-12T03:36:25.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.494+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c406c100 con 0x7f37c40d1050 2024-09-12T03:36:25.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.494+0000 7f37b9ffb640 1 -- 172.21.15.73:0/2345387139 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f37b4018070 con 0x7f37c40d1050 2024-09-12T03:36:25.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.494+0000 7f37b9ffb640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37a80678c0 0x7f37a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:25.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.494+0000 7f37b9ffb640 1 -- 172.21.15.73:0/2345387139 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5807+0+0 (secure 0 0 0) 0x7f37b4085c50 con 0x7f37c40d1050 2024-09-12T03:36:25.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.494+0000 7f37c93a3640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37a80678c0 0x7f37a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:25.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.494+0000 7f37c93a3640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37a80678c0 0x7f37a8069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f37c00af000 tx=0x7f37c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:25.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.498+0000 7f37b9ffb640 1 -- 172.21.15.73:0/2345387139 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f37b408b020 con 0x7f37c40d1050 2024-09-12T03:36:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:25.662+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f37c413f3e0 con 0x7f37c40d1050 2024-09-12T03:36:26.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.334+0000 7f37b9ffb640 1 -- 172.21.15.73:0/2345387139 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) ==== 169+0+0 (secure 0 0 0) 0x7f37b4056730 con 0x7f37c40d1050 2024-09-12T03:36:26.337 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T03:36:26.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37a80678c0 msgr2=0x7f37a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37a80678c0 0x7f37a8069d80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f37c00af000 tx=0x7f37c0008040 comp rx=0 tx=0).stop 2024-09-12T03:36:26.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c40d1050 msgr2=0x7f37c4159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c40d1050 0x7f37c4159640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c7c0 tx=0x7f37b400cc80 comp rx=0 tx=0).stop 2024-09-12T03:36:26.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 shutdown_connections 2024-09-12T03:36:26.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f37a80678c0 0x7f37a8069d80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37c40d1050 0x7f37c4159640 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f37c4145d90 0x7f37c4143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 --2- 172.21.15.73:0/2345387139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f37c406bcc0 0x7f37c4158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 >> 172.21.15.73:0/2345387139 conn(0x7f37c409aa00 msgr2=0x7f37c40ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:26.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 shutdown_connections 2024-09-12T03:36:26.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.338+0000 7f37cb607640 1 -- 172.21.15.73:0/2345387139 wait complete. 2024-09-12T03:36:26.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T03:36:26.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.486+0000 7fd8f14bb640 1 Processor -- start 2024-09-12T03:36:26.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.486+0000 7fd8f14bb640 1 -- start start 2024-09-12T03:36:26.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8f14bb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8ec1520a0 0x7fd8ec06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8f14bb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec15f3a0 0x7fd8ec0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8f14bb640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8ec070250 con 0x7fd8ec06fe50 2024-09-12T03:36:26.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8f14bb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ec152480 con 0x7fd8ec1520a0 2024-09-12T03:36:26.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8f14bb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec0aede0 con 0x7fd8ec15f3a0 2024-09-12T03:36:26.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eb7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec15f3a0 0x7fd8ec0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eaffd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8ec1520a0 0x7fd8ec06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eb7fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec15f3a0 0x7fd8ec0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:33042/0 (socket says 172.21.15.73:33042) 2024-09-12T03:36:26.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eb7fe640 1 -- 172.21.15.73:0/1579129958 learned_addr learned my addr 172.21.15.73:0/1579129958 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:26.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8e27fc640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd8ec06fe50 0x7fd8ec15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:40674/0 (socket says 172.21.15.73:40674) 2024-09-12T03:36:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eaffd640 1 -- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec15f3a0 msgr2=0x7fd8ec0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eaffd640 1 --2- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec15f3a0 0x7fd8ec0adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eaffd640 1 -- 172.21.15.73:0/1579129958 >> v1:172.21.15.150:6789/0 conn(0x7fd8ec06fe50 legacy=0x7fd8ec15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8ea7fc640 1 -- 172.21.15.73:0/1579129958 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1096511866 0 0) 0x7fd8ec070250 con 0x7fd8ec06fe50 2024-09-12T03:36:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eaffd640 1 -- 172.21.15.73:0/1579129958 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec15fa10 con 0x7fd8ec1520a0 2024-09-12T03:36:26.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eb7fe640 1 --2- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec15f3a0 0x7fd8ec0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:36:26.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.490+0000 7fd8eaffd640 1 --2- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec06f910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0097c0 tx=0x7fd8dc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8933f6e3405ddee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:26.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8ea7fc640 1 -- 172.21.15.73:0/1579129958 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0b2070 con 0x7fd8ec1520a0 2024-09-12T03:36:26.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8ea7fc640 1 -- 172.21.15.73:0/1579129958 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc0ad640 con 0x7fd8ec1520a0 2024-09-12T03:36:26.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8ea7fc640 1 -- 172.21.15.73:0/1579129958 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0ada10 con 0x7fd8ec1520a0 2024-09-12T03:36:26.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec1520a0 msgr2=0x7fd8ec06f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec06f910 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0097c0 tx=0x7fd8dc01c4a0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- 172.21.15.73:0/1579129958 shutdown_connections 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec15f3a0 0x7fd8ec0adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/1579129958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec06f910 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- 172.21.15.73:0/1579129958 >> 172.21.15.73:0/1579129958 conn(0x7fd8ec0b1f90 msgr2=0x7fd8ec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- 172.21.15.73:0/1579129958 shutdown_connections 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- 172.21.15.73:0/1579129958 wait complete. 2024-09-12T03:36:26.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 Processor -- start 2024-09-12T03:36:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- start start 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec06fe50 0x7fd8ec099870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec165120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec15f3a0 0x7fd8ec165660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec073d30 con 0x7fd8ec1520a0 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec073a50 con 0x7fd8ec15f3a0 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8f14bb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ec06e800 con 0x7fd8ec06fe50 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34380/0 (socket says 172.21.15.73:34380) 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 -- 172.21.15.73:0/2986635957 learned_addr learned my addr 172.21.15.73:0/2986635957 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8eaffd640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec06fe50 0x7fd8ec099870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8eb7fe640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec15f3a0 0x7fd8ec165660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 -- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec06fe50 msgr2=0x7fd8ec099870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec06fe50 0x7fd8ec099870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 -- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec15f3a0 msgr2=0x7fd8ec165660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec15f3a0 0x7fd8ec165660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 -- 172.21.15.73:0/2986635957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec0b0d80 con 0x7fd8ec1520a0 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.494+0000 7fd8e27fc640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec165120 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c480 tx=0x7fd8d400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8e3fff640 1 -- 172.21.15.73:0/2986635957 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4018070 con 0x7fd8ec1520a0 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8e3fff640 1 -- 172.21.15.73:0/2986635957 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d4007500 con 0x7fd8ec1520a0 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec0b1060 con 0x7fd8ec1520a0 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8e3fff640 1 -- 172.21.15.73:0/2986635957 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4004a30 con 0x7fd8ec1520a0 2024-09-12T03:36:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec0b1620 con 0x7fd8ec1520a0 2024-09-12T03:36:26.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ec0adc80 con 0x7fd8ec1520a0 2024-09-12T03:36:26.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8e3fff640 1 -- 172.21.15.73:0/2986635957 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8d401b070 con 0x7fd8ec1520a0 2024-09-12T03:36:26.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8e3fff640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8cc0678f0 0x7fd8cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8e3fff640 1 -- 172.21.15.73:0/2986635957 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fd8d4084e60 con 0x7fd8ec1520a0 2024-09-12T03:36:26.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8eaffd640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8cc0678f0 0x7fd8cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.498+0000 7fd8eaffd640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8cc0678f0 0x7fd8cc069db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0af000 tx=0x7fd8dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:26.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.502+0000 7fd8e3fff640 1 -- 172.21.15.73:0/2986635957 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd8d4055b10 con 0x7fd8ec1520a0 2024-09-12T03:36:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.682+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd8ec06ecb0 con 0x7fd8ec1520a0 2024-09-12T03:36:26.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8e3fff640 1 -- 172.21.15.73:0/2986635957 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fd8d4055410 con 0x7fd8ec1520a0 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8cc0678f0 msgr2=0x7fd8cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8cc0678f0 0x7fd8cc069db0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0af000 tx=0x7fd8dc008040 comp rx=0 tx=0).stop 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec1520a0 msgr2=0x7fd8ec165120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec165120 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c480 tx=0x7fd8d400c940 comp rx=0 tx=0).stop 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 shutdown_connections 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8cc0678f0 0x7fd8cc069db0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8ec1520a0 0x7fd8ec165120 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8ec15f3a0 0x7fd8ec165660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 --2- 172.21.15.73:0/2986635957 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8ec06fe50 0x7fd8ec099870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 >> 172.21.15.73:0/2986635957 conn(0x7fd8ec0b1f90 msgr2=0x7fd8ec0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 shutdown_connections 2024-09-12T03:36:26.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.690+0000 7fd8f14bb640 1 -- 172.21.15.73:0/2986635957 wait complete. 2024-09-12T03:36:26.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values' 2024-09-12T03:36:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89ab467640 1 Processor -- start 2024-09-12T03:36:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89ab467640 1 -- start start 2024-09-12T03:36:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89ab467640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89a4071730 0x7f89a4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89ab467640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f89a4072050 0x7f89a406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89ab467640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a406e060 con 0x7f89a406d830 2024-09-12T03:36:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89ab467640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f89a415efe0 con 0x7f89a4071730 2024-09-12T03:36:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89ab467640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f89a406e340 con 0x7f89a4072050 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a9203640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89a4071730 0x7f89a4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a9203640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89a4071730 0x7f89a4071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34394/0 (socket says 172.21.15.73:34394) 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a9203640 1 -- 172.21.15.73:0/597126520 learned_addr learned my addr 172.21.15.73:0/597126520 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a8a02640 1 --2- 172.21.15.73:0/597126520 >> v2:172.21.15.150:3300/0 conn(0x7f89a4072050 0x7f89a406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a9203640 1 -- 172.21.15.73:0/597126520 >> v2:172.21.15.150:3300/0 conn(0x7f89a4072050 msgr2=0x7f89a406d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a9203640 1 --2- 172.21.15.73:0/597126520 >> v2:172.21.15.150:3300/0 conn(0x7f89a4072050 0x7f89a406d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a9203640 1 -- 172.21.15.73:0/597126520 >> v1:172.21.15.73:6789/0 conn(0x7f89a406d830 legacy=0x7f89a415f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f89a9203640 1 -- 172.21.15.73:0/597126520 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a415e990 con 0x7f89a4071730 2024-09-12T03:36:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.830+0000 7f899bfff640 1 -- 172.21.15.73:0/597126520 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124105750 0 0) 0x7f89a406e060 con 0x7f89a406d830 2024-09-12T03:36:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a9203640 1 --2- 172.21.15.73:0/597126520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4071b10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f89a415e880 tx=0x7f89a001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107fb43f1e26a9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f899bfff640 1 -- 172.21.15.73:0/597126520 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00aa670 con 0x7f89a4071730 2024-09-12T03:36:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f899bfff640 1 -- 172.21.15.73:0/597126520 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a00af070 con 0x7f89a4071730 2024-09-12T03:36:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f899bfff640 1 -- 172.21.15.73:0/597126520 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a00aaa30 con 0x7f89a4071730 2024-09-12T03:36:26.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- 172.21.15.73:0/597126520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 msgr2=0x7f89a4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 --2- 172.21.15.73:0/597126520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4071b10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f89a415e880 tx=0x7f89a001c4f0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- 172.21.15.73:0/597126520 shutdown_connections 2024-09-12T03:36:26.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 --2- 172.21.15.73:0/597126520 >> v2:172.21.15.150:3300/0 conn(0x7f89a4072050 0x7f89a406d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 --2- 172.21.15.73:0/597126520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4071b10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- 172.21.15.73:0/597126520 >> 172.21.15.73:0/597126520 conn(0x7f89a40b3e70 msgr2=0x7f89a40b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:26.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- 172.21.15.73:0/597126520 shutdown_connections 2024-09-12T03:36:26.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- 172.21.15.73:0/597126520 wait complete. 2024-09-12T03:36:26.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 Processor -- start 2024-09-12T03:36:26.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- start start 2024-09-12T03:36:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89a406d830 0x7f89a413cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89a4072050 0x7f89a4146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4148080 con 0x7f89a4071730 2024-09-12T03:36:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4147f00 con 0x7f89a406d830 2024-09-12T03:36:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89ab467640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f89a4160390 con 0x7f89a4072050 2024-09-12T03:36:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34402/0 (socket says 172.21.15.73:34402) 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 -- 172.21.15.73:0/3678488666 learned_addr learned my addr 172.21.15.73:0/3678488666 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 -- 172.21.15.73:0/3678488666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89a4072050 msgr2=0x7f89a4146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89a4072050 0x7f89a4146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 -- 172.21.15.73:0/3678488666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89a406d830 msgr2=0x7f89a413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89a406d830 0x7f89a413cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.834+0000 7f89a8a02640 1 -- 172.21.15.73:0/3678488666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a4163340 con 0x7f89a4071730 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f89a8a02640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4146810 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f899400d5f0 tx=0x7f899400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:26.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f8999ffb640 1 -- 172.21.15.73:0/3678488666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940125f0 con 0x7f89a4071730 2024-09-12T03:36:26.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f8999ffb640 1 -- 172.21.15.73:0/3678488666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8994019070 con 0x7f89a4071730 2024-09-12T03:36:26.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a4163620 con 0x7f89a4071730 2024-09-12T03:36:26.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a4163be0 con 0x7f89a4071730 2024-09-12T03:36:26.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f8999ffb640 1 -- 172.21.15.73:0/3678488666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940129d0 con 0x7f89a4071730 2024-09-12T03:36:26.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89840052a0 con 0x7f89a4071730 2024-09-12T03:36:26.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f8999ffb640 1 -- 172.21.15.73:0/3678488666 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8994012b70 con 0x7f89a4071730 2024-09-12T03:36:26.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f8999ffb640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89880678c0 0x7f8988069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:26.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f8999ffb640 1 -- 172.21.15.73:0/3678488666 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f8994085f40 con 0x7f89a4071730 2024-09-12T03:36:26.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f89a9203640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89880678c0 0x7f8988069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:26.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.838+0000 7f89a9203640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89880678c0 0x7f8988069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89a00ae000 tx=0x7f89a0004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:26.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:26.842+0000 7f8999ffb640 1 -- 172.21.15.73:0/3678488666 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8994056c80 con 0x7f89a4071730 2024-09-12T03:36:27.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.066+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]} v 0) -- 0x7f8984005590 con 0x7f89a4071730 2024-09-12T03:36:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.338+0000 7f8999ffb640 1 -- 172.21.15.73:0/3678488666 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_invalid_values"]}]=0 v118) ==== 153+0+0 (secure 0 0 0) 0x7f8994056580 con 0x7f89a4071730 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.338+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89880678c0 msgr2=0x7f8988069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.338+0000 7f89ab467640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89880678c0 0x7f8988069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89a00ae000 tx=0x7f89a0004740 comp rx=0 tx=0).stop 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.338+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 msgr2=0x7f89a4146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.338+0000 7f89ab467640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4146810 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f899400d5f0 tx=0x7f899400dab0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 shutdown_connections 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89880678c0 0x7f8988069d80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89a4071730 0x7f89a4146810 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89a4072050 0x7f89a4146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 --2- 172.21.15.73:0/3678488666 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89a406d830 0x7f89a413cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 >> 172.21.15.73:0/3678488666 conn(0x7f89a40b3e70 msgr2=0x7f89a4160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 shutdown_connections 2024-09-12T03:36:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.342+0000 7f89ab467640 1 -- 172.21.15.73:0/3678488666 wait complete. 2024-09-12T03:36:27.365 INFO:tasks.cephfs_test_runner:test invalid values for ceph.quota.max_bytes ... ok 2024-09-12T03:36:27.365 INFO:tasks.cephfs_test_runner:Starting test: test_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test human-readable values for setting ceph.quota.max_bytes 2024-09-12T03:36:27.365 INFO:tasks.cephfs_test_runner:test_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2024-09-12T03:36:27.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17bbb2640 1 Processor -- start 2024-09-12T03:36:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17bbb2640 1 -- start start 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17bbb2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd17415c2a0 0x7fd1740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17bbb2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1740b3290 con 0x7fd1740af2a0 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17bbb2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1740b3570 con 0x7fd17415bec0 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17bbb2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd1740b3850 con 0x7fd17415c2a0 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17a14f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd1740af2a0 0x7fd17406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42248/0 (socket says 172.21.15.73:42248) 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17a14f640 1 -- 172.21.15.73:0/207073727 learned_addr learned my addr 172.21.15.73:0/207073727 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17914d640 1 --2- 172.21.15.73:0/207073727 >> v2:172.21.15.150:3300/0 conn(0x7fd17415c2a0 0x7fd1740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136850755 0 0) 0x7fd1740b3290 con 0x7fd1740af2a0 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd160003530 con 0x7fd1740af2a0 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1894491006 0 0) 0x7fd160003530 con 0x7fd1740af2a0 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 >> v2:172.21.15.150:3300/0 conn(0x7fd17415c2a0 msgr2=0x7fd1740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 --2- 172.21.15.73:0/207073727 >> v2:172.21.15.150:3300/0 conn(0x7fd17415c2a0 0x7fd1740aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 >> v1:172.21.15.150:6789/0 conn(0x7fd17415bec0 legacy=0x7fd1740ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1740b3b30 con 0x7fd1740af2a0 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fd16c001a00 con 0x7fd1740af2a0 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 >> v1:172.21.15.73:6789/0 conn(0x7fd1740af2a0 legacy=0x7fd17406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1600039c0 0x7fd160003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd160004810 0x7fd160004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1600051d0 0x7fd16000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd1740b3850 con 0x7fd160004810 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd16000c070 con 0x7fd1600039c0 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd16000c270 con 0x7fd1600051d0 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17914d640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd160004810 0x7fd160004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17914d640 1 -- 172.21.15.73:0/207073727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1600051d0 msgr2=0x7fd16000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17914d640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd1600051d0 0x7fd16000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17914d640 1 -- 172.21.15.73:0/207073727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1600039c0 msgr2=0x7fd160003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17914d640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1600039c0 0x7fd160003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17914d640 1 -- 172.21.15.73:0/207073727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd160003530 con 0x7fd160004810 2024-09-12T03:36:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.490+0000 7fd17a14f640 1 -- 172.21.15.73:0/207073727 reap_dead start 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17914d640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd160004810 0x7fd160004c90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd170009ab0 tx=0x7fd17001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da8e533a01c4d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700b2070 con 0x7fd160004810 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1700a5660 con 0x7fd160004810 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17894c640 1 -- 172.21.15.73:0/207073727 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700096b0 con 0x7fd160004810 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- 172.21.15.73:0/207073727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd160004810 msgr2=0x7fd160004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd160004810 0x7fd160004c90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd170009ab0 tx=0x7fd17001ca70 comp rx=0 tx=0).stop 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- 172.21.15.73:0/207073727 shutdown_connections 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/207073727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd160004810 0x7fd160004c90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- 172.21.15.73:0/207073727 >> 172.21.15.73:0/207073727 conn(0x7fd1740b1f90 msgr2=0x7fd1740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- 172.21.15.73:0/207073727 shutdown_connections 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- 172.21.15.73:0/207073727 wait complete. 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 Processor -- start 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- start start 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd160004810 0x7fd1740b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740afef0 0x7fd174148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd174145c40 0x7fd17409d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd1740afc90 con 0x7fd1740afef0 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd1740b40f0 con 0x7fd160004810 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.494+0000 7fd17bbb2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd1740af710 con 0x7fd174145c40 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740afef0 0x7fd174148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740afef0 0x7fd174148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34422/0 (socket says 172.21.15.73:34422) 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 -- 172.21.15.73:0/971427181 learned_addr learned my addr 172.21.15.73:0/971427181 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17a14f640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd174145c40 0x7fd17409d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17994e640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd160004810 0x7fd1740b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 -- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd174145c40 msgr2=0x7fd17409d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd174145c40 0x7fd17409d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 -- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd160004810 msgr2=0x7fd1740b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd160004810 0x7fd1740b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 -- 172.21.15.73:0/971427181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1740b0420 con 0x7fd1740afef0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17994e640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd160004810 0x7fd1740b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17914d640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740afef0 0x7fd174148c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd17001c8a0 tx=0x7fd170019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd16a7fc640 1 -- 172.21.15.73:0/971427181 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700b2040 con 0x7fd1740afef0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd16a7fc640 1 -- 172.21.15.73:0/971427181 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17000f000 con 0x7fd1740afef0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1740b0700 con 0x7fd1740afef0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd16a7fc640 1 -- 172.21.15.73:0/971427181 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700096b0 con 0x7fd1740afef0 2024-09-12T03:36:27.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1740b0cc0 con 0x7fd1740afef0 2024-09-12T03:36:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17406fcd0 con 0x7fd1740afef0 2024-09-12T03:36:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd16a7fc640 1 -- 172.21.15.73:0/971427181 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1700bf030 con 0x7fd1740afef0 2024-09-12T03:36:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd16a7fc640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1580678f0 0x7fd158069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd16a7fc640 1 -- 172.21.15.73:0/971427181 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fd17011f740 con 0x7fd1740afef0 2024-09-12T03:36:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17994e640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1580678f0 0x7fd158069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.498+0000 7fd17994e640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1580678f0 0x7fd158069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd164007fd0 tx=0x7fd164009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:27.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.506+0000 7fd16a7fc640 1 -- 172.21.15.73:0/971427181 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1700c6060 con 0x7fd1740afef0 2024-09-12T03:36:27.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.662+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd174149180 con 0x7fd1740afef0 2024-09-12T03:36:27.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd16a7fc640 1 -- 172.21.15.73:0/971427181 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+13317 (secure 0 0 0) 0x7fd170016780 con 0x7fd1740afef0 2024-09-12T03:36:27.668 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:27.668 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:26.328789+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/3307908616":"2024-09-13T03:36:23.312769+0000","172.21.15.73:6836/3307908616":"2024-09-13T03:36:23.312769+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1580678f0 msgr2=0x7fd158069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1580678f0 0x7fd158069db0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd164007fd0 tx=0x7fd164009040 comp rx=0 tx=0).stop 2024-09-12T03:36:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740afef0 msgr2=0x7fd174148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740afef0 0x7fd174148c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd17001c8a0 tx=0x7fd170019810 comp rx=0 tx=0).stop 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 shutdown_connections 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1580678f0 0x7fd158069db0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1740afef0 0x7fd174148c40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd174145c40 0x7fd17409d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 --2- 172.21.15.73:0/971427181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd160004810 0x7fd1740b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 >> 172.21.15.73:0/971427181 conn(0x7fd1740b1f90 msgr2=0x7fd17415ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 shutdown_connections 2024-09-12T03:36:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.666+0000 7fd17bbb2640 1 -- 172.21.15.73:0/971427181 wait complete. 2024-09-12T03:36:27.686 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T03:34:25.956292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T03:36:27.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T03:36:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 Processor -- start 2024-09-12T03:36:27.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 -- start start 2024-09-12T03:36:27.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5415bec0 0x7fec540ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec5415c2a0 0x7fec540aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec540af2a0 0x7fec5415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fec540b3290 con 0x7fec5415c2a0 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fec540b3570 con 0x7fec540af2a0 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec58893640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec540b3850 con 0x7fec5415bec0 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec5415c2a0 0x7fec540aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec5415c2a0 0x7fec540aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34436/0 (socket says 172.21.15.73:34436) 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 -- 172.21.15.73:0/3908997258 learned_addr learned my addr 172.21.15.73:0/3908997258 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec52d9d640 1 --2- 172.21.15.73:0/3908997258 >> v2:172.21.15.150:3300/0 conn(0x7fec540af2a0 0x7fec5415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec5259c640 1 --2- 172.21.15.73:0/3908997258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5415bec0 0x7fec540ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 -- 172.21.15.73:0/3908997258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5415bec0 msgr2=0x7fec540ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 --2- 172.21.15.73:0/3908997258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5415bec0 0x7fec540ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 -- 172.21.15.73:0/3908997258 >> v2:172.21.15.150:3300/0 conn(0x7fec540af2a0 msgr2=0x7fec5415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 --2- 172.21.15.73:0/3908997258 >> v2:172.21.15.150:3300/0 conn(0x7fec540af2a0 0x7fec5415fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.806+0000 7fec4bfff640 1 -- 172.21.15.73:0/3908997258 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec540b3b30 con 0x7fec5415c2a0 2024-09-12T03:36:27.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 --2- 172.21.15.73:0/3908997258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415c2a0 0x7fec540aed60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fec540ada40 tx=0x7fec3c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45d1fc2aa2e6b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:27.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec51d9b640 1 -- 172.21.15.73:0/3908997258 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0b0070 con 0x7fec5415c2a0 2024-09-12T03:36:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec51d9b640 1 -- 172.21.15.73:0/3908997258 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c0ab600 con 0x7fec5415c2a0 2024-09-12T03:36:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec51d9b640 1 -- 172.21.15.73:0/3908997258 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0ab9d0 con 0x7fec5415c2a0 2024-09-12T03:36:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- 172.21.15.73:0/3908997258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415c2a0 msgr2=0x7fec540aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 --2- 172.21.15.73:0/3908997258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415c2a0 0x7fec540aed60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fec540ada40 tx=0x7fec3c01c230 comp rx=0 tx=0).stop 2024-09-12T03:36:27.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- 172.21.15.73:0/3908997258 shutdown_connections 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 --2- 172.21.15.73:0/3908997258 >> v2:172.21.15.150:3300/0 conn(0x7fec540af2a0 0x7fec5415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 --2- 172.21.15.73:0/3908997258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415c2a0 0x7fec540aed60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 --2- 172.21.15.73:0/3908997258 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5415bec0 0x7fec540ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- 172.21.15.73:0/3908997258 >> 172.21.15.73:0/3908997258 conn(0x7fec540b1f90 msgr2=0x7fec540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- 172.21.15.73:0/3908997258 shutdown_connections 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- 172.21.15.73:0/3908997258 wait complete. 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 Processor -- start 2024-09-12T03:36:27.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- start start 2024-09-12T03:36:27.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec540af2a0 0x7fec5415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415bec0 0x7fec54160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5415c2a0 0x7fec54099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec540af6b0 con 0x7fec5415bec0 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec540ad740 con 0x7fec5415c2a0 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec5406e000 con 0x7fec540af2a0 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415bec0 0x7fec54160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415bec0 0x7fec54160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34442/0 (socket says 172.21.15.73:34442) 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 -- 172.21.15.73:0/3431899612 learned_addr learned my addr 172.21.15.73:0/3431899612 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec52d9d640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5415c2a0 0x7fec54099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec5259c640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec540af2a0 0x7fec5415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 -- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec540af2a0 msgr2=0x7fec5415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec540af2a0 0x7fec5415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 -- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5415c2a0 msgr2=0x7fec54099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5415c2a0 0x7fec54099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 -- 172.21.15.73:0/3431899612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec54155230 con 0x7fec5415bec0 2024-09-12T03:36:27.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4bfff640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415bec0 0x7fec54160c70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fec3c01cad0 tx=0x7fec3c018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:27.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4affd640 1 -- 172.21.15.73:0/3431899612 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0b0050 con 0x7fec5415bec0 2024-09-12T03:36:27.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4affd640 1 -- 172.21.15.73:0/3431899612 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec3c0bc070 con 0x7fec5415bec0 2024-09-12T03:36:27.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec54155510 con 0x7fec5415bec0 2024-09-12T03:36:27.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec4affd640 1 -- 172.21.15.73:0/3431899612 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0b5a50 con 0x7fec5415bec0 2024-09-12T03:36:27.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.810+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec541407b0 con 0x7fec5415bec0 2024-09-12T03:36:27.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.814+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec540ad200 con 0x7fec5415bec0 2024-09-12T03:36:27.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.814+0000 7fec4affd640 1 -- 172.21.15.73:0/3431899612 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec3c0ab4c0 con 0x7fec5415bec0 2024-09-12T03:36:27.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.814+0000 7fec4affd640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec340678c0 0x7fec34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:27.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.814+0000 7fec4affd640 1 -- 172.21.15.73:0/3431899612 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7fec3c120320 con 0x7fec5415bec0 2024-09-12T03:36:27.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.814+0000 7fec5259c640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec340678c0 0x7fec34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:27.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.814+0000 7fec5259c640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec340678c0 0x7fec34069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec44009710 tx=0x7fec44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:27.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.818+0000 7fec4affd640 1 -- 172.21.15.73:0/3431899612 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec3c016110 con 0x7fec5415bec0 2024-09-12T03:36:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.978+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec5406fcd0 con 0x7fec5415bec0 2024-09-12T03:36:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.978+0000 7fec4affd640 1 -- 172.21.15.73:0/3431899612 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7fec3c0f0fd0 con 0x7fec5415bec0 2024-09-12T03:36:27.981 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-12T03:36:27.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec340678c0 msgr2=0x7fec34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec340678c0 0x7fec34069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec44009710 tx=0x7fec44008040 comp rx=0 tx=0).stop 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415bec0 msgr2=0x7fec54160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415bec0 0x7fec54160c70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fec3c01cad0 tx=0x7fec3c018fd0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 shutdown_connections 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec340678c0 0x7fec34069d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5415bec0 0x7fec54160c70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5415c2a0 0x7fec54099520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 --2- 172.21.15.73:0/3431899612 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec540af2a0 0x7fec5415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 >> 172.21.15.73:0/3431899612 conn(0x7fec540b1f90 msgr2=0x7fec540cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 shutdown_connections 2024-09-12T03:36:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:27.982+0000 7fec58893640 1 -- 172.21.15.73:0/3431899612 wait complete. 2024-09-12T03:36:27.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values' 2024-09-12T03:36:28.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba4410640 1 Processor -- start 2024-09-12T03:36:28.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba4410640 1 -- start start 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba4410640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 0x7f6b9c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba4410640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b9c15c2a0 0x7f6b9c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba4410640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0b3290 con 0x7f6b9c0af2a0 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba4410640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9c0b3570 con 0x7f6b9c15c2a0 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba4410640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c0b3850 con 0x7f6b9c15bec0 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba29ad640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6b9c0af2a0 0x7f6b9c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42258/0 (socket says 172.21.15.73:42258) 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba29ad640 1 -- 172.21.15.73:0/920921412 learned_addr learned my addr 172.21.15.73:0/920921412 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724601447 0 0) 0x7f6b9c0b3290 con 0x7f6b9c0af2a0 2024-09-12T03:36:28.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba19ab640 1 --2- 172.21.15.73:0/920921412 >> v2:172.21.15.150:3300/0 conn(0x7f6b9c15c2a0 0x7f6b9c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b88003530 con 0x7f6b9c0af2a0 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba21ac640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 0x7f6b9c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1289650028 0 0) 0x7f6b88003530 con 0x7f6b9c0af2a0 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 msgr2=0x7f6b9c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 0x7f6b9c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 >> v2:172.21.15.150:3300/0 conn(0x7f6b9c15c2a0 msgr2=0x7f6b9c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 --2- 172.21.15.73:0/920921412 >> v2:172.21.15.150:3300/0 conn(0x7f6b9c15c2a0 0x7f6b9c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c0b3b30 con 0x7f6b9c0af2a0 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f6b94001a00 con 0x7f6b9c0af2a0 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 >> v1:172.21.15.73:6789/0 conn(0x7f6b9c0af2a0 legacy=0x7f6b9c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 0x7f6b880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b88003ff0 0x7f6b88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88004d50 0x7f6b880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0b3570 con 0x7f6b88003ff0 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0b3850 con 0x7f6b88004d50 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8800bad0 con 0x7f6b9c15bec0 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba19ab640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b88003ff0 0x7f6b88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba29ad640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88004d50 0x7f6b880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba21ac640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 0x7f6b880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba19ab640 1 -- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 msgr2=0x7f6b880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba19ab640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c15bec0 0x7f6b880039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba19ab640 1 -- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88004d50 msgr2=0x7f6b880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba19ab640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88004d50 0x7f6b880051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.106+0000 7f6ba19ab640 1 -- 172.21.15.73:0/920921412 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b88003530 con 0x7f6b88003ff0 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba19ab640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b88003ff0 0x7f6b88004810 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c06da50 tx=0x7f6b8c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aac41911b59280b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0ae070 con 0x7f6b88003ff0 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0a9660 con 0x7f6b88003ff0 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba11aa640 1 -- 172.21.15.73:0/920921412 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00b600 con 0x7f6b88003ff0 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- 172.21.15.73:0/920921412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b88003ff0 msgr2=0x7f6b88004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 --2- 172.21.15.73:0/920921412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b88003ff0 0x7f6b88004810 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c06da50 tx=0x7f6b8c01c680 comp rx=0 tx=0).stop 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 -- 172.21.15.73:0/920921412 reap_dead start 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- 172.21.15.73:0/920921412 shutdown_connections 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- 172.21.15.73:0/920921412 >> 172.21.15.73:0/920921412 conn(0x7f6b9c0b1f90 msgr2=0x7f6b9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- 172.21.15.73:0/920921412 shutdown_connections 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- 172.21.15.73:0/920921412 wait complete. 2024-09-12T03:36:28.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 Processor -- start 2024-09-12T03:36:28.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- start start 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88003ff0 0x7f6b9c152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c154850 0x7f6b9c154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9c1f5b40 0x7f6b9c1f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0af730 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0b40f0 con 0x7f6b88003ff0 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba4410640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c0afc90 con 0x7f6b9c154850 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9c1f5b40 0x7f6b9c1f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9c1f5b40 0x7f6b9c1f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34448/0 (socket says 172.21.15.73:34448) 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 -- 172.21.15.73:0/3644135887 learned_addr learned my addr 172.21.15.73:0/3644135887 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba19ab640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c154850 0x7f6b9c154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba21ac640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88003ff0 0x7f6b9c152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 -- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c154850 msgr2=0x7f6b9c154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c154850 0x7f6b9c154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 -- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88003ff0 msgr2=0x7f6b9c152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88003ff0 0x7f6b9c152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 -- 172.21.15.73:0/3644135887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c1553c0 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6ba29ad640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9c1f5b40 0x7f6b9c1f5fc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c071880 tx=0x7f6b94005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.110+0000 7f6b92ffd640 1 -- 172.21.15.73:0/3644135887 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9401a070 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6b92ffd640 1 -- 172.21.15.73:0/3644135887 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b94011040 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c1e1520 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6b92ffd640 1 -- 172.21.15.73:0/3644135887 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400ed80 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c1e1aa0 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c0aed60 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6b92ffd640 1 -- 172.21.15.73:0/3644135887 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b9401d070 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6b92ffd640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b800678c0 0x7f6b80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6b92ffd640 1 -- 172.21.15.73:0/3644135887 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f6b940883c0 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6ba21ac640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b800678c0 0x7f6b80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.114+0000 7f6ba21ac640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b800678c0 0x7f6b80069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d750 tx=0x7f6b98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.118+0000 7f6b92ffd640 1 -- 172.21.15.73:0/3644135887 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b94059060 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.322+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]} v 0) -- 0x7f6b9c06fcd0 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6b92ffd640 1 -- 172.21.15.73:0/3644135887 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]}]=0 v119) ==== 148+0+0 (secure 0 0 0) 0x7f6b94086e20 con 0x7f6b9c1f5b40 2024-09-12T03:36:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b800678c0 msgr2=0x7f6b80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b800678c0 0x7f6b80069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d750 tx=0x7f6b98008040 comp rx=0 tx=0).stop 2024-09-12T03:36:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9c1f5b40 msgr2=0x7f6b9c1f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9c1f5b40 0x7f6b9c1f5fc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c071880 tx=0x7f6b94005a60 comp rx=0 tx=0).stop 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 shutdown_connections 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b800678c0 0x7f6b80069d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9c1f5b40 0x7f6b9c1f5fc0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b9c154850 0x7f6b9c154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 --2- 172.21.15.73:0/3644135887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b88003ff0 0x7f6b9c152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 >> 172.21.15.73:0/3644135887 conn(0x7f6b9c0b1f90 msgr2=0x7f6b9c15b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 shutdown_connections 2024-09-12T03:36:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.346+0000 7f6ba4410640 1 -- 172.21.15.73:0/3644135887 wait complete. 2024-09-12T03:36:28.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T03:36:28.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2ff565c640 1 Processor -- start 2024-09-12T03:36:28.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2ff565c640 1 -- start start 2024-09-12T03:36:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2ff565c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ff01587a0 0x7f2ff00b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2ff565c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff006ec60 con 0x7f2ff006e680 2024-09-12T03:36:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2ff565c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff006ef40 con 0x7f2ff00b37d0 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2ff565c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff00b3c40 con 0x7f2ff01587a0 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2feeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ff01587a0 0x7f2ff00b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2fef7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2ff006e680 0x7f2ff0072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42272/0 (socket says 172.21.15.73:42272) 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2fef7fe640 1 -- 172.21.15.73:0/872422399 learned_addr learned my addr 172.21.15.73:0/872422399 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2feeffd640 1 -- 172.21.15.73:0/872422399 >> v1:172.21.15.150:6789/0 conn(0x7f2ff00b37d0 legacy=0x7f2ff006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2feeffd640 1 -- 172.21.15.73:0/872422399 >> v1:172.21.15.73:6789/0 conn(0x7f2ff006e680 legacy=0x7f2ff0072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2feeffd640 1 -- 172.21.15.73:0/872422399 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff006f220 con 0x7f2ff01587a0 2024-09-12T03:36:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.474+0000 7f2fedffb640 1 -- 172.21.15.73:0/872422399 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557100362 0 0) 0x7f2ff006ec60 con 0x7f2ff006e680 2024-09-12T03:36:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2feeffd640 1 --2- 172.21.15.73:0/872422399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff01587a0 0x7f2ff00b3290 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40097c0 tx=0x7f2fe401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef7e1c18c2f5290 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2fedffb640 1 -- 172.21.15.73:0/872422399 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40b0070 con 0x7f2ff01587a0 2024-09-12T03:36:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2fedffb640 1 -- 172.21.15.73:0/872422399 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe40ab600 con 0x7f2ff01587a0 2024-09-12T03:36:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2fedffb640 1 -- 172.21.15.73:0/872422399 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40ab9d0 con 0x7f2ff01587a0 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- 172.21.15.73:0/872422399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff01587a0 msgr2=0x7f2ff00b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 --2- 172.21.15.73:0/872422399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff01587a0 0x7f2ff00b3290 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40097c0 tx=0x7f2fe401c460 comp rx=0 tx=0).stop 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- 172.21.15.73:0/872422399 shutdown_connections 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 --2- 172.21.15.73:0/872422399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff01587a0 0x7f2ff00b3290 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- 172.21.15.73:0/872422399 >> 172.21.15.73:0/872422399 conn(0x7f2ff00b1f90 msgr2=0x7f2ff00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- 172.21.15.73:0/872422399 shutdown_connections 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- 172.21.15.73:0/872422399 wait complete. 2024-09-12T03:36:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 Processor -- start 2024-09-12T03:36:28.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- start start 2024-09-12T03:36:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff006e680 0x7f2ff009c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff00b37d0 0x7f2ff009caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff01587a0 0x7f2ff0146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff016c200 con 0x7f2ff006e680 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0073310 con 0x7f2ff00b37d0 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2ff565c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff016c380 con 0x7f2ff01587a0 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2feeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff006e680 0x7f2ff009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2feeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff006e680 0x7f2ff009c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34464/0 (socket says 172.21.15.73:34464) 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.478+0000 7f2feeffd640 1 -- 172.21.15.73:0/3949136512 learned_addr learned my addr 172.21.15.73:0/3949136512 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fef7fe640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff01587a0 0x7f2ff0146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fee7fc640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff00b37d0 0x7f2ff009caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2feeffd640 1 -- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff01587a0 msgr2=0x7f2ff0146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2feeffd640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff01587a0 0x7f2ff0146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2feeffd640 1 -- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff00b37d0 msgr2=0x7f2ff009caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2feeffd640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff00b37d0 0x7f2ff009caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2feeffd640 1 -- 172.21.15.73:0/3949136512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff009a420 con 0x7f2ff006e680 2024-09-12T03:36:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2feeffd640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff006e680 0x7f2ff009c560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40ae040 tx=0x7f2fe401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fd77fe640 1 -- 172.21.15.73:0/3949136512 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40b0050 con 0x7f2ff006e680 2024-09-12T03:36:28.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fd77fe640 1 -- 172.21.15.73:0/3949136512 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe40bc070 con 0x7f2ff006e680 2024-09-12T03:36:28.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff009a700 con 0x7f2ff006e680 2024-09-12T03:36:28.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fd77fe640 1 -- 172.21.15.73:0/3949136512 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40b5a50 con 0x7f2ff006e680 2024-09-12T03:36:28.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff009acc0 con 0x7f2ff006e680 2024-09-12T03:36:28.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff00b3290 con 0x7f2ff006e680 2024-09-12T03:36:28.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fd77fe640 1 -- 172.21.15.73:0/3949136512 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fe40ab4a0 con 0x7f2ff006e680 2024-09-12T03:36:28.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fd77fe640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2fdc0678c0 0x7f2fdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fd77fe640 1 -- 172.21.15.73:0/3949136512 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f2fe4120460 con 0x7f2ff006e680 2024-09-12T03:36:28.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fee7fc640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2fdc0678c0 0x7f2fdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.482+0000 7f2fee7fc640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2fdc0678c0 0x7f2fdc069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0161a20 tx=0x7f2fe0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.486+0000 7f2fd77fe640 1 -- 172.21.15.73:0/3949136512 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2fe4016050 con 0x7f2ff006e680 2024-09-12T03:36:28.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.634+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2ff0070080 con 0x7f2ff006e680 2024-09-12T03:36:28.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.638+0000 7f2fd77fe640 1 -- 172.21.15.73:0/3949136512 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f2fe40f11a0 con 0x7f2ff006e680 2024-09-12T03:36:28.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2fdc0678c0 msgr2=0x7f2fdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2fdc0678c0 0x7f2fdc069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0161a20 tx=0x7f2fe0009040 comp rx=0 tx=0).stop 2024-09-12T03:36:28.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff006e680 msgr2=0x7f2ff009c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff006e680 0x7f2ff009c560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40ae040 tx=0x7f2fe401aca0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 shutdown_connections 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2fdc0678c0 0x7f2fdc069d80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2ff01587a0 0x7f2ff0146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ff00b37d0 0x7f2ff009caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 --2- 172.21.15.73:0/3949136512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff006e680 0x7f2ff009c560 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 >> 172.21.15.73:0/3949136512 conn(0x7f2ff00b1f90 msgr2=0x7f2ff00b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 shutdown_connections 2024-09-12T03:36:28.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.642+0000 7f2ff565c640 1 -- 172.21.15.73:0/3949136512 wait complete. 2024-09-12T03:36:28.659 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:36:28.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:36:28.712 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:36:28.750 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:36:28.751 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:36:28.751 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:28.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:36:28.755 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:36:28.755 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:28.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:36:28.803 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:36:28.803 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:28.809 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:36:28.809 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:36:28.810 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:28.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:36:28.852 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T03:36:28.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:28.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.970+0000 7f92aa88b640 1 Processor -- start 2024-09-12T03:36:28.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92aa88b640 1 -- start start 2024-09-12T03:36:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92aa88b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92a415bec0 0x7f92a40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92aa88b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92a40af470 0x7f92a406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92aa88b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92a40b3290 con 0x7f92a415c2a0 2024-09-12T03:36:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92aa88b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f92a40b3570 con 0x7f92a40af470 2024-09-12T03:36:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92aa88b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f92a40b3850 con 0x7f92a415bec0 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a8e28640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92a40af470 0x7f92a406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a8e28640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92a40af470 0x7f92a406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34476/0 (socket says 172.21.15.73:34476) 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a8e28640 1 -- 172.21.15.73:0/285412226 learned_addr learned my addr 172.21.15.73:0/285412226 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a3fff640 1 --2- 172.21.15.73:0/285412226 >> v2:172.21.15.150:3300/0 conn(0x7f92a415bec0 0x7f92a40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a8e28640 1 -- 172.21.15.73:0/285412226 >> v2:172.21.15.150:3300/0 conn(0x7f92a415bec0 msgr2=0x7f92a40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a8e28640 1 --2- 172.21.15.73:0/285412226 >> v2:172.21.15.150:3300/0 conn(0x7f92a415bec0 0x7f92a40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a8e28640 1 -- 172.21.15.73:0/285412226 >> v1:172.21.15.150:6789/0 conn(0x7f92a415c2a0 legacy=0x7f92a40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a8e28640 1 -- 172.21.15.73:0/285412226 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a40b3b30 con 0x7f92a40af470 2024-09-12T03:36:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.974+0000 7f92a3fff640 1 --2- 172.21.15.73:0/285412226 >> v2:172.21.15.150:3300/0 conn(0x7f92a415bec0 0x7f92a40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:28.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a8e28640 1 --2- 172.21.15.73:0/285412226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a40af470 0x7f92a406e000 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f92a4071710 tx=0x7f929c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac8cad19dd6916e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a2ffd640 1 -- 172.21.15.73:0/285412226 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c0a5840 con 0x7f92a40af470 2024-09-12T03:36:28.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a2ffd640 1 -- 172.21.15.73:0/285412226 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c0a59e0 con 0x7f92a40af470 2024-09-12T03:36:28.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a2ffd640 1 -- 172.21.15.73:0/285412226 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c0a5db0 con 0x7f92a40af470 2024-09-12T03:36:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- 172.21.15.73:0/285412226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a40af470 msgr2=0x7f92a406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 --2- 172.21.15.73:0/285412226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a40af470 0x7f92a406e000 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f92a4071710 tx=0x7f929c01c980 comp rx=0 tx=0).stop 2024-09-12T03:36:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- 172.21.15.73:0/285412226 shutdown_connections 2024-09-12T03:36:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 --2- 172.21.15.73:0/285412226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a40af470 0x7f92a406e000 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 --2- 172.21.15.73:0/285412226 >> v2:172.21.15.150:3300/0 conn(0x7f92a415bec0 0x7f92a40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- 172.21.15.73:0/285412226 >> 172.21.15.73:0/285412226 conn(0x7f92a40b1f90 msgr2=0x7f92a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:28.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- 172.21.15.73:0/285412226 shutdown_connections 2024-09-12T03:36:28.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- 172.21.15.73:0/285412226 wait complete. 2024-09-12T03:36:28.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 Processor -- start 2024-09-12T03:36:28.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- start start 2024-09-12T03:36:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92a40af470 0x7f92a41558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92a415bec0 0x7f92a40b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a415c2a0 0x7f92a41540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f92a406ed50 con 0x7f92a415c2a0 2024-09-12T03:36:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f92a40ad740 con 0x7f92a40af470 2024-09-12T03:36:28.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92aa88b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f92a406eed0 con 0x7f92a415bec0 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a8e28640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a415c2a0 0x7f92a41540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a8e28640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a415c2a0 0x7f92a41540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34490/0 (socket says 172.21.15.73:34490) 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a8e28640 1 -- 172.21.15.73:0/223645875 learned_addr learned my addr 172.21.15.73:0/223645875 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a3fff640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92a40af470 0x7f92a41558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.978+0000 7f92a37fe640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92a415bec0 0x7f92a40b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a8e28640 1 -- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92a415bec0 msgr2=0x7f92a40b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a8e28640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92a415bec0 0x7f92a40b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a8e28640 1 -- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92a40af470 msgr2=0x7f92a41558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a8e28640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92a40af470 0x7f92a41558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a8e28640 1 -- 172.21.15.73:0/223645875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a414d4c0 con 0x7f92a415c2a0 2024-09-12T03:36:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a8e28640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a415c2a0 0x7f92a41540d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f929c01a5b0 tx=0x7f929c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a0ff9640 1 -- 172.21.15.73:0/223645875 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c0b8880 con 0x7f92a415c2a0 2024-09-12T03:36:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a0ff9640 1 -- 172.21.15.73:0/223645875 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c0be070 con 0x7f92a415c2a0 2024-09-12T03:36:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a414eef0 con 0x7f92a415c2a0 2024-09-12T03:36:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a0ff9640 1 -- 172.21.15.73:0/223645875 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f929c0b8c80 con 0x7f92a415c2a0 2024-09-12T03:36:28.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a414d140 con 0x7f92a415c2a0 2024-09-12T03:36:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a406f260 con 0x7f92a415c2a0 2024-09-12T03:36:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a0ff9640 1 -- 172.21.15.73:0/223645875 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f929c0c3460 con 0x7f92a415c2a0 2024-09-12T03:36:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a0ff9640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92900678c0 0x7f9290069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a0ff9640 1 -- 172.21.15.73:0/223645875 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5335+0+0 (secure 0 0 0) 0x7f929c120fb0 con 0x7f92a415c2a0 2024-09-12T03:36:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a3fff640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92900678c0 0x7f9290069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.982+0000 7f92a3fff640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92900678c0 0x7f9290069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f929400a9a0 tx=0x7f9294008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:28.986+0000 7f92a0ff9640 1 -- 172.21.15.73:0/223645875 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f929c0165a0 con 0x7f92a415c2a0 2024-09-12T03:36:29.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.182+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92a4075140 con 0x7f92a415c2a0 2024-09-12T03:36:29.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.182+0000 7f92a0ff9640 1 -- 172.21.15.73:0/223645875 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+3911 (secure 0 0 0) 0x7f929c0f1cf0 con 0x7f92a415c2a0 2024-09-12T03:36:29.185 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:29.185 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":26,"btime":"2024-09-12T03:36:24:315922+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4583,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/4068395780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":4068395780},{"type":"v1","addr":"172.21.15.150:6833","nonce":4068395780}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":4810,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/801266996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":801266996},{"type":"v1","addr":"172.21.15.150:6835","nonce":801266996}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/204856876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":204856876},{"type":"v1","addr":"172.21.15.73:6835","nonce":204856876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1511557775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1511557775},{"type":"v1","addr":"172.21.15.73:6837","nonce":1511557775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[]} 2024-09-12T03:36:29.185 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 26 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92900678c0 msgr2=0x7f9290069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92900678c0 0x7f9290069d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f929400a9a0 tx=0x7f9294008040 comp rx=0 tx=0).stop 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a415c2a0 msgr2=0x7f92a41540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a415c2a0 0x7f92a41540d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f929c01a5b0 tx=0x7f929c019720 comp rx=0 tx=0).stop 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 shutdown_connections 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92900678c0 0x7f9290069d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92a415c2a0 0x7f92a41540d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f92a415bec0 0x7f92a40b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 --2- 172.21.15.73:0/223645875 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92a40af470 0x7f92a41558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 >> 172.21.15.73:0/223645875 conn(0x7f92a40b1f90 msgr2=0x7f92a414fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:29.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 shutdown_connections 2024-09-12T03:36:29.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.186+0000 7f92aa88b640 1 -- 172.21.15.73:0/223645875 wait complete. 2024-09-12T03:36:29.203 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T03:36:29.203 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T03:36:29.203 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:36:29.204 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:36:29.204 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T03:36:29.204 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T03:36:29.204 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:36:29.204 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:36:29.205 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T03:36:29.205 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T03:36:29.205 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:36:29.205 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:36:29.205 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T03:36:29.206 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T03:36:29.206 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:36:29.206 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:36:29.214 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:36:29.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T03:36:29.215 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:36:29.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T03:36:29.225 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:36:29.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T03:36:29.226 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:36:29.226 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T03:36:29.256 INFO:tasks.ceph.mds.c:Started 2024-09-12T03:36:29.257 DEBUG:teuthology.parallel:result is None 2024-09-12T03:36:29.257 INFO:tasks.ceph.mds.a:Started 2024-09-12T03:36:29.257 DEBUG:teuthology.parallel:result is None 2024-09-12T03:36:29.273 INFO:tasks.ceph.mds.d:Started 2024-09-12T03:36:29.274 DEBUG:teuthology.parallel:result is None 2024-09-12T03:36:29.274 INFO:tasks.ceph.mds.b:Started 2024-09-12T03:36:29.274 DEBUG:teuthology.parallel:result is None 2024-09-12T03:36:29.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T03:36:29.314 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:36:29.314 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:36:29.348 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-12T03:36:29.349 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:36:29.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.386+0000 7f180ac5e640 1 Processor -- start 2024-09-12T03:36:29.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.386+0000 7f180ac5e640 1 -- start start 2024-09-12T03:36:29.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f180ac5e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f18040cf620 0x7f1804168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f180ac5e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18040d0300 con 0x7f18040d3060 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f180ac5e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f180406e6c0 con 0x7f1804161a60 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f180ac5e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f18040cfa90 con 0x7f18040cf620 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f1803fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f18040d3060 0x7f18040cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42290/0 (socket says 172.21.15.73:42290) 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f1803fff640 1 -- 172.21.15.73:0/120707999 learned_addr learned my addr 172.21.15.73:0/120707999 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18091fb640 1 --2- 172.21.15.73:0/120707999 >> v2:172.21.15.150:3300/0 conn(0x7f18040cf620 0x7f1804168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022165489 0 0) 0x7f17f8001120 con 0x7f18040d3060 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17ec003530 con 0x7f18040d3060 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 600676101 0 0) 0x7f17ec003530 con 0x7f18040d3060 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 >> v2:172.21.15.150:3300/0 conn(0x7f18040cf620 msgr2=0x7f1804168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 --2- 172.21.15.73:0/120707999 >> v2:172.21.15.150:3300/0 conn(0x7f18040cf620 0x7f1804168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 >> v1:172.21.15.150:6789/0 conn(0x7f1804161a60 legacy=0x7f18040d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:29.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18040b0f60 con 0x7f18040d3060 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f17f8001850 con 0x7f18040d3060 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 >> v1:172.21.15.73:6789/0 conn(0x7f18040d3060 legacy=0x7f18040cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ec0039c0 0x7f17ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec004810 0x7f17ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec0051d0 0x7f17ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f18040cfa90 con 0x7f17ec0039c0 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec00c170 con 0x7f17ec004810 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec00c370 con 0x7f17ec0051d0 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18089fa640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ec0039c0 0x7f17ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18091fb640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec0051d0 0x7f17ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f1803fff640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec004810 0x7f17ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18089fa640 1 -- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec0051d0 msgr2=0x7f17ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:29.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18089fa640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec0051d0 0x7f17ec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18089fa640 1 -- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec004810 msgr2=0x7f17ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18089fa640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec004810 0x7f17ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18089fa640 1 -- 172.21.15.73:0/120707999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec003530 con 0x7f17ec0039c0 2024-09-12T03:36:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18091fb640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f17ec0051d0 0x7f17ec00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:29.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18091fb640 1 -- 172.21.15.73:0/120707999 reap_dead start 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18089fa640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ec0039c0 0x7f17ec003de0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f17f4001780 tx=0x7f17f401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacc7ec403feb3a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f40013a0 con 0x7f17ec0039c0 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f40052f0 con 0x7f17ec0039c0 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f18037fe640 1 -- 172.21.15.73:0/120707999 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f4003840 con 0x7f17ec0039c0 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f180ac5e640 1 -- 172.21.15.73:0/120707999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ec0039c0 msgr2=0x7f17ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.390+0000 7f180ac5e640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ec0039c0 0x7f17ec003de0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f17f4001780 tx=0x7f17f401c3d0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- 172.21.15.73:0/120707999 shutdown_connections 2024-09-12T03:36:29.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 --2- 172.21.15.73:0/120707999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17ec0039c0 0x7f17ec003de0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- 172.21.15.73:0/120707999 >> 172.21.15.73:0/120707999 conn(0x7f180408bf90 msgr2=0x7f180409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- 172.21.15.73:0/120707999 shutdown_connections 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- 172.21.15.73:0/120707999 wait complete. 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 Processor -- start 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- start start 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec0039c0 0x7f1804156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f180415a8b0 0x7f180415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18040d04e0 0x7f18040d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f18040d2d60 con 0x7f18040d04e0 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f180406d190 con 0x7f17ec0039c0 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f18040d2ee0 con 0x7f180415a8b0 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18040d04e0 0x7f18040d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18040d04e0 0x7f18040d0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34516/0 (socket says 172.21.15.73:34516) 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 -- 172.21.15.73:0/4219165651 learned_addr learned my addr 172.21.15.73:0/4219165651 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18089fa640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec0039c0 0x7f1804156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f1803fff640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f180415a8b0 0x7f180415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 -- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f180415a8b0 msgr2=0x7f180415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f180415a8b0 0x7f180415d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 -- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec0039c0 msgr2=0x7f1804156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec0039c0 0x7f1804156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 -- 172.21.15.73:0/4219165651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180415ad10 con 0x7f18040d04e0 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18091fb640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18040d04e0 0x7f18040d0960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f18040b6f60 tx=0x7f17fc010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18017fa640 1 -- 172.21.15.73:0/4219165651 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc010da0 con 0x7f18040d04e0 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18017fa640 1 -- 172.21.15.73:0/4219165651 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc0039a0 con 0x7f18040d04e0 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f18017fa640 1 -- 172.21.15.73:0/4219165651 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc003d90 con 0x7f18040d04e0 2024-09-12T03:36:29.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180415da20 con 0x7f18040d04e0 2024-09-12T03:36:29.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18040cb4e0 con 0x7f18040d04e0 2024-09-12T03:36:29.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.394+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18040cf370 con 0x7f18040d04e0 2024-09-12T03:36:29.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.398+0000 7f18017fa640 1 -- 172.21.15.73:0/4219165651 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f17fc01e020 con 0x7f18040d04e0 2024-09-12T03:36:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.398+0000 7f18017fa640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f17f00678f0 0x7f17f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.398+0000 7f18017fa640 1 -- 172.21.15.73:0/4219165651 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5335+0+0 (secure 0 0 0) 0x7f17fc085ff0 con 0x7f18040d04e0 2024-09-12T03:36:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.398+0000 7f18089fa640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f17f00678f0 0x7f17f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:29.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.398+0000 7f18089fa640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f17f00678f0 0x7f17f0069db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17f4001750 tx=0x7f17f40011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:29.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.402+0000 7f18017fa640 1 -- 172.21.15.73:0/4219165651 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f180415ad10 con 0x7f18040d04e0 2024-09-12T03:36:29.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:29.574+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f180415fde0 con 0x7f18040d04e0 2024-09-12T03:36:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.354+0000 7f18017fa640 1 -- 172.21.15.73:0/4219165651 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) ==== 97+0+0 (secure 0 0 0) 0x7f17fc056650 con 0x7f18040d04e0 2024-09-12T03:36:30.358 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f17f00678f0 msgr2=0x7f17f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f17f00678f0 0x7f17f0069db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17f4001750 tx=0x7f17f40011a0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18040d04e0 msgr2=0x7f18040d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18040d04e0 0x7f18040d0960 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f18040b6f60 tx=0x7f17fc010590 comp rx=0 tx=0).stop 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 shutdown_connections 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f17f00678f0 0x7f17f0069db0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18040d04e0 0x7f18040d0960 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f180415a8b0 0x7f180415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 --2- 172.21.15.73:0/4219165651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f17ec0039c0 0x7f1804156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 >> 172.21.15.73:0/4219165651 conn(0x7f180408bf90 msgr2=0x7f1804160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 shutdown_connections 2024-09-12T03:36:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.358+0000 7f180ac5e640 1 -- 172.21.15.73:0/4219165651 wait complete. 2024-09-12T03:36:30.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T03:36:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.542+0000 7f0876a0f640 1 Processor -- start 2024-09-12T03:36:30.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.542+0000 7f0876a0f640 1 -- start start 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f0876a0f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f08701630c0 0x7f087006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f0876a0f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f087006df70 0x7f08701634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f0876a0f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f087006e470 con 0x7f08700b3290 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f0876a0f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f087006e750 con 0x7f08701630c0 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f0876a0f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f087006ea30 con 0x7f087006df70 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f0874fac640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f08700b3290 0x7f08700ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42306/0 (socket says 172.21.15.73:42306) 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f0874fac640 1 -- 172.21.15.73:0/1955457431 learned_addr learned my addr 172.21.15.73:0/1955457431 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:30.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086f7fe640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f087006df70 0x7f08701634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086ffff640 1 --2- 172.21.15.73:0/1955457431 >> v2:172.21.15.150:3300/0 conn(0x7f08701630c0 0x7f087006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372761078 0 0) 0x7f087006e470 con 0x7f08700b3290 2024-09-12T03:36:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0858003530 con 0x7f08700b3290 2024-09-12T03:36:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1987122094 0 0) 0x7f0858003530 con 0x7f08700b3290 2024-09-12T03:36:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f087006df70 msgr2=0x7f08701634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f087006df70 0x7f08701634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 >> v2:172.21.15.150:3300/0 conn(0x7f08701630c0 msgr2=0x7f087006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 --2- 172.21.15.73:0/1955457431 >> v2:172.21.15.150:3300/0 conn(0x7f08701630c0 0x7f087006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087006ed10 con 0x7f08700b3290 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f0868001a00 con 0x7f08700b3290 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 >> v1:172.21.15.73:6789/0 conn(0x7f08700b3290 legacy=0x7f08700ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08580039c0 0x7f0858003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f087006df70 0x7f0858004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0858004d50 0x7f08580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f087006e750 con 0x7f08580039c0 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f087006ea30 con 0x7f0858004d50 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f085800b9d0 con 0x7f087006df70 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086ffff640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08580039c0 0x7f0858003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086ffff640 1 -- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f087006df70 msgr2=0x7f0858004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:30.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086ffff640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f087006df70 0x7f0858004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086ffff640 1 -- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0858004d50 msgr2=0x7f08580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086ffff640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0858004d50 0x7f08580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.546+0000 7f086ffff640 1 -- 172.21.15.73:0/1955457431 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0858003530 con 0x7f08580039c0 2024-09-12T03:36:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086ffff640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08580039c0 0x7f0858003de0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0860009ae0 tx=0x7f086001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c140beecfe6dce3a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:30.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08600b2070 con 0x7f08580039c0 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08600a5590 con 0x7f08580039c0 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086effd640 1 -- 172.21.15.73:0/1955457431 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08600096b0 con 0x7f08580039c0 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- 172.21.15.73:0/1955457431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08580039c0 msgr2=0x7f0858003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 --2- 172.21.15.73:0/1955457431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08580039c0 0x7f0858003de0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0860009ae0 tx=0x7f086001cab0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0874fac640 1 -- 172.21.15.73:0/1955457431 reap_dead start 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- 172.21.15.73:0/1955457431 shutdown_connections 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- 172.21.15.73:0/1955457431 >> 172.21.15.73:0/1955457431 conn(0x7f08700b1f90 msgr2=0x7f08700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- 172.21.15.73:0/1955457431 shutdown_connections 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- 172.21.15.73:0/1955457431 wait complete. 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 Processor -- start 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- start start 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08580039c0 0x7f0870157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0870152550 0x7f08701570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0870168ae0 0x7f0870073170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f087016d760 con 0x7f0870152550 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f087016d5e0 con 0x7f08580039c0 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f087016d8e0 con 0x7f0870168ae0 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0870152550 0x7f08701570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0870152550 0x7f08701570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34546/0 (socket says 172.21.15.73:34546) 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 -- 172.21.15.73:0/1836843965 learned_addr learned my addr 172.21.15.73:0/1836843965 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0874fac640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0870168ae0 0x7f0870073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086ffff640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08580039c0 0x7f0870157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 -- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0870168ae0 msgr2=0x7f0870073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0870168ae0 0x7f0870073170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 -- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08580039c0 msgr2=0x7f0870157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08580039c0 0x7f0870157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 -- 172.21.15.73:0/1836843965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08701583e0 con 0x7f0870152550 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0874fac640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0870168ae0 0x7f0870073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086f7fe640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0870152550 0x7f08701570c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f086400e7f0 tx=0x7f086400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086cff9640 1 -- 172.21.15.73:0/1836843965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864017070 con 0x7f0870152550 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086cff9640 1 -- 172.21.15.73:0/1836843965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086400c940 con 0x7f0870152550 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08701586c0 con 0x7f0870152550 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f086cff9640 1 -- 172.21.15.73:0/1836843965 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086400cd30 con 0x7f0870152550 2024-09-12T03:36:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.550+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0870156ba0 con 0x7f0870152550 2024-09-12T03:36:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.554+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0870070080 con 0x7f0870152550 2024-09-12T03:36:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.554+0000 7f086cff9640 1 -- 172.21.15.73:0/1836843965 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f086401a070 con 0x7f0870152550 2024-09-12T03:36:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.554+0000 7f086cff9640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f085c0678f0 0x7f085c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.554+0000 7f086cff9640 1 -- 172.21.15.73:0/1836843965 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f0864085d00 con 0x7f0870152550 2024-09-12T03:36:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.554+0000 7f086ffff640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f085c0678f0 0x7f085c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.554+0000 7f086ffff640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f085c0678f0 0x7f085c069db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08600af000 tx=0x7f08600046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:30.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.558+0000 7f086cff9640 1 -- 172.21.15.73:0/1836843965 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0864056a00 con 0x7f0870152550 2024-09-12T03:36:30.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.774+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0870165a20 con 0x7f0870152550 2024-09-12T03:36:30.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.774+0000 7f086cff9640 1 -- 172.21.15.73:0/1836843965 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f0864056300 con 0x7f0870152550 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ==", 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.778 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw==", 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA==", 2024-09-12T03:36:30.779 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ==", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.780 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg==", 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw==", 2024-09-12T03:36:30.781 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig==", 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ==", 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A==", 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.783 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg==", 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.784 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ==", 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g==", 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.785 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg==", 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.786 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA==", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw==", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.787 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ==", 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:36:30.788 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQASYeJmw4+ENRAAkTAy3UFY3keAJJFJvyQaAA==", 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-09-12T03:36:30.789 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw==", 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA==", 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:36:30.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:30.791 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T03:36:30.791 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:36:30.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f085c0678f0 msgr2=0x7f085c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f085c0678f0 0x7f085c069db0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08600af000 tx=0x7f08600046d0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0870152550 msgr2=0x7f08701570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0870152550 0x7f08701570c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f086400e7f0 tx=0x7f086400ecb0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 shutdown_connections 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f085c0678f0 0x7f085c069db0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0870152550 0x7f08701570c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0870168ae0 0x7f0870073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 --2- 172.21.15.73:0/1836843965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08580039c0 0x7f0870157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 >> 172.21.15.73:0/1836843965 conn(0x7f08700b1f90 msgr2=0x7f0870158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 shutdown_connections 2024-09-12T03:36:30.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.778+0000 7f0876a0f640 1 -- 172.21.15.73:0/1836843965 wait complete. 2024-09-12T03:36:30.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T03:36:30.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.910+0000 7f8fba7ac640 1 Processor -- start 2024-09-12T03:36:30.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.910+0000 7f8fba7ac640 1 -- start start 2024-09-12T03:36:30.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fba7ac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb4145d90 0x7f8fb40b0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fba7ac640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fb406bcc0 0x7f8fb406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fba7ac640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb40d1d80 con 0x7f8fb40d1050 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fba7ac640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb406c640 con 0x7f8fb406bcc0 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fba7ac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb40afa20 con 0x7f8fb4145d90 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fb406bcc0 0x7f8fb406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fb406bcc0 0x7f8fb406c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34550/0 (socket says 172.21.15.73:34550) 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 -- 172.21.15.73:0/2023140299 learned_addr learned my addr 172.21.15.73:0/2023140299 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb3fff640 1 --2- 172.21.15.73:0/2023140299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb4145d90 0x7f8fb40b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 -- 172.21.15.73:0/2023140299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb4145d90 msgr2=0x7f8fb40b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 --2- 172.21.15.73:0/2023140299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb4145d90 0x7f8fb40b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 -- 172.21.15.73:0/2023140299 >> v1:172.21.15.150:6789/0 conn(0x7f8fb40d1050 legacy=0x7f8fb40d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 -- 172.21.15.73:0/2023140299 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb40afd00 con 0x7f8fb406bcc0 2024-09-12T03:36:30.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb37fe640 1 --2- 172.21.15.73:0/2023140299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb406bcc0 0x7f8fb406c100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009870 tx=0x7f8fa801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df6b7d76964cb2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:30.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb2ffd640 1 -- 172.21.15.73:0/2023140299 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80b2070 con 0x7f8fb406bcc0 2024-09-12T03:36:30.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb2ffd640 1 -- 172.21.15.73:0/2023140299 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa80ad640 con 0x7f8fb406bcc0 2024-09-12T03:36:30.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.914+0000 7f8fb2ffd640 1 -- 172.21.15.73:0/2023140299 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80ada10 con 0x7f8fb406bcc0 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- 172.21.15.73:0/2023140299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb406bcc0 msgr2=0x7f8fb406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/2023140299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb406bcc0 0x7f8fb406c100 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009870 tx=0x7f8fa801c520 comp rx=0 tx=0).stop 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- 172.21.15.73:0/2023140299 shutdown_connections 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/2023140299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb406bcc0 0x7f8fb406c100 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/2023140299 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb4145d90 0x7f8fb40b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- 172.21.15.73:0/2023140299 >> 172.21.15.73:0/2023140299 conn(0x7f8fb409aa00 msgr2=0x7f8fb40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- 172.21.15.73:0/2023140299 shutdown_connections 2024-09-12T03:36:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- 172.21.15.73:0/2023140299 wait complete. 2024-09-12T03:36:30.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 Processor -- start 2024-09-12T03:36:30.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- start start 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb406bcc0 0x7f8fb413adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb40d1050 0x7f8fb415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb4145d90 0x7f8fb415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb40b4a20 con 0x7f8fb40d1050 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb40b48a0 con 0x7f8fb4145d90 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb40b4ba0 con 0x7f8fb406bcc0 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb40d1050 0x7f8fb415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb40d1050 0x7f8fb415bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34562/0 (socket says 172.21.15.73:34562) 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 -- 172.21.15.73:0/1918081613 learned_addr learned my addr 172.21.15.73:0/1918081613 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb3fff640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb406bcc0 0x7f8fb413adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb8d49640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb4145d90 0x7f8fb415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 -- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb406bcc0 msgr2=0x7f8fb413adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb406bcc0 0x7f8fb413adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 -- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb4145d90 msgr2=0x7f8fb415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb4145d90 0x7f8fb415e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 -- 172.21.15.73:0/1918081613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb413b660 con 0x7f8fb40d1050 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb37fe640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb40d1050 0x7f8fb415bde0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b0040 tx=0x7f8fa80192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb0ff9640 1 -- 172.21.15.73:0/1918081613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80bd070 con 0x7f8fb40d1050 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb0ff9640 1 -- 172.21.15.73:0/1918081613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa80b8630 con 0x7f8fb40d1050 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb413b940 con 0x7f8fb40d1050 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fb0ff9640 1 -- 172.21.15.73:0/1918081613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80b2040 con 0x7f8fb40d1050 2024-09-12T03:36:30.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.918+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb413bf00 con 0x7f8fb40d1050 2024-09-12T03:36:30.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.922+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb406c100 con 0x7f8fb40d1050 2024-09-12T03:36:30.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.922+0000 7f8fb0ff9640 1 -- 172.21.15.73:0/1918081613 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8fa80c0070 con 0x7f8fb40d1050 2024-09-12T03:36:30.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.922+0000 7f8fb0ff9640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fa00678c0 0x7f8fa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:30.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.922+0000 7f8fb0ff9640 1 -- 172.21.15.73:0/1918081613 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f8fa811f7d0 con 0x7f8fb40d1050 2024-09-12T03:36:30.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.922+0000 7f8fb3fff640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fa00678c0 0x7f8fa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:30.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.922+0000 7f8fb3fff640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fa00678c0 0x7f8fa0069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4144ae0 tx=0x7f8fa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:30.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:30.926+0000 7f8fb0ff9640 1 -- 172.21.15.73:0/1918081613 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8fa8016110 con 0x7f8fb40d1050 2024-09-12T03:36:31.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.074+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8fb413f040 con 0x7f8fb40d1050 2024-09-12T03:36:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fb0ff9640 1 -- 172.21.15.73:0/1918081613 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) ==== 84+0+65 (secure 0 0 0) 0x7f8fa80f04c0 con 0x7f8fb40d1050 2024-09-12T03:36:31.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:31.079 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T03:36:31.079 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:36:31.079 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T03:36:31.079 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T03:36:31.079 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:31.080 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T03:36:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fa00678c0 msgr2=0x7f8fa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fa00678c0 0x7f8fa0069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4144ae0 tx=0x7f8fa4008040 comp rx=0 tx=0).stop 2024-09-12T03:36:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb40d1050 msgr2=0x7f8fb415bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:31.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb40d1050 0x7f8fb415bde0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b0040 tx=0x7f8fa80192c0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 shutdown_connections 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fa00678c0 0x7f8fa0069d80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fb40d1050 0x7f8fb415bde0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb4145d90 0x7f8fb415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 --2- 172.21.15.73:0/1918081613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fb406bcc0 0x7f8fb413adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 >> 172.21.15.73:0/1918081613 conn(0x7f8fb409aa00 msgr2=0x7f8fb415c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 shutdown_connections 2024-09-12T03:36:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.078+0000 7f8fba7ac640 1 -- 172.21.15.73:0/1918081613 wait complete. 2024-09-12T03:36:31.096 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T03:36:31.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T03:36:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.218+0000 7f44a308d640 1 Processor -- start 2024-09-12T03:36:31.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.218+0000 7f44a308d640 1 -- start start 2024-09-12T03:36:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f449c15bec0 0x7f449c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15c2a0 0x7f449c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:31.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f449c0af2a0 0x7f449c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f449c0b3290 con 0x7f449c15bec0 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f449c0b3570 con 0x7f449c0af2a0 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f449c0b3850 con 0x7f449c15c2a0 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f449c15bec0 0x7f449c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f449c15bec0 0x7f449c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34570/0 (socket says 172.21.15.73:34570) 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 -- 172.21.15.73:0/2540301268 learned_addr learned my addr 172.21.15.73:0/2540301268 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f449bfff640 1 --2- 172.21.15.73:0/2540301268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15c2a0 0x7f449c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:31.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a162a640 1 --2- 172.21.15.73:0/2540301268 >> v2:172.21.15.150:3300/0 conn(0x7f449c0af2a0 0x7f449c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 -- 172.21.15.73:0/2540301268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15c2a0 msgr2=0x7f449c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 --2- 172.21.15.73:0/2540301268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15c2a0 0x7f449c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 -- 172.21.15.73:0/2540301268 >> v2:172.21.15.150:3300/0 conn(0x7f449c0af2a0 msgr2=0x7f449c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 --2- 172.21.15.73:0/2540301268 >> v2:172.21.15.150:3300/0 conn(0x7f449c0af2a0 0x7f449c15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 -- 172.21.15.73:0/2540301268 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c0b3b30 con 0x7f449c15bec0 2024-09-12T03:36:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f449bfff640 1 --2- 172.21.15.73:0/2540301268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15c2a0 0x7f449c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:31.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a162a640 1 --2- 172.21.15.73:0/2540301268 >> v2:172.21.15.150:3300/0 conn(0x7f449c0af2a0 0x7f449c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a0e29640 1 --2- 172.21.15.73:0/2540301268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c15bec0 0x7f449c0ad200 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f449c06dc90 tx=0x7f449401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c0b7f35bd9e2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f449b7fe640 1 -- 172.21.15.73:0/2540301268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44940a5580 con 0x7f449c15bec0 2024-09-12T03:36:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f449b7fe640 1 -- 172.21.15.73:0/2540301268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44940a5720 con 0x7f449c15bec0 2024-09-12T03:36:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f449b7fe640 1 -- 172.21.15.73:0/2540301268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44940a5af0 con 0x7f449c15bec0 2024-09-12T03:36:31.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- 172.21.15.73:0/2540301268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c15bec0 msgr2=0x7f449c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 --2- 172.21.15.73:0/2540301268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c15bec0 0x7f449c0ad200 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f449c06dc90 tx=0x7f449401c700 comp rx=0 tx=0).stop 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- 172.21.15.73:0/2540301268 shutdown_connections 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 --2- 172.21.15.73:0/2540301268 >> v2:172.21.15.150:3300/0 conn(0x7f449c0af2a0 0x7f449c15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 --2- 172.21.15.73:0/2540301268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15c2a0 0x7f449c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 --2- 172.21.15.73:0/2540301268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c15bec0 0x7f449c0ad200 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- 172.21.15.73:0/2540301268 >> 172.21.15.73:0/2540301268 conn(0x7f449c0b1f90 msgr2=0x7f449c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- 172.21.15.73:0/2540301268 shutdown_connections 2024-09-12T03:36:31.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.222+0000 7f44a308d640 1 -- 172.21.15.73:0/2540301268 wait complete. 2024-09-12T03:36:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 Processor -- start 2024-09-12T03:36:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 -- start start 2024-09-12T03:36:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c0af2a0 0x7f449c14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15bec0 0x7f449c151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f449c15c2a0 0x7f449c152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f449c0af6b0 con 0x7f449c0af2a0 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f449c0ad740 con 0x7f449c15c2a0 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f449c06e000 con 0x7f449c15bec0 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c0af2a0 0x7f449c14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c0af2a0 0x7f449c14cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34580/0 (socket says 172.21.15.73:34580) 2024-09-12T03:36:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 -- 172.21.15.73:0/2185321997 learned_addr learned my addr 172.21.15.73:0/2185321997 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f449bfff640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15bec0 0x7f449c151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a162a640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f449c15c2a0 0x7f449c152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 -- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15bec0 msgr2=0x7f449c151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15bec0 0x7f449c151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 -- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f449c15c2a0 msgr2=0x7f449c152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f449c15c2a0 0x7f449c152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 -- 172.21.15.73:0/2185321997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c152c60 con 0x7f449c0af2a0 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a0e29640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c0af2a0 0x7f449c14cff0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f44940af040 tx=0x7f44940194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44997fa640 1 -- 172.21.15.73:0/2185321997 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44940b8670 con 0x7f449c0af2a0 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44997fa640 1 -- 172.21.15.73:0/2185321997 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44940be070 con 0x7f449c0af2a0 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44997fa640 1 -- 172.21.15.73:0/2185321997 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44940b8a70 con 0x7f449c0af2a0 2024-09-12T03:36:31.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c14e440 con 0x7f449c0af2a0 2024-09-12T03:36:31.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c14ea00 con 0x7f449c0af2a0 2024-09-12T03:36:31.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.226+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449c154090 con 0x7f449c0af2a0 2024-09-12T03:36:31.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.230+0000 7f44997fa640 1 -- 172.21.15.73:0/2185321997 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f44940b8c10 con 0x7f449c0af2a0 2024-09-12T03:36:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.230+0000 7f44997fa640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44880678c0 0x7f4488069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.230+0000 7f44997fa640 1 -- 172.21.15.73:0/2185321997 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5249+0+0 (secure 0 0 0) 0x7f4494120c50 con 0x7f449c0af2a0 2024-09-12T03:36:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.230+0000 7f449bfff640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44880678c0 0x7f4488069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:31.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.230+0000 7f449bfff640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44880678c0 0x7f4488069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4490006fd0 tx=0x7f4490008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.234+0000 7f44997fa640 1 -- 172.21.15.73:0/2185321997 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4494126020 con 0x7f449c0af2a0 2024-09-12T03:36:31.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:31.390+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f449c0ad200 con 0x7f449c0af2a0 2024-09-12T03:36:32.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.366+0000 7f44997fa640 1 -- 172.21.15.73:0/2185321997 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) ==== 138+0+0 (secure 0 0 0) 0x7f44940165e0 con 0x7f449c0af2a0 2024-09-12T03:36:32.370 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T03:36:32.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.370+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44880678c0 msgr2=0x7f4488069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:32.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.370+0000 7f44a308d640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44880678c0 0x7f4488069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4490006fd0 tx=0x7f4490008040 comp rx=0 tx=0).stop 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.370+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c0af2a0 msgr2=0x7f449c14cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.370+0000 7f44a308d640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c0af2a0 0x7f449c14cff0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f44940af040 tx=0x7f44940194a0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.374+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 shutdown_connections 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.374+0000 7f44a308d640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44880678c0 0x7f4488069d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.374+0000 7f44a308d640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f449c15c2a0 0x7f449c152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.374+0000 7f44a308d640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f449c15bec0 0x7f449c151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.374+0000 7f44a308d640 1 --2- 172.21.15.73:0/2185321997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f449c0af2a0 0x7f449c14cff0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.374+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 >> 172.21.15.73:0/2185321997 conn(0x7f449c0b1f90 msgr2=0x7f449c0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:32.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.378+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 shutdown_connections 2024-09-12T03:36:32.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.378+0000 7f44a308d640 1 -- 172.21.15.73:0/2185321997 wait complete. 2024-09-12T03:36:32.399 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T03:36:32.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed2b54640 1 Processor -- start 2024-09-12T03:36:32.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed2b54640 1 -- start start 2024-09-12T03:36:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed2b54640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbecc0af100 0x7fbecc071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed2b54640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc06f620 0x7fbecc073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed2b54640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbecc15b800 con 0x7fbecc0acf60 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed2b54640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbecc0723a0 con 0x7fbecc0af100 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed2b54640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc072680 con 0x7fbecc06f620 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed08f0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbecc0af100 0x7fbecc071da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbecbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbecc0acf60 0x7fbecc06ef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42314/0 (socket says 172.21.15.73:42314) 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbecbfff640 1 -- 172.21.15.73:0/2399393642 learned_addr learned my addr 172.21.15.73:0/2399393642 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed10f1640 1 --2- 172.21.15.73:0/2399393642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc06f620 0x7fbecc073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed08f0640 1 -- 172.21.15.73:0/2399393642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc06f620 msgr2=0x7fbecc073440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed08f0640 1 --2- 172.21.15.73:0/2399393642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc06f620 0x7fbecc073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbed08f0640 1 -- 172.21.15.73:0/2399393642 >> v1:172.21.15.73:6789/0 conn(0x7fbecc0acf60 legacy=0x7fbecc06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.522+0000 7fbecb7fe640 1 -- 172.21.15.73:0/2399393642 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217713699 0 0) 0x7fbecc15b800 con 0x7fbecc0acf60 2024-09-12T03:36:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed08f0640 1 -- 172.21.15.73:0/2399393642 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc072960 con 0x7fbecc0af100 2024-09-12T03:36:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed08f0640 1 --2- 172.21.15.73:0/2399393642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc071da0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097c0 tx=0x7fbebc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa57df5154b114fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbecb7fe640 1 -- 172.21.15.73:0/2399393642 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0b0070 con 0x7fbecc0af100 2024-09-12T03:36:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbecb7fe640 1 -- 172.21.15.73:0/2399393642 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc0ab600 con 0x7fbecc0af100 2024-09-12T03:36:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbecb7fe640 1 -- 172.21.15.73:0/2399393642 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0ab9d0 con 0x7fbecc0af100 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 -- 172.21.15.73:0/2399393642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 msgr2=0x7fbecc071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 --2- 172.21.15.73:0/2399393642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc071da0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097c0 tx=0x7fbebc01c410 comp rx=0 tx=0).stop 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 -- 172.21.15.73:0/2399393642 shutdown_connections 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 --2- 172.21.15.73:0/2399393642 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc06f620 0x7fbecc073440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 --2- 172.21.15.73:0/2399393642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc071da0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 -- 172.21.15.73:0/2399393642 >> 172.21.15.73:0/2399393642 conn(0x7fbecc0b1c80 msgr2=0x7fbecc0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 -- 172.21.15.73:0/2399393642 shutdown_connections 2024-09-12T03:36:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.526+0000 7fbed2b54640 1 -- 172.21.15.73:0/2399393642 wait complete. 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 Processor -- start 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 -- start start 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc06f620 0x7fbecc163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0acf60 0x7fbecc15da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc073b00 con 0x7fbecc0af100 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc073980 con 0x7fbecc06f620 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc073c80 con 0x7fbecc0acf60 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34586/0 (socket says 172.21.15.73:34586) 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 -- 172.21.15.73:0/3551770537 learned_addr learned my addr 172.21.15.73:0/3551770537 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbecbfff640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0acf60 0x7fbecc15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed08f0640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc06f620 0x7fbecc163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 -- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0acf60 msgr2=0x7fbecc15da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0acf60 0x7fbecc15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 -- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc06f620 msgr2=0x7fbecc163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc06f620 0x7fbecc163260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 -- 172.21.15.73:0/3551770537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc1637a0 con 0x7fbecc0af100 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed10f1640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc155d30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbec400cd70 tx=0x7fbec400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbec97fa640 1 -- 172.21.15.73:0/3551770537 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4003ba0 con 0x7fbecc0af100 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbec97fa640 1 -- 172.21.15.73:0/3551770537 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4003d40 con 0x7fbecc0af100 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc15dfa0 con 0x7fbecc0af100 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbec97fa640 1 -- 172.21.15.73:0/3551770537 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4004240 con 0x7fbecc0af100 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc1fad20 con 0x7fbecc0af100 2024-09-12T03:36:32.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc073420 con 0x7fbecc0af100 2024-09-12T03:36:32.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.530+0000 7fbec97fa640 1 -- 172.21.15.73:0/3551770537 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbec40043e0 con 0x7fbecc0af100 2024-09-12T03:36:32.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.534+0000 7fbec97fa640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbeb80678c0 0x7fbeb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:32.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.534+0000 7fbec97fa640 1 -- 172.21.15.73:0/3551770537 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5619+0+0 (secure 0 0 0) 0x7fbec4086b30 con 0x7fbecc0af100 2024-09-12T03:36:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.534+0000 7fbed08f0640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbeb80678c0 0x7fbeb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.534+0000 7fbed08f0640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbeb80678c0 0x7fbeb8069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ad000 tx=0x7fbebc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:32.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.538+0000 7fbec97fa640 1 -- 172.21.15.73:0/3551770537 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbec401d340 con 0x7fbecc0af100 2024-09-12T03:36:32.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:32.698+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbecc0ad920 con 0x7fbecc0af100 2024-09-12T03:36:33.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.370+0000 7fbec97fa640 1 -- 172.21.15.73:0/3551770537 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) ==== 170+0+0 (secure 0 0 0) 0x7fbec40577a0 con 0x7fbecc0af100 2024-09-12T03:36:33.375 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T03:36:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbeb80678c0 msgr2=0x7fbeb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbeb80678c0 0x7fbeb8069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ad000 tx=0x7fbebc008040 comp rx=0 tx=0).stop 2024-09-12T03:36:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 msgr2=0x7fbecc155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc155d30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbec400cd70 tx=0x7fbec400a660 comp rx=0 tx=0).stop 2024-09-12T03:36:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 shutdown_connections 2024-09-12T03:36:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbeb80678c0 0x7fbeb8069d80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbecc0af100 0x7fbecc155d30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbecc0acf60 0x7fbecc15da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 --2- 172.21.15.73:0/3551770537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbecc06f620 0x7fbecc163260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 >> 172.21.15.73:0/3551770537 conn(0x7fbecc0b1c80 msgr2=0x7fbecc0afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 shutdown_connections 2024-09-12T03:36:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.374+0000 7fbed2b54640 1 -- 172.21.15.73:0/3551770537 wait complete. 2024-09-12T03:36:33.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T03:36:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c919c640 1 Processor -- start 2024-09-12T03:36:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c919c640 1 -- start start 2024-09-12T03:36:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c919c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70c415bec0 0x7f70c40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c919c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c40b3290 con 0x7f70c40af470 2024-09-12T03:36:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c919c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c40b3570 con 0x7f70c415c2a0 2024-09-12T03:36:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c919c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f70c40b3850 con 0x7f70c415bec0 2024-09-12T03:36:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c2d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f70c415bec0 0x7f70c40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c359e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f70c40af470 0x7f70c406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42330/0 (socket says 172.21.15.73:42330) 2024-09-12T03:36:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c359e640 1 -- 172.21.15.73:0/4120216848 learned_addr learned my addr 172.21.15.73:0/4120216848 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c2d9d640 1 -- 172.21.15.73:0/4120216848 >> v1:172.21.15.150:6789/0 conn(0x7f70c415c2a0 legacy=0x7f70c40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c2d9d640 1 -- 172.21.15.73:0/4120216848 >> v1:172.21.15.73:6789/0 conn(0x7f70c40af470 legacy=0x7f70c406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.534+0000 7f70c2d9d640 1 -- 172.21.15.73:0/4120216848 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40b3b30 con 0x7f70c415bec0 2024-09-12T03:36:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c2d9d640 1 --2- 172.21.15.73:0/4120216848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415bec0 0x7f70c40ad200 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0097c0 tx=0x7f70ac01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def7f1c45466e580 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c259c640 1 -- 172.21.15.73:0/4120216848 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0b2070 con 0x7f70c415bec0 2024-09-12T03:36:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c259c640 1 -- 172.21.15.73:0/4120216848 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ac0ad680 con 0x7f70c415bec0 2024-09-12T03:36:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c259c640 1 -- 172.21.15.73:0/4120216848 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0ada50 con 0x7f70c415bec0 2024-09-12T03:36:33.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 -- 172.21.15.73:0/4120216848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415bec0 msgr2=0x7f70c40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:33.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 --2- 172.21.15.73:0/4120216848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415bec0 0x7f70c40ad200 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0097c0 tx=0x7f70ac01c470 comp rx=0 tx=0).stop 2024-09-12T03:36:33.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 -- 172.21.15.73:0/4120216848 shutdown_connections 2024-09-12T03:36:33.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 --2- 172.21.15.73:0/4120216848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415bec0 0x7f70c40ad200 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:33.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 -- 172.21.15.73:0/4120216848 >> 172.21.15.73:0/4120216848 conn(0x7f70c40b1f90 msgr2=0x7f70c40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:33.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 -- 172.21.15.73:0/4120216848 shutdown_connections 2024-09-12T03:36:33.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 -- 172.21.15.73:0/4120216848 wait complete. 2024-09-12T03:36:33.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 Processor -- start 2024-09-12T03:36:33.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.538+0000 7f70c919c640 1 -- start start 2024-09-12T03:36:33.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70c40af470 0x7f70c40726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:33.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70c415bec0 0x7f70c40b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:33.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415c2a0 0x7f70c40b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:33.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f70c406ef20 con 0x7f70c415c2a0 2024-09-12T03:36:33.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f70c40ad740 con 0x7f70c40af470 2024-09-12T03:36:33.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f70c406f0a0 con 0x7f70c415bec0 2024-09-12T03:36:33.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415c2a0 0x7f70c40b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:33.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415c2a0 0x7f70c40b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34602/0 (socket says 172.21.15.73:34602) 2024-09-12T03:36:33.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 -- 172.21.15.73:0/3558824919 learned_addr learned my addr 172.21.15.73:0/3558824919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c2d9d640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70c40af470 0x7f70c40726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70bbfff640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70c415bec0 0x7f70c40b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 -- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70c415bec0 msgr2=0x7f70c40b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70c415bec0 0x7f70c40b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 -- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70c40af470 msgr2=0x7f70c40726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70c40af470 0x7f70c40726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 -- 172.21.15.73:0/3558824919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c4156710 con 0x7f70c415c2a0 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c359e640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415c2a0 0x7f70c40b0640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00cbc0 tx=0x7f70bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70bb7fe640 1 -- 172.21.15.73:0/3558824919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc017070 con 0x7f70c415c2a0 2024-09-12T03:36:33.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70bb7fe640 1 -- 172.21.15.73:0/3558824919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc00ad40 con 0x7f70c415c2a0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70bb7fe640 1 -- 172.21.15.73:0/3558824919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc012600 con 0x7f70c415c2a0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c4156980 con 0x7f70c415c2a0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c4156f40 con 0x7f70c415c2a0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c40ad200 con 0x7f70c415c2a0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70bb7fe640 1 -- 172.21.15.73:0/3558824919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70bc01a070 con 0x7f70c415c2a0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70bb7fe640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70a40678c0 0x7f70a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70bb7fe640 1 -- 172.21.15.73:0/3558824919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6001+0+0 (secure 0 0 0) 0x7f70bc085a20 con 0x7f70c415c2a0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c2d9d640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70a40678c0 0x7f70a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:33.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.542+0000 7f70c2d9d640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70a40678c0 0x7f70a4069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0af000 tx=0x7f70ac0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:33.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.550+0000 7f70bb7fe640 1 -- 172.21.15.73:0/3558824919 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f70bc055de0 con 0x7f70c415c2a0 2024-09-12T03:36:33.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:33.746+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f70c40b2bd0 con 0x7f70c415c2a0 2024-09-12T03:36:34.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.414+0000 7f70bb7fe640 1 -- 172.21.15.73:0/3558824919 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v29) ==== 173+0+0 (secure 0 0 0) 0x7f70bc05a0e0 con 0x7f70c415c2a0 2024-09-12T03:36:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 9 and data pool 10 2024-09-12T03:36:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70a40678c0 msgr2=0x7f70a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70a40678c0 0x7f70a4069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0af000 tx=0x7f70ac0a7000 comp rx=0 tx=0).stop 2024-09-12T03:36:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415c2a0 msgr2=0x7f70c40b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415c2a0 0x7f70c40b0640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00cbc0 tx=0x7f70bc00a430 comp rx=0 tx=0).stop 2024-09-12T03:36:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 shutdown_connections 2024-09-12T03:36:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f70a40678c0 0x7f70a4069d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c415c2a0 0x7f70c40b0640 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f70c415bec0 0x7f70c40b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 --2- 172.21.15.73:0/3558824919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f70c40af470 0x7f70c40726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 >> 172.21.15.73:0/3558824919 conn(0x7f70c40b1f90 msgr2=0x7f70c40d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 shutdown_connections 2024-09-12T03:36:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.434+0000 7f70c919c640 1 -- 172.21.15.73:0/3558824919 wait complete. 2024-09-12T03:36:34.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:34.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.570+0000 7f86e4938640 1 Processor -- start 2024-09-12T03:36:34.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.570+0000 7f86e4938640 1 -- start start 2024-09-12T03:36:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86e4938640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86e0073e60 0x7f86e006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86e4938640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e006fef0 0x7f86e015b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86e4938640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86e015bda0 con 0x7f86e00b3d50 2024-09-12T03:36:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86e4938640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f86e006ee50 con 0x7f86e0073e60 2024-09-12T03:36:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86e4938640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f86e006f130 con 0x7f86e006fef0 2024-09-12T03:36:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ded9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86e00b3d50 0x7f86e00b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42334/0 (socket says 172.21.15.73:42334) 2024-09-12T03:36:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ded9d640 1 -- 172.21.15.73:0/3296673168 learned_addr learned my addr 172.21.15.73:0/3296673168 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e006fef0 0x7f86e015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86de59c640 1 --2- 172.21.15.73:0/3296673168 >> v2:172.21.15.150:3300/0 conn(0x7f86e0073e60 0x7f86e006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650078815 0 0) 0x7f86e015bda0 con 0x7f86e00b3d50 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86c8003530 con 0x7f86e00b3d50 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1401836203 0 0) 0x7f86c8003530 con 0x7f86e00b3d50 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e006fef0 msgr2=0x7f86e015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e006fef0 0x7f86e015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 >> v2:172.21.15.150:3300/0 conn(0x7f86e0073e60 msgr2=0x7f86e006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 --2- 172.21.15.73:0/3296673168 >> v2:172.21.15.150:3300/0 conn(0x7f86e0073e60 0x7f86e006e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e006f410 con 0x7f86e00b3d50 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f86d8001a00 con 0x7f86e00b3d50 2024-09-12T03:36:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 >> v1:172.21.15.73:6789/0 conn(0x7f86e00b3d50 legacy=0x7f86e00b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80039c0 0x7f86c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86c8004810 0x7f86c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e006fef0 0x7f86c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f86e006ee50 con 0x7f86c8004810 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f86e006f130 con 0x7f86c80039c0 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f86c800ba50 con 0x7f86e006fef0 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86c8004810 0x7f86c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86de59c640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80039c0 0x7f86c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 -- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e006fef0 msgr2=0x7f86c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86e006fef0 0x7f86c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 -- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80039c0 msgr2=0x7f86c8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86c80039c0 0x7f86c8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 -- 172.21.15.73:0/3296673168 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c8003530 con 0x7f86c8004810 2024-09-12T03:36:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86c8004810 0x7f86c8004c90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f86d000aae0 tx=0x7f86d001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5789791ca85f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00b3070 con 0x7f86c8004810 2024-09-12T03:36:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d00a6c80 con 0x7f86c8004810 2024-09-12T03:36:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.574+0000 7f86dd59a640 1 -- 172.21.15.73:0/3296673168 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d000b040 con 0x7f86c8004810 2024-09-12T03:36:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- 172.21.15.73:0/3296673168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86c8004810 msgr2=0x7f86c8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 --2- 172.21.15.73:0/3296673168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86c8004810 0x7f86c8004c90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f86d000aae0 tx=0x7f86d001e000 comp rx=0 tx=0).stop 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ded9d640 1 -- 172.21.15.73:0/3296673168 reap_dead start 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- 172.21.15.73:0/3296673168 shutdown_connections 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- 172.21.15.73:0/3296673168 >> 172.21.15.73:0/3296673168 conn(0x7f86e00b1f90 msgr2=0x7f86e00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- 172.21.15.73:0/3296673168 shutdown_connections 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- 172.21.15.73:0/3296673168 wait complete. 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 Processor -- start 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- start start 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86c8004810 0x7f86e0149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e00d0510 0x7f86e0147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e00d0970 0x7f86e0148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f86e00729a0 con 0x7f86e00d0510 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0072820 con 0x7f86e00d0970 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f86e0072b20 con 0x7f86c8004810 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e00d0510 0x7f86e0147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e00d0510 0x7f86e0147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34630/0 (socket says 172.21.15.73:34630) 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 -- 172.21.15.73:0/549626145 learned_addr learned my addr 172.21.15.73:0/549626145 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86de59c640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86c8004810 0x7f86e0149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ded9d640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e00d0970 0x7f86e0148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 -- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86c8004810 msgr2=0x7f86e0149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86c8004810 0x7f86e0149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 -- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e00d0970 msgr2=0x7f86e0148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e00d0970 0x7f86e0148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 -- 172.21.15.73:0/549626145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e00ad6c0 con 0x7f86e00d0510 2024-09-12T03:36:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ddd9b640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e00d0510 0x7f86e0147dd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f86d00b1040 tx=0x7f86d001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ceffd640 1 -- 172.21.15.73:0/549626145 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00aea40 con 0x7f86e00d0510 2024-09-12T03:36:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ceffd640 1 -- 172.21.15.73:0/549626145 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d00aebe0 con 0x7f86e00d0510 2024-09-12T03:36:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e00ad9a0 con 0x7f86e00d0510 2024-09-12T03:36:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86ceffd640 1 -- 172.21.15.73:0/549626145 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0004020 con 0x7f86e00d0510 2024-09-12T03:36:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.578+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e00adf60 con 0x7f86e00d0510 2024-09-12T03:36:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.582+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86e00ad430 con 0x7f86e00d0510 2024-09-12T03:36:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.582+0000 7f86ceffd640 1 -- 172.21.15.73:0/549626145 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86d00041c0 con 0x7f86e00d0510 2024-09-12T03:36:34.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.582+0000 7f86ceffd640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86c00678f0 0x7f86c0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.582+0000 7f86ceffd640 1 -- 172.21.15.73:0/549626145 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f86d0122600 con 0x7f86e00d0510 2024-09-12T03:36:34.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.582+0000 7f86de59c640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86c00678f0 0x7f86c0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.582+0000 7f86de59c640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86c00678f0 0x7f86c0069db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009ab0 tx=0x7f86d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:34.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.586+0000 7f86ceffd640 1 -- 172.21.15.73:0/549626145 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f86d0017d10 con 0x7f86e00d0510 2024-09-12T03:36:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.750+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86e006e800 con 0x7f86e00d0510 2024-09-12T03:36:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.750+0000 7f86ceffd640 1 -- 172.21.15.73:0/549626145 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16969 (secure 0 0 0) 0x7f86d00044b0 con 0x7f86e00d0510 2024-09-12T03:36:34.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:34.753 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":63,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:33.751521+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:31.428624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:32.740289+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86c00678f0 msgr2=0x7f86c0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86c00678f0 0x7f86c0069db0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009ab0 tx=0x7f86d4008040 comp rx=0 tx=0).stop 2024-09-12T03:36:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e00d0510 msgr2=0x7f86e0147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e00d0510 0x7f86e0147dd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f86d00b1040 tx=0x7f86d001ada0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 shutdown_connections 2024-09-12T03:36:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86c00678f0 0x7f86c0069db0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e00d0510 0x7f86e0147dd0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86e00d0970 0x7f86e0148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 --2- 172.21.15.73:0/549626145 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86c8004810 0x7f86e0149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 >> 172.21.15.73:0/549626145 conn(0x7f86e00b1f90 msgr2=0x7f86e0152940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 shutdown_connections 2024-09-12T03:36:34.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.754+0000 7f86e4938640 1 -- 172.21.15.73:0/549626145 wait complete. 2024-09-12T03:36:34.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:34.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3fb188640 1 Processor -- start 2024-09-12T03:36:34.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3fb188640 1 -- start start 2024-09-12T03:36:34.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3fb188640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3fb188640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3f40af2a0 0x7ff3f406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3fb188640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f40b3290 con 0x7ff3f415bec0 2024-09-12T03:36:34.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3fb188640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f40b3570 con 0x7ff3f40af2a0 2024-09-12T03:36:34.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3fb188640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f40b3850 con 0x7ff3f415c2a0 2024-09-12T03:36:34.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f9725640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3f40af2a0 0x7ff3f406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f8f24640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff3f415bec0 0x7ff3f40ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42346/0 (socket says 172.21.15.73:42346) 2024-09-12T03:36:34.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f8f24640 1 -- 172.21.15.73:0/410316901 learned_addr learned my addr 172.21.15.73:0/410316901 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:34.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f3fff640 1 --2- 172.21.15.73:0/410316901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f9725640 1 -- 172.21.15.73:0/410316901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 msgr2=0x7ff3f40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:34.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f9725640 1 --2- 172.21.15.73:0/410316901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f9725640 1 -- 172.21.15.73:0/410316901 >> v1:172.21.15.73:6789/0 conn(0x7ff3f415bec0 legacy=0x7ff3f40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f9725640 1 -- 172.21.15.73:0/410316901 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f40b3b30 con 0x7ff3f40af2a0 2024-09-12T03:36:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.894+0000 7ff3f9725640 1 --2- 172.21.15.73:0/410316901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f406e000 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0097c0 tx=0x7ff3ec01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b363af41dd885be server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f37fe640 1 -- 172.21.15.73:0/410316901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec0b0070 con 0x7ff3f40af2a0 2024-09-12T03:36:34.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f37fe640 1 -- 172.21.15.73:0/410316901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec0ab600 con 0x7ff3f40af2a0 2024-09-12T03:36:34.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f37fe640 1 -- 172.21.15.73:0/410316901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec0ab9d0 con 0x7ff3f40af2a0 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- 172.21.15.73:0/410316901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 msgr2=0x7ff3f406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 --2- 172.21.15.73:0/410316901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f406e000 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0097c0 tx=0x7ff3ec01c300 comp rx=0 tx=0).stop 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- 172.21.15.73:0/410316901 shutdown_connections 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 --2- 172.21.15.73:0/410316901 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 --2- 172.21.15.73:0/410316901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f406e000 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- 172.21.15.73:0/410316901 >> 172.21.15.73:0/410316901 conn(0x7ff3f40b1f90 msgr2=0x7ff3f40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- 172.21.15.73:0/410316901 shutdown_connections 2024-09-12T03:36:34.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- 172.21.15.73:0/410316901 wait complete. 2024-09-12T03:36:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 Processor -- start 2024-09-12T03:36:34.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- start start 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f415bec0 0x7ff3f414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f415e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f406ed50 con 0x7ff3f40af2a0 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40afc90 con 0x7ff3f415bec0 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3fb188640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f406eed0 con 0x7ff3f415c2a0 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f41508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34636/0 (socket says 172.21.15.73:34636) 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 -- 172.21.15.73:0/3063529812 learned_addr learned my addr 172.21.15.73:0/3063529812 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f9725640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f415e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f3fff640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f415bec0 0x7ff3f414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 -- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 msgr2=0x7ff3f415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f415e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 -- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f415bec0 msgr2=0x7ff3f414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f415bec0 0x7ff3f414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 -- 172.21.15.73:0/3063529812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f414d370 con 0x7ff3f40af2a0 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f3fff640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f415bec0 0x7ff3f414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.898+0000 7ff3f8f24640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f41508f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400cb20 tx=0x7ff3e4002150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f17fa640 1 -- 172.21.15.73:0/3063529812 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4018070 con 0x7ff3f40af2a0 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f17fa640 1 -- 172.21.15.73:0/3063529812 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e400a7c0 con 0x7ff3f40af2a0 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f415eea0 con 0x7ff3f40af2a0 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f17fa640 1 -- 172.21.15.73:0/3063529812 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400abb0 con 0x7ff3f40af2a0 2024-09-12T03:36:34.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f415f460 con 0x7ff3f40af2a0 2024-09-12T03:36:34.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f406e000 con 0x7ff3f40af2a0 2024-09-12T03:36:34.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f17fa640 1 -- 172.21.15.73:0/3063529812 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3e401b070 con 0x7ff3f40af2a0 2024-09-12T03:36:34.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f17fa640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3d40678c0 0x7ff3d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:34.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f17fa640 1 -- 172.21.15.73:0/3063529812 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7ff3e4085930 con 0x7ff3f40af2a0 2024-09-12T03:36:34.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f3fff640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3d40678c0 0x7ff3d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:34.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.902+0000 7ff3f3fff640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3d40678c0 0x7ff3d4069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3f414d2f0 tx=0x7ff3dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:34.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:34.906+0000 7ff3f17fa640 1 -- 172.21.15.73:0/3063529812 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3e40563d0 con 0x7ff3f40af2a0 2024-09-12T03:36:35.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.070+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3f406fcd0 con 0x7ff3f40af2a0 2024-09-12T03:36:35.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3f17fa640 1 -- 172.21.15.73:0/3063529812 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16969 (secure 0 0 0) 0x7ff3e4055cd0 con 0x7ff3f40af2a0 2024-09-12T03:36:35.075 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:35.075 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":63,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:33.751521+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:31.428624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:32.740289+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:35.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3d40678c0 msgr2=0x7ff3d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3d40678c0 0x7ff3d4069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3f414d2f0 tx=0x7ff3dc008040 comp rx=0 tx=0).stop 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 msgr2=0x7ff3f41508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f41508f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400cb20 tx=0x7ff3e4002150 comp rx=0 tx=0).stop 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 shutdown_connections 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff3d40678c0 0x7ff3d4069d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff3f415c2a0 0x7ff3f415e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff3f415bec0 0x7ff3f414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 --2- 172.21.15.73:0/3063529812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3f40af2a0 0x7ff3f41508f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 >> 172.21.15.73:0/3063529812 conn(0x7ff3f40b1f90 msgr2=0x7ff3f40afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 shutdown_connections 2024-09-12T03:36:35.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.074+0000 7ff3fb188640 1 -- 172.21.15.73:0/3063529812 wait complete. 2024-09-12T03:36:35.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T03:36:35.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1db976640 1 Processor -- start 2024-09-12T03:36:35.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1db976640 1 -- start start 2024-09-12T03:36:35.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1db976640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d4070020 0x7fe1d415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:35.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1db976640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1d415f1d0 0x7fe1d40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:35.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1db976640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d40aede0 con 0x7fe1d41520a0 2024-09-12T03:36:35.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1db976640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d4152480 con 0x7fe1d415f1d0 2024-09-12T03:36:35.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1db976640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d415fa10 con 0x7fe1d4070020 2024-09-12T03:36:35.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d8f11640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d4070020 0x7fe1d415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d9f13640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1d415f1d0 0x7fe1d40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d8f11640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d4070020 0x7fe1d415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:38818/0 (socket says 172.21.15.73:38818) 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d8f11640 1 -- 172.21.15.73:0/1869300529 learned_addr learned my addr 172.21.15.73:0/1869300529 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d9f13640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1d415f1d0 0x7fe1d40adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:34640/0 (socket says 172.21.15.73:34640) 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d9f13640 1 -- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d4070020 msgr2=0x7fe1d415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d9f13640 1 --2- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d4070020 0x7fe1d415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d9f13640 1 -- 172.21.15.73:0/1869300529 >> v1:172.21.15.150:6789/0 conn(0x7fe1d41520a0 legacy=0x7fe1d406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d9f13640 1 -- 172.21.15.73:0/1869300529 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d4074250 con 0x7fe1d415f1d0 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1cbfff640 1 -- 172.21.15.73:0/1869300529 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020021524 0 0) 0x7fe1d40aede0 con 0x7fe1d41520a0 2024-09-12T03:36:35.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.218+0000 7fe1d8f11640 1 --2- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d4070020 0x7fe1d415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:36:35.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1d9f13640 1 --2- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d415f1d0 0x7fe1d40adc80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009dc0 tx=0x7fe1cc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67200472318950fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:35.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1cbfff640 1 -- 172.21.15.73:0/1869300529 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0b2070 con 0x7fe1d415f1d0 2024-09-12T03:36:35.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1cbfff640 1 -- 172.21.15.73:0/1869300529 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0a59e0 con 0x7fe1d415f1d0 2024-09-12T03:36:35.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1cbfff640 1 -- 172.21.15.73:0/1869300529 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0a5db0 con 0x7fe1d415f1d0 2024-09-12T03:36:35.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 -- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d415f1d0 msgr2=0x7fe1d40adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:35.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 --2- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d415f1d0 0x7fe1d40adc80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009dc0 tx=0x7fe1cc01c920 comp rx=0 tx=0).stop 2024-09-12T03:36:35.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 -- 172.21.15.73:0/1869300529 shutdown_connections 2024-09-12T03:36:35.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 --2- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d4070020 0x7fe1d415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 --2- 172.21.15.73:0/1869300529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d415f1d0 0x7fe1d40adc80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 -- 172.21.15.73:0/1869300529 >> 172.21.15.73:0/1869300529 conn(0x7fe1d40b1f90 msgr2=0x7fe1d40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:35.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 -- 172.21.15.73:0/1869300529 shutdown_connections 2024-09-12T03:36:35.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 -- 172.21.15.73:0/1869300529 wait complete. 2024-09-12T03:36:35.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 Processor -- start 2024-09-12T03:36:35.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.222+0000 7fe1db976640 1 -- start start 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d4070020 0x7fe1d414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d41520a0 0x7fe1d40cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d415f1d0 0x7fe1d40cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d415f680 con 0x7fe1d41520a0 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d4073d30 con 0x7fe1d4070020 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d406e800 con 0x7fe1d415f1d0 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d41520a0 0x7fe1d40cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d41520a0 0x7fe1d40cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54816/0 (socket says 172.21.15.73:54816) 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 -- 172.21.15.73:0/2588048087 learned_addr learned my addr 172.21.15.73:0/2588048087 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d9712640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d4070020 0x7fe1d414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d9f13640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d415f1d0 0x7fe1d40cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 -- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d415f1d0 msgr2=0x7fe1d40cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d415f1d0 0x7fe1d40cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 -- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d4070020 msgr2=0x7fe1d414a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d4070020 0x7fe1d414a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 -- 172.21.15.73:0/2588048087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d414e100 con 0x7fe1d41520a0 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d8f11640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d41520a0 0x7fe1d40cccb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4010df0 tx=0x7fe1c400e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1c9ffb640 1 -- 172.21.15.73:0/2588048087 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c401e070 con 0x7fe1d41520a0 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1c9ffb640 1 -- 172.21.15.73:0/2588048087 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4011660 con 0x7fe1d41520a0 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d414de20 con 0x7fe1d41520a0 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1c9ffb640 1 -- 172.21.15.73:0/2588048087 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4011a50 con 0x7fe1d41520a0 2024-09-12T03:36:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d414f900 con 0x7fe1d41520a0 2024-09-12T03:36:35.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d4151ec0 con 0x7fe1d41520a0 2024-09-12T03:36:35.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1c9ffb640 1 -- 172.21.15.73:0/2588048087 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1c4021070 con 0x7fe1d41520a0 2024-09-12T03:36:35.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1c9ffb640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1b80678c0 0x7fe1b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:35.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d9712640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1b80678c0 0x7fe1b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:35.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1c9ffb640 1 -- 172.21.15.73:0/2588048087 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fe1c4088720 con 0x7fe1d41520a0 2024-09-12T03:36:35.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.226+0000 7fe1d9712640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1b80678c0 0x7fe1b8069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000f70 tx=0x7fe1d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:35.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.230+0000 7fe1c9ffb640 1 -- 172.21.15.73:0/2588048087 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1d4151ec0 con 0x7fe1d41520a0 2024-09-12T03:36:35.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:35.434+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe1d415ec90 con 0x7fe1d41520a0 2024-09-12T03:36:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.434+0000 7fe1c9ffb640 1 -- 172.21.15.73:0/2588048087 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7fe1c4058b10 con 0x7fe1d41520a0 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1b80678c0 msgr2=0x7fe1b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1b80678c0 0x7fe1b8069d80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000f70 tx=0x7fe1d0009040 comp rx=0 tx=0).stop 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d41520a0 msgr2=0x7fe1d40cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d41520a0 0x7fe1d40cccb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4010df0 tx=0x7fe1c400e730 comp rx=0 tx=0).stop 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 shutdown_connections 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1b80678c0 0x7fe1b8069d80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d41520a0 0x7fe1d40cccb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d415f1d0 0x7fe1d40cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 --2- 172.21.15.73:0/2588048087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d4070020 0x7fe1d414a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 >> 172.21.15.73:0/2588048087 conn(0x7fe1d40b1f90 msgr2=0x7fe1d4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 shutdown_connections 2024-09-12T03:36:36.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.438+0000 7fe1db976640 1 -- 172.21.15.73:0/2588048087 wait complete. 2024-09-12T03:36:36.460 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T03:36:36.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T03:36:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b45a4640 1 Processor -- start 2024-09-12T03:36:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b45a4640 1 -- start start 2024-09-12T03:36:36.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b45a4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f56ac0b5cf0 0x7f56ac15e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b45a4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac15ecb0 0x7f56ac06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b45a4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56ac15f180 con 0x7f56ac06e180 2024-09-12T03:36:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b45a4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f56ac15f460 con 0x7f56ac0b5cf0 2024-09-12T03:36:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b45a4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac06d440 con 0x7f56ac15ecb0 2024-09-12T03:36:36.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b1b3f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac15ecb0 0x7f56ac06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b2340640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f56ac0b5cf0 0x7f56ac15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b1b3f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac15ecb0 0x7f56ac06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:38836/0 (socket says 172.21.15.73:38836) 2024-09-12T03:36:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b1b3f640 1 -- 172.21.15.73:0/777449659 learned_addr learned my addr 172.21.15.73:0/777449659 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b1b3f640 1 -- 172.21.15.73:0/777449659 >> v2:172.21.15.150:3300/0 conn(0x7f56ac0b5cf0 msgr2=0x7f56ac15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b1b3f640 1 --2- 172.21.15.73:0/777449659 >> v2:172.21.15.150:3300/0 conn(0x7f56ac0b5cf0 0x7f56ac15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b1b3f640 1 -- 172.21.15.73:0/777449659 >> v1:172.21.15.150:6789/0 conn(0x7f56ac06e180 legacy=0x7f56ac15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:36.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.586+0000 7f56b1b3f640 1 -- 172.21.15.73:0/777449659 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac0b60d0 con 0x7f56ac15ecb0 2024-09-12T03:36:36.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b1b3f640 1 --2- 172.21.15.73:0/777449659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac15ecb0 0x7f56ac06dc40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f569c009870 tx=0x7f569c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae458a73f5fc4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:36.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b133e640 1 -- 172.21.15.73:0/777449659 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c0b0070 con 0x7f56ac15ecb0 2024-09-12T03:36:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b133e640 1 -- 172.21.15.73:0/777449659 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f569c0ab600 con 0x7f56ac15ecb0 2024-09-12T03:36:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b133e640 1 -- 172.21.15.73:0/777449659 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c0ab9d0 con 0x7f56ac15ecb0 2024-09-12T03:36:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- 172.21.15.73:0/777449659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac15ecb0 msgr2=0x7f56ac06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:36.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 --2- 172.21.15.73:0/777449659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac15ecb0 0x7f56ac06dc40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f569c009870 tx=0x7f569c01c4d0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- 172.21.15.73:0/777449659 shutdown_connections 2024-09-12T03:36:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 --2- 172.21.15.73:0/777449659 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac15ecb0 0x7f56ac06dc40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 --2- 172.21.15.73:0/777449659 >> v2:172.21.15.150:3300/0 conn(0x7f56ac0b5cf0 0x7f56ac15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- 172.21.15.73:0/777449659 >> 172.21.15.73:0/777449659 conn(0x7f56ac06c0c0 msgr2=0x7f56ac06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- 172.21.15.73:0/777449659 shutdown_connections 2024-09-12T03:36:36.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- 172.21.15.73:0/777449659 wait complete. 2024-09-12T03:36:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 Processor -- start 2024-09-12T03:36:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- start start 2024-09-12T03:36:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ac06e180 0x7f56ac157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac0b5cf0 0x7f56ac1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac15ecb0 0x7f56ac163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac16b130 con 0x7f56ac15ecb0 2024-09-12T03:36:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac072900 con 0x7f56ac06e180 2024-09-12T03:36:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b45a4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f56ac16b2b0 con 0x7f56ac0b5cf0 2024-09-12T03:36:36.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.590+0000 7f56b2b41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac15ecb0 0x7f56ac163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac15ecb0 0x7f56ac163e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54824/0 (socket says 172.21.15.73:54824) 2024-09-12T03:36:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 -- 172.21.15.73:0/694728990 learned_addr learned my addr 172.21.15.73:0/694728990 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b1b3f640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac0b5cf0 0x7f56ac1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2340640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ac06e180 0x7f56ac157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:36.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 -- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac0b5cf0 msgr2=0x7f56ac1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac0b5cf0 0x7f56ac1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 -- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ac06e180 msgr2=0x7f56ac157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ac06e180 0x7f56ac157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 -- 172.21.15.73:0/694728990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac166220 con 0x7f56ac15ecb0 2024-09-12T03:36:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2b41640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac15ecb0 0x7f56ac163e50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c7d0 tx=0x7f56a400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56a2ffd640 1 -- 172.21.15.73:0/694728990 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4003b80 con 0x7f56ac15ecb0 2024-09-12T03:36:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56a2ffd640 1 -- 172.21.15.73:0/694728990 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a4003d20 con 0x7f56ac15ecb0 2024-09-12T03:36:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56a2ffd640 1 -- 172.21.15.73:0/694728990 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a400aa30 con 0x7f56ac15ecb0 2024-09-12T03:36:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac166500 con 0x7f56ac15ecb0 2024-09-12T03:36:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac166ac0 con 0x7f56ac15ecb0 2024-09-12T03:36:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac15e770 con 0x7f56ac15ecb0 2024-09-12T03:36:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56a2ffd640 1 -- 172.21.15.73:0/694728990 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f56a400abd0 con 0x7f56ac15ecb0 2024-09-12T03:36:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56a2ffd640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56900678c0 0x7f5690069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2340640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56900678c0 0x7f5690069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56a2ffd640 1 -- 172.21.15.73:0/694728990 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f56a4085c00 con 0x7f56ac15ecb0 2024-09-12T03:36:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.594+0000 7f56b2340640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56900678c0 0x7f5690069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009af0 tx=0x7f56a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.598+0000 7f56a2ffd640 1 -- 172.21.15.73:0/694728990 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f56a408c080 con 0x7f56ac15ecb0 2024-09-12T03:36:36.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:36.782+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f56ac069170 con 0x7f56ac15ecb0 2024-09-12T03:36:37.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.438+0000 7f56a2ffd640 1 -- 172.21.15.73:0/694728990 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f56a4056640 con 0x7f56ac15ecb0 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56900678c0 msgr2=0x7f5690069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56900678c0 0x7f5690069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009af0 tx=0x7f56a8008040 comp rx=0 tx=0).stop 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac15ecb0 msgr2=0x7f56ac163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac15ecb0 0x7f56ac163e50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f56a400c7d0 tx=0x7f56a400cc90 comp rx=0 tx=0).stop 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 shutdown_connections 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56900678c0 0x7f5690069d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56ac15ecb0 0x7f56ac163e50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56ac0b5cf0 0x7f56ac1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 --2- 172.21.15.73:0/694728990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56ac06e180 0x7f56ac157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 >> 172.21.15.73:0/694728990 conn(0x7f56ac06c0c0 msgr2=0x7f56ac152520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 shutdown_connections 2024-09-12T03:36:37.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.442+0000 7f56b45a4640 1 -- 172.21.15.73:0/694728990 wait complete. 2024-09-12T03:36:37.462 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T03:36:37.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:37.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:36:37.507 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:36:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.582+0000 7fcc1af03640 1 Processor -- start 2024-09-12T03:36:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.582+0000 7fcc1af03640 1 -- start start 2024-09-12T03:36:37.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc1af03640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc14161a60 0x7fcc140d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc1af03640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcc140d2e90 0x7fcc140cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc1af03640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc140d32b0 con 0x7fcc140cf450 2024-09-12T03:36:37.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc1af03640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcc140d0300 con 0x7fcc140d2e90 2024-09-12T03:36:37.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc1af03640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1406e6c0 con 0x7fcc14161a60 2024-09-12T03:36:37.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc13fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcc140d2e90 0x7fcc140cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc194a0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcc140cf450 0x7fcc140d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57360/0 (socket says 172.21.15.73:57360) 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc13fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcc140d2e90 0x7fcc140cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54840/0 (socket says 172.21.15.73:54840) 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc194a0640 1 -- 172.21.15.73:0/93858883 learned_addr learned my addr 172.21.15.73:0/93858883 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc18c9f640 1 --2- 172.21.15.73:0/93858883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc14161a60 0x7fcc140d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc13fff640 1 -- 172.21.15.73:0/93858883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc14161a60 msgr2=0x7fcc140d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc13fff640 1 --2- 172.21.15.73:0/93858883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc14161a60 0x7fcc140d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc13fff640 1 -- 172.21.15.73:0/93858883 >> v1:172.21.15.73:6789/0 conn(0x7fcc140cf450 legacy=0x7fcc140d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc13fff640 1 -- 172.21.15.73:0/93858883 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc140b0f60 con 0x7fcc140d2e90 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc137fe640 1 -- 172.21.15.73:0/93858883 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334082966 0 0) 0x7fcc140d32b0 con 0x7fcc140cf450 2024-09-12T03:36:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc18c9f640 1 --2- 172.21.15.73:0/93858883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc14161a60 0x7fcc140d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc13fff640 1 --2- 172.21.15.73:0/93858883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140d2e90 0x7fcc140cef10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd992c7b300de477 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc137fe640 1 -- 172.21.15.73:0/93858883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080b1070 con 0x7fcc140d2e90 2024-09-12T03:36:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc137fe640 1 -- 172.21.15.73:0/93858883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc080a8050 con 0x7fcc140d2e90 2024-09-12T03:36:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.586+0000 7fcc137fe640 1 -- 172.21.15.73:0/93858883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc140d1930 con 0x7fcc140d2e90 2024-09-12T03:36:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- 172.21.15.73:0/93858883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140d2e90 msgr2=0x7fcc140cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 --2- 172.21.15.73:0/93858883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140d2e90 0x7fcc140cef10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c3e0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- 172.21.15.73:0/93858883 shutdown_connections 2024-09-12T03:36:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 --2- 172.21.15.73:0/93858883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140d2e90 0x7fcc140cef10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 --2- 172.21.15.73:0/93858883 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc14161a60 0x7fcc140d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- 172.21.15.73:0/93858883 >> 172.21.15.73:0/93858883 conn(0x7fcc1408bf90 msgr2=0x7fcc1409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- 172.21.15.73:0/93858883 shutdown_connections 2024-09-12T03:36:37.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- 172.21.15.73:0/93858883 wait complete. 2024-09-12T03:36:37.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 Processor -- start 2024-09-12T03:36:37.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- start start 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140cf450 0x7fcc1414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc140d2e90 0x7fcc140b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc14161a60 0x7fcc140b9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcc140cf8c0 con 0x7fcc140cf450 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1406d190 con 0x7fcc14161a60 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcc140cfa40 con 0x7fcc140d2e90 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140cf450 0x7fcc1414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140cf450 0x7fcc1414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54846/0 (socket says 172.21.15.73:54846) 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 -- 172.21.15.73:0/1882329397 learned_addr learned my addr 172.21.15.73:0/1882329397 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc13fff640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc140d2e90 0x7fcc140b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 -- 172.21.15.73:0/1882329397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc140d2e90 msgr2=0x7fcc140b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc140d2e90 0x7fcc140b8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 -- 172.21.15.73:0/1882329397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc14161a60 msgr2=0x7fcc140b9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc14161a60 0x7fcc140b9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 -- 172.21.15.73:0/1882329397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc141589f0 con 0x7fcc140cf450 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc18c9f640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140cf450 0x7fcc1414fe00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c7c0 tx=0x7fcc0400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc117fa640 1 -- 172.21.15.73:0/1882329397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc04007a30 con 0x7fcc140cf450 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc117fa640 1 -- 172.21.15.73:0/1882329397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc04007bd0 con 0x7fcc140cf450 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc14158cd0 con 0x7fcc140cf450 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.590+0000 7fcc117fa640 1 -- 172.21.15.73:0/1882329397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc040113f0 con 0x7fcc140cf450 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.594+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc14159290 con 0x7fcc140cf450 2024-09-12T03:36:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.594+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1415d120 con 0x7fcc140cf450 2024-09-12T03:36:37.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.594+0000 7fcc117fa640 1 -- 172.21.15.73:0/1882329397 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcc04011590 con 0x7fcc140cf450 2024-09-12T03:36:37.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.594+0000 7fcc117fa640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcc000678c0 0x7fcc00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.594+0000 7fcc13fff640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcc000678c0 0x7fcc00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.594+0000 7fcc117fa640 1 -- 172.21.15.73:0/1882329397 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fcc04085fc0 con 0x7fcc140cf450 2024-09-12T03:36:37.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.594+0000 7fcc13fff640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcc000678c0 0x7fcc00069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcc080ae000 tx=0x7fcc08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:37.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.598+0000 7fcc117fa640 1 -- 172.21.15.73:0/1882329397 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcc04015020 con 0x7fcc140cf450 2024-09-12T03:36:37.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.794+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc1406bcc0 con 0x7fcc140cf450 2024-09-12T03:36:37.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc117fa640 1 -- 172.21.15.73:0/1882329397 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5227 (secure 0 0 0) 0x7fcc040569e0 con 0x7fcc140cf450 2024-09-12T03:36:37.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:37.799 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"btime":"2024-09-12T03:36:37:437965+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423262735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":423262735},{"type":"v1","addr":"172.21.15.150:6835","nonce":423262735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3010572042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3010572042},{"type":"v1","addr":"172.21.15.150:6833","nonce":3010572042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2140641329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2140641329},{"type":"v1","addr":"172.21.15.73:6836","nonce":2140641329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:33.751869+0000","modified":"2024-09-12T03:36:36.786974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2746514655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2746514655},{"type":"v1","addr":"172.21.15.73:6837","nonce":2746514655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5550,"qdb_cluster":[5550]},"id":4}]} 2024-09-12T03:36:37.799 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcc000678c0 msgr2=0x7fcc00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcc000678c0 0x7fcc00069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcc080ae000 tx=0x7fcc08008040 comp rx=0 tx=0).stop 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140cf450 msgr2=0x7fcc1414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140cf450 0x7fcc1414fe00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c7c0 tx=0x7fcc0400cc80 comp rx=0 tx=0).stop 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 shutdown_connections 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcc000678c0 0x7fcc00069d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc14161a60 0x7fcc140b9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcc140d2e90 0x7fcc140b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 --2- 172.21.15.73:0/1882329397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140cf450 0x7fcc1414fe00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 >> 172.21.15.73:0/1882329397 conn(0x7fcc1408bf90 msgr2=0x7fcc140d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:37.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 shutdown_connections 2024-09-12T03:36:37.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.798+0000 7fcc1af03640 1 -- 172.21.15.73:0/1882329397 wait complete. 2024-09-12T03:36:37.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:37.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 Processor -- start 2024-09-12T03:36:37.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 -- start start 2024-09-12T03:36:37.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed3c073e60 0x7fed3c06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fed3c06fef0 0x7fed3c15b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fed3c0b46b0 con 0x7fed3c073e60 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fed3c15bda0 con 0x7fed3c06fef0 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed43650640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c06ee50 con 0x7fed3c0b3d50 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed413ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed3c073e60 0x7fed3c06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed413ec640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed3c073e60 0x7fed3c06e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54858/0 (socket says 172.21.15.73:54858) 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.934+0000 7fed413ec640 1 -- 172.21.15.73:0/1297308654 learned_addr learned my addr 172.21.15.73:0/1297308654 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed41bed640 1 --2- 172.21.15.73:0/1297308654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed40beb640 1 --2- 172.21.15.73:0/1297308654 >> v2:172.21.15.150:3300/0 conn(0x7fed3c06fef0 0x7fed3c15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed413ec640 1 -- 172.21.15.73:0/1297308654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 msgr2=0x7fed3c0b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:37.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed413ec640 1 --2- 172.21.15.73:0/1297308654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed413ec640 1 -- 172.21.15.73:0/1297308654 >> v2:172.21.15.150:3300/0 conn(0x7fed3c06fef0 msgr2=0x7fed3c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:37.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed413ec640 1 --2- 172.21.15.73:0/1297308654 >> v2:172.21.15.150:3300/0 conn(0x7fed3c06fef0 0x7fed3c15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed413ec640 1 -- 172.21.15.73:0/1297308654 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c06f130 con 0x7fed3c073e60 2024-09-12T03:36:37.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed40beb640 1 --2- 172.21.15.73:0/1297308654 >> v2:172.21.15.150:3300/0 conn(0x7fed3c06fef0 0x7fed3c15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:37.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed413ec640 1 --2- 172.21.15.73:0/1297308654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c073e60 0x7fed3c06e800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed3c1589e0 tx=0x7fed3801e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9316fcfd4ec28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:37.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed33fff640 1 -- 172.21.15.73:0/1297308654 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380a7660 con 0x7fed3c073e60 2024-09-12T03:36:37.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed33fff640 1 -- 172.21.15.73:0/1297308654 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed380a7800 con 0x7fed3c073e60 2024-09-12T03:36:37.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed33fff640 1 -- 172.21.15.73:0/1297308654 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380a7bd0 con 0x7fed3c073e60 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 -- 172.21.15.73:0/1297308654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c073e60 msgr2=0x7fed3c06e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 --2- 172.21.15.73:0/1297308654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c073e60 0x7fed3c06e800 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fed3c1589e0 tx=0x7fed3801e960 comp rx=0 tx=0).stop 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 -- 172.21.15.73:0/1297308654 shutdown_connections 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 --2- 172.21.15.73:0/1297308654 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 --2- 172.21.15.73:0/1297308654 >> v2:172.21.15.150:3300/0 conn(0x7fed3c06fef0 0x7fed3c15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 --2- 172.21.15.73:0/1297308654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c073e60 0x7fed3c06e800 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 -- 172.21.15.73:0/1297308654 >> 172.21.15.73:0/1297308654 conn(0x7fed3c0b1f90 msgr2=0x7fed3c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 -- 172.21.15.73:0/1297308654 shutdown_connections 2024-09-12T03:36:37.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.938+0000 7fed43650640 1 -- 172.21.15.73:0/1297308654 wait complete. 2024-09-12T03:36:37.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 Processor -- start 2024-09-12T03:36:37.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 -- start start 2024-09-12T03:36:37.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c06fef0 0x7fed3c147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed3c073e60 0x7fed3c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c15e580 con 0x7fed3c06fef0 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c15e400 con 0x7fed3c073e60 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c15e700 con 0x7fed3c0b3d50 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c06fef0 0x7fed3c147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c06fef0 0x7fed3c147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54860/0 (socket says 172.21.15.73:54860) 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 -- 172.21.15.73:0/339291796 learned_addr learned my addr 172.21.15.73:0/339291796 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 -- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 msgr2=0x7fed3c0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed40beb640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed3c073e60 0x7fed3c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed41bed640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 -- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed3c073e60 msgr2=0x7fed3c1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed3c073e60 0x7fed3c1482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 -- 172.21.15.73:0/339291796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c154000 con 0x7fed3c06fef0 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed413ec640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c06fef0 0x7fed3c147830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fed3801f200 tx=0x7fed3801b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed31ffb640 1 -- 172.21.15.73:0/339291796 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380be020 con 0x7fed3c06fef0 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed31ffb640 1 -- 172.21.15.73:0/339291796 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed380ba670 con 0x7fed3c06fef0 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c151d10 con 0x7fed3c06fef0 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed31ffb640 1 -- 172.21.15.73:0/339291796 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380baa60 con 0x7fed3c06fef0 2024-09-12T03:36:37.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c1542a0 con 0x7fed3c06fef0 2024-09-12T03:36:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c15b860 con 0x7fed3c06fef0 2024-09-12T03:36:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed31ffb640 1 -- 172.21.15.73:0/339291796 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed380c1020 con 0x7fed3c06fef0 2024-09-12T03:36:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed31ffb640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed200678c0 0x7fed20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.942+0000 7fed31ffb640 1 -- 172.21.15.73:0/339291796 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fed38122dd0 con 0x7fed3c06fef0 2024-09-12T03:36:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.946+0000 7fed40beb640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed200678c0 0x7fed20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:37.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.946+0000 7fed40beb640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed200678c0 0x7fed20069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0af730 tx=0x7fed2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:37.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:37.950+0000 7fed31ffb640 1 -- 172.21.15.73:0/339291796 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed380c8030 con 0x7fed3c06fef0 2024-09-12T03:36:38.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.098+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed3c0723f0 con 0x7fed3c06fef0 2024-09-12T03:36:38.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed31ffb640 1 -- 172.21.15.73:0/339291796 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16956 (secure 0 0 0) 0x7fed380185e0 con 0x7fed3c06fef0 2024-09-12T03:36:38.103 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:38.103 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":64,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:35.415084+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:31.428624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:32.740289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed200678c0 msgr2=0x7fed20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed200678c0 0x7fed20069d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0af730 tx=0x7fed2c008040 comp rx=0 tx=0).stop 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c06fef0 msgr2=0x7fed3c147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c06fef0 0x7fed3c147830 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fed3801f200 tx=0x7fed3801b700 comp rx=0 tx=0).stop 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 shutdown_connections 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed200678c0 0x7fed20069d80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed3c0b3d50 0x7fed3c0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed3c073e60 0x7fed3c1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 --2- 172.21.15.73:0/339291796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed3c06fef0 0x7fed3c147830 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 >> 172.21.15.73:0/339291796 conn(0x7fed3c0b1f90 msgr2=0x7fed3c15a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 shutdown_connections 2024-09-12T03:36:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.102+0000 7fed43650640 1 -- 172.21.15.73:0/339291796 wait complete. 2024-09-12T03:36:38.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:36:38.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:38.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.234+0000 7fdaa2199640 1 Processor -- start 2024-09-12T03:36:38.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.234+0000 7fdaa2199640 1 -- start start 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fdaa2199640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda9c159eb0 0x7fda9c06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fdaa2199640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda9c0b3430 0x7fda9c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fdaa2199640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c0b0ab0 con 0x7fda9c06c740 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fdaa2199640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fda9c09aa00 con 0x7fda9c159eb0 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fdaa2199640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fda9c09ac50 con 0x7fda9c0b3430 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda9c159eb0 0x7fda9c06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda9c159eb0 0x7fda9c06bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54878/0 (socket says 172.21.15.73:54878) 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 -- 172.21.15.73:0/2705703851 learned_addr learned my addr 172.21.15.73:0/2705703851 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9affd640 1 --2- 172.21.15.73:0/2705703851 >> v2:172.21.15.150:3300/0 conn(0x7fda9c0b3430 0x7fda9c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 -- 172.21.15.73:0/2705703851 >> v2:172.21.15.150:3300/0 conn(0x7fda9c0b3430 msgr2=0x7fda9c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:38.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 --2- 172.21.15.73:0/2705703851 >> v2:172.21.15.150:3300/0 conn(0x7fda9c0b3430 0x7fda9c06c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 -- 172.21.15.73:0/2705703851 >> v1:172.21.15.150:6789/0 conn(0x7fda9c06c740 legacy=0x7fda9c15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:38.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 -- 172.21.15.73:0/2705703851 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c15d370 con 0x7fda9c159eb0 2024-09-12T03:36:38.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9b7fe640 1 --2- 172.21.15.73:0/2705703851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c159eb0 0x7fda9c06bcc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0af150 tx=0x7fda8c01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76a420e4488018e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9a7fc640 1 -- 172.21.15.73:0/2705703851 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0b0070 con 0x7fda9c159eb0 2024-09-12T03:36:38.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9a7fc640 1 -- 172.21.15.73:0/2705703851 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c0ab600 con 0x7fda9c159eb0 2024-09-12T03:36:38.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.238+0000 7fda9a7fc640 1 -- 172.21.15.73:0/2705703851 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0ab9d0 con 0x7fda9c159eb0 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- 172.21.15.73:0/2705703851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c159eb0 msgr2=0x7fda9c06bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 --2- 172.21.15.73:0/2705703851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c159eb0 0x7fda9c06bcc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0af150 tx=0x7fda8c01c300 comp rx=0 tx=0).stop 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- 172.21.15.73:0/2705703851 shutdown_connections 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 --2- 172.21.15.73:0/2705703851 >> v2:172.21.15.150:3300/0 conn(0x7fda9c0b3430 0x7fda9c06c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 --2- 172.21.15.73:0/2705703851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c159eb0 0x7fda9c06bcc0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- 172.21.15.73:0/2705703851 >> 172.21.15.73:0/2705703851 conn(0x7fda9c0733a0 msgr2=0x7fda9c0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- 172.21.15.73:0/2705703851 shutdown_connections 2024-09-12T03:36:38.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- 172.21.15.73:0/2705703851 wait complete. 2024-09-12T03:36:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 Processor -- start 2024-09-12T03:36:38.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- start start 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c06c740 0x7fda9c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0b3430 0x7fda9c14cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c159eb0 0x7fda9c0cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c169030 con 0x7fda9c06c740 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c168eb0 con 0x7fda9c0b3430 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fda9c1691b0 con 0x7fda9c159eb0 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c06c740 0x7fda9c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c06c740 0x7fda9c0cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54882/0 (socket says 172.21.15.73:54882) 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 -- 172.21.15.73:0/1643076984 learned_addr learned my addr 172.21.15.73:0/1643076984 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:38.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 -- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c159eb0 msgr2=0x7fda9c0cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9bfff640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c159eb0 0x7fda9c0cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c159eb0 0x7fda9c0cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9affd640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0b3430 0x7fda9c14cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 -- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0b3430 msgr2=0x7fda9c14cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0b3430 0x7fda9c14cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 -- 172.21.15.73:0/1643076984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c14a2a0 con 0x7fda9c06c740 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda9b7fe640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c06c740 0x7fda9c0cdaa0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0ae040 tx=0x7fda8c0190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda83fff640 1 -- 172.21.15.73:0/1643076984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0b0040 con 0x7fda9c06c740 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda83fff640 1 -- 172.21.15.73:0/1643076984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c0b9070 con 0x7fda9c06c740 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c0ce1a0 con 0x7fda9c06c740 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fda83fff640 1 -- 172.21.15.73:0/1643076984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0b48a0 con 0x7fda9c06c740 2024-09-12T03:36:38.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.242+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c0ce760 con 0x7fda9c06c740 2024-09-12T03:36:38.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.246+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c15fd40 con 0x7fda9c06c740 2024-09-12T03:36:38.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.246+0000 7fda83fff640 1 -- 172.21.15.73:0/1643076984 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda8c0ab4c0 con 0x7fda9c06c740 2024-09-12T03:36:38.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.246+0000 7fda83fff640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda880678c0 0x7fda88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.246+0000 7fda83fff640 1 -- 172.21.15.73:0/1643076984 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fda8c11fbd0 con 0x7fda9c06c740 2024-09-12T03:36:38.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.246+0000 7fda9affd640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda880678c0 0x7fda88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.246+0000 7fda9affd640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda880678c0 0x7fda88069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0b6060 tx=0x7fda90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.250+0000 7fda83fff640 1 -- 172.21.15.73:0/1643076984 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fda9c14a2a0 con 0x7fda9c06c740 2024-09-12T03:36:38.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.398+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda9c0ce9a0 con 0x7fda880678c0 2024-09-12T03:36:38.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.414+0000 7fda83fff640 1 -- 172.21.15.73:0/1643076984 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242921 (secure 0 0 0) 0x7fda9c0ce9a0 con 0x7fda880678c0 2024-09-12T03:36:38.419 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:38.420 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:38.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda880678c0 msgr2=0x7fda88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda880678c0 0x7fda88069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0b6060 tx=0x7fda90008040 comp rx=0 tx=0).stop 2024-09-12T03:36:38.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c06c740 msgr2=0x7fda9c0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c06c740 0x7fda9c0cdaa0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0ae040 tx=0x7fda8c0190a0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 shutdown_connections 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda880678c0 0x7fda88069d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda9c159eb0 0x7fda9c0cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda9c0b3430 0x7fda9c14cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 --2- 172.21.15.73:0/1643076984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda9c06c740 0x7fda9c0cdaa0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 >> 172.21.15.73:0/1643076984 conn(0x7fda9c0733a0 msgr2=0x7fda9c0b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 shutdown_connections 2024-09-12T03:36:38.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.418+0000 7fdaa2199640 1 -- 172.21.15.73:0/1643076984 wait complete. 2024-09-12T03:36:38.435 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-12T03:36:37.825457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239788,"kb_used_data":6884,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734932,"statfs":{"total":773094113280,"available":772848570368,"internally_reserved":0,"allocated":7049216,"data_stored":3797703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454368"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502924+0000","last_change":"2024-09-12T03:36:34.420931+0000","last_active":"2024-09-12T03:36:35.502924+0000","last_peered":"2024-09-12T03:36:35.502924+0000","last_clean":"2024-09-12T03:36:35.502924+0000","last_became_active":"2024-09-12T03:36:34.420153+0000","last_became_peered":"2024-09-12T03:36:34.420153+0000","last_unstale":"2024-09-12T03:36:35.502924+0000","last_undegraded":"2024-09-12T03:36:35.502924+0000","last_fullsized":"2024-09-12T03:36:35.502924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:24.308610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502284+0000","last_change":"2024-09-12T03:36:34.459041+0000","last_active":"2024-09-12T03:36:35.502284+0000","last_peered":"2024-09-12T03:36:35.502284+0000","last_clean":"2024-09-12T03:36:35.502284+0000","last_became_active":"2024-09-12T03:36:34.458649+0000","last_became_peered":"2024-09-12T03:36:34.458649+0000","last_unstale":"2024-09-12T03:36:35.502284+0000","last_undegraded":"2024-09-12T03:36:35.502284+0000","last_fullsized":"2024-09-12T03:36:35.502284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:49.414429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503442+0000","last_change":"2024-09-12T03:36:34.430953+0000","last_active":"2024-09-12T03:36:35.503442+0000","last_peered":"2024-09-12T03:36:35.503442+0000","last_clean":"2024-09-12T03:36:35.503442+0000","last_became_active":"2024-09-12T03:36:34.430263+0000","last_became_peered":"2024-09-12T03:36:34.430263+0000","last_unstale":"2024-09-12T03:36:35.503442+0000","last_undegraded":"2024-09-12T03:36:35.503442+0000","last_fullsized":"2024-09-12T03:36:35.503442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:13.336540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502339+0000","last_change":"2024-09-12T03:36:34.424794+0000","last_active":"2024-09-12T03:36:35.502339+0000","last_peered":"2024-09-12T03:36:35.502339+0000","last_clean":"2024-09-12T03:36:35.502339+0000","last_became_active":"2024-09-12T03:36:34.424305+0000","last_became_peered":"2024-09-12T03:36:34.424305+0000","last_unstale":"2024-09-12T03:36:35.502339+0000","last_undegraded":"2024-09-12T03:36:35.502339+0000","last_fullsized":"2024-09-12T03:36:35.502339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:38.743608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503040+0000","last_change":"2024-09-12T03:36:34.425193+0000","last_active":"2024-09-12T03:36:35.503040+0000","last_peered":"2024-09-12T03:36:35.503040+0000","last_clean":"2024-09-12T03:36:35.503040+0000","last_became_active":"2024-09-12T03:36:34.424455+0000","last_became_peered":"2024-09-12T03:36:34.424455+0000","last_unstale":"2024-09-12T03:36:35.503040+0000","last_undegraded":"2024-09-12T03:36:35.503040+0000","last_fullsized":"2024-09-12T03:36:35.503040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:15.167843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377838+0000","last_change":"2024-09-12T03:36:32.377838+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377838+0000","last_undegraded":"2024-09-12T03:36:32.377838+0000","last_fullsized":"2024-09-12T03:36:32.377838+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502263+0000","last_change":"2024-09-12T03:36:33.426212+0000","last_active":"2024-09-12T03:36:35.502263+0000","last_peered":"2024-09-12T03:36:35.502263+0000","last_clean":"2024-09-12T03:36:35.502263+0000","last_became_active":"2024-09-12T03:36:33.425771+0000","last_became_peered":"2024-09-12T03:36:33.425771+0000","last_unstale":"2024-09-12T03:36:35.502263+0000","last_undegraded":"2024-09-12T03:36:35.502263+0000","last_fullsized":"2024-09-12T03:36:35.502263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:39.047872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502277+0000","last_change":"2024-09-12T03:36:34.426973+0000","last_active":"2024-09-12T03:36:35.502277+0000","last_peered":"2024-09-12T03:36:35.502277+0000","last_clean":"2024-09-12T03:36:35.502277+0000","last_became_active":"2024-09-12T03:36:34.424246+0000","last_became_peered":"2024-09-12T03:36:34.424246+0000","last_unstale":"2024-09-12T03:36:35.502277+0000","last_undegraded":"2024-09-12T03:36:35.502277+0000","last_fullsized":"2024-09-12T03:36:35.502277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:08.547780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501964+0000","last_change":"2024-09-12T03:36:33.417749+0000","last_active":"2024-09-12T03:36:35.501964+0000","last_peered":"2024-09-12T03:36:35.501964+0000","last_clean":"2024-09-12T03:36:35.501964+0000","last_became_active":"2024-09-12T03:36:33.417326+0000","last_became_peered":"2024-09-12T03:36:33.417326+0000","last_unstale":"2024-09-12T03:36:35.501964+0000","last_undegraded":"2024-09-12T03:36:35.501964+0000","last_fullsized":"2024-09-12T03:36:35.501964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.097333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502206+0000","last_change":"2024-09-12T03:36:33.415881+0000","last_active":"2024-09-12T03:36:35.502206+0000","last_peered":"2024-09-12T03:36:35.502206+0000","last_clean":"2024-09-12T03:36:35.502206+0000","last_became_active":"2024-09-12T03:36:33.415348+0000","last_became_peered":"2024-09-12T03:36:33.415348+0000","last_unstale":"2024-09-12T03:36:35.502206+0000","last_undegraded":"2024-09-12T03:36:35.502206+0000","last_fullsized":"2024-09-12T03:36:35.502206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:28.390227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375535+0000","last_change":"2024-09-12T03:36:32.375535+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375535+0000","last_undegraded":"2024-09-12T03:36:32.375535+0000","last_fullsized":"2024-09-12T03:36:32.375535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375695+0000","last_change":"2024-09-12T03:36:32.375695+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375695+0000","last_undegraded":"2024-09-12T03:36:32.375695+0000","last_fullsized":"2024-09-12T03:36:32.375695+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502513+0000","last_change":"2024-09-12T03:36:34.422629+0000","last_active":"2024-09-12T03:36:35.502513+0000","last_peered":"2024-09-12T03:36:35.502513+0000","last_clean":"2024-09-12T03:36:35.502513+0000","last_became_active":"2024-09-12T03:36:34.421821+0000","last_became_peered":"2024-09-12T03:36:34.421821+0000","last_unstale":"2024-09-12T03:36:35.502513+0000","last_undegraded":"2024-09-12T03:36:35.502513+0000","last_fullsized":"2024-09-12T03:36:35.502513+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:50.766660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.374549+0000","last_change":"2024-09-12T03:36:32.374549+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.374549+0000","last_undegraded":"2024-09-12T03:36:32.374549+0000","last_fullsized":"2024-09-12T03:36:32.374549+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502275+0000","last_change":"2024-09-12T03:36:33.424986+0000","last_active":"2024-09-12T03:36:35.502275+0000","last_peered":"2024-09-12T03:36:35.502275+0000","last_clean":"2024-09-12T03:36:35.502275+0000","last_became_active":"2024-09-12T03:36:33.424292+0000","last_became_peered":"2024-09-12T03:36:33.424292+0000","last_unstale":"2024-09-12T03:36:35.502275+0000","last_undegraded":"2024-09-12T03:36:35.502275+0000","last_fullsized":"2024-09-12T03:36:35.502275+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:31.276349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385202+0000","last_change":"2024-09-12T03:36:32.385202+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385202+0000","last_undegraded":"2024-09-12T03:36:32.385202+0000","last_fullsized":"2024-09-12T03:36:32.385202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378586+0000","last_change":"2024-09-12T03:36:32.378586+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378586+0000","last_undegraded":"2024-09-12T03:36:32.378586+0000","last_fullsized":"2024-09-12T03:36:32.378586+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503131+0000","last_change":"2024-09-12T03:36:34.468055+0000","last_active":"2024-09-12T03:36:35.503131+0000","last_peered":"2024-09-12T03:36:35.503131+0000","last_clean":"2024-09-12T03:36:35.503131+0000","last_became_active":"2024-09-12T03:36:34.467444+0000","last_became_peered":"2024-09-12T03:36:34.467444+0000","last_unstale":"2024-09-12T03:36:35.503131+0000","last_undegraded":"2024-09-12T03:36:35.503131+0000","last_fullsized":"2024-09-12T03:36:35.503131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:12.580444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.386370+0000","last_change":"2024-09-12T03:36:32.386370+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.386370+0000","last_undegraded":"2024-09-12T03:36:32.386370+0000","last_fullsized":"2024-09-12T03:36:32.386370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378385+0000","last_change":"2024-09-12T03:36:32.378385+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378385+0000","last_undegraded":"2024-09-12T03:36:32.378385+0000","last_fullsized":"2024-09-12T03:36:32.378385+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.386383+0000","last_change":"2024-09-12T03:36:32.386383+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.386383+0000","last_undegraded":"2024-09-12T03:36:32.386383+0000","last_fullsized":"2024-09-12T03:36:32.386383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378027+0000","last_change":"2024-09-12T03:36:32.378027+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378027+0000","last_undegraded":"2024-09-12T03:36:32.378027+0000","last_fullsized":"2024-09-12T03:36:32.378027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502597+0000","last_change":"2024-09-12T03:36:34.424336+0000","last_active":"2024-09-12T03:36:35.502597+0000","last_peered":"2024-09-12T03:36:35.502597+0000","last_clean":"2024-09-12T03:36:35.502597+0000","last_became_active":"2024-09-12T03:36:34.423596+0000","last_became_peered":"2024-09-12T03:36:34.423596+0000","last_unstale":"2024-09-12T03:36:35.502597+0000","last_undegraded":"2024-09-12T03:36:35.502597+0000","last_fullsized":"2024-09-12T03:36:35.502597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:06.748555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385248+0000","last_change":"2024-09-12T03:36:32.385248+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385248+0000","last_undegraded":"2024-09-12T03:36:32.385248+0000","last_fullsized":"2024-09-12T03:36:32.385248+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.379993+0000","last_change":"2024-09-12T03:36:32.379993+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.379993+0000","last_undegraded":"2024-09-12T03:36:32.379993+0000","last_fullsized":"2024-09-12T03:36:32.379993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.380104+0000","last_change":"2024-09-12T03:36:32.380104+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.380104+0000","last_undegraded":"2024-09-12T03:36:32.380104+0000","last_fullsized":"2024-09-12T03:36:32.380104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503037+0000","last_change":"2024-09-12T03:36:34.436468+0000","last_active":"2024-09-12T03:36:35.503037+0000","last_peered":"2024-09-12T03:36:35.503037+0000","last_clean":"2024-09-12T03:36:35.503037+0000","last_became_active":"2024-09-12T03:36:34.433336+0000","last_became_peered":"2024-09-12T03:36:34.433336+0000","last_unstale":"2024-09-12T03:36:35.503037+0000","last_undegraded":"2024-09-12T03:36:35.503037+0000","last_fullsized":"2024-09-12T03:36:35.503037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:50.198807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385201+0000","last_change":"2024-09-12T03:36:32.385201+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385201+0000","last_undegraded":"2024-09-12T03:36:32.385201+0000","last_fullsized":"2024-09-12T03:36:32.385201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385247+0000","last_change":"2024-09-12T03:36:32.385247+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385247+0000","last_undegraded":"2024-09-12T03:36:32.385247+0000","last_fullsized":"2024-09-12T03:36:32.385247+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503033+0000","last_change":"2024-09-12T03:36:34.417956+0000","last_active":"2024-09-12T03:36:35.503033+0000","last_peered":"2024-09-12T03:36:35.503033+0000","last_clean":"2024-09-12T03:36:35.503033+0000","last_became_active":"2024-09-12T03:36:34.416639+0000","last_became_peered":"2024-09-12T03:36:34.416639+0000","last_unstale":"2024-09-12T03:36:35.503033+0000","last_undegraded":"2024-09-12T03:36:35.503033+0000","last_fullsized":"2024-09-12T03:36:35.503033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:06.603286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373936+0000","last_change":"2024-09-12T03:36:32.373936+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373936+0000","last_undegraded":"2024-09-12T03:36:32.373936+0000","last_fullsized":"2024-09-12T03:36:32.373936+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501805+0000","last_change":"2024-09-12T03:36:34.423982+0000","last_active":"2024-09-12T03:36:35.501805+0000","last_peered":"2024-09-12T03:36:35.501805+0000","last_clean":"2024-09-12T03:36:35.501805+0000","last_became_active":"2024-09-12T03:36:34.423407+0000","last_became_peered":"2024-09-12T03:36:34.423407+0000","last_unstale":"2024-09-12T03:36:35.501805+0000","last_undegraded":"2024-09-12T03:36:35.501805+0000","last_fullsized":"2024-09-12T03:36:35.501805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.314364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501717+0000","last_change":"2024-09-12T03:36:33.419981+0000","last_active":"2024-09-12T03:36:35.501717+0000","last_peered":"2024-09-12T03:36:35.501717+0000","last_clean":"2024-09-12T03:36:35.501717+0000","last_became_active":"2024-09-12T03:36:33.419512+0000","last_became_peered":"2024-09-12T03:36:33.419512+0000","last_unstale":"2024-09-12T03:36:35.501717+0000","last_undegraded":"2024-09-12T03:36:35.501717+0000","last_fullsized":"2024-09-12T03:36:35.501717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.891702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.376974+0000","last_change":"2024-09-12T03:36:32.376974+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.376974+0000","last_undegraded":"2024-09-12T03:36:32.376974+0000","last_fullsized":"2024-09-12T03:36:32.376974+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503127+0000","last_change":"2024-09-12T03:36:34.420143+0000","last_active":"2024-09-12T03:36:35.503127+0000","last_peered":"2024-09-12T03:36:35.503127+0000","last_clean":"2024-09-12T03:36:35.503127+0000","last_became_active":"2024-09-12T03:36:34.419222+0000","last_became_peered":"2024-09-12T03:36:34.419222+0000","last_unstale":"2024-09-12T03:36:35.503127+0000","last_undegraded":"2024-09-12T03:36:35.503127+0000","last_fullsized":"2024-09-12T03:36:35.503127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:20.623310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501583+0000","last_change":"2024-09-12T03:36:33.427179+0000","last_active":"2024-09-12T03:36:35.501583+0000","last_peered":"2024-09-12T03:36:35.501583+0000","last_clean":"2024-09-12T03:36:35.501583+0000","last_became_active":"2024-09-12T03:36:33.426240+0000","last_became_peered":"2024-09-12T03:36:33.426240+0000","last_unstale":"2024-09-12T03:36:35.501583+0000","last_undegraded":"2024-09-12T03:36:35.501583+0000","last_fullsized":"2024-09-12T03:36:35.501583+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:05.593351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501804+0000","last_change":"2024-09-12T03:36:34.432798+0000","last_active":"2024-09-12T03:36:35.501804+0000","last_peered":"2024-09-12T03:36:35.501804+0000","last_clean":"2024-09-12T03:36:35.501804+0000","last_became_active":"2024-09-12T03:36:34.432577+0000","last_became_peered":"2024-09-12T03:36:34.432577+0000","last_unstale":"2024-09-12T03:36:35.501804+0000","last_undegraded":"2024-09-12T03:36:35.501804+0000","last_fullsized":"2024-09-12T03:36:35.501804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:21.914671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.379070+0000","last_change":"2024-09-12T03:36:32.379070+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.379070+0000","last_undegraded":"2024-09-12T03:36:32.379070+0000","last_fullsized":"2024-09-12T03:36:32.379070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375581+0000","last_change":"2024-09-12T03:36:32.375581+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375581+0000","last_undegraded":"2024-09-12T03:36:32.375581+0000","last_fullsized":"2024-09-12T03:36:32.375581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502130+0000","last_change":"2024-09-12T03:36:33.417423+0000","last_active":"2024-09-12T03:36:35.502130+0000","last_peered":"2024-09-12T03:36:35.502130+0000","last_clean":"2024-09-12T03:36:35.502130+0000","last_became_active":"2024-09-12T03:36:33.417134+0000","last_became_peered":"2024-09-12T03:36:33.417134+0000","last_unstale":"2024-09-12T03:36:35.502130+0000","last_undegraded":"2024-09-12T03:36:35.502130+0000","last_fullsized":"2024-09-12T03:36:35.502130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:43.675137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503401+0000","last_change":"2024-09-12T03:36:34.417391+0000","last_active":"2024-09-12T03:36:35.503401+0000","last_peered":"2024-09-12T03:36:35.503401+0000","last_clean":"2024-09-12T03:36:35.503401+0000","last_became_active":"2024-09-12T03:36:34.415727+0000","last_became_peered":"2024-09-12T03:36:34.415727+0000","last_unstale":"2024-09-12T03:36:35.503401+0000","last_undegraded":"2024-09-12T03:36:35.503401+0000","last_fullsized":"2024-09-12T03:36:35.503401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:48.626206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377806+0000","last_change":"2024-09-12T03:36:32.377806+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377806+0000","last_undegraded":"2024-09-12T03:36:32.377806+0000","last_fullsized":"2024-09-12T03:36:32.377806+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502795+0000","last_change":"2024-09-12T03:36:34.426947+0000","last_active":"2024-09-12T03:36:35.502795+0000","last_peered":"2024-09-12T03:36:35.502795+0000","last_clean":"2024-09-12T03:36:35.502795+0000","last_became_active":"2024-09-12T03:36:34.426228+0000","last_became_peered":"2024-09-12T03:36:34.426228+0000","last_unstale":"2024-09-12T03:36:35.502795+0000","last_undegraded":"2024-09-12T03:36:35.502795+0000","last_fullsized":"2024-09-12T03:36:35.502795+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.421639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385191+0000","last_change":"2024-09-12T03:36:32.385191+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385191+0000","last_undegraded":"2024-09-12T03:36:32.385191+0000","last_fullsized":"2024-09-12T03:36:32.385191+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.374206+0000","last_change":"2024-09-12T03:36:32.374206+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.374206+0000","last_undegraded":"2024-09-12T03:36:32.374206+0000","last_fullsized":"2024-09-12T03:36:32.374206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373673+0000","last_change":"2024-09-12T03:36:32.373673+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373673+0000","last_undegraded":"2024-09-12T03:36:32.373673+0000","last_fullsized":"2024-09-12T03:36:32.373673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377618+0000","last_change":"2024-09-12T03:36:32.377618+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377618+0000","last_undegraded":"2024-09-12T03:36:32.377618+0000","last_fullsized":"2024-09-12T03:36:32.377618+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503957+0000","last_change":"2024-09-12T03:36:34.425092+0000","last_active":"2024-09-12T03:36:35.503957+0000","last_peered":"2024-09-12T03:36:35.503957+0000","last_clean":"2024-09-12T03:36:35.503957+0000","last_became_active":"2024-09-12T03:36:34.424390+0000","last_became_peered":"2024-09-12T03:36:34.424390+0000","last_unstale":"2024-09-12T03:36:35.503957+0000","last_undegraded":"2024-09-12T03:36:35.503957+0000","last_fullsized":"2024-09-12T03:36:35.503957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.579899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373795+0000","last_change":"2024-09-12T03:36:32.373795+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373795+0000","last_undegraded":"2024-09-12T03:36:32.373795+0000","last_fullsized":"2024-09-12T03:36:32.373795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T03:36:32.387026+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:32.387026+0000","last_peered":"2024-09-12T03:36:32.387026+0000","last_clean":"2024-09-12T03:36:32.387026+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:32.387026+0000","last_undegraded":"2024-09-12T03:36:32.387026+0000","last_fullsized":"2024-09-12T03:36:32.387026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":915520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":325152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":325152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":345704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":929346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:38.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:38.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6977f51640 1 Processor -- start 2024-09-12T03:36:38.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6977f51640 1 -- start start 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6977f51640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f697015c2a0 0x7f69700aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6977f51640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69700af2a0 0x7f697006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6977f51640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69700b3290 con 0x7f697015bec0 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6977f51640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f69700b3570 con 0x7f69700af2a0 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6977f51640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f69700b3850 con 0x7f697015c2a0 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6975ced640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f697015bec0 0x7f69700ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57374/0 (socket says 172.21.15.73:57374) 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6975ced640 1 -- 172.21.15.73:0/3105141570 learned_addr learned my addr 172.21.15.73:0/3105141570 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:38.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f69764ee640 1 --2- 172.21.15.73:0/3105141570 >> v2:172.21.15.73:3300/0 conn(0x7f69700af2a0 0x7f697006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6974ceb640 1 -- 172.21.15.73:0/3105141570 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301032690 0 0) 0x7f69700b3290 con 0x7f697015bec0 2024-09-12T03:36:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f6974ceb640 1 -- 172.21.15.73:0/3105141570 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f695c003530 con 0x7f697015bec0 2024-09-12T03:36:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f69754ec640 1 --2- 172.21.15.73:0/3105141570 >> v2:172.21.15.150:3300/0 conn(0x7f697015c2a0 0x7f69700aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f69764ee640 1 -- 172.21.15.73:0/3105141570 >> v2:172.21.15.150:3300/0 conn(0x7f697015c2a0 msgr2=0x7f69700aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f69764ee640 1 --2- 172.21.15.73:0/3105141570 >> v2:172.21.15.150:3300/0 conn(0x7f697015c2a0 0x7f69700aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f69764ee640 1 -- 172.21.15.73:0/3105141570 >> v1:172.21.15.73:6789/0 conn(0x7f697015bec0 legacy=0x7f69700ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.598+0000 7f69764ee640 1 -- 172.21.15.73:0/3105141570 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69700b3b30 con 0x7f69700af2a0 2024-09-12T03:36:38.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f69764ee640 1 --2- 172.21.15.73:0/3105141570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69700af2a0 0x7f697006e000 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f69700ae510 tx=0x7f696801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5af9e8ac31e8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6974ceb640 1 -- 172.21.15.73:0/3105141570 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69680ab650 con 0x7f69700af2a0 2024-09-12T03:36:38.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6974ceb640 1 -- 172.21.15.73:0/3105141570 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69680b0070 con 0x7f69700af2a0 2024-09-12T03:36:38.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6974ceb640 1 -- 172.21.15.73:0/3105141570 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69680aba10 con 0x7f69700af2a0 2024-09-12T03:36:38.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- 172.21.15.73:0/3105141570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69700af2a0 msgr2=0x7f697006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 --2- 172.21.15.73:0/3105141570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69700af2a0 0x7f697006e000 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f69700ae510 tx=0x7f696801c450 comp rx=0 tx=0).stop 2024-09-12T03:36:38.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- 172.21.15.73:0/3105141570 shutdown_connections 2024-09-12T03:36:38.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 --2- 172.21.15.73:0/3105141570 >> v2:172.21.15.150:3300/0 conn(0x7f697015c2a0 0x7f69700aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 --2- 172.21.15.73:0/3105141570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69700af2a0 0x7f697006e000 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- 172.21.15.73:0/3105141570 >> 172.21.15.73:0/3105141570 conn(0x7f69700b1f90 msgr2=0x7f69700b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:38.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- 172.21.15.73:0/3105141570 shutdown_connections 2024-09-12T03:36:38.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- 172.21.15.73:0/3105141570 wait complete. 2024-09-12T03:36:38.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 Processor -- start 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- start start 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69700af2a0 0x7f697014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697015bec0 0x7f697014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697015c2a0 0x7f6970157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f697006ed50 con 0x7f697015bec0 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f69700af710 con 0x7f69700af2a0 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.602+0000 7f6977f51640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f697006eed0 con 0x7f697015c2a0 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697015bec0 0x7f697014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697015bec0 0x7f697014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54902/0 (socket says 172.21.15.73:54902) 2024-09-12T03:36:38.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 -- 172.21.15.73:0/4042781448 learned_addr learned my addr 172.21.15.73:0/4042781448 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f6975ced640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69700af2a0 0x7f697014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69764ee640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697015c2a0 0x7f6970157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 -- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697015c2a0 msgr2=0x7f6970157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697015c2a0 0x7f6970157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 -- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69700af2a0 msgr2=0x7f697014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69700af2a0 0x7f697014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 -- 172.21.15.73:0/4042781448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6970138bc0 con 0x7f697015bec0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69754ec640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697015bec0 0x7f697014c1a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f696000d7d0 tx=0x7f696000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69667fc640 1 -- 172.21.15.73:0/4042781448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696000b6c0 con 0x7f697015bec0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69667fc640 1 -- 172.21.15.73:0/4042781448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6960019070 con 0x7f697015bec0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6970138ea0 con 0x7f697015bec0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69667fc640 1 -- 172.21.15.73:0/4042781448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696000ba80 con 0x7f697015bec0 2024-09-12T03:36:38.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6970139460 con 0x7f697015bec0 2024-09-12T03:36:38.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f697006f260 con 0x7f697015bec0 2024-09-12T03:36:38.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69667fc640 1 -- 172.21.15.73:0/4042781448 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f696000bc20 con 0x7f697015bec0 2024-09-12T03:36:38.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69667fc640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678f0 0x7f6954069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f6975ced640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678f0 0x7f6954069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f69667fc640 1 -- 172.21.15.73:0/4042781448 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f69600861d0 con 0x7f697015bec0 2024-09-12T03:36:38.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.606+0000 7f6975ced640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678f0 0x7f6954069db0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f696c005c10 tx=0x7f696c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.610+0000 7f69667fc640 1 -- 172.21.15.73:0/4042781448 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6960056b80 con 0x7f697015bec0 2024-09-12T03:36:38.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.770+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f697006fcd0 con 0x7f69540678f0 2024-09-12T03:36:38.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.786+0000 7f69667fc640 1 -- 172.21.15.73:0/4042781448 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242921 (secure 0 0 0) 0x7f697006fcd0 con 0x7f69540678f0 2024-09-12T03:36:38.791 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678f0 msgr2=0x7f6954069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678f0 0x7f6954069db0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f696c005c10 tx=0x7f696c009040 comp rx=0 tx=0).stop 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697015bec0 msgr2=0x7f697014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697015bec0 0x7f697014c1a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f696000d7d0 tx=0x7f696000dc90 comp rx=0 tx=0).stop 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 shutdown_connections 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f69540678f0 0x7f6954069db0 secure :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f696c005c10 tx=0x7f696c009040 comp rx=0 tx=0).stop 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f697015bec0 0x7f697014c1a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f697015c2a0 0x7f6970157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 --2- 172.21.15.73:0/4042781448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69700af2a0 0x7f697014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.790+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 >> 172.21.15.73:0/4042781448 conn(0x7f69700b1f90 msgr2=0x7f697015a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.794+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 shutdown_connections 2024-09-12T03:36:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.794+0000 7f6977f51640 1 -- 172.21.15.73:0/4042781448 wait complete. 2024-09-12T03:36:38.811 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-12T03:36:37.825457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239788,"kb_used_data":6884,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734932,"statfs":{"total":773094113280,"available":772848570368,"internally_reserved":0,"allocated":7049216,"data_stored":3797703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454368"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502924+0000","last_change":"2024-09-12T03:36:34.420931+0000","last_active":"2024-09-12T03:36:35.502924+0000","last_peered":"2024-09-12T03:36:35.502924+0000","last_clean":"2024-09-12T03:36:35.502924+0000","last_became_active":"2024-09-12T03:36:34.420153+0000","last_became_peered":"2024-09-12T03:36:34.420153+0000","last_unstale":"2024-09-12T03:36:35.502924+0000","last_undegraded":"2024-09-12T03:36:35.502924+0000","last_fullsized":"2024-09-12T03:36:35.502924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:24.308610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502284+0000","last_change":"2024-09-12T03:36:34.459041+0000","last_active":"2024-09-12T03:36:35.502284+0000","last_peered":"2024-09-12T03:36:35.502284+0000","last_clean":"2024-09-12T03:36:35.502284+0000","last_became_active":"2024-09-12T03:36:34.458649+0000","last_became_peered":"2024-09-12T03:36:34.458649+0000","last_unstale":"2024-09-12T03:36:35.502284+0000","last_undegraded":"2024-09-12T03:36:35.502284+0000","last_fullsized":"2024-09-12T03:36:35.502284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:49.414429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503442+0000","last_change":"2024-09-12T03:36:34.430953+0000","last_active":"2024-09-12T03:36:35.503442+0000","last_peered":"2024-09-12T03:36:35.503442+0000","last_clean":"2024-09-12T03:36:35.503442+0000","last_became_active":"2024-09-12T03:36:34.430263+0000","last_became_peered":"2024-09-12T03:36:34.430263+0000","last_unstale":"2024-09-12T03:36:35.503442+0000","last_undegraded":"2024-09-12T03:36:35.503442+0000","last_fullsized":"2024-09-12T03:36:35.503442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:13.336540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502339+0000","last_change":"2024-09-12T03:36:34.424794+0000","last_active":"2024-09-12T03:36:35.502339+0000","last_peered":"2024-09-12T03:36:35.502339+0000","last_clean":"2024-09-12T03:36:35.502339+0000","last_became_active":"2024-09-12T03:36:34.424305+0000","last_became_peered":"2024-09-12T03:36:34.424305+0000","last_unstale":"2024-09-12T03:36:35.502339+0000","last_undegraded":"2024-09-12T03:36:35.502339+0000","last_fullsized":"2024-09-12T03:36:35.502339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:38.743608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503040+0000","last_change":"2024-09-12T03:36:34.425193+0000","last_active":"2024-09-12T03:36:35.503040+0000","last_peered":"2024-09-12T03:36:35.503040+0000","last_clean":"2024-09-12T03:36:35.503040+0000","last_became_active":"2024-09-12T03:36:34.424455+0000","last_became_peered":"2024-09-12T03:36:34.424455+0000","last_unstale":"2024-09-12T03:36:35.503040+0000","last_undegraded":"2024-09-12T03:36:35.503040+0000","last_fullsized":"2024-09-12T03:36:35.503040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:15.167843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377838+0000","last_change":"2024-09-12T03:36:32.377838+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377838+0000","last_undegraded":"2024-09-12T03:36:32.377838+0000","last_fullsized":"2024-09-12T03:36:32.377838+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502263+0000","last_change":"2024-09-12T03:36:33.426212+0000","last_active":"2024-09-12T03:36:35.502263+0000","last_peered":"2024-09-12T03:36:35.502263+0000","last_clean":"2024-09-12T03:36:35.502263+0000","last_became_active":"2024-09-12T03:36:33.425771+0000","last_became_peered":"2024-09-12T03:36:33.425771+0000","last_unstale":"2024-09-12T03:36:35.502263+0000","last_undegraded":"2024-09-12T03:36:35.502263+0000","last_fullsized":"2024-09-12T03:36:35.502263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:39.047872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502277+0000","last_change":"2024-09-12T03:36:34.426973+0000","last_active":"2024-09-12T03:36:35.502277+0000","last_peered":"2024-09-12T03:36:35.502277+0000","last_clean":"2024-09-12T03:36:35.502277+0000","last_became_active":"2024-09-12T03:36:34.424246+0000","last_became_peered":"2024-09-12T03:36:34.424246+0000","last_unstale":"2024-09-12T03:36:35.502277+0000","last_undegraded":"2024-09-12T03:36:35.502277+0000","last_fullsized":"2024-09-12T03:36:35.502277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:08.547780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501964+0000","last_change":"2024-09-12T03:36:33.417749+0000","last_active":"2024-09-12T03:36:35.501964+0000","last_peered":"2024-09-12T03:36:35.501964+0000","last_clean":"2024-09-12T03:36:35.501964+0000","last_became_active":"2024-09-12T03:36:33.417326+0000","last_became_peered":"2024-09-12T03:36:33.417326+0000","last_unstale":"2024-09-12T03:36:35.501964+0000","last_undegraded":"2024-09-12T03:36:35.501964+0000","last_fullsized":"2024-09-12T03:36:35.501964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.097333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502206+0000","last_change":"2024-09-12T03:36:33.415881+0000","last_active":"2024-09-12T03:36:35.502206+0000","last_peered":"2024-09-12T03:36:35.502206+0000","last_clean":"2024-09-12T03:36:35.502206+0000","last_became_active":"2024-09-12T03:36:33.415348+0000","last_became_peered":"2024-09-12T03:36:33.415348+0000","last_unstale":"2024-09-12T03:36:35.502206+0000","last_undegraded":"2024-09-12T03:36:35.502206+0000","last_fullsized":"2024-09-12T03:36:35.502206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:28.390227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375535+0000","last_change":"2024-09-12T03:36:32.375535+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375535+0000","last_undegraded":"2024-09-12T03:36:32.375535+0000","last_fullsized":"2024-09-12T03:36:32.375535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375695+0000","last_change":"2024-09-12T03:36:32.375695+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375695+0000","last_undegraded":"2024-09-12T03:36:32.375695+0000","last_fullsized":"2024-09-12T03:36:32.375695+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502513+0000","last_change":"2024-09-12T03:36:34.422629+0000","last_active":"2024-09-12T03:36:35.502513+0000","last_peered":"2024-09-12T03:36:35.502513+0000","last_clean":"2024-09-12T03:36:35.502513+0000","last_became_active":"2024-09-12T03:36:34.421821+0000","last_became_peered":"2024-09-12T03:36:34.421821+0000","last_unstale":"2024-09-12T03:36:35.502513+0000","last_undegraded":"2024-09-12T03:36:35.502513+0000","last_fullsized":"2024-09-12T03:36:35.502513+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:50.766660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.374549+0000","last_change":"2024-09-12T03:36:32.374549+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.374549+0000","last_undegraded":"2024-09-12T03:36:32.374549+0000","last_fullsized":"2024-09-12T03:36:32.374549+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502275+0000","last_change":"2024-09-12T03:36:33.424986+0000","last_active":"2024-09-12T03:36:35.502275+0000","last_peered":"2024-09-12T03:36:35.502275+0000","last_clean":"2024-09-12T03:36:35.502275+0000","last_became_active":"2024-09-12T03:36:33.424292+0000","last_became_peered":"2024-09-12T03:36:33.424292+0000","last_unstale":"2024-09-12T03:36:35.502275+0000","last_undegraded":"2024-09-12T03:36:35.502275+0000","last_fullsized":"2024-09-12T03:36:35.502275+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:31.276349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385202+0000","last_change":"2024-09-12T03:36:32.385202+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385202+0000","last_undegraded":"2024-09-12T03:36:32.385202+0000","last_fullsized":"2024-09-12T03:36:32.385202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378586+0000","last_change":"2024-09-12T03:36:32.378586+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378586+0000","last_undegraded":"2024-09-12T03:36:32.378586+0000","last_fullsized":"2024-09-12T03:36:32.378586+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503131+0000","last_change":"2024-09-12T03:36:34.468055+0000","last_active":"2024-09-12T03:36:35.503131+0000","last_peered":"2024-09-12T03:36:35.503131+0000","last_clean":"2024-09-12T03:36:35.503131+0000","last_became_active":"2024-09-12T03:36:34.467444+0000","last_became_peered":"2024-09-12T03:36:34.467444+0000","last_unstale":"2024-09-12T03:36:35.503131+0000","last_undegraded":"2024-09-12T03:36:35.503131+0000","last_fullsized":"2024-09-12T03:36:35.503131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:12.580444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.386370+0000","last_change":"2024-09-12T03:36:32.386370+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.386370+0000","last_undegraded":"2024-09-12T03:36:32.386370+0000","last_fullsized":"2024-09-12T03:36:32.386370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378385+0000","last_change":"2024-09-12T03:36:32.378385+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378385+0000","last_undegraded":"2024-09-12T03:36:32.378385+0000","last_fullsized":"2024-09-12T03:36:32.378385+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.386383+0000","last_change":"2024-09-12T03:36:32.386383+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.386383+0000","last_undegraded":"2024-09-12T03:36:32.386383+0000","last_fullsized":"2024-09-12T03:36:32.386383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378027+0000","last_change":"2024-09-12T03:36:32.378027+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378027+0000","last_undegraded":"2024-09-12T03:36:32.378027+0000","last_fullsized":"2024-09-12T03:36:32.378027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502597+0000","last_change":"2024-09-12T03:36:34.424336+0000","last_active":"2024-09-12T03:36:35.502597+0000","last_peered":"2024-09-12T03:36:35.502597+0000","last_clean":"2024-09-12T03:36:35.502597+0000","last_became_active":"2024-09-12T03:36:34.423596+0000","last_became_peered":"2024-09-12T03:36:34.423596+0000","last_unstale":"2024-09-12T03:36:35.502597+0000","last_undegraded":"2024-09-12T03:36:35.502597+0000","last_fullsized":"2024-09-12T03:36:35.502597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:06.748555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385248+0000","last_change":"2024-09-12T03:36:32.385248+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385248+0000","last_undegraded":"2024-09-12T03:36:32.385248+0000","last_fullsized":"2024-09-12T03:36:32.385248+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.379993+0000","last_change":"2024-09-12T03:36:32.379993+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.379993+0000","last_undegraded":"2024-09-12T03:36:32.379993+0000","last_fullsized":"2024-09-12T03:36:32.379993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.380104+0000","last_change":"2024-09-12T03:36:32.380104+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.380104+0000","last_undegraded":"2024-09-12T03:36:32.380104+0000","last_fullsized":"2024-09-12T03:36:32.380104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503037+0000","last_change":"2024-09-12T03:36:34.436468+0000","last_active":"2024-09-12T03:36:35.503037+0000","last_peered":"2024-09-12T03:36:35.503037+0000","last_clean":"2024-09-12T03:36:35.503037+0000","last_became_active":"2024-09-12T03:36:34.433336+0000","last_became_peered":"2024-09-12T03:36:34.433336+0000","last_unstale":"2024-09-12T03:36:35.503037+0000","last_undegraded":"2024-09-12T03:36:35.503037+0000","last_fullsized":"2024-09-12T03:36:35.503037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:50.198807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385201+0000","last_change":"2024-09-12T03:36:32.385201+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385201+0000","last_undegraded":"2024-09-12T03:36:32.385201+0000","last_fullsized":"2024-09-12T03:36:32.385201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385247+0000","last_change":"2024-09-12T03:36:32.385247+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385247+0000","last_undegraded":"2024-09-12T03:36:32.385247+0000","last_fullsized":"2024-09-12T03:36:32.385247+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503033+0000","last_change":"2024-09-12T03:36:34.417956+0000","last_active":"2024-09-12T03:36:35.503033+0000","last_peered":"2024-09-12T03:36:35.503033+0000","last_clean":"2024-09-12T03:36:35.503033+0000","last_became_active":"2024-09-12T03:36:34.416639+0000","last_became_peered":"2024-09-12T03:36:34.416639+0000","last_unstale":"2024-09-12T03:36:35.503033+0000","last_undegraded":"2024-09-12T03:36:35.503033+0000","last_fullsized":"2024-09-12T03:36:35.503033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:06.603286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373936+0000","last_change":"2024-09-12T03:36:32.373936+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373936+0000","last_undegraded":"2024-09-12T03:36:32.373936+0000","last_fullsized":"2024-09-12T03:36:32.373936+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501805+0000","last_change":"2024-09-12T03:36:34.423982+0000","last_active":"2024-09-12T03:36:35.501805+0000","last_peered":"2024-09-12T03:36:35.501805+0000","last_clean":"2024-09-12T03:36:35.501805+0000","last_became_active":"2024-09-12T03:36:34.423407+0000","last_became_peered":"2024-09-12T03:36:34.423407+0000","last_unstale":"2024-09-12T03:36:35.501805+0000","last_undegraded":"2024-09-12T03:36:35.501805+0000","last_fullsized":"2024-09-12T03:36:35.501805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.314364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501717+0000","last_change":"2024-09-12T03:36:33.419981+0000","last_active":"2024-09-12T03:36:35.501717+0000","last_peered":"2024-09-12T03:36:35.501717+0000","last_clean":"2024-09-12T03:36:35.501717+0000","last_became_active":"2024-09-12T03:36:33.419512+0000","last_became_peered":"2024-09-12T03:36:33.419512+0000","last_unstale":"2024-09-12T03:36:35.501717+0000","last_undegraded":"2024-09-12T03:36:35.501717+0000","last_fullsized":"2024-09-12T03:36:35.501717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.891702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.376974+0000","last_change":"2024-09-12T03:36:32.376974+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.376974+0000","last_undegraded":"2024-09-12T03:36:32.376974+0000","last_fullsized":"2024-09-12T03:36:32.376974+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503127+0000","last_change":"2024-09-12T03:36:34.420143+0000","last_active":"2024-09-12T03:36:35.503127+0000","last_peered":"2024-09-12T03:36:35.503127+0000","last_clean":"2024-09-12T03:36:35.503127+0000","last_became_active":"2024-09-12T03:36:34.419222+0000","last_became_peered":"2024-09-12T03:36:34.419222+0000","last_unstale":"2024-09-12T03:36:35.503127+0000","last_undegraded":"2024-09-12T03:36:35.503127+0000","last_fullsized":"2024-09-12T03:36:35.503127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:20.623310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501583+0000","last_change":"2024-09-12T03:36:33.427179+0000","last_active":"2024-09-12T03:36:35.501583+0000","last_peered":"2024-09-12T03:36:35.501583+0000","last_clean":"2024-09-12T03:36:35.501583+0000","last_became_active":"2024-09-12T03:36:33.426240+0000","last_became_peered":"2024-09-12T03:36:33.426240+0000","last_unstale":"2024-09-12T03:36:35.501583+0000","last_undegraded":"2024-09-12T03:36:35.501583+0000","last_fullsized":"2024-09-12T03:36:35.501583+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:05.593351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501804+0000","last_change":"2024-09-12T03:36:34.432798+0000","last_active":"2024-09-12T03:36:35.501804+0000","last_peered":"2024-09-12T03:36:35.501804+0000","last_clean":"2024-09-12T03:36:35.501804+0000","last_became_active":"2024-09-12T03:36:34.432577+0000","last_became_peered":"2024-09-12T03:36:34.432577+0000","last_unstale":"2024-09-12T03:36:35.501804+0000","last_undegraded":"2024-09-12T03:36:35.501804+0000","last_fullsized":"2024-09-12T03:36:35.501804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:21.914671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.379070+0000","last_change":"2024-09-12T03:36:32.379070+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.379070+0000","last_undegraded":"2024-09-12T03:36:32.379070+0000","last_fullsized":"2024-09-12T03:36:32.379070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375581+0000","last_change":"2024-09-12T03:36:32.375581+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375581+0000","last_undegraded":"2024-09-12T03:36:32.375581+0000","last_fullsized":"2024-09-12T03:36:32.375581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502130+0000","last_change":"2024-09-12T03:36:33.417423+0000","last_active":"2024-09-12T03:36:35.502130+0000","last_peered":"2024-09-12T03:36:35.502130+0000","last_clean":"2024-09-12T03:36:35.502130+0000","last_became_active":"2024-09-12T03:36:33.417134+0000","last_became_peered":"2024-09-12T03:36:33.417134+0000","last_unstale":"2024-09-12T03:36:35.502130+0000","last_undegraded":"2024-09-12T03:36:35.502130+0000","last_fullsized":"2024-09-12T03:36:35.502130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:43.675137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503401+0000","last_change":"2024-09-12T03:36:34.417391+0000","last_active":"2024-09-12T03:36:35.503401+0000","last_peered":"2024-09-12T03:36:35.503401+0000","last_clean":"2024-09-12T03:36:35.503401+0000","last_became_active":"2024-09-12T03:36:34.415727+0000","last_became_peered":"2024-09-12T03:36:34.415727+0000","last_unstale":"2024-09-12T03:36:35.503401+0000","last_undegraded":"2024-09-12T03:36:35.503401+0000","last_fullsized":"2024-09-12T03:36:35.503401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:48.626206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377806+0000","last_change":"2024-09-12T03:36:32.377806+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377806+0000","last_undegraded":"2024-09-12T03:36:32.377806+0000","last_fullsized":"2024-09-12T03:36:32.377806+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502795+0000","last_change":"2024-09-12T03:36:34.426947+0000","last_active":"2024-09-12T03:36:35.502795+0000","last_peered":"2024-09-12T03:36:35.502795+0000","last_clean":"2024-09-12T03:36:35.502795+0000","last_became_active":"2024-09-12T03:36:34.426228+0000","last_became_peered":"2024-09-12T03:36:34.426228+0000","last_unstale":"2024-09-12T03:36:35.502795+0000","last_undegraded":"2024-09-12T03:36:35.502795+0000","last_fullsized":"2024-09-12T03:36:35.502795+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.421639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385191+0000","last_change":"2024-09-12T03:36:32.385191+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385191+0000","last_undegraded":"2024-09-12T03:36:32.385191+0000","last_fullsized":"2024-09-12T03:36:32.385191+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.374206+0000","last_change":"2024-09-12T03:36:32.374206+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.374206+0000","last_undegraded":"2024-09-12T03:36:32.374206+0000","last_fullsized":"2024-09-12T03:36:32.374206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373673+0000","last_change":"2024-09-12T03:36:32.373673+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373673+0000","last_undegraded":"2024-09-12T03:36:32.373673+0000","last_fullsized":"2024-09-12T03:36:32.373673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377618+0000","last_change":"2024-09-12T03:36:32.377618+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377618+0000","last_undegraded":"2024-09-12T03:36:32.377618+0000","last_fullsized":"2024-09-12T03:36:32.377618+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503957+0000","last_change":"2024-09-12T03:36:34.425092+0000","last_active":"2024-09-12T03:36:35.503957+0000","last_peered":"2024-09-12T03:36:35.503957+0000","last_clean":"2024-09-12T03:36:35.503957+0000","last_became_active":"2024-09-12T03:36:34.424390+0000","last_became_peered":"2024-09-12T03:36:34.424390+0000","last_unstale":"2024-09-12T03:36:35.503957+0000","last_undegraded":"2024-09-12T03:36:35.503957+0000","last_fullsized":"2024-09-12T03:36:35.503957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.579899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373795+0000","last_change":"2024-09-12T03:36:32.373795+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373795+0000","last_undegraded":"2024-09-12T03:36:32.373795+0000","last_fullsized":"2024-09-12T03:36:32.373795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T03:36:32.387026+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:32.387026+0000","last_peered":"2024-09-12T03:36:32.387026+0000","last_clean":"2024-09-12T03:36:32.387026+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:32.387026+0000","last_undegraded":"2024-09-12T03:36:32.387026+0000","last_fullsized":"2024-09-12T03:36:32.387026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":915520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":325152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":325152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":345704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":929346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:38.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:38.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.966+0000 7fdd226c2640 1 Processor -- start 2024-09-12T03:36:38.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd226c2640 1 -- start start 2024-09-12T03:36:38.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd226c2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdd1c0cfaf0 0x7fdd1c168f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd226c2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c06d9c0 con 0x7fdd1c15e5f0 2024-09-12T03:36:38.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd226c2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c06dca0 con 0x7fdd1c0ce9d0 2024-09-12T03:36:38.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd226c2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fdd1c06d7a0 con 0x7fdd1c0cfaf0 2024-09-12T03:36:38.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdd1c15e5f0 0x7fdd1c06d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57380/0 (socket says 172.21.15.73:57380) 2024-09-12T03:36:38.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1bfff640 1 -- 172.21.15.73:0/2101827636 learned_addr learned my addr 172.21.15.73:0/2101827636 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:38.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd20c5f640 1 --2- 172.21.15.73:0/2101827636 >> v2:172.21.15.150:3300/0 conn(0x7fdd1c0cfaf0 0x7fdd1c168f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264065047 0 0) 0x7fdd1c06d9c0 con 0x7fdd1c15e5f0 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd08003530 con 0x7fdd1c15e5f0 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 499267574 0 0) 0x7fdd08003530 con 0x7fdd1c15e5f0 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 >> v2:172.21.15.150:3300/0 conn(0x7fdd1c0cfaf0 msgr2=0x7fdd1c168f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 --2- 172.21.15.73:0/2101827636 >> v2:172.21.15.150:3300/0 conn(0x7fdd1c0cfaf0 0x7fdd1c168f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 >> v1:172.21.15.150:6789/0 conn(0x7fdd1c0ce9d0 legacy=0x7fdd1c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c06df80 con 0x7fdd1c15e5f0 2024-09-12T03:36:38.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fdd0c001680 con 0x7fdd1c15e5f0 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 >> v1:172.21.15.73:6789/0 conn(0x7fdd1c15e5f0 legacy=0x7fdd1c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd080039c0 0x7fdd08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd08004810 0x7fdd08004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd080051d0 0x7fdd0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c06d7a0 con 0x7fdd08004810 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0800c070 con 0x7fdd080039c0 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdd0800c270 con 0x7fdd080051d0 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1b7fe640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd08004810 0x7fdd08004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1bfff640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd080039c0 0x7fdd08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd20c5f640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd080051d0 0x7fdd0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1b7fe640 1 -- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd080051d0 msgr2=0x7fdd0800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:38.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1b7fe640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd080051d0 0x7fdd0800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1b7fe640 1 -- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd080039c0 msgr2=0x7fdd08003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:38.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1b7fe640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd080039c0 0x7fdd08003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd20c5f640 1 -- 172.21.15.73:0/2101827636 reap_dead start 2024-09-12T03:36:38.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.970+0000 7fdd1b7fe640 1 -- 172.21.15.73:0/2101827636 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd08003530 con 0x7fdd08004810 2024-09-12T03:36:38.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd1b7fe640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd08004810 0x7fdd08004c90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001780 tx=0x7fdd0401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903c4674097c1906 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd040013a0 con 0x7fdd08004810 2024-09-12T03:36:38.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040052f0 con 0x7fdd08004810 2024-09-12T03:36:38.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd1affd640 1 -- 172.21.15.73:0/2101827636 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04003840 con 0x7fdd08004810 2024-09-12T03:36:38.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 -- 172.21.15.73:0/2101827636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd08004810 msgr2=0x7fdd08004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd08004810 0x7fdd08004c90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001780 tx=0x7fdd0401c400 comp rx=0 tx=0).stop 2024-09-12T03:36:38.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 -- 172.21.15.73:0/2101827636 shutdown_connections 2024-09-12T03:36:38.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 --2- 172.21.15.73:0/2101827636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd08004810 0x7fdd08004c90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 -- 172.21.15.73:0/2101827636 >> 172.21.15.73:0/2101827636 conn(0x7fdd1c074030 msgr2=0x7fdd1c09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:38.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 -- 172.21.15.73:0/2101827636 shutdown_connections 2024-09-12T03:36:38.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 -- 172.21.15.73:0/2101827636 wait complete. 2024-09-12T03:36:38.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 Processor -- start 2024-09-12T03:36:38.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.974+0000 7fdd226c2640 1 -- start start 2024-09-12T03:36:38.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c15d770 0x7fdd1c0d3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c0cd760 0x7fdd1c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c15db50 0x7fdd1c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0cf560 con 0x7fdd1c15d770 2024-09-12T03:36:38.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c0cf3e0 con 0x7fdd1c0cd760 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c0cf6e0 con 0x7fdd1c15db50 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c15d770 0x7fdd1c0d3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c15d770 0x7fdd1c0d3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54926/0 (socket says 172.21.15.73:54926) 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 -- 172.21.15.73:0/1212411472 learned_addr learned my addr 172.21.15.73:0/1212411472 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd20c5f640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c15db50 0x7fdd1c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1b7fe640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c0cd760 0x7fdd1c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 -- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c15db50 msgr2=0x7fdd1c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c15db50 0x7fdd1c15cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 -- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c0cd760 msgr2=0x7fdd1c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c0cd760 0x7fdd1c15c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 -- 172.21.15.73:0/1212411472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c0d3e80 con 0x7fdd1c15d770 2024-09-12T03:36:38.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd20c5f640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c15db50 0x7fdd1c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:38.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1bfff640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c15d770 0x7fdd1c0d3940 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c011810 tx=0x7fdd0c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd18ff9640 1 -- 172.21.15.73:0/1212411472 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c010040 con 0x7fdd1c15d770 2024-09-12T03:36:38.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd18ff9640 1 -- 172.21.15.73:0/1212411472 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0c01a070 con 0x7fdd1c15d770 2024-09-12T03:36:38.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c0cc6c0 con 0x7fdd1c15d770 2024-09-12T03:36:38.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd18ff9640 1 -- 172.21.15.73:0/1212411472 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00fba0 con 0x7fdd1c15d770 2024-09-12T03:36:38.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c0ccc80 con 0x7fdd1c15d770 2024-09-12T03:36:38.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c06d090 con 0x7fdd1c15d770 2024-09-12T03:36:38.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd18ff9640 1 -- 172.21.15.73:0/1212411472 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdd0c01f460 con 0x7fdd1c15d770 2024-09-12T03:36:38.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd18ff9640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdcfc0678c0 0x7fdcfc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:38.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd18ff9640 1 -- 172.21.15.73:0/1212411472 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fdd0c088f60 con 0x7fdd1c15d770 2024-09-12T03:36:38.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1b7fe640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdcfc0678c0 0x7fdcfc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:38.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.978+0000 7fdd1b7fe640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdcfc0678c0 0x7fdcfc069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001750 tx=0x7fdd040011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:38.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:38.982+0000 7fdd18ff9640 1 -- 172.21.15.73:0/1212411472 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdd0c059880 con 0x7fdd1c15d770 2024-09-12T03:36:39.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.142+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd1c06ea20 con 0x7fdcfc0678c0 2024-09-12T03:36:39.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.150+0000 7fdd18ff9640 1 -- 172.21.15.73:0/1212411472 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242921 (secure 0 0 0) 0x7fdd1c06ea20 con 0x7fdcfc0678c0 2024-09-12T03:36:39.156 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:39.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdcfc0678c0 msgr2=0x7fdcfc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdcfc0678c0 0x7fdcfc069d80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdd04001750 tx=0x7fdd040011a0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c15d770 msgr2=0x7fdd1c0d3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c15d770 0x7fdd1c0d3940 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c011810 tx=0x7fdd0c011cd0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 shutdown_connections 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdcfc0678c0 0x7fdcfc069d80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdd1c15db50 0x7fdd1c15cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdd1c0cd760 0x7fdd1c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 --2- 172.21.15.73:0/1212411472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c15d770 0x7fdd1c0d3940 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 >> 172.21.15.73:0/1212411472 conn(0x7fdd08004810 msgr2=0x7fdd1c0b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 shutdown_connections 2024-09-12T03:36:39.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.154+0000 7fdd226c2640 1 -- 172.21.15.73:0/1212411472 wait complete. 2024-09-12T03:36:39.174 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-12T03:36:37.825457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":166,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":100,"acting":100,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239788,"kb_used_data":6884,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734932,"statfs":{"total":773094113280,"available":772848570368,"internally_reserved":0,"allocated":7049216,"data_stored":3797703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.454368"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502924+0000","last_change":"2024-09-12T03:36:34.420931+0000","last_active":"2024-09-12T03:36:35.502924+0000","last_peered":"2024-09-12T03:36:35.502924+0000","last_clean":"2024-09-12T03:36:35.502924+0000","last_became_active":"2024-09-12T03:36:34.420153+0000","last_became_peered":"2024-09-12T03:36:34.420153+0000","last_unstale":"2024-09-12T03:36:35.502924+0000","last_undegraded":"2024-09-12T03:36:35.502924+0000","last_fullsized":"2024-09-12T03:36:35.502924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:24.308610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502284+0000","last_change":"2024-09-12T03:36:34.459041+0000","last_active":"2024-09-12T03:36:35.502284+0000","last_peered":"2024-09-12T03:36:35.502284+0000","last_clean":"2024-09-12T03:36:35.502284+0000","last_became_active":"2024-09-12T03:36:34.458649+0000","last_became_peered":"2024-09-12T03:36:34.458649+0000","last_unstale":"2024-09-12T03:36:35.502284+0000","last_undegraded":"2024-09-12T03:36:35.502284+0000","last_fullsized":"2024-09-12T03:36:35.502284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:49.414429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503442+0000","last_change":"2024-09-12T03:36:34.430953+0000","last_active":"2024-09-12T03:36:35.503442+0000","last_peered":"2024-09-12T03:36:35.503442+0000","last_clean":"2024-09-12T03:36:35.503442+0000","last_became_active":"2024-09-12T03:36:34.430263+0000","last_became_peered":"2024-09-12T03:36:34.430263+0000","last_unstale":"2024-09-12T03:36:35.503442+0000","last_undegraded":"2024-09-12T03:36:35.503442+0000","last_fullsized":"2024-09-12T03:36:35.503442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:13.336540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502339+0000","last_change":"2024-09-12T03:36:34.424794+0000","last_active":"2024-09-12T03:36:35.502339+0000","last_peered":"2024-09-12T03:36:35.502339+0000","last_clean":"2024-09-12T03:36:35.502339+0000","last_became_active":"2024-09-12T03:36:34.424305+0000","last_became_peered":"2024-09-12T03:36:34.424305+0000","last_unstale":"2024-09-12T03:36:35.502339+0000","last_undegraded":"2024-09-12T03:36:35.502339+0000","last_fullsized":"2024-09-12T03:36:35.502339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:38.743608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503040+0000","last_change":"2024-09-12T03:36:34.425193+0000","last_active":"2024-09-12T03:36:35.503040+0000","last_peered":"2024-09-12T03:36:35.503040+0000","last_clean":"2024-09-12T03:36:35.503040+0000","last_became_active":"2024-09-12T03:36:34.424455+0000","last_became_peered":"2024-09-12T03:36:34.424455+0000","last_unstale":"2024-09-12T03:36:35.503040+0000","last_undegraded":"2024-09-12T03:36:35.503040+0000","last_fullsized":"2024-09-12T03:36:35.503040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:15.167843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377838+0000","last_change":"2024-09-12T03:36:32.377838+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377838+0000","last_undegraded":"2024-09-12T03:36:32.377838+0000","last_fullsized":"2024-09-12T03:36:32.377838+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502263+0000","last_change":"2024-09-12T03:36:33.426212+0000","last_active":"2024-09-12T03:36:35.502263+0000","last_peered":"2024-09-12T03:36:35.502263+0000","last_clean":"2024-09-12T03:36:35.502263+0000","last_became_active":"2024-09-12T03:36:33.425771+0000","last_became_peered":"2024-09-12T03:36:33.425771+0000","last_unstale":"2024-09-12T03:36:35.502263+0000","last_undegraded":"2024-09-12T03:36:35.502263+0000","last_fullsized":"2024-09-12T03:36:35.502263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:39.047872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502277+0000","last_change":"2024-09-12T03:36:34.426973+0000","last_active":"2024-09-12T03:36:35.502277+0000","last_peered":"2024-09-12T03:36:35.502277+0000","last_clean":"2024-09-12T03:36:35.502277+0000","last_became_active":"2024-09-12T03:36:34.424246+0000","last_became_peered":"2024-09-12T03:36:34.424246+0000","last_unstale":"2024-09-12T03:36:35.502277+0000","last_undegraded":"2024-09-12T03:36:35.502277+0000","last_fullsized":"2024-09-12T03:36:35.502277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:08.547780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501964+0000","last_change":"2024-09-12T03:36:33.417749+0000","last_active":"2024-09-12T03:36:35.501964+0000","last_peered":"2024-09-12T03:36:35.501964+0000","last_clean":"2024-09-12T03:36:35.501964+0000","last_became_active":"2024-09-12T03:36:33.417326+0000","last_became_peered":"2024-09-12T03:36:33.417326+0000","last_unstale":"2024-09-12T03:36:35.501964+0000","last_undegraded":"2024-09-12T03:36:35.501964+0000","last_fullsized":"2024-09-12T03:36:35.501964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.097333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502206+0000","last_change":"2024-09-12T03:36:33.415881+0000","last_active":"2024-09-12T03:36:35.502206+0000","last_peered":"2024-09-12T03:36:35.502206+0000","last_clean":"2024-09-12T03:36:35.502206+0000","last_became_active":"2024-09-12T03:36:33.415348+0000","last_became_peered":"2024-09-12T03:36:33.415348+0000","last_unstale":"2024-09-12T03:36:35.502206+0000","last_undegraded":"2024-09-12T03:36:35.502206+0000","last_fullsized":"2024-09-12T03:36:35.502206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:28.390227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375535+0000","last_change":"2024-09-12T03:36:32.375535+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375535+0000","last_undegraded":"2024-09-12T03:36:32.375535+0000","last_fullsized":"2024-09-12T03:36:32.375535+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375695+0000","last_change":"2024-09-12T03:36:32.375695+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375695+0000","last_undegraded":"2024-09-12T03:36:32.375695+0000","last_fullsized":"2024-09-12T03:36:32.375695+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502513+0000","last_change":"2024-09-12T03:36:34.422629+0000","last_active":"2024-09-12T03:36:35.502513+0000","last_peered":"2024-09-12T03:36:35.502513+0000","last_clean":"2024-09-12T03:36:35.502513+0000","last_became_active":"2024-09-12T03:36:34.421821+0000","last_became_peered":"2024-09-12T03:36:34.421821+0000","last_unstale":"2024-09-12T03:36:35.502513+0000","last_undegraded":"2024-09-12T03:36:35.502513+0000","last_fullsized":"2024-09-12T03:36:35.502513+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:50.766660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.374549+0000","last_change":"2024-09-12T03:36:32.374549+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.374549+0000","last_undegraded":"2024-09-12T03:36:32.374549+0000","last_fullsized":"2024-09-12T03:36:32.374549+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502275+0000","last_change":"2024-09-12T03:36:33.424986+0000","last_active":"2024-09-12T03:36:35.502275+0000","last_peered":"2024-09-12T03:36:35.502275+0000","last_clean":"2024-09-12T03:36:35.502275+0000","last_became_active":"2024-09-12T03:36:33.424292+0000","last_became_peered":"2024-09-12T03:36:33.424292+0000","last_unstale":"2024-09-12T03:36:35.502275+0000","last_undegraded":"2024-09-12T03:36:35.502275+0000","last_fullsized":"2024-09-12T03:36:35.502275+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:31.276349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385202+0000","last_change":"2024-09-12T03:36:32.385202+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385202+0000","last_undegraded":"2024-09-12T03:36:32.385202+0000","last_fullsized":"2024-09-12T03:36:32.385202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378586+0000","last_change":"2024-09-12T03:36:32.378586+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378586+0000","last_undegraded":"2024-09-12T03:36:32.378586+0000","last_fullsized":"2024-09-12T03:36:32.378586+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503131+0000","last_change":"2024-09-12T03:36:34.468055+0000","last_active":"2024-09-12T03:36:35.503131+0000","last_peered":"2024-09-12T03:36:35.503131+0000","last_clean":"2024-09-12T03:36:35.503131+0000","last_became_active":"2024-09-12T03:36:34.467444+0000","last_became_peered":"2024-09-12T03:36:34.467444+0000","last_unstale":"2024-09-12T03:36:35.503131+0000","last_undegraded":"2024-09-12T03:36:35.503131+0000","last_fullsized":"2024-09-12T03:36:35.503131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:12.580444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.386370+0000","last_change":"2024-09-12T03:36:32.386370+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.386370+0000","last_undegraded":"2024-09-12T03:36:32.386370+0000","last_fullsized":"2024-09-12T03:36:32.386370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378385+0000","last_change":"2024-09-12T03:36:32.378385+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378385+0000","last_undegraded":"2024-09-12T03:36:32.378385+0000","last_fullsized":"2024-09-12T03:36:32.378385+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.386383+0000","last_change":"2024-09-12T03:36:32.386383+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.386383+0000","last_undegraded":"2024-09-12T03:36:32.386383+0000","last_fullsized":"2024-09-12T03:36:32.386383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.378027+0000","last_change":"2024-09-12T03:36:32.378027+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.378027+0000","last_undegraded":"2024-09-12T03:36:32.378027+0000","last_fullsized":"2024-09-12T03:36:32.378027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502597+0000","last_change":"2024-09-12T03:36:34.424336+0000","last_active":"2024-09-12T03:36:35.502597+0000","last_peered":"2024-09-12T03:36:35.502597+0000","last_clean":"2024-09-12T03:36:35.502597+0000","last_became_active":"2024-09-12T03:36:34.423596+0000","last_became_peered":"2024-09-12T03:36:34.423596+0000","last_unstale":"2024-09-12T03:36:35.502597+0000","last_undegraded":"2024-09-12T03:36:35.502597+0000","last_fullsized":"2024-09-12T03:36:35.502597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:06.748555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385248+0000","last_change":"2024-09-12T03:36:32.385248+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385248+0000","last_undegraded":"2024-09-12T03:36:32.385248+0000","last_fullsized":"2024-09-12T03:36:32.385248+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.379993+0000","last_change":"2024-09-12T03:36:32.379993+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.379993+0000","last_undegraded":"2024-09-12T03:36:32.379993+0000","last_fullsized":"2024-09-12T03:36:32.379993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.380104+0000","last_change":"2024-09-12T03:36:32.380104+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.380104+0000","last_undegraded":"2024-09-12T03:36:32.380104+0000","last_fullsized":"2024-09-12T03:36:32.380104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503037+0000","last_change":"2024-09-12T03:36:34.436468+0000","last_active":"2024-09-12T03:36:35.503037+0000","last_peered":"2024-09-12T03:36:35.503037+0000","last_clean":"2024-09-12T03:36:35.503037+0000","last_became_active":"2024-09-12T03:36:34.433336+0000","last_became_peered":"2024-09-12T03:36:34.433336+0000","last_unstale":"2024-09-12T03:36:35.503037+0000","last_undegraded":"2024-09-12T03:36:35.503037+0000","last_fullsized":"2024-09-12T03:36:35.503037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:50.198807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385201+0000","last_change":"2024-09-12T03:36:32.385201+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385201+0000","last_undegraded":"2024-09-12T03:36:32.385201+0000","last_fullsized":"2024-09-12T03:36:32.385201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385247+0000","last_change":"2024-09-12T03:36:32.385247+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385247+0000","last_undegraded":"2024-09-12T03:36:32.385247+0000","last_fullsized":"2024-09-12T03:36:32.385247+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503033+0000","last_change":"2024-09-12T03:36:34.417956+0000","last_active":"2024-09-12T03:36:35.503033+0000","last_peered":"2024-09-12T03:36:35.503033+0000","last_clean":"2024-09-12T03:36:35.503033+0000","last_became_active":"2024-09-12T03:36:34.416639+0000","last_became_peered":"2024-09-12T03:36:34.416639+0000","last_unstale":"2024-09-12T03:36:35.503033+0000","last_undegraded":"2024-09-12T03:36:35.503033+0000","last_fullsized":"2024-09-12T03:36:35.503033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:06.603286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373936+0000","last_change":"2024-09-12T03:36:32.373936+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373936+0000","last_undegraded":"2024-09-12T03:36:32.373936+0000","last_fullsized":"2024-09-12T03:36:32.373936+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501805+0000","last_change":"2024-09-12T03:36:34.423982+0000","last_active":"2024-09-12T03:36:35.501805+0000","last_peered":"2024-09-12T03:36:35.501805+0000","last_clean":"2024-09-12T03:36:35.501805+0000","last_became_active":"2024-09-12T03:36:34.423407+0000","last_became_peered":"2024-09-12T03:36:34.423407+0000","last_unstale":"2024-09-12T03:36:35.501805+0000","last_undegraded":"2024-09-12T03:36:35.501805+0000","last_fullsized":"2024-09-12T03:36:35.501805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.314364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501717+0000","last_change":"2024-09-12T03:36:33.419981+0000","last_active":"2024-09-12T03:36:35.501717+0000","last_peered":"2024-09-12T03:36:35.501717+0000","last_clean":"2024-09-12T03:36:35.501717+0000","last_became_active":"2024-09-12T03:36:33.419512+0000","last_became_peered":"2024-09-12T03:36:33.419512+0000","last_unstale":"2024-09-12T03:36:35.501717+0000","last_undegraded":"2024-09-12T03:36:35.501717+0000","last_fullsized":"2024-09-12T03:36:35.501717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.891702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.376974+0000","last_change":"2024-09-12T03:36:32.376974+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.376974+0000","last_undegraded":"2024-09-12T03:36:32.376974+0000","last_fullsized":"2024-09-12T03:36:32.376974+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503127+0000","last_change":"2024-09-12T03:36:34.420143+0000","last_active":"2024-09-12T03:36:35.503127+0000","last_peered":"2024-09-12T03:36:35.503127+0000","last_clean":"2024-09-12T03:36:35.503127+0000","last_became_active":"2024-09-12T03:36:34.419222+0000","last_became_peered":"2024-09-12T03:36:34.419222+0000","last_unstale":"2024-09-12T03:36:35.503127+0000","last_undegraded":"2024-09-12T03:36:35.503127+0000","last_fullsized":"2024-09-12T03:36:35.503127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:20.623310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501583+0000","last_change":"2024-09-12T03:36:33.427179+0000","last_active":"2024-09-12T03:36:35.501583+0000","last_peered":"2024-09-12T03:36:35.501583+0000","last_clean":"2024-09-12T03:36:35.501583+0000","last_became_active":"2024-09-12T03:36:33.426240+0000","last_became_peered":"2024-09-12T03:36:33.426240+0000","last_unstale":"2024-09-12T03:36:35.501583+0000","last_undegraded":"2024-09-12T03:36:35.501583+0000","last_fullsized":"2024-09-12T03:36:35.501583+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:05.593351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501804+0000","last_change":"2024-09-12T03:36:34.432798+0000","last_active":"2024-09-12T03:36:35.501804+0000","last_peered":"2024-09-12T03:36:35.501804+0000","last_clean":"2024-09-12T03:36:35.501804+0000","last_became_active":"2024-09-12T03:36:34.432577+0000","last_became_peered":"2024-09-12T03:36:34.432577+0000","last_unstale":"2024-09-12T03:36:35.501804+0000","last_undegraded":"2024-09-12T03:36:35.501804+0000","last_fullsized":"2024-09-12T03:36:35.501804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:21.914671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.379070+0000","last_change":"2024-09-12T03:36:32.379070+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.379070+0000","last_undegraded":"2024-09-12T03:36:32.379070+0000","last_fullsized":"2024-09-12T03:36:32.379070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.375581+0000","last_change":"2024-09-12T03:36:32.375581+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.375581+0000","last_undegraded":"2024-09-12T03:36:32.375581+0000","last_fullsized":"2024-09-12T03:36:32.375581+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502130+0000","last_change":"2024-09-12T03:36:33.417423+0000","last_active":"2024-09-12T03:36:35.502130+0000","last_peered":"2024-09-12T03:36:35.502130+0000","last_clean":"2024-09-12T03:36:35.502130+0000","last_became_active":"2024-09-12T03:36:33.417134+0000","last_became_peered":"2024-09-12T03:36:33.417134+0000","last_unstale":"2024-09-12T03:36:35.502130+0000","last_undegraded":"2024-09-12T03:36:35.502130+0000","last_fullsized":"2024-09-12T03:36:35.502130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:43.675137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503401+0000","last_change":"2024-09-12T03:36:34.417391+0000","last_active":"2024-09-12T03:36:35.503401+0000","last_peered":"2024-09-12T03:36:35.503401+0000","last_clean":"2024-09-12T03:36:35.503401+0000","last_became_active":"2024-09-12T03:36:34.415727+0000","last_became_peered":"2024-09-12T03:36:34.415727+0000","last_unstale":"2024-09-12T03:36:35.503401+0000","last_undegraded":"2024-09-12T03:36:35.503401+0000","last_fullsized":"2024-09-12T03:36:35.503401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:48.626206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377806+0000","last_change":"2024-09-12T03:36:32.377806+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377806+0000","last_undegraded":"2024-09-12T03:36:32.377806+0000","last_fullsized":"2024-09-12T03:36:32.377806+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502795+0000","last_change":"2024-09-12T03:36:34.426947+0000","last_active":"2024-09-12T03:36:35.502795+0000","last_peered":"2024-09-12T03:36:35.502795+0000","last_clean":"2024-09-12T03:36:35.502795+0000","last_became_active":"2024-09-12T03:36:34.426228+0000","last_became_peered":"2024-09-12T03:36:34.426228+0000","last_unstale":"2024-09-12T03:36:35.502795+0000","last_undegraded":"2024-09-12T03:36:35.502795+0000","last_fullsized":"2024-09-12T03:36:35.502795+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.421639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.385191+0000","last_change":"2024-09-12T03:36:32.385191+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.385191+0000","last_undegraded":"2024-09-12T03:36:32.385191+0000","last_fullsized":"2024-09-12T03:36:32.385191+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.374206+0000","last_change":"2024-09-12T03:36:32.374206+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.374206+0000","last_undegraded":"2024-09-12T03:36:32.374206+0000","last_fullsized":"2024-09-12T03:36:32.374206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373673+0000","last_change":"2024-09-12T03:36:32.373673+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373673+0000","last_undegraded":"2024-09-12T03:36:32.373673+0000","last_fullsized":"2024-09-12T03:36:32.373673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:36:33.369870+0000","last_change":"2024-09-12T03:36:33.369870+0000","last_active":"2024-09-12T03:36:33.369870+0000","last_peered":"2024-09-12T03:36:33.369870+0000","last_clean":"2024-09-12T03:36:33.369870+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:33.369870+0000","last_undegraded":"2024-09-12T03:36:33.369870+0000","last_fullsized":"2024-09-12T03:36:33.369870+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.377618+0000","last_change":"2024-09-12T03:36:32.377618+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.377618+0000","last_undegraded":"2024-09-12T03:36:32.377618+0000","last_fullsized":"2024-09-12T03:36:32.377618+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503957+0000","last_change":"2024-09-12T03:36:34.425092+0000","last_active":"2024-09-12T03:36:35.503957+0000","last_peered":"2024-09-12T03:36:35.503957+0000","last_clean":"2024-09-12T03:36:35.503957+0000","last_became_active":"2024-09-12T03:36:34.424390+0000","last_became_peered":"2024-09-12T03:36:34.424390+0000","last_unstale":"2024-09-12T03:36:35.503957+0000","last_undegraded":"2024-09-12T03:36:35.503957+0000","last_fullsized":"2024-09-12T03:36:35.503957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.579899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2024-09-12T03:36:32.373795+0000","last_change":"2024-09-12T03:36:32.373795+0000","last_active":"2024-09-12T03:36:32.360285+0000","last_peered":"2024-09-12T03:36:32.360285+0000","last_clean":"2024-09-12T03:36:32.360285+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:36:32.373795+0000","last_undegraded":"2024-09-12T03:36:32.373795+0000","last_fullsized":"2024-09-12T03:36:32.373795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":240,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-12T03:36:32.387026+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:32.387026+0000","last_peered":"2024-09-12T03:36:32.387026+0000","last_clean":"2024-09-12T03:36:32.387026+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:32.387026+0000","last_undegraded":"2024-09-12T03:36:32.387026+0000","last_fullsized":"2024-09-12T03:36:32.387026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1323008,"data_stored":915520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":325152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":325152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":716800,"data_stored":318943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":345704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":929346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:39.177 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3f is not active+clean 2024-09-12T03:36:39.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.177 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3e is not active+clean 2024-09-12T03:36:39.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3d is not active+clean 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3c is not active+clean 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:PG 10.39 is not active+clean 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:PG 10.38 is not active+clean 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:PG 10.37 is not active+clean 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:PG 10.36 is not active+clean 2024-09-12T03:36:39.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:PG 10.35 is not active+clean 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:PG 10.34 is not active+clean 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:PG 10.33 is not active+clean 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:PG 10.32 is not active+clean 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:PG 10.31 is not active+clean 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:PG 10.30 is not active+clean 2024-09-12T03:36:39.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2f is not active+clean 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2e is not active+clean 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2c is not active+clean 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2b is not active+clean 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2a is not active+clean 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:PG 10.29 is not active+clean 2024-09-12T03:36:39.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:PG 10.28 is not active+clean 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:PG 10.27 is not active+clean 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:PG 10.26 is not active+clean 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:PG 10.25 is not active+clean 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:PG 10.24 is not active+clean 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.181 INFO:tasks.ceph.ceph_manager.ceph:PG 10.23 is not active+clean 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:PG 10.22 is not active+clean 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:PG 10.21 is not active+clean 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.377838+0000', 'last_change': '2024-09-12T03:36:32.377838+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.377838+0000', 'last_undegraded': '2024-09-12T03:36:32.377838+0000', 'last_fullsized': '2024-09-12T03:36:32.377838+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.182 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.375535+0000', 'last_change': '2024-09-12T03:36:32.375535+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.375535+0000', 'last_undegraded': '2024-09-12T03:36:32.375535+0000', 'last_fullsized': '2024-09-12T03:36:32.375535+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.375695+0000', 'last_change': '2024-09-12T03:36:32.375695+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.375695+0000', 'last_undegraded': '2024-09-12T03:36:32.375695+0000', 'last_fullsized': '2024-09-12T03:36:32.375695+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.374549+0000', 'last_change': '2024-09-12T03:36:32.374549+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.374549+0000', 'last_undegraded': '2024-09-12T03:36:32.374549+0000', 'last_fullsized': '2024-09-12T03:36:32.374549+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-12T03:36:39.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.385202+0000', 'last_change': '2024-09-12T03:36:32.385202+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.385202+0000', 'last_undegraded': '2024-09-12T03:36:32.385202+0000', 'last_fullsized': '2024-09-12T03:36:32.385202+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.378586+0000', 'last_change': '2024-09-12T03:36:32.378586+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.378586+0000', 'last_undegraded': '2024-09-12T03:36:32.378586+0000', 'last_fullsized': '2024-09-12T03:36:32.378586+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.386370+0000', 'last_change': '2024-09-12T03:36:32.386370+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.386370+0000', 'last_undegraded': '2024-09-12T03:36:32.386370+0000', 'last_fullsized': '2024-09-12T03:36:32.386370+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-12T03:36:39.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.378385+0000', 'last_change': '2024-09-12T03:36:32.378385+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.378385+0000', 'last_undegraded': '2024-09-12T03:36:32.378385+0000', 'last_fullsized': '2024-09-12T03:36:32.378385+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.386383+0000', 'last_change': '2024-09-12T03:36:32.386383+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.386383+0000', 'last_undegraded': '2024-09-12T03:36:32.386383+0000', 'last_fullsized': '2024-09-12T03:36:32.386383+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.378027+0000', 'last_change': '2024-09-12T03:36:32.378027+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.378027+0000', 'last_undegraded': '2024-09-12T03:36:32.378027+0000', 'last_fullsized': '2024-09-12T03:36:32.378027+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-12T03:36:39.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.385248+0000', 'last_change': '2024-09-12T03:36:32.385248+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.385248+0000', 'last_undegraded': '2024-09-12T03:36:32.385248+0000', 'last_fullsized': '2024-09-12T03:36:32.385248+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.379993+0000', 'last_change': '2024-09-12T03:36:32.379993+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.379993+0000', 'last_undegraded': '2024-09-12T03:36:32.379993+0000', 'last_fullsized': '2024-09-12T03:36:32.379993+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.380104+0000', 'last_change': '2024-09-12T03:36:32.380104+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.380104+0000', 'last_undegraded': '2024-09-12T03:36:32.380104+0000', 'last_fullsized': '2024-09-12T03:36:32.380104+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.385201+0000', 'last_change': '2024-09-12T03:36:32.385201+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.385201+0000', 'last_undegraded': '2024-09-12T03:36:32.385201+0000', 'last_fullsized': '2024-09-12T03:36:32.385201+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-12T03:36:39.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.385247+0000', 'last_change': '2024-09-12T03:36:32.385247+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.385247+0000', 'last_undegraded': '2024-09-12T03:36:32.385247+0000', 'last_fullsized': '2024-09-12T03:36:32.385247+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.373936+0000', 'last_change': '2024-09-12T03:36:32.373936+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.373936+0000', 'last_undegraded': '2024-09-12T03:36:32.373936+0000', 'last_fullsized': '2024-09-12T03:36:32.373936+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.376974+0000', 'last_change': '2024-09-12T03:36:32.376974+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.376974+0000', 'last_undegraded': '2024-09-12T03:36:32.376974+0000', 'last_fullsized': '2024-09-12T03:36:32.376974+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.379070+0000', 'last_change': '2024-09-12T03:36:32.379070+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.379070+0000', 'last_undegraded': '2024-09-12T03:36:32.379070+0000', 'last_fullsized': '2024-09-12T03:36:32.379070+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-12T03:36:39.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.375581+0000', 'last_change': '2024-09-12T03:36:32.375581+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.375581+0000', 'last_undegraded': '2024-09-12T03:36:32.375581+0000', 'last_fullsized': '2024-09-12T03:36:32.375581+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.377806+0000', 'last_change': '2024-09-12T03:36:32.377806+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.377806+0000', 'last_undegraded': '2024-09-12T03:36:32.377806+0000', 'last_fullsized': '2024-09-12T03:36:32.377806+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.385191+0000', 'last_change': '2024-09-12T03:36:32.385191+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.385191+0000', 'last_undegraded': '2024-09-12T03:36:32.385191+0000', 'last_fullsized': '2024-09-12T03:36:32.385191+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-12T03:36:39.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.374206+0000', 'last_change': '2024-09-12T03:36:32.374206+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.374206+0000', 'last_undegraded': '2024-09-12T03:36:32.374206+0000', 'last_fullsized': '2024-09-12T03:36:32.374206+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.373673+0000', 'last_change': '2024-09-12T03:36:32.373673+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.373673+0000', 'last_undegraded': '2024-09-12T03:36:32.373673+0000', 'last_fullsized': '2024-09-12T03:36:32.373673+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T03:36:33.369870+0000', 'last_change': '2024-09-12T03:36:33.369870+0000', 'last_active': '2024-09-12T03:36:33.369870+0000', 'last_peered': '2024-09-12T03:36:33.369870+0000', 'last_clean': '2024-09-12T03:36:33.369870+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:33.369870+0000', 'last_undegraded': '2024-09-12T03:36:33.369870+0000', 'last_fullsized': '2024-09-12T03:36:33.369870+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:33.369870+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.377618+0000', 'last_change': '2024-09-12T03:36:32.377618+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.377618+0000', 'last_undegraded': '2024-09-12T03:36:32.377618+0000', 'last_fullsized': '2024-09-12T03:36:32.377618+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-12T03:36:39.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:36:32.373795+0000', 'last_change': '2024-09-12T03:36:32.373795+0000', 'last_active': '2024-09-12T03:36:32.360285+0000', 'last_peered': '2024-09-12T03:36:32.360285+0000', 'last_clean': '2024-09-12T03:36:32.360285+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:36:32.373795+0000', 'last_undegraded': '2024-09-12T03:36:32.373795+0000', 'last_fullsized': '2024-09-12T03:36:32.373795+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'last_clean_scrub_stamp': '2024-09-12T03:36:32.360285+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T03:36:39.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T03:36:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.334+0000 7fae6cc93640 1 Processor -- start 2024-09-12T03:36:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.334+0000 7fae6cc93640 1 -- start start 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6cc93640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae6815c2a0 0x7fae680aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6cc93640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae680af2a0 0x7fae6806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6cc93640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae680b3290 con 0x7fae6815bec0 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6cc93640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fae680b3570 con 0x7fae680af2a0 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6cc93640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fae680b3850 con 0x7fae6815c2a0 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae680af2a0 0x7fae6806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae680af2a0 0x7fae6806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54936/0 (socket says 172.21.15.73:54936) 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 -- 172.21.15.73:0/4108256855 learned_addr learned my addr 172.21.15.73:0/4108256855 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae65d9b640 1 --2- 172.21.15.73:0/4108256855 >> v2:172.21.15.150:3300/0 conn(0x7fae6815c2a0 0x7fae680aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 -- 172.21.15.73:0/4108256855 >> v2:172.21.15.150:3300/0 conn(0x7fae6815c2a0 msgr2=0x7fae680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:39.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 --2- 172.21.15.73:0/4108256855 >> v2:172.21.15.150:3300/0 conn(0x7fae6815c2a0 0x7fae680aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 -- 172.21.15.73:0/4108256855 >> v1:172.21.15.150:6789/0 conn(0x7fae6815bec0 legacy=0x7fae680ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:39.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 -- 172.21.15.73:0/4108256855 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae680b3b30 con 0x7fae680af2a0 2024-09-12T03:36:39.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae65d9b640 1 --2- 172.21.15.73:0/4108256855 >> v2:172.21.15.150:3300/0 conn(0x7fae6815c2a0 0x7fae680aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:39.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae66d9d640 1 --2- 172.21.15.73:0/4108256855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6806e000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fae680ae510 tx=0x7fae6001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66fc4954dead093 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:39.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6559a640 1 -- 172.21.15.73:0/4108256855 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae600a5840 con 0x7fae680af2a0 2024-09-12T03:36:39.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6559a640 1 -- 172.21.15.73:0/4108256855 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae600a59e0 con 0x7fae680af2a0 2024-09-12T03:36:39.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.338+0000 7fae6559a640 1 -- 172.21.15.73:0/4108256855 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae600a5db0 con 0x7fae680af2a0 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- 172.21.15.73:0/4108256855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 msgr2=0x7fae6806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 --2- 172.21.15.73:0/4108256855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6806e000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fae680ae510 tx=0x7fae6001c980 comp rx=0 tx=0).stop 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- 172.21.15.73:0/4108256855 shutdown_connections 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 --2- 172.21.15.73:0/4108256855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6806e000 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 --2- 172.21.15.73:0/4108256855 >> v2:172.21.15.150:3300/0 conn(0x7fae6815c2a0 0x7fae680aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- 172.21.15.73:0/4108256855 >> 172.21.15.73:0/4108256855 conn(0x7fae680b1f90 msgr2=0x7fae680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- 172.21.15.73:0/4108256855 shutdown_connections 2024-09-12T03:36:39.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- 172.21.15.73:0/4108256855 wait complete. 2024-09-12T03:36:39.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 Processor -- start 2024-09-12T03:36:39.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- start start 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6814a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae6815bec0 0x7fae6809a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae6815c2a0 0x7fae6815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae6806ed50 con 0x7fae680af2a0 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fae680af710 con 0x7fae6815bec0 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fae6806eed0 con 0x7fae6815c2a0 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6814a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6814a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54942/0 (socket says 172.21.15.73:54942) 2024-09-12T03:36:39.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 -- 172.21.15.73:0/1105879008 learned_addr learned my addr 172.21.15.73:0/1105879008 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae65d9b640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae6815bec0 0x7fae6809a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 -- 172.21.15.73:0/1105879008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae6815c2a0 msgr2=0x7fae6815e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae6815c2a0 0x7fae6815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 -- 172.21.15.73:0/1105879008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae6815bec0 msgr2=0x7fae6809a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae6815bec0 0x7fae6809a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 -- 172.21.15.73:0/1105879008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6815f730 con 0x7fae680af2a0 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6659c640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6814a6b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c450 tx=0x7fae5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae56ffd640 1 -- 172.21.15.73:0/1105879008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58012830 con 0x7fae680af2a0 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae56ffd640 1 -- 172.21.15.73:0/1105879008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae58017070 con 0x7fae680af2a0 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae68156070 con 0x7fae680af2a0 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae56ffd640 1 -- 172.21.15.73:0/1105879008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58012c30 con 0x7fae680af2a0 2024-09-12T03:36:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.342+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae68156310 con 0x7fae680af2a0 2024-09-12T03:36:39.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.346+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6806f260 con 0x7fae680af2a0 2024-09-12T03:36:39.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.346+0000 7fae56ffd640 1 -- 172.21.15.73:0/1105879008 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae5801c460 con 0x7fae680af2a0 2024-09-12T03:36:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.346+0000 7fae56ffd640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae480678c0 0x7fae48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.346+0000 7fae65d9b640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae480678c0 0x7fae48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.346+0000 7fae56ffd640 1 -- 172.21.15.73:0/1105879008 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fae58085bb0 con 0x7fae680af2a0 2024-09-12T03:36:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.346+0000 7fae65d9b640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae480678c0 0x7fae48069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae68157800 tx=0x7fae5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:39.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.350+0000 7fae56ffd640 1 -- 172.21.15.73:0/1105879008 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae58056550 con 0x7fae680af2a0 2024-09-12T03:36:39.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fae6806fcd0 con 0x7fae680af2a0 2024-09-12T03:36:39.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae56ffd640 1 -- 172.21.15.73:0/1105879008 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1632 (secure 0 0 0) 0x7fae58055e50 con 0x7fae680af2a0 2024-09-12T03:36:39.575 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:39.576 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1726112066,"num_in_osds":8,"osd_in_since":1726112057,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":47},{"state_name":"active+clean","count":25},{"state_name":"creating+peering","count":25}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590368,"bytes_used":245542912,"bytes_avail":772848570368,"bytes_total":773094113280,"unknown_pgs_ratio":0.48453608155250549,"inactive_pgs_ratio":0.25773194432258606,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":32,"btime":"2024-09-12T03:36:37:437965+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5550}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-12T03:36:23.821828+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae480678c0 msgr2=0x7fae48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae480678c0 0x7fae48069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae68157800 tx=0x7fae5c008040 comp rx=0 tx=0).stop 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 msgr2=0x7fae6814a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6814a6b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c450 tx=0x7fae5800c910 comp rx=0 tx=0).stop 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 shutdown_connections 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae480678c0 0x7fae48069d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae6815c2a0 0x7fae6815e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae6815bec0 0x7fae6809a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 --2- 172.21.15.73:0/1105879008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae680af2a0 0x7fae6814a6b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 >> 172.21.15.73:0/1105879008 conn(0x7fae680b1f90 msgr2=0x7fae680b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:39.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 shutdown_connections 2024-09-12T03:36:39.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.574+0000 7fae6cc93640 1 -- 172.21.15.73:0/1105879008 wait complete. 2024-09-12T03:36:39.595 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T03:36:39.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:39.658 INFO:tasks.ceph.mds.a.smithi073.stderr:2024-09-12T03:36:39.654+0000 7fbfdccdd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:36:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806c820640 1 Processor -- start 2024-09-12T03:36:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806c820640 1 -- start start 2024-09-12T03:36:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806c820640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815bec0 0x7f80680ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806c820640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f80680af470 0x7f806806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806c820640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80680b3290 con 0x7f806815c2a0 2024-09-12T03:36:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806c820640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f80680b3570 con 0x7f80680af470 2024-09-12T03:36:39.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806c820640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f80680b3850 con 0x7f806815bec0 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806659c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815bec0 0x7f80680ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f8066d9d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f80680af470 0x7f806806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806659c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815bec0 0x7f80680ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:38940/0 (socket says 172.21.15.73:38940) 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806659c640 1 -- 172.21.15.73:0/2363704514 learned_addr learned my addr 172.21.15.73:0/2363704514 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806659c640 1 -- 172.21.15.73:0/2363704514 >> v2:172.21.15.150:3300/0 conn(0x7f80680af470 msgr2=0x7f806806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806659c640 1 --2- 172.21.15.73:0/2363704514 >> v2:172.21.15.150:3300/0 conn(0x7f80680af470 0x7f806806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806659c640 1 -- 172.21.15.73:0/2363704514 >> v1:172.21.15.150:6789/0 conn(0x7f806815c2a0 legacy=0x7f80680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.714+0000 7f806659c640 1 -- 172.21.15.73:0/2363704514 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80680b3b30 con 0x7f806815bec0 2024-09-12T03:36:39.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806659c640 1 --2- 172.21.15.73:0/2363704514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815bec0 0x7f80680ad200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8058009870 tx=0x7f805801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be84a8e4f4e9219 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806559a640 1 -- 172.21.15.73:0/2363704514 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580a95f0 con 0x7f806815bec0 2024-09-12T03:36:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806559a640 1 -- 172.21.15.73:0/2363704514 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80580a9790 con 0x7f806815bec0 2024-09-12T03:36:39.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806559a640 1 -- 172.21.15.73:0/2363704514 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580a9b60 con 0x7f806815bec0 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 -- 172.21.15.73:0/2363704514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815bec0 msgr2=0x7f80680ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 --2- 172.21.15.73:0/2363704514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815bec0 0x7f80680ad200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8058009870 tx=0x7f805801c530 comp rx=0 tx=0).stop 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 -- 172.21.15.73:0/2363704514 shutdown_connections 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 --2- 172.21.15.73:0/2363704514 >> v2:172.21.15.150:3300/0 conn(0x7f80680af470 0x7f806806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 --2- 172.21.15.73:0/2363704514 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815bec0 0x7f80680ad200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 -- 172.21.15.73:0/2363704514 >> 172.21.15.73:0/2363704514 conn(0x7f80680b1f90 msgr2=0x7f80680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 -- 172.21.15.73:0/2363704514 shutdown_connections 2024-09-12T03:36:39.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.718+0000 7f806c820640 1 -- 172.21.15.73:0/2363704514 wait complete. 2024-09-12T03:36:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 Processor -- start 2024-09-12T03:36:39.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 -- start start 2024-09-12T03:36:39.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80680af470 0x7f806814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f806815bec0 0x7f806814c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815c2a0 0x7f806814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f806806ed50 con 0x7f80680af470 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f80680ad740 con 0x7f806815bec0 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f806806eed0 con 0x7f806815c2a0 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80680af470 0x7f806814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80680af470 0x7f806814ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54958/0 (socket says 172.21.15.73:54958) 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 -- 172.21.15.73:0/3308723832 learned_addr learned my addr 172.21.15.73:0/3308723832 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f8066d9d640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815c2a0 0x7f806814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f8065d9b640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f806815bec0 0x7f806814c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 -- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815c2a0 msgr2=0x7f806814cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815c2a0 0x7f806814cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 -- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f806815bec0 msgr2=0x7f806814c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f806815bec0 0x7f806814c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 -- 172.21.15.73:0/3308723832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8068156f30 con 0x7f80680af470 2024-09-12T03:36:39.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806659c640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80680af470 0x7f806814ea70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f805801a160 tx=0x7f805801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:39.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f8056ffd640 1 -- 172.21.15.73:0/3308723832 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580a95f0 con 0x7f80680af470 2024-09-12T03:36:39.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f8056ffd640 1 -- 172.21.15.73:0/3308723832 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80580b1800 con 0x7f80680af470 2024-09-12T03:36:39.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80681576f0 con 0x7f80680af470 2024-09-12T03:36:39.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f8056ffd640 1 -- 172.21.15.73:0/3308723832 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80580b1bf0 con 0x7f80680af470 2024-09-12T03:36:39.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806814c420 con 0x7f80680af470 2024-09-12T03:36:39.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f806806f280 con 0x7f80680af470 2024-09-12T03:36:39.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f8056ffd640 1 -- 172.21.15.73:0/3308723832 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f80580bc450 con 0x7f80680af470 2024-09-12T03:36:39.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.722+0000 7f8056ffd640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80480678c0 0x7f8048069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.726+0000 7f8056ffd640 1 -- 172.21.15.73:0/3308723832 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f8058120870 con 0x7f80680af470 2024-09-12T03:36:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.726+0000 7f8065d9b640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80480678c0 0x7f8048069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:39.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.726+0000 7f8065d9b640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80480678c0 0x7f8048069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f80681f83e0 tx=0x7f805c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:39.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.730+0000 7f8056ffd640 1 -- 172.21.15.73:0/3308723832 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80580ad020 con 0x7f80680af470 2024-09-12T03:36:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.878+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80680d0900 con 0x7f80480678c0 2024-09-12T03:36:39.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.894+0000 7f8056ffd640 1 -- 172.21.15.73:0/3308723832 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252022 (secure 0 0 0) 0x7f80680d0900 con 0x7f80480678c0 2024-09-12T03:36:39.899 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:39.900 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:39.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80480678c0 msgr2=0x7f8048069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80480678c0 0x7f8048069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f80681f83e0 tx=0x7f805c009040 comp rx=0 tx=0).stop 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80680af470 msgr2=0x7f806814ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80680af470 0x7f806814ea70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f805801a160 tx=0x7f805801ad70 comp rx=0 tx=0).stop 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 shutdown_connections 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80480678c0 0x7f8048069d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f806815c2a0 0x7f806814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f806815bec0 0x7f806814c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 --2- 172.21.15.73:0/3308723832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80680af470 0x7f806814ea70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 >> 172.21.15.73:0/3308723832 conn(0x7f80680b1f90 msgr2=0x7f80680b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 shutdown_connections 2024-09-12T03:36:39.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:39.898+0000 7f806c820640 1 -- 172.21.15.73:0/3308723832 wait complete. 2024-09-12T03:36:39.916 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-12T03:36:39.825873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240076,"kb_used_data":7196,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734644,"statfs":{"total":773094113280,"available":772848275456,"internally_reserved":0,"allocated":7368704,"data_stored":3944224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.449428"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422017+0000","last_change":"2024-09-12T03:36:34.463528+0000","last_active":"2024-09-12T03:36:35.422017+0000","last_peered":"2024-09-12T03:36:35.422017+0000","last_clean":"2024-09-12T03:36:35.422017+0000","last_became_active":"2024-09-12T03:36:34.463253+0000","last_became_peered":"2024-09-12T03:36:34.463253+0000","last_unstale":"2024-09-12T03:36:35.422017+0000","last_undegraded":"2024-09-12T03:36:35.422017+0000","last_fullsized":"2024-09-12T03:36:35.422017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:06.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421826+0000","last_change":"2024-09-12T03:36:34.419958+0000","last_active":"2024-09-12T03:36:35.421826+0000","last_peered":"2024-09-12T03:36:35.421826+0000","last_clean":"2024-09-12T03:36:35.421826+0000","last_became_active":"2024-09-12T03:36:34.419226+0000","last_became_peered":"2024-09-12T03:36:34.419226+0000","last_unstale":"2024-09-12T03:36:35.421826+0000","last_undegraded":"2024-09-12T03:36:35.421826+0000","last_fullsized":"2024-09-12T03:36:35.421826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:49.354398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503938+0000","last_change":"2024-09-12T03:36:34.464323+0000","last_active":"2024-09-12T03:36:35.503938+0000","last_peered":"2024-09-12T03:36:35.503938+0000","last_clean":"2024-09-12T03:36:35.503938+0000","last_became_active":"2024-09-12T03:36:34.453118+0000","last_became_peered":"2024-09-12T03:36:34.453118+0000","last_unstale":"2024-09-12T03:36:35.503938+0000","last_undegraded":"2024-09-12T03:36:35.503938+0000","last_fullsized":"2024-09-12T03:36:35.503938+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:43.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.507228+0000","last_change":"2024-09-12T03:36:34.435338+0000","last_active":"2024-09-12T03:36:35.507228+0000","last_peered":"2024-09-12T03:36:35.507228+0000","last_clean":"2024-09-12T03:36:35.507228+0000","last_became_active":"2024-09-12T03:36:34.434628+0000","last_became_peered":"2024-09-12T03:36:34.434628+0000","last_unstale":"2024-09-12T03:36:35.507228+0000","last_undegraded":"2024-09-12T03:36:35.507228+0000","last_fullsized":"2024-09-12T03:36:35.507228+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:34.345611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502924+0000","last_change":"2024-09-12T03:36:34.420931+0000","last_active":"2024-09-12T03:36:35.502924+0000","last_peered":"2024-09-12T03:36:35.502924+0000","last_clean":"2024-09-12T03:36:35.502924+0000","last_became_active":"2024-09-12T03:36:34.420153+0000","last_became_peered":"2024-09-12T03:36:34.420153+0000","last_unstale":"2024-09-12T03:36:35.502924+0000","last_undegraded":"2024-09-12T03:36:35.502924+0000","last_fullsized":"2024-09-12T03:36:35.502924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:24.308610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502284+0000","last_change":"2024-09-12T03:36:34.459041+0000","last_active":"2024-09-12T03:36:35.502284+0000","last_peered":"2024-09-12T03:36:35.502284+0000","last_clean":"2024-09-12T03:36:35.502284+0000","last_became_active":"2024-09-12T03:36:34.458649+0000","last_became_peered":"2024-09-12T03:36:34.458649+0000","last_unstale":"2024-09-12T03:36:35.502284+0000","last_undegraded":"2024-09-12T03:36:35.502284+0000","last_fullsized":"2024-09-12T03:36:35.502284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:49.414429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436001+0000","last_change":"2024-09-12T03:36:34.453582+0000","last_active":"2024-09-12T03:36:35.436001+0000","last_peered":"2024-09-12T03:36:35.436001+0000","last_clean":"2024-09-12T03:36:35.436001+0000","last_became_active":"2024-09-12T03:36:34.453275+0000","last_became_peered":"2024-09-12T03:36:34.453275+0000","last_unstale":"2024-09-12T03:36:35.436001+0000","last_undegraded":"2024-09-12T03:36:35.436001+0000","last_fullsized":"2024-09-12T03:36:35.436001+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.544755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426139+0000","last_change":"2024-09-12T03:36:34.471135+0000","last_active":"2024-09-12T03:36:35.426139+0000","last_peered":"2024-09-12T03:36:35.426139+0000","last_clean":"2024-09-12T03:36:35.426139+0000","last_became_active":"2024-09-12T03:36:34.470613+0000","last_became_peered":"2024-09-12T03:36:34.470613+0000","last_unstale":"2024-09-12T03:36:35.426139+0000","last_undegraded":"2024-09-12T03:36:35.426139+0000","last_fullsized":"2024-09-12T03:36:35.426139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:19.474193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505436+0000","last_change":"2024-09-12T03:36:34.459291+0000","last_active":"2024-09-12T03:36:35.505436+0000","last_peered":"2024-09-12T03:36:35.505436+0000","last_clean":"2024-09-12T03:36:35.505436+0000","last_became_active":"2024-09-12T03:36:34.458591+0000","last_became_peered":"2024-09-12T03:36:34.458591+0000","last_unstale":"2024-09-12T03:36:35.505436+0000","last_undegraded":"2024-09-12T03:36:35.505436+0000","last_fullsized":"2024-09-12T03:36:35.505436+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:16.041230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504171+0000","last_change":"2024-09-12T03:36:34.458233+0000","last_active":"2024-09-12T03:36:35.504171+0000","last_peered":"2024-09-12T03:36:35.504171+0000","last_clean":"2024-09-12T03:36:35.504171+0000","last_became_active":"2024-09-12T03:36:34.457576+0000","last_became_peered":"2024-09-12T03:36:34.457576+0000","last_unstale":"2024-09-12T03:36:35.504171+0000","last_undegraded":"2024-09-12T03:36:35.504171+0000","last_fullsized":"2024-09-12T03:36:35.504171+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:27.239395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506547+0000","last_change":"2024-09-12T03:36:34.431584+0000","last_active":"2024-09-12T03:36:35.506547+0000","last_peered":"2024-09-12T03:36:35.506547+0000","last_clean":"2024-09-12T03:36:35.506547+0000","last_became_active":"2024-09-12T03:36:34.430819+0000","last_became_peered":"2024-09-12T03:36:34.430819+0000","last_unstale":"2024-09-12T03:36:35.506547+0000","last_undegraded":"2024-09-12T03:36:35.506547+0000","last_fullsized":"2024-09-12T03:36:35.506547+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:12.569954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427040+0000","last_change":"2024-09-12T03:36:34.471389+0000","last_active":"2024-09-12T03:36:35.427040+0000","last_peered":"2024-09-12T03:36:35.427040+0000","last_clean":"2024-09-12T03:36:35.427040+0000","last_became_active":"2024-09-12T03:36:34.470789+0000","last_became_peered":"2024-09-12T03:36:34.470789+0000","last_unstale":"2024-09-12T03:36:35.427040+0000","last_undegraded":"2024-09-12T03:36:35.427040+0000","last_fullsized":"2024-09-12T03:36:35.427040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:53.591504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426880+0000","last_change":"2024-09-12T03:36:34.460987+0000","last_active":"2024-09-12T03:36:35.426880+0000","last_peered":"2024-09-12T03:36:35.426880+0000","last_clean":"2024-09-12T03:36:35.426880+0000","last_became_active":"2024-09-12T03:36:34.455708+0000","last_became_peered":"2024-09-12T03:36:34.455708+0000","last_unstale":"2024-09-12T03:36:35.426880+0000","last_undegraded":"2024-09-12T03:36:35.426880+0000","last_fullsized":"2024-09-12T03:36:35.426880+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:19.469821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504442+0000","last_change":"2024-09-12T03:36:34.464115+0000","last_active":"2024-09-12T03:36:35.504442+0000","last_peered":"2024-09-12T03:36:35.504442+0000","last_clean":"2024-09-12T03:36:35.504442+0000","last_became_active":"2024-09-12T03:36:34.451939+0000","last_became_peered":"2024-09-12T03:36:34.451939+0000","last_unstale":"2024-09-12T03:36:35.504442+0000","last_undegraded":"2024-09-12T03:36:35.504442+0000","last_fullsized":"2024-09-12T03:36:35.504442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:32.791588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504693+0000","last_change":"2024-09-12T03:36:34.453208+0000","last_active":"2024-09-12T03:36:35.504693+0000","last_peered":"2024-09-12T03:36:35.504693+0000","last_clean":"2024-09-12T03:36:35.504693+0000","last_became_active":"2024-09-12T03:36:34.452551+0000","last_became_peered":"2024-09-12T03:36:34.452551+0000","last_unstale":"2024-09-12T03:36:35.504693+0000","last_undegraded":"2024-09-12T03:36:35.504693+0000","last_fullsized":"2024-09-12T03:36:35.504693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436209+0000","last_change":"2024-09-12T03:36:34.465477+0000","last_active":"2024-09-12T03:36:35.436209+0000","last_peered":"2024-09-12T03:36:35.436209+0000","last_clean":"2024-09-12T03:36:35.436209+0000","last_became_active":"2024-09-12T03:36:34.465239+0000","last_became_peered":"2024-09-12T03:36:34.465239+0000","last_unstale":"2024-09-12T03:36:35.436209+0000","last_undegraded":"2024-09-12T03:36:35.436209+0000","last_fullsized":"2024-09-12T03:36:35.436209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:40.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422109+0000","last_change":"2024-09-12T03:36:34.432773+0000","last_active":"2024-09-12T03:36:35.422109+0000","last_peered":"2024-09-12T03:36:35.422109+0000","last_clean":"2024-09-12T03:36:35.422109+0000","last_became_active":"2024-09-12T03:36:34.432471+0000","last_became_peered":"2024-09-12T03:36:34.432471+0000","last_unstale":"2024-09-12T03:36:35.422109+0000","last_undegraded":"2024-09-12T03:36:35.422109+0000","last_fullsized":"2024-09-12T03:36:35.422109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:38.943962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506870+0000","last_change":"2024-09-12T03:36:34.433578+0000","last_active":"2024-09-12T03:36:35.506870+0000","last_peered":"2024-09-12T03:36:35.506870+0000","last_clean":"2024-09-12T03:36:35.506870+0000","last_became_active":"2024-09-12T03:36:34.432859+0000","last_became_peered":"2024-09-12T03:36:34.432859+0000","last_unstale":"2024-09-12T03:36:35.506870+0000","last_undegraded":"2024-09-12T03:36:35.506870+0000","last_fullsized":"2024-09-12T03:36:35.506870+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:41.481427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503442+0000","last_change":"2024-09-12T03:36:34.430953+0000","last_active":"2024-09-12T03:36:35.503442+0000","last_peered":"2024-09-12T03:36:35.503442+0000","last_clean":"2024-09-12T03:36:35.503442+0000","last_became_active":"2024-09-12T03:36:34.430263+0000","last_became_peered":"2024-09-12T03:36:34.430263+0000","last_unstale":"2024-09-12T03:36:35.503442+0000","last_undegraded":"2024-09-12T03:36:35.503442+0000","last_fullsized":"2024-09-12T03:36:35.503442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:13.336540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426091+0000","last_change":"2024-09-12T03:36:34.415283+0000","last_active":"2024-09-12T03:36:35.426091+0000","last_peered":"2024-09-12T03:36:35.426091+0000","last_clean":"2024-09-12T03:36:35.426091+0000","last_became_active":"2024-09-12T03:36:34.414573+0000","last_became_peered":"2024-09-12T03:36:34.414573+0000","last_unstale":"2024-09-12T03:36:35.426091+0000","last_undegraded":"2024-09-12T03:36:35.426091+0000","last_fullsized":"2024-09-12T03:36:35.426091+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:16.041230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426986+0000","last_change":"2024-09-12T03:36:34.463950+0000","last_active":"2024-09-12T03:36:35.426986+0000","last_peered":"2024-09-12T03:36:35.426986+0000","last_clean":"2024-09-12T03:36:35.426986+0000","last_became_active":"2024-09-12T03:36:34.455562+0000","last_became_peered":"2024-09-12T03:36:34.455562+0000","last_unstale":"2024-09-12T03:36:35.426986+0000","last_undegraded":"2024-09-12T03:36:35.426986+0000","last_fullsized":"2024-09-12T03:36:35.426986+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:43.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425631+0000","last_change":"2024-09-12T03:36:34.459077+0000","last_active":"2024-09-12T03:36:35.425631+0000","last_peered":"2024-09-12T03:36:35.425631+0000","last_clean":"2024-09-12T03:36:35.425631+0000","last_became_active":"2024-09-12T03:36:34.458743+0000","last_became_peered":"2024-09-12T03:36:34.458743+0000","last_unstale":"2024-09-12T03:36:35.425631+0000","last_undegraded":"2024-09-12T03:36:35.425631+0000","last_fullsized":"2024-09-12T03:36:35.425631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425462+0000","last_change":"2024-09-12T03:36:34.459267+0000","last_active":"2024-09-12T03:36:35.425462+0000","last_peered":"2024-09-12T03:36:35.425462+0000","last_clean":"2024-09-12T03:36:35.425462+0000","last_became_active":"2024-09-12T03:36:34.458999+0000","last_became_peered":"2024-09-12T03:36:34.458999+0000","last_unstale":"2024-09-12T03:36:35.425462+0000","last_undegraded":"2024-09-12T03:36:35.425462+0000","last_fullsized":"2024-09-12T03:36:35.425462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:32.791588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504571+0000","last_change":"2024-09-12T03:36:34.453461+0000","last_active":"2024-09-12T03:36:35.504571+0000","last_peered":"2024-09-12T03:36:35.504571+0000","last_clean":"2024-09-12T03:36:35.504571+0000","last_became_active":"2024-09-12T03:36:34.452815+0000","last_became_peered":"2024-09-12T03:36:34.452815+0000","last_unstale":"2024-09-12T03:36:35.504571+0000","last_undegraded":"2024-09-12T03:36:35.504571+0000","last_fullsized":"2024-09-12T03:36:35.504571+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:40.734616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427923+0000","last_change":"2024-09-12T03:36:34.463604+0000","last_active":"2024-09-12T03:36:35.427923+0000","last_peered":"2024-09-12T03:36:35.427923+0000","last_clean":"2024-09-12T03:36:35.427923+0000","last_became_active":"2024-09-12T03:36:34.463206+0000","last_became_peered":"2024-09-12T03:36:34.463206+0000","last_unstale":"2024-09-12T03:36:35.427923+0000","last_undegraded":"2024-09-12T03:36:35.427923+0000","last_fullsized":"2024-09-12T03:36:35.427923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:32.791588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427139+0000","last_change":"2024-09-12T03:36:34.466379+0000","last_active":"2024-09-12T03:36:35.427139+0000","last_peered":"2024-09-12T03:36:35.427139+0000","last_clean":"2024-09-12T03:36:35.427139+0000","last_became_active":"2024-09-12T03:36:34.465764+0000","last_became_peered":"2024-09-12T03:36:34.465764+0000","last_unstale":"2024-09-12T03:36:35.427139+0000","last_undegraded":"2024-09-12T03:36:35.427139+0000","last_fullsized":"2024-09-12T03:36:35.427139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:45.367778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506726+0000","last_change":"2024-09-12T03:36:34.433299+0000","last_active":"2024-09-12T03:36:35.506726+0000","last_peered":"2024-09-12T03:36:35.506726+0000","last_clean":"2024-09-12T03:36:35.506726+0000","last_became_active":"2024-09-12T03:36:34.432584+0000","last_became_peered":"2024-09-12T03:36:34.432584+0000","last_unstale":"2024-09-12T03:36:35.506726+0000","last_undegraded":"2024-09-12T03:36:35.506726+0000","last_fullsized":"2024-09-12T03:36:35.506726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:28.736689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421334+0000","last_change":"2024-09-12T03:36:34.414473+0000","last_active":"2024-09-12T03:36:35.421334+0000","last_peered":"2024-09-12T03:36:35.421334+0000","last_clean":"2024-09-12T03:36:35.421334+0000","last_became_active":"2024-09-12T03:36:34.412915+0000","last_became_peered":"2024-09-12T03:36:34.412915+0000","last_unstale":"2024-09-12T03:36:35.421334+0000","last_undegraded":"2024-09-12T03:36:35.421334+0000","last_fullsized":"2024-09-12T03:36:35.421334+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:49.931411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504033+0000","last_change":"2024-09-12T03:36:34.464648+0000","last_active":"2024-09-12T03:36:35.504033+0000","last_peered":"2024-09-12T03:36:35.504033+0000","last_clean":"2024-09-12T03:36:35.504033+0000","last_became_active":"2024-09-12T03:36:34.458463+0000","last_became_peered":"2024-09-12T03:36:34.458463+0000","last_unstale":"2024-09-12T03:36:35.504033+0000","last_undegraded":"2024-09-12T03:36:35.504033+0000","last_fullsized":"2024-09-12T03:36:35.504033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:45.367778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426136+0000","last_change":"2024-09-12T03:36:34.460922+0000","last_active":"2024-09-12T03:36:35.426136+0000","last_peered":"2024-09-12T03:36:35.426136+0000","last_clean":"2024-09-12T03:36:35.426136+0000","last_became_active":"2024-09-12T03:36:34.455997+0000","last_became_peered":"2024-09-12T03:36:34.455997+0000","last_unstale":"2024-09-12T03:36:35.426136+0000","last_undegraded":"2024-09-12T03:36:35.426136+0000","last_fullsized":"2024-09-12T03:36:35.426136+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:38.975094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505752+0000","last_change":"2024-09-12T03:36:34.436645+0000","last_active":"2024-09-12T03:36:35.505752+0000","last_peered":"2024-09-12T03:36:35.505752+0000","last_clean":"2024-09-12T03:36:35.505752+0000","last_became_active":"2024-09-12T03:36:34.435918+0000","last_became_peered":"2024-09-12T03:36:34.435918+0000","last_unstale":"2024-09-12T03:36:35.505752+0000","last_undegraded":"2024-09-12T03:36:35.505752+0000","last_fullsized":"2024-09-12T03:36:35.505752+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:59.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502339+0000","last_change":"2024-09-12T03:36:34.424794+0000","last_active":"2024-09-12T03:36:35.502339+0000","last_peered":"2024-09-12T03:36:35.502339+0000","last_clean":"2024-09-12T03:36:35.502339+0000","last_became_active":"2024-09-12T03:36:34.424305+0000","last_became_peered":"2024-09-12T03:36:34.424305+0000","last_unstale":"2024-09-12T03:36:35.502339+0000","last_undegraded":"2024-09-12T03:36:35.502339+0000","last_fullsized":"2024-09-12T03:36:35.502339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:38.743608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503040+0000","last_change":"2024-09-12T03:36:34.425193+0000","last_active":"2024-09-12T03:36:35.503040+0000","last_peered":"2024-09-12T03:36:35.503040+0000","last_clean":"2024-09-12T03:36:35.503040+0000","last_became_active":"2024-09-12T03:36:34.424455+0000","last_became_peered":"2024-09-12T03:36:34.424455+0000","last_unstale":"2024-09-12T03:36:35.503040+0000","last_undegraded":"2024-09-12T03:36:35.503040+0000","last_fullsized":"2024-09-12T03:36:35.503040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:15.167843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422192+0000","last_change":"2024-09-12T03:36:33.430680+0000","last_active":"2024-09-12T03:36:35.422192+0000","last_peered":"2024-09-12T03:36:35.422192+0000","last_clean":"2024-09-12T03:36:35.422192+0000","last_became_active":"2024-09-12T03:36:33.430173+0000","last_became_peered":"2024-09-12T03:36:33.430173+0000","last_unstale":"2024-09-12T03:36:35.422192+0000","last_undegraded":"2024-09-12T03:36:35.422192+0000","last_fullsized":"2024-09-12T03:36:35.422192+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:27.727103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506865+0000","last_change":"2024-09-12T03:36:34.416219+0000","last_active":"2024-09-12T03:36:35.506865+0000","last_peered":"2024-09-12T03:36:35.506865+0000","last_clean":"2024-09-12T03:36:35.506865+0000","last_became_active":"2024-09-12T03:36:34.415408+0000","last_became_peered":"2024-09-12T03:36:34.415408+0000","last_unstale":"2024-09-12T03:36:35.506865+0000","last_undegraded":"2024-09-12T03:36:35.506865+0000","last_fullsized":"2024-09-12T03:36:35.506865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:01.823208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502263+0000","last_change":"2024-09-12T03:36:33.426212+0000","last_active":"2024-09-12T03:36:35.502263+0000","last_peered":"2024-09-12T03:36:35.502263+0000","last_clean":"2024-09-12T03:36:35.502263+0000","last_became_active":"2024-09-12T03:36:33.425771+0000","last_became_peered":"2024-09-12T03:36:33.425771+0000","last_unstale":"2024-09-12T03:36:35.502263+0000","last_undegraded":"2024-09-12T03:36:35.502263+0000","last_fullsized":"2024-09-12T03:36:35.502263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:39.047872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502277+0000","last_change":"2024-09-12T03:36:34.426973+0000","last_active":"2024-09-12T03:36:35.502277+0000","last_peered":"2024-09-12T03:36:35.502277+0000","last_clean":"2024-09-12T03:36:35.502277+0000","last_became_active":"2024-09-12T03:36:34.424246+0000","last_became_peered":"2024-09-12T03:36:34.424246+0000","last_unstale":"2024-09-12T03:36:35.502277+0000","last_undegraded":"2024-09-12T03:36:35.502277+0000","last_fullsized":"2024-09-12T03:36:35.502277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:08.547780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501964+0000","last_change":"2024-09-12T03:36:33.417749+0000","last_active":"2024-09-12T03:36:35.501964+0000","last_peered":"2024-09-12T03:36:35.501964+0000","last_clean":"2024-09-12T03:36:35.501964+0000","last_became_active":"2024-09-12T03:36:33.417326+0000","last_became_peered":"2024-09-12T03:36:33.417326+0000","last_unstale":"2024-09-12T03:36:35.501964+0000","last_undegraded":"2024-09-12T03:36:35.501964+0000","last_fullsized":"2024-09-12T03:36:35.501964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.097333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504918+0000","last_change":"2024-09-12T03:36:34.457867+0000","last_active":"2024-09-12T03:36:35.504918+0000","last_peered":"2024-09-12T03:36:35.504918+0000","last_clean":"2024-09-12T03:36:35.504918+0000","last_became_active":"2024-09-12T03:36:34.453217+0000","last_became_peered":"2024-09-12T03:36:34.453217+0000","last_unstale":"2024-09-12T03:36:35.504918+0000","last_undegraded":"2024-09-12T03:36:35.504918+0000","last_fullsized":"2024-09-12T03:36:35.504918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:01.244906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502206+0000","last_change":"2024-09-12T03:36:33.415881+0000","last_active":"2024-09-12T03:36:35.502206+0000","last_peered":"2024-09-12T03:36:35.502206+0000","last_clean":"2024-09-12T03:36:35.502206+0000","last_became_active":"2024-09-12T03:36:33.415348+0000","last_became_peered":"2024-09-12T03:36:33.415348+0000","last_unstale":"2024-09-12T03:36:35.502206+0000","last_undegraded":"2024-09-12T03:36:35.502206+0000","last_fullsized":"2024-09-12T03:36:35.502206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:28.390227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436063+0000","last_change":"2024-09-12T03:36:34.427828+0000","last_active":"2024-09-12T03:36:35.436063+0000","last_peered":"2024-09-12T03:36:35.436063+0000","last_clean":"2024-09-12T03:36:35.436063+0000","last_became_active":"2024-09-12T03:36:34.427537+0000","last_became_peered":"2024-09-12T03:36:34.427537+0000","last_unstale":"2024-09-12T03:36:35.436063+0000","last_undegraded":"2024-09-12T03:36:35.436063+0000","last_fullsized":"2024-09-12T03:36:35.436063+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:57.586272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425610+0000","last_change":"2024-09-12T03:36:33.404487+0000","last_active":"2024-09-12T03:36:35.425610+0000","last_peered":"2024-09-12T03:36:35.425610+0000","last_clean":"2024-09-12T03:36:35.425610+0000","last_became_active":"2024-09-12T03:36:33.403918+0000","last_became_peered":"2024-09-12T03:36:33.403918+0000","last_unstale":"2024-09-12T03:36:35.425610+0000","last_undegraded":"2024-09-12T03:36:35.425610+0000","last_fullsized":"2024-09-12T03:36:35.425610+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:45.178275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421309+0000","last_change":"2024-09-12T03:36:34.418937+0000","last_active":"2024-09-12T03:36:35.421309+0000","last_peered":"2024-09-12T03:36:35.421309+0000","last_clean":"2024-09-12T03:36:35.421309+0000","last_became_active":"2024-09-12T03:36:34.418185+0000","last_became_peered":"2024-09-12T03:36:34.418185+0000","last_unstale":"2024-09-12T03:36:35.421309+0000","last_undegraded":"2024-09-12T03:36:35.421309+0000","last_fullsized":"2024-09-12T03:36:35.421309+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:00.063330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425386+0000","last_change":"2024-09-12T03:36:33.394314+0000","last_active":"2024-09-12T03:36:35.425386+0000","last_peered":"2024-09-12T03:36:35.425386+0000","last_clean":"2024-09-12T03:36:35.425386+0000","last_became_active":"2024-09-12T03:36:33.393608+0000","last_became_peered":"2024-09-12T03:36:33.393608+0000","last_unstale":"2024-09-12T03:36:35.425386+0000","last_undegraded":"2024-09-12T03:36:35.425386+0000","last_fullsized":"2024-09-12T03:36:35.425386+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:21.687183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502513+0000","last_change":"2024-09-12T03:36:34.422629+0000","last_active":"2024-09-12T03:36:35.502513+0000","last_peered":"2024-09-12T03:36:35.502513+0000","last_clean":"2024-09-12T03:36:35.502513+0000","last_became_active":"2024-09-12T03:36:34.421821+0000","last_became_peered":"2024-09-12T03:36:34.421821+0000","last_unstale":"2024-09-12T03:36:35.502513+0000","last_undegraded":"2024-09-12T03:36:35.502513+0000","last_fullsized":"2024-09-12T03:36:35.502513+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:50.766660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425236+0000","last_change":"2024-09-12T03:36:33.409220+0000","last_active":"2024-09-12T03:36:35.425236+0000","last_peered":"2024-09-12T03:36:35.425236+0000","last_clean":"2024-09-12T03:36:35.425236+0000","last_became_active":"2024-09-12T03:36:33.408511+0000","last_became_peered":"2024-09-12T03:36:33.408511+0000","last_unstale":"2024-09-12T03:36:35.425236+0000","last_undegraded":"2024-09-12T03:36:35.425236+0000","last_fullsized":"2024-09-12T03:36:35.425236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:18.464608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425858+0000","last_change":"2024-09-12T03:36:34.430098+0000","last_active":"2024-09-12T03:36:35.425858+0000","last_peered":"2024-09-12T03:36:35.425858+0000","last_clean":"2024-09-12T03:36:35.425858+0000","last_became_active":"2024-09-12T03:36:34.429746+0000","last_became_peered":"2024-09-12T03:36:34.429746+0000","last_unstale":"2024-09-12T03:36:35.425858+0000","last_undegraded":"2024-09-12T03:36:35.425858+0000","last_fullsized":"2024-09-12T03:36:35.425858+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:01.244906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502275+0000","last_change":"2024-09-12T03:36:33.424986+0000","last_active":"2024-09-12T03:36:35.502275+0000","last_peered":"2024-09-12T03:36:35.502275+0000","last_clean":"2024-09-12T03:36:35.502275+0000","last_became_active":"2024-09-12T03:36:33.424292+0000","last_became_peered":"2024-09-12T03:36:33.424292+0000","last_unstale":"2024-09-12T03:36:35.502275+0000","last_undegraded":"2024-09-12T03:36:35.502275+0000","last_fullsized":"2024-09-12T03:36:35.502275+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:31.276349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421195+0000","last_change":"2024-09-12T03:36:34.422382+0000","last_active":"2024-09-12T03:36:35.421195+0000","last_peered":"2024-09-12T03:36:35.421195+0000","last_clean":"2024-09-12T03:36:35.421195+0000","last_became_active":"2024-09-12T03:36:34.422029+0000","last_became_peered":"2024-09-12T03:36:34.422029+0000","last_unstale":"2024-09-12T03:36:35.421195+0000","last_undegraded":"2024-09-12T03:36:35.421195+0000","last_fullsized":"2024-09-12T03:36:35.421195+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:52.355222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505730+0000","last_change":"2024-09-12T03:36:33.430686+0000","last_active":"2024-09-12T03:36:35.505730+0000","last_peered":"2024-09-12T03:36:35.505730+0000","last_clean":"2024-09-12T03:36:35.505730+0000","last_became_active":"2024-09-12T03:36:33.429936+0000","last_became_peered":"2024-09-12T03:36:33.429936+0000","last_unstale":"2024-09-12T03:36:35.505730+0000","last_undegraded":"2024-09-12T03:36:35.505730+0000","last_fullsized":"2024-09-12T03:36:35.505730+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:48.921825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425555+0000","last_change":"2024-09-12T03:36:34.447414+0000","last_active":"2024-09-12T03:36:35.425555+0000","last_peered":"2024-09-12T03:36:35.425555+0000","last_clean":"2024-09-12T03:36:35.425555+0000","last_became_active":"2024-09-12T03:36:34.447188+0000","last_became_peered":"2024-09-12T03:36:34.447188+0000","last_unstale":"2024-09-12T03:36:35.425555+0000","last_undegraded":"2024-09-12T03:36:35.425555+0000","last_fullsized":"2024-09-12T03:36:35.425555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:40.734616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.507004+0000","last_change":"2024-09-12T03:36:33.403132+0000","last_active":"2024-09-12T03:36:35.507004+0000","last_peered":"2024-09-12T03:36:35.507004+0000","last_clean":"2024-09-12T03:36:35.507004+0000","last_became_active":"2024-09-12T03:36:33.402328+0000","last_became_peered":"2024-09-12T03:36:33.402328+0000","last_unstale":"2024-09-12T03:36:35.507004+0000","last_undegraded":"2024-09-12T03:36:35.507004+0000","last_fullsized":"2024-09-12T03:36:35.507004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:57.760244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503131+0000","last_change":"2024-09-12T03:36:34.468055+0000","last_active":"2024-09-12T03:36:35.503131+0000","last_peered":"2024-09-12T03:36:35.503131+0000","last_clean":"2024-09-12T03:36:35.503131+0000","last_became_active":"2024-09-12T03:36:34.467444+0000","last_became_peered":"2024-09-12T03:36:34.467444+0000","last_unstale":"2024-09-12T03:36:35.503131+0000","last_undegraded":"2024-09-12T03:36:35.503131+0000","last_fullsized":"2024-09-12T03:36:35.503131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:12.580444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503721+0000","last_change":"2024-09-12T03:36:33.429706+0000","last_active":"2024-09-12T03:36:35.503721+0000","last_peered":"2024-09-12T03:36:35.503721+0000","last_clean":"2024-09-12T03:36:35.503721+0000","last_became_active":"2024-09-12T03:36:33.428953+0000","last_became_peered":"2024-09-12T03:36:33.428953+0000","last_unstale":"2024-09-12T03:36:35.503721+0000","last_undegraded":"2024-09-12T03:36:35.503721+0000","last_fullsized":"2024-09-12T03:36:35.503721+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:59.053745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506921+0000","last_change":"2024-09-12T03:36:34.422498+0000","last_active":"2024-09-12T03:36:35.506921+0000","last_peered":"2024-09-12T03:36:35.506921+0000","last_clean":"2024-09-12T03:36:35.506921+0000","last_became_active":"2024-09-12T03:36:34.421750+0000","last_became_peered":"2024-09-12T03:36:34.421750+0000","last_unstale":"2024-09-12T03:36:35.506921+0000","last_undegraded":"2024-09-12T03:36:35.506921+0000","last_fullsized":"2024-09-12T03:36:35.506921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.765020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421325+0000","last_change":"2024-09-12T03:36:33.409871+0000","last_active":"2024-09-12T03:36:35.421325+0000","last_peered":"2024-09-12T03:36:35.421325+0000","last_clean":"2024-09-12T03:36:35.421325+0000","last_became_active":"2024-09-12T03:36:33.408066+0000","last_became_peered":"2024-09-12T03:36:33.408066+0000","last_unstale":"2024-09-12T03:36:35.421325+0000","last_undegraded":"2024-09-12T03:36:35.421325+0000","last_fullsized":"2024-09-12T03:36:35.421325+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:11.560369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505635+0000","last_change":"2024-09-12T03:36:34.460216+0000","last_active":"2024-09-12T03:36:35.505635+0000","last_peered":"2024-09-12T03:36:35.505635+0000","last_clean":"2024-09-12T03:36:35.505635+0000","last_became_active":"2024-09-12T03:36:34.459370+0000","last_became_peered":"2024-09-12T03:36:34.459370+0000","last_unstale":"2024-09-12T03:36:35.505635+0000","last_undegraded":"2024-09-12T03:36:35.505635+0000","last_fullsized":"2024-09-12T03:36:35.505635+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.926260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504213+0000","last_change":"2024-09-12T03:36:33.432799+0000","last_active":"2024-09-12T03:36:35.504213+0000","last_peered":"2024-09-12T03:36:35.504213+0000","last_clean":"2024-09-12T03:36:35.504213+0000","last_became_active":"2024-09-12T03:36:33.432127+0000","last_became_peered":"2024-09-12T03:36:33.432127+0000","last_unstale":"2024-09-12T03:36:35.504213+0000","last_undegraded":"2024-09-12T03:36:35.504213+0000","last_fullsized":"2024-09-12T03:36:35.504213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:05.402247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426581+0000","last_change":"2024-09-12T03:36:34.461593+0000","last_active":"2024-09-12T03:36:35.426581+0000","last_peered":"2024-09-12T03:36:35.426581+0000","last_clean":"2024-09-12T03:36:35.426581+0000","last_became_active":"2024-09-12T03:36:34.446803+0000","last_became_peered":"2024-09-12T03:36:34.446803+0000","last_unstale":"2024-09-12T03:36:35.426581+0000","last_undegraded":"2024-09-12T03:36:35.426581+0000","last_fullsized":"2024-09-12T03:36:35.426581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.035114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426228+0000","last_change":"2024-09-12T03:36:33.410918+0000","last_active":"2024-09-12T03:36:35.426228+0000","last_peered":"2024-09-12T03:36:35.426228+0000","last_clean":"2024-09-12T03:36:35.426228+0000","last_became_active":"2024-09-12T03:36:33.409681+0000","last_became_peered":"2024-09-12T03:36:33.409681+0000","last_unstale":"2024-09-12T03:36:35.426228+0000","last_undegraded":"2024-09-12T03:36:35.426228+0000","last_fullsized":"2024-09-12T03:36:35.426228+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:33.336026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502597+0000","last_change":"2024-09-12T03:36:34.424336+0000","last_active":"2024-09-12T03:36:35.502597+0000","last_peered":"2024-09-12T03:36:35.502597+0000","last_clean":"2024-09-12T03:36:35.502597+0000","last_became_active":"2024-09-12T03:36:34.423596+0000","last_became_peered":"2024-09-12T03:36:34.423596+0000","last_unstale":"2024-09-12T03:36:35.502597+0000","last_undegraded":"2024-09-12T03:36:35.502597+0000","last_fullsized":"2024-09-12T03:36:35.502597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:06.748555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504451+0000","last_change":"2024-09-12T03:36:33.431606+0000","last_active":"2024-09-12T03:36:35.504451+0000","last_peered":"2024-09-12T03:36:35.504451+0000","last_clean":"2024-09-12T03:36:35.504451+0000","last_became_active":"2024-09-12T03:36:33.430929+0000","last_became_peered":"2024-09-12T03:36:33.430929+0000","last_unstale":"2024-09-12T03:36:35.504451+0000","last_undegraded":"2024-09-12T03:36:35.504451+0000","last_fullsized":"2024-09-12T03:36:35.504451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:13.744771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422150+0000","last_change":"2024-09-12T03:36:34.458660+0000","last_active":"2024-09-12T03:36:35.422150+0000","last_peered":"2024-09-12T03:36:35.422150+0000","last_clean":"2024-09-12T03:36:35.422150+0000","last_became_active":"2024-09-12T03:36:34.458321+0000","last_became_peered":"2024-09-12T03:36:34.458321+0000","last_unstale":"2024-09-12T03:36:35.422150+0000","last_undegraded":"2024-09-12T03:36:35.422150+0000","last_fullsized":"2024-09-12T03:36:35.422150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:14.754357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"63'8","reported_seq":22,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505389+0000","last_change":"2024-09-12T03:36:33.427316+0000","last_active":"2024-09-12T03:36:35.505389+0000","last_peered":"2024-09-12T03:36:35.505389+0000","last_clean":"2024-09-12T03:36:35.505389+0000","last_became_active":"2024-09-12T03:36:33.426595+0000","last_became_peered":"2024-09-12T03:36:33.426595+0000","last_unstale":"2024-09-12T03:36:35.505389+0000","last_undegraded":"2024-09-12T03:36:35.505389+0000","last_fullsized":"2024-09-12T03:36:35.505389+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:21.372816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503989+0000","last_change":"2024-09-12T03:36:34.458695+0000","last_active":"2024-09-12T03:36:35.503989+0000","last_peered":"2024-09-12T03:36:35.503989+0000","last_clean":"2024-09-12T03:36:35.503989+0000","last_became_active":"2024-09-12T03:36:34.458005+0000","last_became_peered":"2024-09-12T03:36:34.458005+0000","last_unstale":"2024-09-12T03:36:35.503989+0000","last_undegraded":"2024-09-12T03:36:35.503989+0000","last_fullsized":"2024-09-12T03:36:35.503989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:53.591504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427590+0000","last_change":"2024-09-12T03:36:33.407126+0000","last_active":"2024-09-12T03:36:35.427590+0000","last_peered":"2024-09-12T03:36:35.427590+0000","last_clean":"2024-09-12T03:36:35.427590+0000","last_became_active":"2024-09-12T03:36:33.406432+0000","last_became_peered":"2024-09-12T03:36:33.406432+0000","last_unstale":"2024-09-12T03:36:35.427590+0000","last_undegraded":"2024-09-12T03:36:35.427590+0000","last_fullsized":"2024-09-12T03:36:35.427590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.554417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503037+0000","last_change":"2024-09-12T03:36:34.436468+0000","last_active":"2024-09-12T03:36:35.503037+0000","last_peered":"2024-09-12T03:36:35.503037+0000","last_clean":"2024-09-12T03:36:35.503037+0000","last_became_active":"2024-09-12T03:36:34.433336+0000","last_became_peered":"2024-09-12T03:36:34.433336+0000","last_unstale":"2024-09-12T03:36:35.503037+0000","last_undegraded":"2024-09-12T03:36:35.503037+0000","last_fullsized":"2024-09-12T03:36:35.503037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:50.198807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504629+0000","last_change":"2024-09-12T03:36:33.436571+0000","last_active":"2024-09-12T03:36:35.504629+0000","last_peered":"2024-09-12T03:36:35.504629+0000","last_clean":"2024-09-12T03:36:35.504629+0000","last_became_active":"2024-09-12T03:36:33.435874+0000","last_became_peered":"2024-09-12T03:36:33.435874+0000","last_unstale":"2024-09-12T03:36:35.504629+0000","last_undegraded":"2024-09-12T03:36:35.504629+0000","last_fullsized":"2024-09-12T03:36:35.504629+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.910029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506938+0000","last_change":"2024-09-12T03:36:34.434650+0000","last_active":"2024-09-12T03:36:35.506938+0000","last_peered":"2024-09-12T03:36:35.506938+0000","last_clean":"2024-09-12T03:36:35.506938+0000","last_became_active":"2024-09-12T03:36:34.433928+0000","last_became_peered":"2024-09-12T03:36:34.433928+0000","last_unstale":"2024-09-12T03:36:35.506938+0000","last_undegraded":"2024-09-12T03:36:35.506938+0000","last_fullsized":"2024-09-12T03:36:35.506938+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:08.676504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504097+0000","last_change":"2024-09-12T03:36:33.430494+0000","last_active":"2024-09-12T03:36:35.504097+0000","last_peered":"2024-09-12T03:36:35.504097+0000","last_clean":"2024-09-12T03:36:35.504097+0000","last_became_active":"2024-09-12T03:36:33.428978+0000","last_became_peered":"2024-09-12T03:36:33.428978+0000","last_unstale":"2024-09-12T03:36:35.504097+0000","last_undegraded":"2024-09-12T03:36:35.504097+0000","last_fullsized":"2024-09-12T03:36:35.504097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:48.344812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503033+0000","last_change":"2024-09-12T03:36:34.417956+0000","last_active":"2024-09-12T03:36:35.503033+0000","last_peered":"2024-09-12T03:36:35.503033+0000","last_clean":"2024-09-12T03:36:35.503033+0000","last_became_active":"2024-09-12T03:36:34.416639+0000","last_became_peered":"2024-09-12T03:36:34.416639+0000","last_unstale":"2024-09-12T03:36:35.503033+0000","last_undegraded":"2024-09-12T03:36:35.503033+0000","last_fullsized":"2024-09-12T03:36:35.503033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:06.603286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426157+0000","last_change":"2024-09-12T03:36:33.400604+0000","last_active":"2024-09-12T03:36:35.426157+0000","last_peered":"2024-09-12T03:36:35.426157+0000","last_clean":"2024-09-12T03:36:35.426157+0000","last_became_active":"2024-09-12T03:36:33.399826+0000","last_became_peered":"2024-09-12T03:36:33.399826+0000","last_unstale":"2024-09-12T03:36:35.426157+0000","last_undegraded":"2024-09-12T03:36:35.426157+0000","last_fullsized":"2024-09-12T03:36:35.426157+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:47.025529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501805+0000","last_change":"2024-09-12T03:36:34.423982+0000","last_active":"2024-09-12T03:36:35.501805+0000","last_peered":"2024-09-12T03:36:35.501805+0000","last_clean":"2024-09-12T03:36:35.501805+0000","last_became_active":"2024-09-12T03:36:34.423407+0000","last_became_peered":"2024-09-12T03:36:34.423407+0000","last_unstale":"2024-09-12T03:36:35.501805+0000","last_undegraded":"2024-09-12T03:36:35.501805+0000","last_fullsized":"2024-09-12T03:36:35.501805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.314364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501717+0000","last_change":"2024-09-12T03:36:33.419981+0000","last_active":"2024-09-12T03:36:35.501717+0000","last_peered":"2024-09-12T03:36:35.501717+0000","last_clean":"2024-09-12T03:36:35.501717+0000","last_became_active":"2024-09-12T03:36:33.419512+0000","last_became_peered":"2024-09-12T03:36:33.419512+0000","last_unstale":"2024-09-12T03:36:35.501717+0000","last_undegraded":"2024-09-12T03:36:35.501717+0000","last_fullsized":"2024-09-12T03:36:35.501717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.891702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426194+0000","last_change":"2024-09-12T03:36:34.460869+0000","last_active":"2024-09-12T03:36:35.426194+0000","last_peered":"2024-09-12T03:36:35.426194+0000","last_clean":"2024-09-12T03:36:35.426194+0000","last_became_active":"2024-09-12T03:36:34.445978+0000","last_became_peered":"2024-09-12T03:36:34.445978+0000","last_unstale":"2024-09-12T03:36:35.426194+0000","last_undegraded":"2024-09-12T03:36:35.426194+0000","last_fullsized":"2024-09-12T03:36:35.426194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:46.187860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426470+0000","last_change":"2024-09-12T03:36:33.410364+0000","last_active":"2024-09-12T03:36:35.426470+0000","last_peered":"2024-09-12T03:36:35.426470+0000","last_clean":"2024-09-12T03:36:35.426470+0000","last_became_active":"2024-09-12T03:36:33.408751+0000","last_became_peered":"2024-09-12T03:36:33.408751+0000","last_unstale":"2024-09-12T03:36:35.426470+0000","last_undegraded":"2024-09-12T03:36:35.426470+0000","last_fullsized":"2024-09-12T03:36:35.426470+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:46.320490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503127+0000","last_change":"2024-09-12T03:36:34.420143+0000","last_active":"2024-09-12T03:36:35.503127+0000","last_peered":"2024-09-12T03:36:35.503127+0000","last_clean":"2024-09-12T03:36:35.503127+0000","last_became_active":"2024-09-12T03:36:34.419222+0000","last_became_peered":"2024-09-12T03:36:34.419222+0000","last_unstale":"2024-09-12T03:36:35.503127+0000","last_undegraded":"2024-09-12T03:36:35.503127+0000","last_fullsized":"2024-09-12T03:36:35.503127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:20.623310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501583+0000","last_change":"2024-09-12T03:36:33.427179+0000","last_active":"2024-09-12T03:36:35.501583+0000","last_peered":"2024-09-12T03:36:35.501583+0000","last_clean":"2024-09-12T03:36:35.501583+0000","last_became_active":"2024-09-12T03:36:33.426240+0000","last_became_peered":"2024-09-12T03:36:33.426240+0000","last_unstale":"2024-09-12T03:36:35.501583+0000","last_undegraded":"2024-09-12T03:36:35.501583+0000","last_fullsized":"2024-09-12T03:36:35.501583+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:05.593351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501804+0000","last_change":"2024-09-12T03:36:34.432798+0000","last_active":"2024-09-12T03:36:35.501804+0000","last_peered":"2024-09-12T03:36:35.501804+0000","last_clean":"2024-09-12T03:36:35.501804+0000","last_became_active":"2024-09-12T03:36:34.432577+0000","last_became_peered":"2024-09-12T03:36:34.432577+0000","last_unstale":"2024-09-12T03:36:35.501804+0000","last_undegraded":"2024-09-12T03:36:35.501804+0000","last_fullsized":"2024-09-12T03:36:35.501804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:21.914671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.428076+0000","last_change":"2024-09-12T03:36:33.424815+0000","last_active":"2024-09-12T03:36:35.428076+0000","last_peered":"2024-09-12T03:36:35.428076+0000","last_clean":"2024-09-12T03:36:35.428076+0000","last_became_active":"2024-09-12T03:36:33.423619+0000","last_became_peered":"2024-09-12T03:36:33.423619+0000","last_unstale":"2024-09-12T03:36:35.428076+0000","last_undegraded":"2024-09-12T03:36:35.428076+0000","last_fullsized":"2024-09-12T03:36:35.428076+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:19.228074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436419+0000","last_change":"2024-09-12T03:36:34.426859+0000","last_active":"2024-09-12T03:36:35.436419+0000","last_peered":"2024-09-12T03:36:35.436419+0000","last_clean":"2024-09-12T03:36:35.436419+0000","last_became_active":"2024-09-12T03:36:34.425120+0000","last_became_peered":"2024-09-12T03:36:34.425120+0000","last_unstale":"2024-09-12T03:36:35.436419+0000","last_undegraded":"2024-09-12T03:36:35.436419+0000","last_fullsized":"2024-09-12T03:36:35.436419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:10.365339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"64'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427727+0000","last_change":"2024-09-12T03:36:33.402123+0000","last_active":"2024-09-12T03:36:35.427727+0000","last_peered":"2024-09-12T03:36:35.427727+0000","last_clean":"2024-09-12T03:36:35.427727+0000","last_became_active":"2024-09-12T03:36:33.401392+0000","last_became_peered":"2024-09-12T03:36:33.401392+0000","last_unstale":"2024-09-12T03:36:35.427727+0000","last_undegraded":"2024-09-12T03:36:35.427727+0000","last_fullsized":"2024-09-12T03:36:35.427727+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.934377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427662+0000","last_change":"2024-09-12T03:36:34.470280+0000","last_active":"2024-09-12T03:36:35.427662+0000","last_peered":"2024-09-12T03:36:35.427662+0000","last_clean":"2024-09-12T03:36:35.427662+0000","last_became_active":"2024-09-12T03:36:34.469662+0000","last_became_peered":"2024-09-12T03:36:34.469662+0000","last_unstale":"2024-09-12T03:36:35.427662+0000","last_undegraded":"2024-09-12T03:36:35.427662+0000","last_fullsized":"2024-09-12T03:36:35.427662+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:27.239395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502130+0000","last_change":"2024-09-12T03:36:33.417423+0000","last_active":"2024-09-12T03:36:35.502130+0000","last_peered":"2024-09-12T03:36:35.502130+0000","last_clean":"2024-09-12T03:36:35.502130+0000","last_became_active":"2024-09-12T03:36:33.417134+0000","last_became_peered":"2024-09-12T03:36:33.417134+0000","last_unstale":"2024-09-12T03:36:35.502130+0000","last_undegraded":"2024-09-12T03:36:35.502130+0000","last_fullsized":"2024-09-12T03:36:35.502130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:43.675137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503401+0000","last_change":"2024-09-12T03:36:34.417391+0000","last_active":"2024-09-12T03:36:35.503401+0000","last_peered":"2024-09-12T03:36:35.503401+0000","last_clean":"2024-09-12T03:36:35.503401+0000","last_became_active":"2024-09-12T03:36:34.415727+0000","last_became_peered":"2024-09-12T03:36:34.415727+0000","last_unstale":"2024-09-12T03:36:35.503401+0000","last_undegraded":"2024-09-12T03:36:35.503401+0000","last_fullsized":"2024-09-12T03:36:35.503401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:48.626206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421466+0000","last_change":"2024-09-12T03:36:33.408744+0000","last_active":"2024-09-12T03:36:35.421466+0000","last_peered":"2024-09-12T03:36:35.421466+0000","last_clean":"2024-09-12T03:36:35.421466+0000","last_became_active":"2024-09-12T03:36:33.406179+0000","last_became_peered":"2024-09-12T03:36:33.406179+0000","last_unstale":"2024-09-12T03:36:35.421466+0000","last_undegraded":"2024-09-12T03:36:35.421466+0000","last_fullsized":"2024-09-12T03:36:35.421466+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:16.063644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502795+0000","last_change":"2024-09-12T03:36:34.426947+0000","last_active":"2024-09-12T03:36:35.502795+0000","last_peered":"2024-09-12T03:36:35.502795+0000","last_clean":"2024-09-12T03:36:35.502795+0000","last_became_active":"2024-09-12T03:36:34.426228+0000","last_became_peered":"2024-09-12T03:36:34.426228+0000","last_unstale":"2024-09-12T03:36:35.502795+0000","last_undegraded":"2024-09-12T03:36:35.502795+0000","last_fullsized":"2024-09-12T03:36:35.502795+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.421639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504426+0000","last_change":"2024-09-12T03:36:33.427336+0000","last_active":"2024-09-12T03:36:35.504426+0000","last_peered":"2024-09-12T03:36:35.504426+0000","last_clean":"2024-09-12T03:36:35.504426+0000","last_became_active":"2024-09-12T03:36:33.426491+0000","last_became_peered":"2024-09-12T03:36:33.426491+0000","last_unstale":"2024-09-12T03:36:35.504426+0000","last_undegraded":"2024-09-12T03:36:35.504426+0000","last_fullsized":"2024-09-12T03:36:35.504426+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.934377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505821+0000","last_change":"2024-09-12T03:36:34.460225+0000","last_active":"2024-09-12T03:36:35.505821+0000","last_peered":"2024-09-12T03:36:35.505821+0000","last_clean":"2024-09-12T03:36:35.505821+0000","last_became_active":"2024-09-12T03:36:34.459510+0000","last_became_peered":"2024-09-12T03:36:34.459510+0000","last_unstale":"2024-09-12T03:36:35.505821+0000","last_undegraded":"2024-09-12T03:36:35.505821+0000","last_fullsized":"2024-09-12T03:36:35.505821+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:17.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425699+0000","last_change":"2024-09-12T03:36:33.395637+0000","last_active":"2024-09-12T03:36:35.425699+0000","last_peered":"2024-09-12T03:36:35.425699+0000","last_clean":"2024-09-12T03:36:35.425699+0000","last_became_active":"2024-09-12T03:36:33.394965+0000","last_became_peered":"2024-09-12T03:36:33.394965+0000","last_unstale":"2024-09-12T03:36:35.425699+0000","last_undegraded":"2024-09-12T03:36:35.425699+0000","last_fullsized":"2024-09-12T03:36:35.425699+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:37.965509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421224+0000","last_change":"2024-09-12T03:36:34.417049+0000","last_active":"2024-09-12T03:36:35.421224+0000","last_peered":"2024-09-12T03:36:35.421224+0000","last_clean":"2024-09-12T03:36:35.421224+0000","last_became_active":"2024-09-12T03:36:34.416270+0000","last_became_peered":"2024-09-12T03:36:34.416270+0000","last_unstale":"2024-09-12T03:36:35.421224+0000","last_undegraded":"2024-09-12T03:36:35.421224+0000","last_fullsized":"2024-09-12T03:36:35.421224+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:00.919614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425339+0000","last_change":"2024-09-12T03:36:33.408323+0000","last_active":"2024-09-12T03:36:35.425339+0000","last_peered":"2024-09-12T03:36:35.425339+0000","last_clean":"2024-09-12T03:36:35.425339+0000","last_became_active":"2024-09-12T03:36:33.408013+0000","last_became_peered":"2024-09-12T03:36:33.408013+0000","last_unstale":"2024-09-12T03:36:35.425339+0000","last_undegraded":"2024-09-12T03:36:35.425339+0000","last_fullsized":"2024-09-12T03:36:35.425339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:55.377257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.435790+0000","last_change":"2024-09-12T03:36:34.455232+0000","last_active":"2024-09-12T03:36:35.435790+0000","last_peered":"2024-09-12T03:36:35.435790+0000","last_clean":"2024-09-12T03:36:35.435790+0000","last_became_active":"2024-09-12T03:36:34.454955+0000","last_became_peered":"2024-09-12T03:36:34.454955+0000","last_unstale":"2024-09-12T03:36:35.435790+0000","last_undegraded":"2024-09-12T03:36:35.435790+0000","last_fullsized":"2024-09-12T03:36:35.435790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:37.289885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.420833+0000","last_change":"2024-09-12T03:36:33.421985+0000","last_active":"2024-09-12T03:36:35.420833+0000","last_peered":"2024-09-12T03:36:35.420833+0000","last_clean":"2024-09-12T03:36:35.420833+0000","last_became_active":"2024-09-12T03:36:33.421494+0000","last_became_peered":"2024-09-12T03:36:33.421494+0000","last_unstale":"2024-09-12T03:36:35.420833+0000","last_undegraded":"2024-09-12T03:36:35.420833+0000","last_fullsized":"2024-09-12T03:36:35.420833+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:58.258241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503957+0000","last_change":"2024-09-12T03:36:34.425092+0000","last_active":"2024-09-12T03:36:35.503957+0000","last_peered":"2024-09-12T03:36:35.503957+0000","last_clean":"2024-09-12T03:36:35.503957+0000","last_became_active":"2024-09-12T03:36:34.424390+0000","last_became_peered":"2024-09-12T03:36:34.424390+0000","last_unstale":"2024-09-12T03:36:35.503957+0000","last_undegraded":"2024-09-12T03:36:35.503957+0000","last_fullsized":"2024-09-12T03:36:35.503957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.579899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425181+0000","last_change":"2024-09-12T03:36:33.413325+0000","last_active":"2024-09-12T03:36:35.425181+0000","last_peered":"2024-09-12T03:36:35.425181+0000","last_clean":"2024-09-12T03:36:35.425181+0000","last_became_active":"2024-09-12T03:36:33.413014+0000","last_became_peered":"2024-09-12T03:36:33.413014+0000","last_unstale":"2024-09-12T03:36:35.425181+0000","last_undegraded":"2024-09-12T03:36:35.425181+0000","last_fullsized":"2024-09-12T03:36:35.425181+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:19.078571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":246,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503979+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:35.503979+0000","last_peered":"2024-09-12T03:36:35.503979+0000","last_clean":"2024-09-12T03:36:35.503979+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:35.503979+0000","last_undegraded":"2024-09-12T03:36:35.503979+0000","last_fullsized":"2024-09-12T03:36:35.503979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1376256,"data_stored":936814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":345692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":347282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":345670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":345670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":348046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":345704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":929346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:42.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:36:43.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f918973b640 1 Processor -- start 2024-09-12T03:36:43.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f918973b640 1 -- start start 2024-09-12T03:36:43.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f918973b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 0x7f9184165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f918973b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91840aede0 con 0x7f9184070020 2024-09-12T03:36:43.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f918973b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f918415fa10 con 0x7f91841520a0 2024-09-12T03:36:43.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f918973b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9184152480 con 0x7f918415f3a0 2024-09-12T03:36:43.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f91827fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9184070020 0x7f918415ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57384/0 (socket says 172.21.15.73:57384) 2024-09-12T03:36:43.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f91827fc640 1 -- 172.21.15.73:0/642356602 learned_addr learned my addr 172.21.15.73:0/642356602 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.050+0000 7f91837fe640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 0x7f9184165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392675931 0 0) 0x7f91840aede0 con 0x7f9184070020 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9170003530 con 0x7f9184070020 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044648285 0 0) 0x7f9170003530 con 0x7f9184070020 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 msgr2=0x7f9184165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 0x7f9184165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 >> v1:172.21.15.150:6789/0 conn(0x7f91841520a0 legacy=0x7f918406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9184074250 con 0x7f9184070020 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f916c001a00 con 0x7f9184070020 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 >> v1:172.21.15.73:6789/0 conn(0x7f9184070020 legacy=0x7f918415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91700039f0 0x7f9170003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9170004810 0x7f9170004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 0x7f91700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f917000ba80 con 0x7f91700039f0 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f917000bc30 con 0x7f9170004810 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f917000be30 con 0x7f918415f3a0 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9182ffd640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91700039f0 0x7f9170003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f91827fc640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9170004810 0x7f9170004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f91837fe640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 0x7f91700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9182ffd640 1 -- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 msgr2=0x7f91700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9182ffd640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f918415f3a0 0x7f91700051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9182ffd640 1 -- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9170004810 msgr2=0x7f9170004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9182ffd640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9170004810 0x7f9170004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9182ffd640 1 -- 172.21.15.73:0/642356602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9170003530 con 0x7f91700039f0 2024-09-12T03:36:43.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9182ffd640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91700039f0 0x7f9170003e10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9174001750 tx=0x7f917401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1800d9255f9adc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91740013a0 con 0x7f91700039f0 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91740052f0 con 0x7f91700039f0 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f9181ffb640 1 -- 172.21.15.73:0/642356602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174003840 con 0x7f91700039f0 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f918973b640 1 -- 172.21.15.73:0/642356602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91700039f0 msgr2=0x7f9170003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f918973b640 1 --2- 172.21.15.73:0/642356602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91700039f0 0x7f9170003e10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9174001750 tx=0x7f917401c3c0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f91837fe640 1 -- 172.21.15.73:0/642356602 reap_dead start 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f918973b640 1 -- 172.21.15.73:0/642356602 shutdown_connections 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f918973b640 1 -- 172.21.15.73:0/642356602 >> 172.21.15.73:0/642356602 conn(0x7f91840b1f90 msgr2=0x7f91840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.054+0000 7f918973b640 1 -- 172.21.15.73:0/642356602 shutdown_connections 2024-09-12T03:36:43.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- 172.21.15.73:0/642356602 wait complete. 2024-09-12T03:36:43.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 Processor -- start 2024-09-12T03:36:43.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- start start 2024-09-12T03:36:43.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91700039f0 0x7f91840999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918414f180 0x7f918415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91840afe00 0x7f918414d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9184166710 con 0x7f918414f180 2024-09-12T03:36:43.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9184073d30 con 0x7f91840afe00 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9184166890 con 0x7f91700039f0 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918414f180 0x7f918415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918414f180 0x7f918415a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54966/0 (socket says 172.21.15.73:54966) 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 -- 172.21.15.73:0/2328741727 learned_addr learned my addr 172.21.15.73:0/2328741727 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91837fe640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91840afe00 0x7f918414d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f9182ffd640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91700039f0 0x7f91840999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 -- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91700039f0 msgr2=0x7f91840999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91700039f0 0x7f91840999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 -- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91840afe00 msgr2=0x7f918414d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91840afe00 0x7f918414d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 -- 172.21.15.73:0/2328741727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91840b03c0 con 0x7f918414f180 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91837fe640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91840afe00 0x7f918414d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f91827fc640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918414f180 0x7f918415a9d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f916c007990 tx=0x7f916c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f917b7fe640 1 -- 172.21.15.73:0/2328741727 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c00ee50 con 0x7f918414f180 2024-09-12T03:36:43.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f917b7fe640 1 -- 172.21.15.73:0/2328741727 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c018070 con 0x7f918414f180 2024-09-12T03:36:43.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91840b06a0 con 0x7f918414f180 2024-09-12T03:36:43.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f917b7fe640 1 -- 172.21.15.73:0/2328741727 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c013660 con 0x7f918414f180 2024-09-12T03:36:43.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91840b0c60 con 0x7f918414f180 2024-09-12T03:36:43.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.058+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918415ec90 con 0x7f918414f180 2024-09-12T03:36:43.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.062+0000 7f917b7fe640 1 -- 172.21.15.73:0/2328741727 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f916c013800 con 0x7f918414f180 2024-09-12T03:36:43.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.062+0000 7f917b7fe640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91640678c0 0x7f9164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.062+0000 7f917b7fe640 1 -- 172.21.15.73:0/2328741727 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f916c086410 con 0x7f918414f180 2024-09-12T03:36:43.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.062+0000 7f9182ffd640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91640678c0 0x7f9164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.062+0000 7f9182ffd640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91640678c0 0x7f9164069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f91700057f0 tx=0x7f91740011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.066+0000 7f917b7fe640 1 -- 172.21.15.73:0/2328741727 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f916c056e50 con 0x7f918414f180 2024-09-12T03:36:43.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.222+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f918415b9c0 con 0x7f91640678c0 2024-09-12T03:36:43.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.230+0000 7f917b7fe640 1 -- 172.21.15.73:0/2328741727 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252000 (secure 0 0 0) 0x7f918415b9c0 con 0x7f91640678c0 2024-09-12T03:36:43.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:36:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91640678c0 msgr2=0x7f9164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91640678c0 0x7f9164069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f91700057f0 tx=0x7f91740011a0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918414f180 msgr2=0x7f918415a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918414f180 0x7f918415a9d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f916c007990 tx=0x7f916c00e530 comp rx=0 tx=0).stop 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 shutdown_connections 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91640678c0 0x7f9164069d80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f918414f180 0x7f918415a9d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91840afe00 0x7f918414d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 --2- 172.21.15.73:0/2328741727 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91700039f0 0x7f91840999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 >> 172.21.15.73:0/2328741727 conn(0x7f91840b1f90 msgr2=0x7f91840b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 shutdown_connections 2024-09-12T03:36:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.238+0000 7f918973b640 1 -- 172.21.15.73:0/2328741727 wait complete. 2024-09-12T03:36:43.254 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-12T03:36:41.826476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240092,"kb_used_data":7208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734628,"statfs":{"total":773094113280,"available":772848259072,"internally_reserved":0,"allocated":7380992,"data_stored":3950916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002309"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422017+0000","last_change":"2024-09-12T03:36:34.463528+0000","last_active":"2024-09-12T03:36:35.422017+0000","last_peered":"2024-09-12T03:36:35.422017+0000","last_clean":"2024-09-12T03:36:35.422017+0000","last_became_active":"2024-09-12T03:36:34.463253+0000","last_became_peered":"2024-09-12T03:36:34.463253+0000","last_unstale":"2024-09-12T03:36:35.422017+0000","last_undegraded":"2024-09-12T03:36:35.422017+0000","last_fullsized":"2024-09-12T03:36:35.422017+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:06.411832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421826+0000","last_change":"2024-09-12T03:36:34.419958+0000","last_active":"2024-09-12T03:36:35.421826+0000","last_peered":"2024-09-12T03:36:35.421826+0000","last_clean":"2024-09-12T03:36:35.421826+0000","last_became_active":"2024-09-12T03:36:34.419226+0000","last_became_peered":"2024-09-12T03:36:34.419226+0000","last_unstale":"2024-09-12T03:36:35.421826+0000","last_undegraded":"2024-09-12T03:36:35.421826+0000","last_fullsized":"2024-09-12T03:36:35.421826+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:49.354398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503938+0000","last_change":"2024-09-12T03:36:34.464323+0000","last_active":"2024-09-12T03:36:35.503938+0000","last_peered":"2024-09-12T03:36:35.503938+0000","last_clean":"2024-09-12T03:36:35.503938+0000","last_became_active":"2024-09-12T03:36:34.453118+0000","last_became_peered":"2024-09-12T03:36:34.453118+0000","last_unstale":"2024-09-12T03:36:35.503938+0000","last_undegraded":"2024-09-12T03:36:35.503938+0000","last_fullsized":"2024-09-12T03:36:35.503938+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:43.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.507228+0000","last_change":"2024-09-12T03:36:34.435338+0000","last_active":"2024-09-12T03:36:35.507228+0000","last_peered":"2024-09-12T03:36:35.507228+0000","last_clean":"2024-09-12T03:36:35.507228+0000","last_became_active":"2024-09-12T03:36:34.434628+0000","last_became_peered":"2024-09-12T03:36:34.434628+0000","last_unstale":"2024-09-12T03:36:35.507228+0000","last_undegraded":"2024-09-12T03:36:35.507228+0000","last_fullsized":"2024-09-12T03:36:35.507228+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:34.345611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502924+0000","last_change":"2024-09-12T03:36:34.420931+0000","last_active":"2024-09-12T03:36:35.502924+0000","last_peered":"2024-09-12T03:36:35.502924+0000","last_clean":"2024-09-12T03:36:35.502924+0000","last_became_active":"2024-09-12T03:36:34.420153+0000","last_became_peered":"2024-09-12T03:36:34.420153+0000","last_unstale":"2024-09-12T03:36:35.502924+0000","last_undegraded":"2024-09-12T03:36:35.502924+0000","last_fullsized":"2024-09-12T03:36:35.502924+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:24.308610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502284+0000","last_change":"2024-09-12T03:36:34.459041+0000","last_active":"2024-09-12T03:36:35.502284+0000","last_peered":"2024-09-12T03:36:35.502284+0000","last_clean":"2024-09-12T03:36:35.502284+0000","last_became_active":"2024-09-12T03:36:34.458649+0000","last_became_peered":"2024-09-12T03:36:34.458649+0000","last_unstale":"2024-09-12T03:36:35.502284+0000","last_undegraded":"2024-09-12T03:36:35.502284+0000","last_fullsized":"2024-09-12T03:36:35.502284+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:49.414429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436001+0000","last_change":"2024-09-12T03:36:34.453582+0000","last_active":"2024-09-12T03:36:35.436001+0000","last_peered":"2024-09-12T03:36:35.436001+0000","last_clean":"2024-09-12T03:36:35.436001+0000","last_became_active":"2024-09-12T03:36:34.453275+0000","last_became_peered":"2024-09-12T03:36:34.453275+0000","last_unstale":"2024-09-12T03:36:35.436001+0000","last_undegraded":"2024-09-12T03:36:35.436001+0000","last_fullsized":"2024-09-12T03:36:35.436001+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.544755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426139+0000","last_change":"2024-09-12T03:36:34.471135+0000","last_active":"2024-09-12T03:36:35.426139+0000","last_peered":"2024-09-12T03:36:35.426139+0000","last_clean":"2024-09-12T03:36:35.426139+0000","last_became_active":"2024-09-12T03:36:34.470613+0000","last_became_peered":"2024-09-12T03:36:34.470613+0000","last_unstale":"2024-09-12T03:36:35.426139+0000","last_undegraded":"2024-09-12T03:36:35.426139+0000","last_fullsized":"2024-09-12T03:36:35.426139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:19.474193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505436+0000","last_change":"2024-09-12T03:36:34.459291+0000","last_active":"2024-09-12T03:36:35.505436+0000","last_peered":"2024-09-12T03:36:35.505436+0000","last_clean":"2024-09-12T03:36:35.505436+0000","last_became_active":"2024-09-12T03:36:34.458591+0000","last_became_peered":"2024-09-12T03:36:34.458591+0000","last_unstale":"2024-09-12T03:36:35.505436+0000","last_undegraded":"2024-09-12T03:36:35.505436+0000","last_fullsized":"2024-09-12T03:36:35.505436+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:16.041230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504171+0000","last_change":"2024-09-12T03:36:34.458233+0000","last_active":"2024-09-12T03:36:35.504171+0000","last_peered":"2024-09-12T03:36:35.504171+0000","last_clean":"2024-09-12T03:36:35.504171+0000","last_became_active":"2024-09-12T03:36:34.457576+0000","last_became_peered":"2024-09-12T03:36:34.457576+0000","last_unstale":"2024-09-12T03:36:35.504171+0000","last_undegraded":"2024-09-12T03:36:35.504171+0000","last_fullsized":"2024-09-12T03:36:35.504171+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:27.239395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506547+0000","last_change":"2024-09-12T03:36:34.431584+0000","last_active":"2024-09-12T03:36:35.506547+0000","last_peered":"2024-09-12T03:36:35.506547+0000","last_clean":"2024-09-12T03:36:35.506547+0000","last_became_active":"2024-09-12T03:36:34.430819+0000","last_became_peered":"2024-09-12T03:36:34.430819+0000","last_unstale":"2024-09-12T03:36:35.506547+0000","last_undegraded":"2024-09-12T03:36:35.506547+0000","last_fullsized":"2024-09-12T03:36:35.506547+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:12.569954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427040+0000","last_change":"2024-09-12T03:36:34.471389+0000","last_active":"2024-09-12T03:36:35.427040+0000","last_peered":"2024-09-12T03:36:35.427040+0000","last_clean":"2024-09-12T03:36:35.427040+0000","last_became_active":"2024-09-12T03:36:34.470789+0000","last_became_peered":"2024-09-12T03:36:34.470789+0000","last_unstale":"2024-09-12T03:36:35.427040+0000","last_undegraded":"2024-09-12T03:36:35.427040+0000","last_fullsized":"2024-09-12T03:36:35.427040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:53.591504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426880+0000","last_change":"2024-09-12T03:36:34.460987+0000","last_active":"2024-09-12T03:36:35.426880+0000","last_peered":"2024-09-12T03:36:35.426880+0000","last_clean":"2024-09-12T03:36:35.426880+0000","last_became_active":"2024-09-12T03:36:34.455708+0000","last_became_peered":"2024-09-12T03:36:34.455708+0000","last_unstale":"2024-09-12T03:36:35.426880+0000","last_undegraded":"2024-09-12T03:36:35.426880+0000","last_fullsized":"2024-09-12T03:36:35.426880+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:19.469821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504442+0000","last_change":"2024-09-12T03:36:34.464115+0000","last_active":"2024-09-12T03:36:35.504442+0000","last_peered":"2024-09-12T03:36:35.504442+0000","last_clean":"2024-09-12T03:36:35.504442+0000","last_became_active":"2024-09-12T03:36:34.451939+0000","last_became_peered":"2024-09-12T03:36:34.451939+0000","last_unstale":"2024-09-12T03:36:35.504442+0000","last_undegraded":"2024-09-12T03:36:35.504442+0000","last_fullsized":"2024-09-12T03:36:35.504442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:32.791588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504693+0000","last_change":"2024-09-12T03:36:34.453208+0000","last_active":"2024-09-12T03:36:35.504693+0000","last_peered":"2024-09-12T03:36:35.504693+0000","last_clean":"2024-09-12T03:36:35.504693+0000","last_became_active":"2024-09-12T03:36:34.452551+0000","last_became_peered":"2024-09-12T03:36:34.452551+0000","last_unstale":"2024-09-12T03:36:35.504693+0000","last_undegraded":"2024-09-12T03:36:35.504693+0000","last_fullsized":"2024-09-12T03:36:35.504693+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436209+0000","last_change":"2024-09-12T03:36:34.465477+0000","last_active":"2024-09-12T03:36:35.436209+0000","last_peered":"2024-09-12T03:36:35.436209+0000","last_clean":"2024-09-12T03:36:35.436209+0000","last_became_active":"2024-09-12T03:36:34.465239+0000","last_became_peered":"2024-09-12T03:36:34.465239+0000","last_unstale":"2024-09-12T03:36:35.436209+0000","last_undegraded":"2024-09-12T03:36:35.436209+0000","last_fullsized":"2024-09-12T03:36:35.436209+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:58:40.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422109+0000","last_change":"2024-09-12T03:36:34.432773+0000","last_active":"2024-09-12T03:36:35.422109+0000","last_peered":"2024-09-12T03:36:35.422109+0000","last_clean":"2024-09-12T03:36:35.422109+0000","last_became_active":"2024-09-12T03:36:34.432471+0000","last_became_peered":"2024-09-12T03:36:34.432471+0000","last_unstale":"2024-09-12T03:36:35.422109+0000","last_undegraded":"2024-09-12T03:36:35.422109+0000","last_fullsized":"2024-09-12T03:36:35.422109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:38.943962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506870+0000","last_change":"2024-09-12T03:36:34.433578+0000","last_active":"2024-09-12T03:36:35.506870+0000","last_peered":"2024-09-12T03:36:35.506870+0000","last_clean":"2024-09-12T03:36:35.506870+0000","last_became_active":"2024-09-12T03:36:34.432859+0000","last_became_peered":"2024-09-12T03:36:34.432859+0000","last_unstale":"2024-09-12T03:36:35.506870+0000","last_undegraded":"2024-09-12T03:36:35.506870+0000","last_fullsized":"2024-09-12T03:36:35.506870+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:58:41.481427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503442+0000","last_change":"2024-09-12T03:36:34.430953+0000","last_active":"2024-09-12T03:36:35.503442+0000","last_peered":"2024-09-12T03:36:35.503442+0000","last_clean":"2024-09-12T03:36:35.503442+0000","last_became_active":"2024-09-12T03:36:34.430263+0000","last_became_peered":"2024-09-12T03:36:34.430263+0000","last_unstale":"2024-09-12T03:36:35.503442+0000","last_undegraded":"2024-09-12T03:36:35.503442+0000","last_fullsized":"2024-09-12T03:36:35.503442+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:13.336540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426091+0000","last_change":"2024-09-12T03:36:34.415283+0000","last_active":"2024-09-12T03:36:35.426091+0000","last_peered":"2024-09-12T03:36:35.426091+0000","last_clean":"2024-09-12T03:36:35.426091+0000","last_became_active":"2024-09-12T03:36:34.414573+0000","last_became_peered":"2024-09-12T03:36:34.414573+0000","last_unstale":"2024-09-12T03:36:35.426091+0000","last_undegraded":"2024-09-12T03:36:35.426091+0000","last_fullsized":"2024-09-12T03:36:35.426091+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:16.041230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426986+0000","last_change":"2024-09-12T03:36:34.463950+0000","last_active":"2024-09-12T03:36:35.426986+0000","last_peered":"2024-09-12T03:36:35.426986+0000","last_clean":"2024-09-12T03:36:35.426986+0000","last_became_active":"2024-09-12T03:36:34.455562+0000","last_became_peered":"2024-09-12T03:36:34.455562+0000","last_unstale":"2024-09-12T03:36:35.426986+0000","last_undegraded":"2024-09-12T03:36:35.426986+0000","last_fullsized":"2024-09-12T03:36:35.426986+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:43.536056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425631+0000","last_change":"2024-09-12T03:36:34.459077+0000","last_active":"2024-09-12T03:36:35.425631+0000","last_peered":"2024-09-12T03:36:35.425631+0000","last_clean":"2024-09-12T03:36:35.425631+0000","last_became_active":"2024-09-12T03:36:34.458743+0000","last_became_peered":"2024-09-12T03:36:34.458743+0000","last_unstale":"2024-09-12T03:36:35.425631+0000","last_undegraded":"2024-09-12T03:36:35.425631+0000","last_fullsized":"2024-09-12T03:36:35.425631+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:35.350932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425462+0000","last_change":"2024-09-12T03:36:34.459267+0000","last_active":"2024-09-12T03:36:35.425462+0000","last_peered":"2024-09-12T03:36:35.425462+0000","last_clean":"2024-09-12T03:36:35.425462+0000","last_became_active":"2024-09-12T03:36:34.458999+0000","last_became_peered":"2024-09-12T03:36:34.458999+0000","last_unstale":"2024-09-12T03:36:35.425462+0000","last_undegraded":"2024-09-12T03:36:35.425462+0000","last_fullsized":"2024-09-12T03:36:35.425462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:32.791588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504571+0000","last_change":"2024-09-12T03:36:34.453461+0000","last_active":"2024-09-12T03:36:35.504571+0000","last_peered":"2024-09-12T03:36:35.504571+0000","last_clean":"2024-09-12T03:36:35.504571+0000","last_became_active":"2024-09-12T03:36:34.452815+0000","last_became_peered":"2024-09-12T03:36:34.452815+0000","last_unstale":"2024-09-12T03:36:35.504571+0000","last_undegraded":"2024-09-12T03:36:35.504571+0000","last_fullsized":"2024-09-12T03:36:35.504571+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:40.734616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427923+0000","last_change":"2024-09-12T03:36:34.463604+0000","last_active":"2024-09-12T03:36:35.427923+0000","last_peered":"2024-09-12T03:36:35.427923+0000","last_clean":"2024-09-12T03:36:35.427923+0000","last_became_active":"2024-09-12T03:36:34.463206+0000","last_became_peered":"2024-09-12T03:36:34.463206+0000","last_unstale":"2024-09-12T03:36:35.427923+0000","last_undegraded":"2024-09-12T03:36:35.427923+0000","last_fullsized":"2024-09-12T03:36:35.427923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:05:32.791588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427139+0000","last_change":"2024-09-12T03:36:34.466379+0000","last_active":"2024-09-12T03:36:35.427139+0000","last_peered":"2024-09-12T03:36:35.427139+0000","last_clean":"2024-09-12T03:36:35.427139+0000","last_became_active":"2024-09-12T03:36:34.465764+0000","last_became_peered":"2024-09-12T03:36:34.465764+0000","last_unstale":"2024-09-12T03:36:35.427139+0000","last_undegraded":"2024-09-12T03:36:35.427139+0000","last_fullsized":"2024-09-12T03:36:35.427139+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:45.367778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506726+0000","last_change":"2024-09-12T03:36:34.433299+0000","last_active":"2024-09-12T03:36:35.506726+0000","last_peered":"2024-09-12T03:36:35.506726+0000","last_clean":"2024-09-12T03:36:35.506726+0000","last_became_active":"2024-09-12T03:36:34.432584+0000","last_became_peered":"2024-09-12T03:36:34.432584+0000","last_unstale":"2024-09-12T03:36:35.506726+0000","last_undegraded":"2024-09-12T03:36:35.506726+0000","last_fullsized":"2024-09-12T03:36:35.506726+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:28.736689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421334+0000","last_change":"2024-09-12T03:36:34.414473+0000","last_active":"2024-09-12T03:36:35.421334+0000","last_peered":"2024-09-12T03:36:35.421334+0000","last_clean":"2024-09-12T03:36:35.421334+0000","last_became_active":"2024-09-12T03:36:34.412915+0000","last_became_peered":"2024-09-12T03:36:34.412915+0000","last_unstale":"2024-09-12T03:36:35.421334+0000","last_undegraded":"2024-09-12T03:36:35.421334+0000","last_fullsized":"2024-09-12T03:36:35.421334+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:49.931411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504033+0000","last_change":"2024-09-12T03:36:34.464648+0000","last_active":"2024-09-12T03:36:35.504033+0000","last_peered":"2024-09-12T03:36:35.504033+0000","last_clean":"2024-09-12T03:36:35.504033+0000","last_became_active":"2024-09-12T03:36:34.458463+0000","last_became_peered":"2024-09-12T03:36:34.458463+0000","last_unstale":"2024-09-12T03:36:35.504033+0000","last_undegraded":"2024-09-12T03:36:35.504033+0000","last_fullsized":"2024-09-12T03:36:35.504033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:47:45.367778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426136+0000","last_change":"2024-09-12T03:36:34.460922+0000","last_active":"2024-09-12T03:36:35.426136+0000","last_peered":"2024-09-12T03:36:35.426136+0000","last_clean":"2024-09-12T03:36:35.426136+0000","last_became_active":"2024-09-12T03:36:34.455997+0000","last_became_peered":"2024-09-12T03:36:34.455997+0000","last_unstale":"2024-09-12T03:36:35.426136+0000","last_undegraded":"2024-09-12T03:36:35.426136+0000","last_fullsized":"2024-09-12T03:36:35.426136+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:38.975094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505752+0000","last_change":"2024-09-12T03:36:34.436645+0000","last_active":"2024-09-12T03:36:35.505752+0000","last_peered":"2024-09-12T03:36:35.505752+0000","last_clean":"2024-09-12T03:36:35.505752+0000","last_became_active":"2024-09-12T03:36:34.435918+0000","last_became_peered":"2024-09-12T03:36:34.435918+0000","last_unstale":"2024-09-12T03:36:35.505752+0000","last_undegraded":"2024-09-12T03:36:35.505752+0000","last_fullsized":"2024-09-12T03:36:35.505752+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:59.267826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502339+0000","last_change":"2024-09-12T03:36:34.424794+0000","last_active":"2024-09-12T03:36:35.502339+0000","last_peered":"2024-09-12T03:36:35.502339+0000","last_clean":"2024-09-12T03:36:35.502339+0000","last_became_active":"2024-09-12T03:36:34.424305+0000","last_became_peered":"2024-09-12T03:36:34.424305+0000","last_unstale":"2024-09-12T03:36:35.502339+0000","last_undegraded":"2024-09-12T03:36:35.502339+0000","last_fullsized":"2024-09-12T03:36:35.502339+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:38.743608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503040+0000","last_change":"2024-09-12T03:36:34.425193+0000","last_active":"2024-09-12T03:36:35.503040+0000","last_peered":"2024-09-12T03:36:35.503040+0000","last_clean":"2024-09-12T03:36:35.503040+0000","last_became_active":"2024-09-12T03:36:34.424455+0000","last_became_peered":"2024-09-12T03:36:34.424455+0000","last_unstale":"2024-09-12T03:36:35.503040+0000","last_undegraded":"2024-09-12T03:36:35.503040+0000","last_fullsized":"2024-09-12T03:36:35.503040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:15.167843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"63'4","reported_seq":18,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422192+0000","last_change":"2024-09-12T03:36:33.430680+0000","last_active":"2024-09-12T03:36:35.422192+0000","last_peered":"2024-09-12T03:36:35.422192+0000","last_clean":"2024-09-12T03:36:35.422192+0000","last_became_active":"2024-09-12T03:36:33.430173+0000","last_became_peered":"2024-09-12T03:36:33.430173+0000","last_unstale":"2024-09-12T03:36:35.422192+0000","last_undegraded":"2024-09-12T03:36:35.422192+0000","last_fullsized":"2024-09-12T03:36:35.422192+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:27.727103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506865+0000","last_change":"2024-09-12T03:36:34.416219+0000","last_active":"2024-09-12T03:36:35.506865+0000","last_peered":"2024-09-12T03:36:35.506865+0000","last_clean":"2024-09-12T03:36:35.506865+0000","last_became_active":"2024-09-12T03:36:34.415408+0000","last_became_peered":"2024-09-12T03:36:34.415408+0000","last_unstale":"2024-09-12T03:36:35.506865+0000","last_undegraded":"2024-09-12T03:36:35.506865+0000","last_fullsized":"2024-09-12T03:36:35.506865+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:01.823208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502263+0000","last_change":"2024-09-12T03:36:33.426212+0000","last_active":"2024-09-12T03:36:35.502263+0000","last_peered":"2024-09-12T03:36:35.502263+0000","last_clean":"2024-09-12T03:36:35.502263+0000","last_became_active":"2024-09-12T03:36:33.425771+0000","last_became_peered":"2024-09-12T03:36:33.425771+0000","last_unstale":"2024-09-12T03:36:35.502263+0000","last_undegraded":"2024-09-12T03:36:35.502263+0000","last_fullsized":"2024-09-12T03:36:35.502263+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:39.047872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502277+0000","last_change":"2024-09-12T03:36:34.426973+0000","last_active":"2024-09-12T03:36:35.502277+0000","last_peered":"2024-09-12T03:36:35.502277+0000","last_clean":"2024-09-12T03:36:35.502277+0000","last_became_active":"2024-09-12T03:36:34.424246+0000","last_became_peered":"2024-09-12T03:36:34.424246+0000","last_unstale":"2024-09-12T03:36:35.502277+0000","last_undegraded":"2024-09-12T03:36:35.502277+0000","last_fullsized":"2024-09-12T03:36:35.502277+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:08.547780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501964+0000","last_change":"2024-09-12T03:36:33.417749+0000","last_active":"2024-09-12T03:36:35.501964+0000","last_peered":"2024-09-12T03:36:35.501964+0000","last_clean":"2024-09-12T03:36:35.501964+0000","last_became_active":"2024-09-12T03:36:33.417326+0000","last_became_peered":"2024-09-12T03:36:33.417326+0000","last_unstale":"2024-09-12T03:36:35.501964+0000","last_undegraded":"2024-09-12T03:36:35.501964+0000","last_fullsized":"2024-09-12T03:36:35.501964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.097333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504918+0000","last_change":"2024-09-12T03:36:34.457867+0000","last_active":"2024-09-12T03:36:35.504918+0000","last_peered":"2024-09-12T03:36:35.504918+0000","last_clean":"2024-09-12T03:36:35.504918+0000","last_became_active":"2024-09-12T03:36:34.453217+0000","last_became_peered":"2024-09-12T03:36:34.453217+0000","last_unstale":"2024-09-12T03:36:35.504918+0000","last_undegraded":"2024-09-12T03:36:35.504918+0000","last_fullsized":"2024-09-12T03:36:35.504918+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:01.244906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502206+0000","last_change":"2024-09-12T03:36:33.415881+0000","last_active":"2024-09-12T03:36:35.502206+0000","last_peered":"2024-09-12T03:36:35.502206+0000","last_clean":"2024-09-12T03:36:35.502206+0000","last_became_active":"2024-09-12T03:36:33.415348+0000","last_became_peered":"2024-09-12T03:36:33.415348+0000","last_unstale":"2024-09-12T03:36:35.502206+0000","last_undegraded":"2024-09-12T03:36:35.502206+0000","last_fullsized":"2024-09-12T03:36:35.502206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:28.390227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436063+0000","last_change":"2024-09-12T03:36:34.427828+0000","last_active":"2024-09-12T03:36:35.436063+0000","last_peered":"2024-09-12T03:36:35.436063+0000","last_clean":"2024-09-12T03:36:35.436063+0000","last_became_active":"2024-09-12T03:36:34.427537+0000","last_became_peered":"2024-09-12T03:36:34.427537+0000","last_unstale":"2024-09-12T03:36:35.436063+0000","last_undegraded":"2024-09-12T03:36:35.436063+0000","last_fullsized":"2024-09-12T03:36:35.436063+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:57.586272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425610+0000","last_change":"2024-09-12T03:36:33.404487+0000","last_active":"2024-09-12T03:36:35.425610+0000","last_peered":"2024-09-12T03:36:35.425610+0000","last_clean":"2024-09-12T03:36:35.425610+0000","last_became_active":"2024-09-12T03:36:33.403918+0000","last_became_peered":"2024-09-12T03:36:33.403918+0000","last_unstale":"2024-09-12T03:36:35.425610+0000","last_undegraded":"2024-09-12T03:36:35.425610+0000","last_fullsized":"2024-09-12T03:36:35.425610+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:45.178275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421309+0000","last_change":"2024-09-12T03:36:34.418937+0000","last_active":"2024-09-12T03:36:35.421309+0000","last_peered":"2024-09-12T03:36:35.421309+0000","last_clean":"2024-09-12T03:36:35.421309+0000","last_became_active":"2024-09-12T03:36:34.418185+0000","last_became_peered":"2024-09-12T03:36:34.418185+0000","last_unstale":"2024-09-12T03:36:35.421309+0000","last_undegraded":"2024-09-12T03:36:35.421309+0000","last_fullsized":"2024-09-12T03:36:35.421309+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:00.063330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425386+0000","last_change":"2024-09-12T03:36:33.394314+0000","last_active":"2024-09-12T03:36:35.425386+0000","last_peered":"2024-09-12T03:36:35.425386+0000","last_clean":"2024-09-12T03:36:35.425386+0000","last_became_active":"2024-09-12T03:36:33.393608+0000","last_became_peered":"2024-09-12T03:36:33.393608+0000","last_unstale":"2024-09-12T03:36:35.425386+0000","last_undegraded":"2024-09-12T03:36:35.425386+0000","last_fullsized":"2024-09-12T03:36:35.425386+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:21.687183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502513+0000","last_change":"2024-09-12T03:36:34.422629+0000","last_active":"2024-09-12T03:36:35.502513+0000","last_peered":"2024-09-12T03:36:35.502513+0000","last_clean":"2024-09-12T03:36:35.502513+0000","last_became_active":"2024-09-12T03:36:34.421821+0000","last_became_peered":"2024-09-12T03:36:34.421821+0000","last_unstale":"2024-09-12T03:36:35.502513+0000","last_undegraded":"2024-09-12T03:36:35.502513+0000","last_fullsized":"2024-09-12T03:36:35.502513+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:50.766660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425236+0000","last_change":"2024-09-12T03:36:33.409220+0000","last_active":"2024-09-12T03:36:35.425236+0000","last_peered":"2024-09-12T03:36:35.425236+0000","last_clean":"2024-09-12T03:36:35.425236+0000","last_became_active":"2024-09-12T03:36:33.408511+0000","last_became_peered":"2024-09-12T03:36:33.408511+0000","last_unstale":"2024-09-12T03:36:35.425236+0000","last_undegraded":"2024-09-12T03:36:35.425236+0000","last_fullsized":"2024-09-12T03:36:35.425236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:18.464608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425858+0000","last_change":"2024-09-12T03:36:34.430098+0000","last_active":"2024-09-12T03:36:35.425858+0000","last_peered":"2024-09-12T03:36:35.425858+0000","last_clean":"2024-09-12T03:36:35.425858+0000","last_became_active":"2024-09-12T03:36:34.429746+0000","last_became_peered":"2024-09-12T03:36:34.429746+0000","last_unstale":"2024-09-12T03:36:35.425858+0000","last_undegraded":"2024-09-12T03:36:35.425858+0000","last_fullsized":"2024-09-12T03:36:35.425858+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:01.244906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502275+0000","last_change":"2024-09-12T03:36:33.424986+0000","last_active":"2024-09-12T03:36:35.502275+0000","last_peered":"2024-09-12T03:36:35.502275+0000","last_clean":"2024-09-12T03:36:35.502275+0000","last_became_active":"2024-09-12T03:36:33.424292+0000","last_became_peered":"2024-09-12T03:36:33.424292+0000","last_unstale":"2024-09-12T03:36:35.502275+0000","last_undegraded":"2024-09-12T03:36:35.502275+0000","last_fullsized":"2024-09-12T03:36:35.502275+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:31.276349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421195+0000","last_change":"2024-09-12T03:36:34.422382+0000","last_active":"2024-09-12T03:36:35.421195+0000","last_peered":"2024-09-12T03:36:35.421195+0000","last_clean":"2024-09-12T03:36:35.421195+0000","last_became_active":"2024-09-12T03:36:34.422029+0000","last_became_peered":"2024-09-12T03:36:34.422029+0000","last_unstale":"2024-09-12T03:36:35.421195+0000","last_undegraded":"2024-09-12T03:36:35.421195+0000","last_fullsized":"2024-09-12T03:36:35.421195+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:52.355222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505730+0000","last_change":"2024-09-12T03:36:33.430686+0000","last_active":"2024-09-12T03:36:35.505730+0000","last_peered":"2024-09-12T03:36:35.505730+0000","last_clean":"2024-09-12T03:36:35.505730+0000","last_became_active":"2024-09-12T03:36:33.429936+0000","last_became_peered":"2024-09-12T03:36:33.429936+0000","last_unstale":"2024-09-12T03:36:35.505730+0000","last_undegraded":"2024-09-12T03:36:35.505730+0000","last_fullsized":"2024-09-12T03:36:35.505730+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:48.921825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425555+0000","last_change":"2024-09-12T03:36:34.447414+0000","last_active":"2024-09-12T03:36:35.425555+0000","last_peered":"2024-09-12T03:36:35.425555+0000","last_clean":"2024-09-12T03:36:35.425555+0000","last_became_active":"2024-09-12T03:36:34.447188+0000","last_became_peered":"2024-09-12T03:36:34.447188+0000","last_unstale":"2024-09-12T03:36:35.425555+0000","last_undegraded":"2024-09-12T03:36:35.425555+0000","last_fullsized":"2024-09-12T03:36:35.425555+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:16:40.734616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.507004+0000","last_change":"2024-09-12T03:36:33.403132+0000","last_active":"2024-09-12T03:36:35.507004+0000","last_peered":"2024-09-12T03:36:35.507004+0000","last_clean":"2024-09-12T03:36:35.507004+0000","last_became_active":"2024-09-12T03:36:33.402328+0000","last_became_peered":"2024-09-12T03:36:33.402328+0000","last_unstale":"2024-09-12T03:36:35.507004+0000","last_undegraded":"2024-09-12T03:36:35.507004+0000","last_fullsized":"2024-09-12T03:36:35.507004+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:57.760244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503131+0000","last_change":"2024-09-12T03:36:34.468055+0000","last_active":"2024-09-12T03:36:35.503131+0000","last_peered":"2024-09-12T03:36:35.503131+0000","last_clean":"2024-09-12T03:36:35.503131+0000","last_became_active":"2024-09-12T03:36:34.467444+0000","last_became_peered":"2024-09-12T03:36:34.467444+0000","last_unstale":"2024-09-12T03:36:35.503131+0000","last_undegraded":"2024-09-12T03:36:35.503131+0000","last_fullsized":"2024-09-12T03:36:35.503131+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:12.580444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"63'3","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503721+0000","last_change":"2024-09-12T03:36:33.429706+0000","last_active":"2024-09-12T03:36:35.503721+0000","last_peered":"2024-09-12T03:36:35.503721+0000","last_clean":"2024-09-12T03:36:35.503721+0000","last_became_active":"2024-09-12T03:36:33.428953+0000","last_became_peered":"2024-09-12T03:36:33.428953+0000","last_unstale":"2024-09-12T03:36:35.503721+0000","last_undegraded":"2024-09-12T03:36:35.503721+0000","last_fullsized":"2024-09-12T03:36:35.503721+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:59.053745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506921+0000","last_change":"2024-09-12T03:36:34.422498+0000","last_active":"2024-09-12T03:36:35.506921+0000","last_peered":"2024-09-12T03:36:35.506921+0000","last_clean":"2024-09-12T03:36:35.506921+0000","last_became_active":"2024-09-12T03:36:34.421750+0000","last_became_peered":"2024-09-12T03:36:34.421750+0000","last_unstale":"2024-09-12T03:36:35.506921+0000","last_undegraded":"2024-09-12T03:36:35.506921+0000","last_fullsized":"2024-09-12T03:36:35.506921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.765020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"63'6","reported_seq":20,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421325+0000","last_change":"2024-09-12T03:36:33.409871+0000","last_active":"2024-09-12T03:36:35.421325+0000","last_peered":"2024-09-12T03:36:35.421325+0000","last_clean":"2024-09-12T03:36:35.421325+0000","last_became_active":"2024-09-12T03:36:33.408066+0000","last_became_peered":"2024-09-12T03:36:33.408066+0000","last_unstale":"2024-09-12T03:36:35.421325+0000","last_undegraded":"2024-09-12T03:36:35.421325+0000","last_fullsized":"2024-09-12T03:36:35.421325+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:11.560369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505635+0000","last_change":"2024-09-12T03:36:34.460216+0000","last_active":"2024-09-12T03:36:35.505635+0000","last_peered":"2024-09-12T03:36:35.505635+0000","last_clean":"2024-09-12T03:36:35.505635+0000","last_became_active":"2024-09-12T03:36:34.459370+0000","last_became_peered":"2024-09-12T03:36:34.459370+0000","last_unstale":"2024-09-12T03:36:35.505635+0000","last_undegraded":"2024-09-12T03:36:35.505635+0000","last_fullsized":"2024-09-12T03:36:35.505635+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.926260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504213+0000","last_change":"2024-09-12T03:36:33.432799+0000","last_active":"2024-09-12T03:36:35.504213+0000","last_peered":"2024-09-12T03:36:35.504213+0000","last_clean":"2024-09-12T03:36:35.504213+0000","last_became_active":"2024-09-12T03:36:33.432127+0000","last_became_peered":"2024-09-12T03:36:33.432127+0000","last_unstale":"2024-09-12T03:36:35.504213+0000","last_undegraded":"2024-09-12T03:36:35.504213+0000","last_fullsized":"2024-09-12T03:36:35.504213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:05.402247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426581+0000","last_change":"2024-09-12T03:36:34.461593+0000","last_active":"2024-09-12T03:36:35.426581+0000","last_peered":"2024-09-12T03:36:35.426581+0000","last_clean":"2024-09-12T03:36:35.426581+0000","last_became_active":"2024-09-12T03:36:34.446803+0000","last_became_peered":"2024-09-12T03:36:34.446803+0000","last_unstale":"2024-09-12T03:36:35.426581+0000","last_undegraded":"2024-09-12T03:36:35.426581+0000","last_fullsized":"2024-09-12T03:36:35.426581+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:48.035114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426228+0000","last_change":"2024-09-12T03:36:33.410918+0000","last_active":"2024-09-12T03:36:35.426228+0000","last_peered":"2024-09-12T03:36:35.426228+0000","last_clean":"2024-09-12T03:36:35.426228+0000","last_became_active":"2024-09-12T03:36:33.409681+0000","last_became_peered":"2024-09-12T03:36:33.409681+0000","last_unstale":"2024-09-12T03:36:35.426228+0000","last_undegraded":"2024-09-12T03:36:35.426228+0000","last_fullsized":"2024-09-12T03:36:35.426228+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:33.336026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502597+0000","last_change":"2024-09-12T03:36:34.424336+0000","last_active":"2024-09-12T03:36:35.502597+0000","last_peered":"2024-09-12T03:36:35.502597+0000","last_clean":"2024-09-12T03:36:35.502597+0000","last_became_active":"2024-09-12T03:36:34.423596+0000","last_became_peered":"2024-09-12T03:36:34.423596+0000","last_unstale":"2024-09-12T03:36:35.502597+0000","last_undegraded":"2024-09-12T03:36:35.502597+0000","last_fullsized":"2024-09-12T03:36:35.502597+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:06.748555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504451+0000","last_change":"2024-09-12T03:36:33.431606+0000","last_active":"2024-09-12T03:36:35.504451+0000","last_peered":"2024-09-12T03:36:35.504451+0000","last_clean":"2024-09-12T03:36:35.504451+0000","last_became_active":"2024-09-12T03:36:33.430929+0000","last_became_peered":"2024-09-12T03:36:33.430929+0000","last_unstale":"2024-09-12T03:36:35.504451+0000","last_undegraded":"2024-09-12T03:36:35.504451+0000","last_fullsized":"2024-09-12T03:36:35.504451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:13.744771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.422150+0000","last_change":"2024-09-12T03:36:34.458660+0000","last_active":"2024-09-12T03:36:35.422150+0000","last_peered":"2024-09-12T03:36:35.422150+0000","last_clean":"2024-09-12T03:36:35.422150+0000","last_became_active":"2024-09-12T03:36:34.458321+0000","last_became_peered":"2024-09-12T03:36:34.458321+0000","last_unstale":"2024-09-12T03:36:35.422150+0000","last_undegraded":"2024-09-12T03:36:35.422150+0000","last_fullsized":"2024-09-12T03:36:35.422150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:14.754357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"63'8","reported_seq":22,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505389+0000","last_change":"2024-09-12T03:36:33.427316+0000","last_active":"2024-09-12T03:36:35.505389+0000","last_peered":"2024-09-12T03:36:35.505389+0000","last_clean":"2024-09-12T03:36:35.505389+0000","last_became_active":"2024-09-12T03:36:33.426595+0000","last_became_peered":"2024-09-12T03:36:33.426595+0000","last_unstale":"2024-09-12T03:36:35.505389+0000","last_undegraded":"2024-09-12T03:36:35.505389+0000","last_fullsized":"2024-09-12T03:36:35.505389+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:21.372816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503989+0000","last_change":"2024-09-12T03:36:34.458695+0000","last_active":"2024-09-12T03:36:35.503989+0000","last_peered":"2024-09-12T03:36:35.503989+0000","last_clean":"2024-09-12T03:36:35.503989+0000","last_became_active":"2024-09-12T03:36:34.458005+0000","last_became_peered":"2024-09-12T03:36:34.458005+0000","last_unstale":"2024-09-12T03:36:35.503989+0000","last_undegraded":"2024-09-12T03:36:35.503989+0000","last_fullsized":"2024-09-12T03:36:35.503989+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:53.591504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427590+0000","last_change":"2024-09-12T03:36:33.407126+0000","last_active":"2024-09-12T03:36:35.427590+0000","last_peered":"2024-09-12T03:36:35.427590+0000","last_clean":"2024-09-12T03:36:35.427590+0000","last_became_active":"2024-09-12T03:36:33.406432+0000","last_became_peered":"2024-09-12T03:36:33.406432+0000","last_unstale":"2024-09-12T03:36:35.427590+0000","last_undegraded":"2024-09-12T03:36:35.427590+0000","last_fullsized":"2024-09-12T03:36:35.427590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.554417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503037+0000","last_change":"2024-09-12T03:36:34.436468+0000","last_active":"2024-09-12T03:36:35.503037+0000","last_peered":"2024-09-12T03:36:35.503037+0000","last_clean":"2024-09-12T03:36:35.503037+0000","last_became_active":"2024-09-12T03:36:34.433336+0000","last_became_peered":"2024-09-12T03:36:34.433336+0000","last_unstale":"2024-09-12T03:36:35.503037+0000","last_undegraded":"2024-09-12T03:36:35.503037+0000","last_fullsized":"2024-09-12T03:36:35.503037+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:19:50.198807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504629+0000","last_change":"2024-09-12T03:36:33.436571+0000","last_active":"2024-09-12T03:36:35.504629+0000","last_peered":"2024-09-12T03:36:35.504629+0000","last_clean":"2024-09-12T03:36:35.504629+0000","last_became_active":"2024-09-12T03:36:33.435874+0000","last_became_peered":"2024-09-12T03:36:33.435874+0000","last_unstale":"2024-09-12T03:36:35.504629+0000","last_undegraded":"2024-09-12T03:36:35.504629+0000","last_fullsized":"2024-09-12T03:36:35.504629+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:59.910029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.506938+0000","last_change":"2024-09-12T03:36:34.434650+0000","last_active":"2024-09-12T03:36:35.506938+0000","last_peered":"2024-09-12T03:36:35.506938+0000","last_clean":"2024-09-12T03:36:35.506938+0000","last_became_active":"2024-09-12T03:36:34.433928+0000","last_became_peered":"2024-09-12T03:36:34.433928+0000","last_unstale":"2024-09-12T03:36:35.506938+0000","last_undegraded":"2024-09-12T03:36:35.506938+0000","last_fullsized":"2024-09-12T03:36:35.506938+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:08.676504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"63'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504097+0000","last_change":"2024-09-12T03:36:33.430494+0000","last_active":"2024-09-12T03:36:35.504097+0000","last_peered":"2024-09-12T03:36:35.504097+0000","last_clean":"2024-09-12T03:36:35.504097+0000","last_became_active":"2024-09-12T03:36:33.428978+0000","last_became_peered":"2024-09-12T03:36:33.428978+0000","last_unstale":"2024-09-12T03:36:35.504097+0000","last_undegraded":"2024-09-12T03:36:35.504097+0000","last_fullsized":"2024-09-12T03:36:35.504097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:48.344812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503033+0000","last_change":"2024-09-12T03:36:34.417956+0000","last_active":"2024-09-12T03:36:35.503033+0000","last_peered":"2024-09-12T03:36:35.503033+0000","last_clean":"2024-09-12T03:36:35.503033+0000","last_became_active":"2024-09-12T03:36:34.416639+0000","last_became_peered":"2024-09-12T03:36:34.416639+0000","last_unstale":"2024-09-12T03:36:35.503033+0000","last_undegraded":"2024-09-12T03:36:35.503033+0000","last_fullsized":"2024-09-12T03:36:35.503033+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:06.603286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426157+0000","last_change":"2024-09-12T03:36:33.400604+0000","last_active":"2024-09-12T03:36:35.426157+0000","last_peered":"2024-09-12T03:36:35.426157+0000","last_clean":"2024-09-12T03:36:35.426157+0000","last_became_active":"2024-09-12T03:36:33.399826+0000","last_became_peered":"2024-09-12T03:36:33.399826+0000","last_unstale":"2024-09-12T03:36:35.426157+0000","last_undegraded":"2024-09-12T03:36:35.426157+0000","last_fullsized":"2024-09-12T03:36:35.426157+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:47.025529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501805+0000","last_change":"2024-09-12T03:36:34.423982+0000","last_active":"2024-09-12T03:36:35.501805+0000","last_peered":"2024-09-12T03:36:35.501805+0000","last_clean":"2024-09-12T03:36:35.501805+0000","last_became_active":"2024-09-12T03:36:34.423407+0000","last_became_peered":"2024-09-12T03:36:34.423407+0000","last_unstale":"2024-09-12T03:36:35.501805+0000","last_undegraded":"2024-09-12T03:36:35.501805+0000","last_fullsized":"2024-09-12T03:36:35.501805+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.314364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501717+0000","last_change":"2024-09-12T03:36:33.419981+0000","last_active":"2024-09-12T03:36:35.501717+0000","last_peered":"2024-09-12T03:36:35.501717+0000","last_clean":"2024-09-12T03:36:35.501717+0000","last_became_active":"2024-09-12T03:36:33.419512+0000","last_became_peered":"2024-09-12T03:36:33.419512+0000","last_unstale":"2024-09-12T03:36:35.501717+0000","last_undegraded":"2024-09-12T03:36:35.501717+0000","last_fullsized":"2024-09-12T03:36:35.501717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:45.891702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426194+0000","last_change":"2024-09-12T03:36:34.460869+0000","last_active":"2024-09-12T03:36:35.426194+0000","last_peered":"2024-09-12T03:36:35.426194+0000","last_clean":"2024-09-12T03:36:35.426194+0000","last_became_active":"2024-09-12T03:36:34.445978+0000","last_became_peered":"2024-09-12T03:36:34.445978+0000","last_unstale":"2024-09-12T03:36:35.426194+0000","last_undegraded":"2024-09-12T03:36:35.426194+0000","last_fullsized":"2024-09-12T03:36:35.426194+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:46.187860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.426470+0000","last_change":"2024-09-12T03:36:33.410364+0000","last_active":"2024-09-12T03:36:35.426470+0000","last_peered":"2024-09-12T03:36:35.426470+0000","last_clean":"2024-09-12T03:36:35.426470+0000","last_became_active":"2024-09-12T03:36:33.408751+0000","last_became_peered":"2024-09-12T03:36:33.408751+0000","last_unstale":"2024-09-12T03:36:35.426470+0000","last_undegraded":"2024-09-12T03:36:35.426470+0000","last_fullsized":"2024-09-12T03:36:35.426470+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:27:46.320490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503127+0000","last_change":"2024-09-12T03:36:34.420143+0000","last_active":"2024-09-12T03:36:35.503127+0000","last_peered":"2024-09-12T03:36:35.503127+0000","last_clean":"2024-09-12T03:36:35.503127+0000","last_became_active":"2024-09-12T03:36:34.419222+0000","last_became_peered":"2024-09-12T03:36:34.419222+0000","last_unstale":"2024-09-12T03:36:35.503127+0000","last_undegraded":"2024-09-12T03:36:35.503127+0000","last_fullsized":"2024-09-12T03:36:35.503127+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:56:20.623310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501583+0000","last_change":"2024-09-12T03:36:33.427179+0000","last_active":"2024-09-12T03:36:35.501583+0000","last_peered":"2024-09-12T03:36:35.501583+0000","last_clean":"2024-09-12T03:36:35.501583+0000","last_became_active":"2024-09-12T03:36:33.426240+0000","last_became_peered":"2024-09-12T03:36:33.426240+0000","last_unstale":"2024-09-12T03:36:35.501583+0000","last_undegraded":"2024-09-12T03:36:35.501583+0000","last_fullsized":"2024-09-12T03:36:35.501583+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:08:05.593351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.501804+0000","last_change":"2024-09-12T03:36:34.432798+0000","last_active":"2024-09-12T03:36:35.501804+0000","last_peered":"2024-09-12T03:36:35.501804+0000","last_clean":"2024-09-12T03:36:35.501804+0000","last_became_active":"2024-09-12T03:36:34.432577+0000","last_became_peered":"2024-09-12T03:36:34.432577+0000","last_unstale":"2024-09-12T03:36:35.501804+0000","last_undegraded":"2024-09-12T03:36:35.501804+0000","last_fullsized":"2024-09-12T03:36:35.501804+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:21.914671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"63'2","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.428076+0000","last_change":"2024-09-12T03:36:33.424815+0000","last_active":"2024-09-12T03:36:35.428076+0000","last_peered":"2024-09-12T03:36:35.428076+0000","last_clean":"2024-09-12T03:36:35.428076+0000","last_became_active":"2024-09-12T03:36:33.423619+0000","last_became_peered":"2024-09-12T03:36:33.423619+0000","last_unstale":"2024-09-12T03:36:35.428076+0000","last_undegraded":"2024-09-12T03:36:35.428076+0000","last_fullsized":"2024-09-12T03:36:35.428076+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:19.228074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.436419+0000","last_change":"2024-09-12T03:36:34.426859+0000","last_active":"2024-09-12T03:36:35.436419+0000","last_peered":"2024-09-12T03:36:35.436419+0000","last_clean":"2024-09-12T03:36:35.436419+0000","last_became_active":"2024-09-12T03:36:34.425120+0000","last_became_peered":"2024-09-12T03:36:34.425120+0000","last_unstale":"2024-09-12T03:36:35.436419+0000","last_undegraded":"2024-09-12T03:36:35.436419+0000","last_fullsized":"2024-09-12T03:36:35.436419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:10.365339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"64'1","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427727+0000","last_change":"2024-09-12T03:36:33.402123+0000","last_active":"2024-09-12T03:36:35.427727+0000","last_peered":"2024-09-12T03:36:35.427727+0000","last_clean":"2024-09-12T03:36:35.427727+0000","last_became_active":"2024-09-12T03:36:33.401392+0000","last_became_peered":"2024-09-12T03:36:33.401392+0000","last_unstale":"2024-09-12T03:36:35.427727+0000","last_undegraded":"2024-09-12T03:36:35.427727+0000","last_fullsized":"2024-09-12T03:36:35.427727+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.934377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.427662+0000","last_change":"2024-09-12T03:36:34.470280+0000","last_active":"2024-09-12T03:36:35.427662+0000","last_peered":"2024-09-12T03:36:35.427662+0000","last_clean":"2024-09-12T03:36:35.427662+0000","last_became_active":"2024-09-12T03:36:34.469662+0000","last_became_peered":"2024-09-12T03:36:34.469662+0000","last_unstale":"2024-09-12T03:36:35.427662+0000","last_undegraded":"2024-09-12T03:36:35.427662+0000","last_fullsized":"2024-09-12T03:36:35.427662+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:27.239395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502130+0000","last_change":"2024-09-12T03:36:33.417423+0000","last_active":"2024-09-12T03:36:35.502130+0000","last_peered":"2024-09-12T03:36:35.502130+0000","last_clean":"2024-09-12T03:36:35.502130+0000","last_became_active":"2024-09-12T03:36:33.417134+0000","last_became_peered":"2024-09-12T03:36:33.417134+0000","last_unstale":"2024-09-12T03:36:35.502130+0000","last_undegraded":"2024-09-12T03:36:35.502130+0000","last_fullsized":"2024-09-12T03:36:35.502130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:43.675137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503401+0000","last_change":"2024-09-12T03:36:34.417391+0000","last_active":"2024-09-12T03:36:35.503401+0000","last_peered":"2024-09-12T03:36:35.503401+0000","last_clean":"2024-09-12T03:36:35.503401+0000","last_became_active":"2024-09-12T03:36:34.415727+0000","last_became_peered":"2024-09-12T03:36:34.415727+0000","last_unstale":"2024-09-12T03:36:35.503401+0000","last_undegraded":"2024-09-12T03:36:35.503401+0000","last_fullsized":"2024-09-12T03:36:35.503401+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:48.626206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421466+0000","last_change":"2024-09-12T03:36:33.408744+0000","last_active":"2024-09-12T03:36:35.421466+0000","last_peered":"2024-09-12T03:36:35.421466+0000","last_clean":"2024-09-12T03:36:35.421466+0000","last_became_active":"2024-09-12T03:36:33.406179+0000","last_became_peered":"2024-09-12T03:36:33.406179+0000","last_unstale":"2024-09-12T03:36:35.421466+0000","last_undegraded":"2024-09-12T03:36:35.421466+0000","last_fullsized":"2024-09-12T03:36:35.421466+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:16.063644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.502795+0000","last_change":"2024-09-12T03:36:34.426947+0000","last_active":"2024-09-12T03:36:35.502795+0000","last_peered":"2024-09-12T03:36:35.502795+0000","last_clean":"2024-09-12T03:36:35.502795+0000","last_became_active":"2024-09-12T03:36:34.426228+0000","last_became_peered":"2024-09-12T03:36:34.426228+0000","last_unstale":"2024-09-12T03:36:35.502795+0000","last_undegraded":"2024-09-12T03:36:35.502795+0000","last_fullsized":"2024-09-12T03:36:35.502795+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.421639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.504426+0000","last_change":"2024-09-12T03:36:33.427336+0000","last_active":"2024-09-12T03:36:35.504426+0000","last_peered":"2024-09-12T03:36:35.504426+0000","last_clean":"2024-09-12T03:36:35.504426+0000","last_became_active":"2024-09-12T03:36:33.426491+0000","last_became_peered":"2024-09-12T03:36:33.426491+0000","last_unstale":"2024-09-12T03:36:35.504426+0000","last_undegraded":"2024-09-12T03:36:35.504426+0000","last_fullsized":"2024-09-12T03:36:35.504426+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:37.934377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.505821+0000","last_change":"2024-09-12T03:36:34.460225+0000","last_active":"2024-09-12T03:36:35.505821+0000","last_peered":"2024-09-12T03:36:35.505821+0000","last_clean":"2024-09-12T03:36:35.505821+0000","last_became_active":"2024-09-12T03:36:34.459510+0000","last_became_peered":"2024-09-12T03:36:34.459510+0000","last_unstale":"2024-09-12T03:36:35.505821+0000","last_undegraded":"2024-09-12T03:36:35.505821+0000","last_fullsized":"2024-09-12T03:36:35.505821+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:17.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425699+0000","last_change":"2024-09-12T03:36:33.395637+0000","last_active":"2024-09-12T03:36:35.425699+0000","last_peered":"2024-09-12T03:36:35.425699+0000","last_clean":"2024-09-12T03:36:35.425699+0000","last_became_active":"2024-09-12T03:36:33.394965+0000","last_became_peered":"2024-09-12T03:36:33.394965+0000","last_unstale":"2024-09-12T03:36:35.425699+0000","last_undegraded":"2024-09-12T03:36:35.425699+0000","last_fullsized":"2024-09-12T03:36:35.425699+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:37.965509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.421224+0000","last_change":"2024-09-12T03:36:34.417049+0000","last_active":"2024-09-12T03:36:35.421224+0000","last_peered":"2024-09-12T03:36:35.421224+0000","last_clean":"2024-09-12T03:36:35.421224+0000","last_became_active":"2024-09-12T03:36:34.416270+0000","last_became_peered":"2024-09-12T03:36:34.416270+0000","last_unstale":"2024-09-12T03:36:35.421224+0000","last_undegraded":"2024-09-12T03:36:35.421224+0000","last_fullsized":"2024-09-12T03:36:35.421224+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:00.919614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425339+0000","last_change":"2024-09-12T03:36:33.408323+0000","last_active":"2024-09-12T03:36:35.425339+0000","last_peered":"2024-09-12T03:36:35.425339+0000","last_clean":"2024-09-12T03:36:35.425339+0000","last_became_active":"2024-09-12T03:36:33.408013+0000","last_became_peered":"2024-09-12T03:36:33.408013+0000","last_unstale":"2024-09-12T03:36:35.425339+0000","last_undegraded":"2024-09-12T03:36:35.425339+0000","last_fullsized":"2024-09-12T03:36:35.425339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:55.377257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.435790+0000","last_change":"2024-09-12T03:36:34.455232+0000","last_active":"2024-09-12T03:36:35.435790+0000","last_peered":"2024-09-12T03:36:35.435790+0000","last_clean":"2024-09-12T03:36:35.435790+0000","last_became_active":"2024-09-12T03:36:34.454955+0000","last_became_peered":"2024-09-12T03:36:34.454955+0000","last_unstale":"2024-09-12T03:36:35.435790+0000","last_undegraded":"2024-09-12T03:36:35.435790+0000","last_fullsized":"2024-09-12T03:36:35.435790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:37.289885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.420833+0000","last_change":"2024-09-12T03:36:33.421985+0000","last_active":"2024-09-12T03:36:35.420833+0000","last_peered":"2024-09-12T03:36:35.420833+0000","last_clean":"2024-09-12T03:36:35.420833+0000","last_became_active":"2024-09-12T03:36:33.421494+0000","last_became_peered":"2024-09-12T03:36:33.421494+0000","last_unstale":"2024-09-12T03:36:35.420833+0000","last_undegraded":"2024-09-12T03:36:35.420833+0000","last_fullsized":"2024-09-12T03:36:35.420833+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:58.258241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503957+0000","last_change":"2024-09-12T03:36:34.425092+0000","last_active":"2024-09-12T03:36:35.503957+0000","last_peered":"2024-09-12T03:36:35.503957+0000","last_clean":"2024-09-12T03:36:35.503957+0000","last_became_active":"2024-09-12T03:36:34.424390+0000","last_became_peered":"2024-09-12T03:36:34.424390+0000","last_unstale":"2024-09-12T03:36:35.503957+0000","last_undegraded":"2024-09-12T03:36:35.503957+0000","last_fullsized":"2024-09-12T03:36:35.503957+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:33.369870+0000","last_clean_scrub_stamp":"2024-09-12T03:36:33.369870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:19.579899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.425181+0000","last_change":"2024-09-12T03:36:33.413325+0000","last_active":"2024-09-12T03:36:35.425181+0000","last_peered":"2024-09-12T03:36:35.425181+0000","last_clean":"2024-09-12T03:36:35.425181+0000","last_became_active":"2024-09-12T03:36:33.413014+0000","last_became_peered":"2024-09-12T03:36:33.413014+0000","last_unstale":"2024-09-12T03:36:35.425181+0000","last_undegraded":"2024-09-12T03:36:35.425181+0000","last_fullsized":"2024-09-12T03:36:35.425181+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:36:32.360285+0000","last_clean_scrub_stamp":"2024-09-12T03:36:32.360285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:19.078571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":246,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-12T03:36:35.503979+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:36:35.503979+0000","last_peered":"2024-09-12T03:36:35.503979+0000","last_clean":"2024-09-12T03:36:35.503979+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:36:35.503979+0000","last_undegraded":"2024-09-12T03:36:35.503979+0000","last_fullsized":"2024-09-12T03:36:35.503979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1376256,"data_stored":936814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":345692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":778240,"data_stored":347282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":345670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509470,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":765952,"data_stored":345670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":348046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":345704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1359872,"data_stored":936038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:36:43.260 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:36:43.260 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T03:36:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffffa1640 1 Processor -- start 2024-09-12T03:36:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffffa1640 1 -- start start 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffffa1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbff8073100 0x7fbff80cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffffa1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff80ce8d0 con 0x7fbff80cc870 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffffa1640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff80cebb0 con 0x7fbff80cdfd0 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffffa1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbff80cee90 con 0x7fbff8073100 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffd53c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbff8073100 0x7fbff80cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffdd3d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbff80cc870 0x7fbff80ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57390/0 (socket says 172.21.15.73:57390) 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffdd3d640 1 -- 172.21.15.73:0/1573769307 learned_addr learned my addr 172.21.15.73:0/1573769307 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffd53c640 1 -- 172.21.15.73:0/1573769307 >> v1:172.21.15.150:6789/0 conn(0x7fbff80cdfd0 legacy=0x7fbff806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffd53c640 1 -- 172.21.15.73:0/1573769307 >> v1:172.21.15.73:6789/0 conn(0x7fbff80cc870 legacy=0x7fbff80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.426+0000 7fbffd53c640 1 -- 172.21.15.73:0/1573769307 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff80cf170 con 0x7fbff8073100 2024-09-12T03:36:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffd53c640 1 --2- 172.21.15.73:0/1573769307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff8073100 0x7fbff80cf970 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097c0 tx=0x7fbfe801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a705403f7767c95e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffcd3b640 1 -- 172.21.15.73:0/1573769307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80ab650 con 0x7fbff8073100 2024-09-12T03:36:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffcd3b640 1 -- 172.21.15.73:0/1573769307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe80b0070 con 0x7fbff8073100 2024-09-12T03:36:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffcd3b640 1 -- 172.21.15.73:0/1573769307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80aba10 con 0x7fbff8073100 2024-09-12T03:36:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 -- 172.21.15.73:0/1573769307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff8073100 msgr2=0x7fbff80cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 --2- 172.21.15.73:0/1573769307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff8073100 0x7fbff80cf970 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097c0 tx=0x7fbfe801c430 comp rx=0 tx=0).stop 2024-09-12T03:36:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 -- 172.21.15.73:0/1573769307 shutdown_connections 2024-09-12T03:36:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 --2- 172.21.15.73:0/1573769307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff8073100 0x7fbff80cf970 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 -- 172.21.15.73:0/1573769307 >> 172.21.15.73:0/1573769307 conn(0x7fbff80b1c80 msgr2=0x7fbff80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 -- 172.21.15.73:0/1573769307 shutdown_connections 2024-09-12T03:36:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 -- 172.21.15.73:0/1573769307 wait complete. 2024-09-12T03:36:43.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 Processor -- start 2024-09-12T03:36:43.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.430+0000 7fbffffa1640 1 -- start start 2024-09-12T03:36:43.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbff8073100 0x7fbff8142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff80cc870 0x7fbff80ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbff80cdfd0 0x7fbff813f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbff816a1a0 con 0x7fbff80cc870 2024-09-12T03:36:43.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbff80ce670 con 0x7fbff80cdfd0 2024-09-12T03:36:43.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbff816a320 con 0x7fbff8073100 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff80cc870 0x7fbff80ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff80cc870 0x7fbff80ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54992/0 (socket says 172.21.15.73:54992) 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 -- 172.21.15.73:0/2168041932 learned_addr learned my addr 172.21.15.73:0/2168041932 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffdd3d640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbff8073100 0x7fbff8142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 -- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbff8073100 msgr2=0x7fbff8142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbff8073100 0x7fbff8142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 -- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbff80cdfd0 msgr2=0x7fbff813f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffe53e640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbff80cdfd0 0x7fbff813f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbff80cdfd0 0x7fbff813f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 -- 172.21.15.73:0/2168041932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff813fdc0 con 0x7fbff80cc870 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffdd3d640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbff8073100 0x7fbff8142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffd53c640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff80cc870 0x7fbff80ae680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80ad040 tx=0x7fbfe80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbfee7fc640 1 -- 172.21.15.73:0/2168041932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80bf610 con 0x7fbff80cc870 2024-09-12T03:36:43.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbfee7fc640 1 -- 172.21.15.73:0/2168041932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe80bf7b0 con 0x7fbff80cc870 2024-09-12T03:36:43.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff81607f0 con 0x7fbff80cc870 2024-09-12T03:36:43.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbfee7fc640 1 -- 172.21.15.73:0/2168041932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80bfba0 con 0x7fbff80cc870 2024-09-12T03:36:43.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff815db40 con 0x7fbff80cc870 2024-09-12T03:36:43.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff80cf970 con 0x7fbff80cc870 2024-09-12T03:36:43.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbfee7fc640 1 -- 172.21.15.73:0/2168041932 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbfe80bd020 con 0x7fbff80cc870 2024-09-12T03:36:43.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbfee7fc640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfdc0678c0 0x7fbfdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbfee7fc640 1 -- 172.21.15.73:0/2168041932 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fbfe8120650 con 0x7fbff80cc870 2024-09-12T03:36:43.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.434+0000 7fbffdd3d640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfdc0678c0 0x7fbfdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.438+0000 7fbffdd3d640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfdc0678c0 0x7fbfdc069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbff8145010 tx=0x7fbff4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.438+0000 7fbfee7fc640 1 -- 172.21.15.73:0/2168041932 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbfe8016050 con 0x7fbff80cc870 2024-09-12T03:36:43.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.650+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbff80af8d0 con 0x7fbff80cc870 2024-09-12T03:36:43.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.654+0000 7fbfee7fc640 1 -- 172.21.15.73:0/2168041932 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fbfe80f1090 con 0x7fbff80cc870 2024-09-12T03:36:43.658 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T03:36:43.658 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:36:43.658 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-09-12T03:36:43.658 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-09-12T03:36:43.658 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T03:36:43.658 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfdc0678c0 msgr2=0x7fbfdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfdc0678c0 0x7fbfdc069d80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbff8145010 tx=0x7fbff4009040 comp rx=0 tx=0).stop 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff80cc870 msgr2=0x7fbff80ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff80cc870 0x7fbff80ae680 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80ad040 tx=0x7fbfe80191d0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 shutdown_connections 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfdc0678c0 0x7fbfdc069d80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbff80cc870 0x7fbff80ae680 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbff80cdfd0 0x7fbff813f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 --2- 172.21.15.73:0/2168041932 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbff8073100 0x7fbff8142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 >> 172.21.15.73:0/2168041932 conn(0x7fbff80b1c80 msgr2=0x7fbff80b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:43.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 shutdown_connections 2024-09-12T03:36:43.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.658+0000 7fbffffa1640 1 -- 172.21.15.73:0/2168041932 wait complete. 2024-09-12T03:36:43.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f80a2144640 1 Processor -- start 2024-09-12T03:36:43.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f80a2144640 1 -- start start 2024-09-12T03:36:43.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f80a2144640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f809c1520a0 0x7f809c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f80a2144640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 0x7f809c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f80a2144640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f809c070250 con 0x7f809c15f1d0 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f80a2144640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f809c152480 con 0x7f809c1520a0 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f80a2144640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f809c0aede0 con 0x7f809c06fe50 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f809c15f1d0 0x7f809c071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57406/0 (socket says 172.21.15.73:57406) 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809bfff640 1 -- 172.21.15.73:0/2153916280 learned_addr learned my addr 172.21.15.73:0/2153916280 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809affd640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 0x7f809c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535127641 0 0) 0x7f809c070250 con 0x7f809c15f1d0 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8084003530 con 0x7f809c15f1d0 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809b7fe640 1 --2- 172.21.15.73:0/2153916280 >> v2:172.21.15.150:3300/0 conn(0x7f809c1520a0 0x7f809c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4117825488 0 0) 0x7f8084003530 con 0x7f809c15f1d0 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 msgr2=0x7f809c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 0x7f809c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 >> v2:172.21.15.150:3300/0 conn(0x7f809c1520a0 msgr2=0x7f809c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 --2- 172.21.15.73:0/2153916280 >> v2:172.21.15.150:3300/0 conn(0x7f809c1520a0 0x7f809c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c15fa10 con 0x7f809c15f1d0 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f8094001a00 con 0x7f809c15f1d0 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 >> v1:172.21.15.73:6789/0 conn(0x7f809c15f1d0 legacy=0x7f809c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80840039c0 0x7f8084003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8084004810 0x7f8084004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 0x7f80840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f809c0aede0 con 0x7f80840039c0 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f808400ba00 con 0x7f8084004810 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f808400bc00 con 0x7f809c06fe50 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809b7fe640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80840039c0 0x7f8084003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809bfff640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 0x7f80840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809affd640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8084004810 0x7f8084004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809b7fe640 1 -- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 msgr2=0x7f80840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809b7fe640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f809c06fe50 0x7f80840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809b7fe640 1 -- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8084004810 msgr2=0x7f8084004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809b7fe640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8084004810 0x7f8084004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.790+0000 7f809b7fe640 1 -- 172.21.15.73:0/2153916280 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8084003530 con 0x7f80840039c0 2024-09-12T03:36:43.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f809b7fe640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80840039c0 0x7f8084003de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f808c00ba00 tx=0x7f808c01c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bd564339e19860 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c00b600 con 0x7f80840039c0 2024-09-12T03:36:43.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808c0b1070 con 0x7f80840039c0 2024-09-12T03:36:43.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f809a7fc640 1 -- 172.21.15.73:0/2153916280 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c0ac840 con 0x7f80840039c0 2024-09-12T03:36:43.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- 172.21.15.73:0/2153916280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80840039c0 msgr2=0x7f8084003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 --2- 172.21.15.73:0/2153916280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80840039c0 0x7f8084003de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f808c00ba00 tx=0x7f808c01c660 comp rx=0 tx=0).stop 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f809bfff640 1 -- 172.21.15.73:0/2153916280 reap_dead start 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- 172.21.15.73:0/2153916280 shutdown_connections 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- 172.21.15.73:0/2153916280 >> 172.21.15.73:0/2153916280 conn(0x7f809c0b1f90 msgr2=0x7f809c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- 172.21.15.73:0/2153916280 shutdown_connections 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- 172.21.15.73:0/2153916280 wait complete. 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 Processor -- start 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- start start 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80840039c0 0x7f809c09a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f809c155740 0x7f809c099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c154880 0x7f809c0b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f809c073d30 con 0x7f809c155740 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f809c073a50 con 0x7f809c154880 2024-09-12T03:36:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f80a2144640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f809c15f600 con 0x7f80840039c0 2024-09-12T03:36:43.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.794+0000 7f809affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f809c155740 0x7f809c099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f809c155740 0x7f809c099810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55008/0 (socket says 172.21.15.73:55008) 2024-09-12T03:36:43.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 -- 172.21.15.73:0/422829804 learned_addr learned my addr 172.21.15.73:0/422829804 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:43.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809b7fe640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80840039c0 0x7f809c09a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809bfff640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c154880 0x7f809c0b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 -- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80840039c0 msgr2=0x7f809c09a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80840039c0 0x7f809c09a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 -- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c154880 msgr2=0x7f809c0b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c154880 0x7f809c0b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 -- 172.21.15.73:0/422829804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c1537e0 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809affd640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f809c155740 0x7f809c099810 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f809000f580 tx=0x7f809000fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f8083fff640 1 -- 172.21.15.73:0/422829804 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090019020 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f8083fff640 1 -- 172.21.15.73:0/422829804 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8090014870 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c153ac0 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f8083fff640 1 -- 172.21.15.73:0/422829804 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090014c40 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c154080 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c06f910 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f8083fff640 1 -- 172.21.15.73:0/422829804 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f809001c020 con 0x7f809c155740 2024-09-12T03:36:43.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f8083fff640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80880678c0 0x7f8088069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:43.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f8083fff640 1 -- 172.21.15.73:0/422829804 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f80900865e0 con 0x7f809c155740 2024-09-12T03:36:43.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809b7fe640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80880678c0 0x7f8088069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:43.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.798+0000 7f809b7fe640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80880678c0 0x7f8088069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f808c0b0000 tx=0x7f808c0b7040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:43.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.802+0000 7f8083fff640 1 -- 172.21.15.73:0/422829804 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8090023020 con 0x7f809c155740 2024-09-12T03:36:43.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.986+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f809c15e450 con 0x7f809c155740 2024-09-12T03:36:43.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.986+0000 7f8083fff640 1 -- 172.21.15.73:0/422829804 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5227 (secure 0 0 0) 0x7f80900568b0 con 0x7f809c155740 2024-09-12T03:36:43.988 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:43.988 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"btime":"2024-09-12T03:36:37:437965+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423262735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":423262735},{"type":"v1","addr":"172.21.15.150:6835","nonce":423262735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3010572042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3010572042},{"type":"v1","addr":"172.21.15.150:6833","nonce":3010572042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2140641329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2140641329},{"type":"v1","addr":"172.21.15.73:6836","nonce":2140641329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:33.751869+0000","modified":"2024-09-12T03:36:36.786974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2746514655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2746514655},{"type":"v1","addr":"172.21.15.73:6837","nonce":2746514655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5550,"qdb_cluster":[5550]},"id":4}]} 2024-09-12T03:36:43.989 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80880678c0 msgr2=0x7f8088069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80880678c0 0x7f8088069d80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f808c0b0000 tx=0x7f808c0b7040 comp rx=0 tx=0).stop 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f809c155740 msgr2=0x7f809c099810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f809c155740 0x7f809c099810 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f809000f580 tx=0x7f809000fa40 comp rx=0 tx=0).stop 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 shutdown_connections 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f80880678c0 0x7f8088069d80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f809c155740 0x7f809c099810 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f809c154880 0x7f809c0b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 --2- 172.21.15.73:0/422829804 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f80840039c0 0x7f809c09a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 >> 172.21.15.73:0/422829804 conn(0x7f809c0b1f90 msgr2=0x7f809c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 shutdown_connections 2024-09-12T03:36:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:43.990+0000 7f80a2144640 1 -- 172.21.15.73:0/422829804 wait complete. 2024-09-12T03:36:44.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:36:33.751869+0000', 'modified': '2024-09-12T03:36:36.786974+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5550': {'gid': 5550, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/2746514655', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2746514655}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2746514655}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5550, 'qdb_cluster': [5550]} 2024-09-12T03:36:44.409 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:36:44.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-12T03:36:44.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8ff521640 1 Processor -- start 2024-09-12T03:36:44.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8ff521640 1 -- start start 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8ff521640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd8f81587a0 0x7fd8f80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8ff521640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd8f80b37d0 0x7fd8f806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8ff521640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f806ec60 con 0x7fd8f806e4b0 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8ff521640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f80b3c40 con 0x7fd8f80b37d0 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8ff521640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f806f870 con 0x7fd8f81587a0 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8fdabe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd8f806e4b0 0x7fd8f8161e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57414/0 (socket says 172.21.15.73:57414) 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8fdabe640 1 -- 172.21.15.73:0/4198730411 learned_addr learned my addr 172.21.15.73:0/4198730411 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/4198730411 >> v2:172.21.15.73:3300/0 conn(0x7fd8f80b37d0 0x7fd8f806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/4198730411 >> v2:172.21.15.150:3300/0 conn(0x7fd8f81587a0 0x7fd8f80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8effff640 1 -- 172.21.15.73:0/4198730411 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464101350 0 0) 0x7fd8f806ec60 con 0x7fd8f806e4b0 2024-09-12T03:36:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8effff640 1 -- 172.21.15.73:0/4198730411 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8e4003530 con 0x7fd8f806e4b0 2024-09-12T03:36:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8fcabc640 1 -- 172.21.15.73:0/4198730411 >> v2:172.21.15.150:3300/0 conn(0x7fd8f81587a0 msgr2=0x7fd8f80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.534+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/4198730411 >> v2:172.21.15.150:3300/0 conn(0x7fd8f81587a0 0x7fd8f80b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8fcabc640 1 -- 172.21.15.73:0/4198730411 >> v1:172.21.15.73:6789/0 conn(0x7fd8f806e4b0 legacy=0x7fd8f8161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8fcabc640 1 -- 172.21.15.73:0/4198730411 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f806ef40 con 0x7fd8f80b37d0 2024-09-12T03:36:44.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/4198730411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f806df70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8071710 tx=0x7fd8e801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385c9921ad2166f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8effff640 1 -- 172.21.15.73:0/4198730411 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80b0070 con 0x7fd8f80b37d0 2024-09-12T03:36:44.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8effff640 1 -- 172.21.15.73:0/4198730411 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e80ab600 con 0x7fd8f80b37d0 2024-09-12T03:36:44.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8effff640 1 -- 172.21.15.73:0/4198730411 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80ab9d0 con 0x7fd8f80b37d0 2024-09-12T03:36:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 -- 172.21.15.73:0/4198730411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 msgr2=0x7fd8f806df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 --2- 172.21.15.73:0/4198730411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f806df70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8071710 tx=0x7fd8e801c450 comp rx=0 tx=0).stop 2024-09-12T03:36:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 -- 172.21.15.73:0/4198730411 shutdown_connections 2024-09-12T03:36:44.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 --2- 172.21.15.73:0/4198730411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f806df70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 --2- 172.21.15.73:0/4198730411 >> v2:172.21.15.150:3300/0 conn(0x7fd8f81587a0 0x7fd8f80b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 -- 172.21.15.73:0/4198730411 >> 172.21.15.73:0/4198730411 conn(0x7fd8f80b1f90 msgr2=0x7fd8f80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 -- 172.21.15.73:0/4198730411 shutdown_connections 2024-09-12T03:36:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.538+0000 7fd8ff521640 1 -- 172.21.15.73:0/4198730411 wait complete. 2024-09-12T03:36:44.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 Processor -- start 2024-09-12T03:36:44.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 -- start start 2024-09-12T03:36:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f806e4b0 0x7fd8f81473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f81599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f81587a0 0x7fd8f8159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8158b80 con 0x7fd8f80b37d0 2024-09-12T03:36:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8073170 con 0x7fd8f81587a0 2024-09-12T03:36:44.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f809d440 con 0x7fd8f806e4b0 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f81599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f81599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55020/0 (socket says 172.21.15.73:55020) 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 -- 172.21.15.73:0/1792741234 learned_addr learned my addr 172.21.15.73:0/1792741234 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 -- 172.21.15.73:0/1792741234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f806e4b0 msgr2=0x7fd8f81473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f806e4b0 0x7fd8f81473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 -- 172.21.15.73:0/1792741234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f81587a0 msgr2=0x7fd8f8159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f81587a0 0x7fd8f8159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 -- 172.21.15.73:0/1792741234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f809d720 con 0x7fd8f80b37d0 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f81599e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80ae040 tx=0x7fd8e80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8edffb640 1 -- 172.21.15.73:0/1792741234 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80b0040 con 0x7fd8f80b37d0 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8edffb640 1 -- 172.21.15.73:0/1792741234 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e80b9070 con 0x7fd8f80b37d0 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f809da00 con 0x7fd8f80b37d0 2024-09-12T03:36:44.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8edffb640 1 -- 172.21.15.73:0/1792741234 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80b4690 con 0x7fd8f80b37d0 2024-09-12T03:36:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f809dfc0 con 0x7fd8f80b37d0 2024-09-12T03:36:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8edffb640 1 -- 172.21.15.73:0/1792741234 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8e80b4830 con 0x7fd8f80b37d0 2024-09-12T03:36:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8edffb640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8dc067910 0x7fd8dc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8edffb640 1 -- 172.21.15.73:0/1792741234 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd8e811fad0 con 0x7fd8f80b37d0 2024-09-12T03:36:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.542+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8dc067910 0x7fd8dc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8dc067910 0x7fd8dc069dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8156090 tx=0x7fd8f400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 Processor -- start 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- start start 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x558483830f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584837e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837e7290 0x5584837e7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5584836ceb60 con 0x558483831440 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558483635c70 con 0x5584837e7290 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x5584835dbed0 con 0x558483830b20 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584837e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584837e6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55030/0 (socket says 172.21.15.73:55030) 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 -- 172.21.15.73:0/493273545 learned_addr learned my addr 172.21.15.73:0/493273545 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837e7290 0x5584837e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x558483830f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 -- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 msgr2=0x558483830f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x558483830f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 -- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837e7290 msgr2=0x5584837e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837e7290 0x5584837e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 -- 172.21.15.73:0/493273545 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584835ede50 con 0x558483831440 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837e7290 0x5584837e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584837e6d50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80f8510 tx=0x7fd8e80efaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dbcca4e142a247 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8e2ffd640 1 -- 172.21.15.73:0/493273545 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e811c070 con 0x558483831440 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8e2ffd640 1 -- 172.21.15.73:0/493273545 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e80efe60 con 0x558483831440 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd8e2ffd640 1 -- 172.21.15.73:0/493273545 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80f4210 con 0x558483831440 2024-09-12T03:36:44.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- 172.21.15.73:0/493273545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 msgr2=0x5584837e6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584837e6d50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80f8510 tx=0x7fd8e80efaa0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- 172.21.15.73:0/493273545 shutdown_connections 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584837e6d50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837e7290 0x5584837e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 --2- 172.21.15.73:0/493273545 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x558483830f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- 172.21.15.73:0/493273545 >> 172.21.15.73:0/493273545 conn(0x5584837ed600 msgr2=0x5584837e5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- 172.21.15.73:0/493273545 shutdown_connections 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- 172.21.15.73:0/493273545 wait complete. 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 -- start start 2024-09-12T03:36:44.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.546+0000 7fd9025dd000 1 Processor -- start 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558483830b20 0x5584837ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x5584837ec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584837f1cf0 0x5584837f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558483697b00 con 0x5584837f1cf0 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x558483610360 con 0x558483830b20 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55848360d2d0 con 0x558483831440 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 10 client.0 _ll_register_callbacks cb 0x5584837d2820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584837f1cf0 0x5584837f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584837f1cf0 0x5584837f20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55046/0 (socket says 172.21.15.73:55046) 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 -- 172.21.15.73:0/213810608 learned_addr learned my addr 172.21.15.73:0/213810608 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x5584837ec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558483830b20 0x5584837ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 -- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 msgr2=0x5584837ec150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x5584837ec150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 -- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558483830b20 msgr2=0x5584837ebc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558483830b20 0x5584837ebc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 -- 172.21.15.73:0/213810608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584835dc120 con 0x5584837f1cf0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558483830b20 0x5584837ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584837f1cf0 0x5584837f20d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0001e10 tx=0x7fd8f000d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce253b81a439dbe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 1 -- 172.21.15.73:0/213810608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0018060 con 0x5584837f1cf0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e80efe60 con 0x5584837f1cf0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 1 -- 172.21.15.73:0/213810608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd8f0005ae0 con 0x5584837f1cf0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 1 -- 172.21.15.73:0/213810608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd8f0005ce0 con 0x5584837f1cf0 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 10 client.5709 fetch_fsmap learned FSMap version 32 2024-09-12T03:36:44.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x5584835d5450 con 0x5584837f1cf0 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 1 -- 172.21.15.73:0/213810608 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e80efe60 con 0x5584837f1cf0 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 1 -- 172.21.15.73:0/213810608 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7fd8f0021080 con 0x5584837f1cf0 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 10 client.5709 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 10 client.5709 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 20 client.5709 populate_metadata read hostname 'smithi073' 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848383f280 0x558483841670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 4 client.5709 mds_command: new command op to 5550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 --> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584835cfc00 con 0x55848383f280 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848383f280 0x558483841670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848383f280 0x558483841670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cec3d194f8dd38a6 server_cookie=c412d4094ff53f36 in_seq=0 out_seq=0 2024-09-12T03:36:44.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 10 client.5709 ms_handle_connect on v2:172.21.15.73:6835/2746514655 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 1 -- 172.21.15.73:0/213810608 <== mds.0 v2:172.21.15.73:6835/2746514655 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584835cfc00 con 0x55848383f280 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 10 client.5709 handle_command_reply: tid=0 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 client.5709 shutdown 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584837f1cf0 msgr2=0x5584837f20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584837f1cf0 0x5584837f20d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0001e10 tx=0x7fd8f000d5e0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 shutdown_connections 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848383f280 0x558483841670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584837f1cf0 0x5584837f20d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x5584837ec150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd8d7fff640 0 client.5709 ms_handle_reset on v2:172.21.15.73:6835/2746514655 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 --2- 172.21.15.73:0/213810608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558483830b20 0x5584837ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 >> 172.21.15.73:0/213810608 conn(0x5584837e7290 msgr2=0x5584837e5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 shutdown_connections 2024-09-12T03:36:44.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 1 -- 172.21.15.73:0/213810608 wait complete. 2024-09-12T03:36:44.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.550+0000 7fd9025dd000 20 client.5709 trim_cache size 0 max 16384 2024-09-12T03:36:44.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 Processor -- start 2024-09-12T03:36:44.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- start start 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x55848382fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483830b20 0x5584838300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x558483841670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8202ab0 con 0x558483830b20 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81467e0 con 0x5584837f1cf0 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f82024e0 con 0x558483831440 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483830b20 0x5584838300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483830b20 0x5584838300a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55056/0 (socket says 172.21.15.73:55056) 2024-09-12T03:36:44.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 -- 172.21.15.73:0/2318723966 learned_addr learned my addr 172.21.15.73:0/2318723966 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x55848382fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x558483841670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 -- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 msgr2=0x558483841670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x558483841670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 -- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 msgr2=0x55848382fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x55848382fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 -- 172.21.15.73:0/2318723966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584835bcfd0 con 0x558483830b20 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483830b20 0x5584838300a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd8e811dfa0 tx=0x7fd8e80f3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f86fd3b90be5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8e27fc640 1 -- 172.21.15.73:0/2318723966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e810c020 con 0x558483830b20 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8e27fc640 1 -- 172.21.15.73:0/2318723966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e80f8a40 con 0x558483830b20 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd8e27fc640 1 -- 172.21.15.73:0/2318723966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e811c040 con 0x558483830b20 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- 172.21.15.73:0/2318723966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483830b20 msgr2=0x5584838300a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483830b20 0x5584838300a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd8e811dfa0 tx=0x7fd8e80f3000 comp rx=0 tx=0).stop 2024-09-12T03:36:44.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- 172.21.15.73:0/2318723966 shutdown_connections 2024-09-12T03:36:44.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483830b20 0x5584838300a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483831440 0x558483841670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2318723966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x55848382fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- 172.21.15.73:0/2318723966 >> 172.21.15.73:0/2318723966 conn(0x5584837e7290 msgr2=0x5584837e8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- 172.21.15.73:0/2318723966 shutdown_connections 2024-09-12T03:36:44.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- 172.21.15.73:0/2318723966 wait complete. 2024-09-12T03:36:44.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 -- start start 2024-09-12T03:36:44.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.570+0000 7fd9025dd000 1 Processor -- start 2024-09-12T03:36:44.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x558483844640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x5584838a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584838a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x558483634f80 con 0x558483831440 2024-09-12T03:36:44.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x5584835edca0 con 0x5584837f1cf0 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55848363a2a0 con 0x558483830b20 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 10 client.0 _ll_register_callbacks cb 0x7fd8f0007c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584838a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584838a32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55072/0 (socket says 172.21.15.73:55072) 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 -- 172.21.15.73:0/2360335198 learned_addr learned my addr 172.21.15.73:0/2360335198 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x558483844640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fcabc640 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x5584838a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 -- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 msgr2=0x5584838a2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x5584838a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 -- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 msgr2=0x558483844640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x558483844640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 -- 172.21.15.73:0/2360335198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584836b8750 con 0x558483831440 2024-09-12T03:36:44.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fdabe640 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584838a32c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0001720 tx=0x7fd8f0001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a11392fb93f28cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 1 -- 172.21.15.73:0/2360335198 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f002d060 con 0x558483831440 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 1 -- 172.21.15.73:0/2360335198 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd8f0007910 con 0x558483831440 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8e80f8a40 con 0x558483831440 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 1 -- 172.21.15.73:0/2360335198 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd8f0033050 con 0x558483831440 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 10 client.5715 fetch_fsmap learned FSMap version 32 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) -- 0x5584835c3a30 con 0x558483831440 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 1 -- 172.21.15.73:0/2360335198 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e80f8a40 con 0x558483831440 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 1 -- 172.21.15.73:0/2360335198 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 32) ==== 3502+0+0 (secure 0 0 0) 0x7fd8f0036020 con 0x558483831440 2024-09-12T03:36:44.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 10 client.5715 fetch_fsmap finished waiting for FSMap version 32 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 10 client.5715 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 20 client.5715 populate_metadata read hostname 'smithi073' 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848385f960 0x55848385fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 4 client.5715 mds_command: new command op to 5550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 --> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] -- command(tid 0: {"prefix": "status"}) -- 0x5584836433a0 con 0x55848385f960 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848385f960 0x55848385fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 10 client.5715 ms_handle_connect on v2:172.21.15.73:6835/2746514655 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8fd2bd640 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848385f960 0x55848385fd40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee7dcefb51625bc server_cookie=4498a297ef5414e6 in_seq=0 out_seq=0 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 1 -- 172.21.15.73:0/2360335198 <== mds.0 v2:172.21.15.73:6835/2746514655 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5584836433a0 con 0x55848385f960 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 10 client.5715 handle_command_reply: tid=0 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 client.5715 shutdown 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 msgr2=0x5584838a32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584838a32c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0001720 tx=0x7fd8f0001160 comp rx=0 tx=0).stop 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 shutdown_connections 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:6835/2746514655,v1:172.21.15.73:6837/2746514655] conn(0x55848385f960 0x55848385fd40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558483831440 0x5584838a32c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x558483830b20 0x5584838a2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8d7fff640 0 client.5715 ms_handle_reset on v2:172.21.15.73:6835/2746514655 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 --2- 172.21.15.73:0/2360335198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5584837f1cf0 0x558483844640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 >> 172.21.15.73:0/2360335198 conn(0x5584837e7290 msgr2=0x55848382eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 shutdown_connections 2024-09-12T03:36:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 1 -- 172.21.15.73:0/2360335198 wait complete. 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd9025dd000 20 client.5715 trim_cache size 0 max 16384 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5550, 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.152701817000001, 2024-09-12T03:36:44.584 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 32, 2024-09-12T03:36:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 64, 2024-09-12T03:36:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 64, 2024-09-12T03:36:44.585 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 15.261121949 2024-09-12T03:36:44.585 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:36:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8dc067910 msgr2=0x7fd8dc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8dc067910 0x7fd8dc069dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8156090 tx=0x7fd8f400b040 comp rx=0 tx=0).stop 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 msgr2=0x7fd8f81599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f81599e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80ae040 tx=0x7fd8e80191f0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 shutdown_connections 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd8dc067910 0x7fd8dc069dd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8f80b37d0 0x7fd8f81599e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd8f81587a0 0x7fd8f8159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 --2- 172.21.15.73:0/1792741234 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd8f806e4b0 0x7fd8f81473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 >> 172.21.15.73:0/1792741234 conn(0x7fd8f80b1f90 msgr2=0x7fd8f8075030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 shutdown_connections 2024-09-12T03:36:44.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.574+0000 7fd8ff521640 1 -- 172.21.15.73:0/1792741234 wait complete. 2024-09-12T03:36:44.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:36:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd173351640 1 Processor -- start 2024-09-12T03:36:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd173351640 1 -- start start 2024-09-12T03:36:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd173351640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 0x7fd16c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd173351640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0d0b80 con 0x7fd16c0b51b0 2024-09-12T03:36:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd173351640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0d0e60 con 0x7fd16c0b3330 2024-09-12T03:36:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd173351640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c0b46d0 con 0x7fd16c15bc80 2024-09-12T03:36:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd16c0b51b0 0x7fd16c15b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57424/0 (socket says 172.21.15.73:57424) 2024-09-12T03:36:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 -- 172.21.15.73:0/4121399605 learned_addr learned my addr 172.21.15.73:0/4121399605 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1718ee640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 0x7fd16c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135246118 0 0) 0x7fd16c0d0b80 con 0x7fd16c0b51b0 2024-09-12T03:36:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd158005740 con 0x7fd16c0b51b0 2024-09-12T03:36:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2171406591 0 0) 0x7fd158005740 con 0x7fd16c0b51b0 2024-09-12T03:36:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 msgr2=0x7fd16c0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 0x7fd16c0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 >> v1:172.21.15.150:6789/0 conn(0x7fd16c0b3330 legacy=0x7fd16c0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c0b49b0 con 0x7fd16c0b51b0 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fd1600016a0 con 0x7fd16c0b51b0 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 >> v1:172.21.15.73:6789/0 conn(0x7fd16c0b51b0 legacy=0x7fd16c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 0x7fd158005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd158006180 0x7fd158006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd158006f60 0x7fd1580073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c0b46d0 con 0x7fd158006180 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd15800dd70 con 0x7fd158006f60 2024-09-12T03:36:44.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd15800df70 con 0x7fd16c15bc80 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd158006180 0x7fd158006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1718ee640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd158006f60 0x7fd1580073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 -- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 msgr2=0x7fd158005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1710ed640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 0x7fd158005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd16c15bc80 0x7fd158005c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 -- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd158006f60 msgr2=0x7fd1580073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd158006f60 0x7fd1580073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1708ec640 1 -- 172.21.15.73:0/4121399605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd158005740 con 0x7fd158006180 2024-09-12T03:36:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.698+0000 7fd1718ee640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd158006f60 0x7fd1580073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1708ec640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd158006180 0x7fd158006a20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c210 tx=0x7fd16001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4afdd0218f707f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160007d20 con 0x7fd158006180 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1600a9020 con 0x7fd158006180 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd15ffff640 1 -- 172.21.15.73:0/4121399605 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd160005b20 con 0x7fd158006180 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- 172.21.15.73:0/4121399605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd158006180 msgr2=0x7fd158006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 --2- 172.21.15.73:0/4121399605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd158006180 0x7fd158006a20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd16000c210 tx=0x7fd16001cc40 comp rx=0 tx=0).stop 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 -- 172.21.15.73:0/4121399605 reap_dead start 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- 172.21.15.73:0/4121399605 shutdown_connections 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- 172.21.15.73:0/4121399605 >> 172.21.15.73:0/4121399605 conn(0x7fd16c0b6870 msgr2=0x7fd16c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- 172.21.15.73:0/4121399605 shutdown_connections 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- 172.21.15.73:0/4121399605 wait complete. 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 Processor -- start 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- start start 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158006180 0x7fd16c0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16c13f190 0x7fd16c142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd16c15ad50 0x7fd16c0ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c144f10 con 0x7fd16c15ad50 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c0d0840 con 0x7fd16c13f190 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd173351640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c06bcc0 con 0x7fd158006180 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd16c15ad50 0x7fd16c0ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd16c15ad50 0x7fd16c0ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55094/0 (socket says 172.21.15.73:55094) 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 -- 172.21.15.73:0/3361493845 learned_addr learned my addr 172.21.15.73:0/3361493845 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:44.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1710ed640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158006180 0x7fd16c0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1708ec640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16c13f190 0x7fd16c142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 -- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158006180 msgr2=0x7fd16c0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158006180 0x7fd16c0aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 -- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16c13f190 msgr2=0x7fd16c142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16c13f190 0x7fd16c142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.702+0000 7fd1718ee640 1 -- 172.21.15.73:0/3361493845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c143f80 con 0x7fd16c15ad50 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd1718ee640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd16c15ad50 0x7fd16c0ab4d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0741d0 tx=0x7fd16400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd15dffb640 1 -- 172.21.15.73:0/3361493845 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16401c070 con 0x7fd16c15ad50 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd15dffb640 1 -- 172.21.15.73:0/3361493845 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd164017400 con 0x7fd16c15ad50 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c144260 con 0x7fd16c15ad50 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd15dffb640 1 -- 172.21.15.73:0/3361493845 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1640177d0 con 0x7fd16c15ad50 2024-09-12T03:36:44.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c1425d0 con 0x7fd16c15ad50 2024-09-12T03:36:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16c0b3710 con 0x7fd16c15ad50 2024-09-12T03:36:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd15dffb640 1 -- 172.21.15.73:0/3361493845 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd16401f070 con 0x7fd16c15ad50 2024-09-12T03:36:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd15dffb640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1500678f0 0x7fd150069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd15dffb640 1 -- 172.21.15.73:0/3361493845 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd164085fb0 con 0x7fd16c15ad50 2024-09-12T03:36:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd1710ed640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1500678f0 0x7fd150069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.706+0000 7fd1710ed640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1500678f0 0x7fd150069db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd168007fd0 tx=0x7fd168009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:44.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.710+0000 7fd15dffb640 1 -- 172.21.15.73:0/3361493845 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd164012070 con 0x7fd16c15ad50 2024-09-12T03:36:44.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.902+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd16c144530 con 0x7fd16c15ad50 2024-09-12T03:36:44.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.902+0000 7fd15dffb640 1 -- 172.21.15.73:0/3361493845 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) ==== 53+0+73 (secure 0 0 0) 0x7fd164056960 con 0x7fd16c15ad50 2024-09-12T03:36:44.906 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1500678f0 msgr2=0x7fd150069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1500678f0 0x7fd150069db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd168007fd0 tx=0x7fd168009040 comp rx=0 tx=0).stop 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd16c15ad50 msgr2=0x7fd16c0ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd16c15ad50 0x7fd16c0ab4d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0741d0 tx=0x7fd16400f4a0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 shutdown_connections 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd1500678f0 0x7fd150069db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd16c15ad50 0x7fd16c0ab4d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16c13f190 0x7fd16c142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 --2- 172.21.15.73:0/3361493845 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd158006180 0x7fd16c0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 >> 172.21.15.73:0/3361493845 conn(0x7fd16c0b6870 msgr2=0x7fd16c0b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 shutdown_connections 2024-09-12T03:36:44.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:44.906+0000 7fd173351640 1 -- 172.21.15.73:0/3361493845 wait complete. 2024-09-12T03:36:44.923 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:36:44.923 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:36:44.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:36:44.923 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T03:36:44.923 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:44.923 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:36:44.924 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:36:44.924 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:36:44.924 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:36:44.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:44.924 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:44.930 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42364sec preferred_lft 42364sec 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:36:44.931 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:44.932 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:36:44.933 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:44.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:44.933 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:36:44.984 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:36:44.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:44.986 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:36:45.039 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:36:45.039 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:36:45.039 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:36:45.039 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:36:45.039 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:36:45.040 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:36:45.040 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:36:45.040 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:45.040 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:45.040 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:45.040 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:36:45.040 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:36:45.040 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:36:45.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:36:45.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:36:45.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:36:45.041 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:36:45.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:36:45.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:45.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:45.160 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:36:45.207 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T03:36:45.207 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:36:45.208 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:36:45.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:45.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:36:45.264 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T03:36:45.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:45.264 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:45.310 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:36:45.311 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:45.311 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:45.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:36:45.416 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:36:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:36:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:36:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:36:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:36:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:36:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:36:45.465 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:36:45.466 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:36:45.467 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:45.467 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:45.467 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:45.467 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:45.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:45.468 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:36:45.515 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:36:45.515 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T03:36:45.560 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:36:45.576 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:45.624 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:36:45.624 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:36:45.624 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:36:45.624 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:36:45.624 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:36:45.624 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:36:45.625 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:36:45.626 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:36:45.627 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:45.627 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:45.627 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:45.627 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:45.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:45.627 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:36:45.635 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-09-12T03:36:45.634+0000 7f7c8ac7a580 -1 init, newargv = 0x55583238dc70 newargc=15 2024-09-12T03:36:45.635 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[40478]: starting ceph client 2024-09-12T03:36:45.641 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[40478]: starting fuse 2024-09-12T03:36:46.740 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:36:46.756 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:36:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:36:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:36:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:36:46.805 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:36:46.806 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:46.807 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:36:46.808 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:46.808 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:36:46.808 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:46.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:46.809 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:36:46.855 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:36:46.855 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:36:46.855 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:36:46.855 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:36:46.856 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-09-12T03:36:46.857 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:36:46.980 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.40478.asok 2024-09-12T03:36:46.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:46.992 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.40478.asok 2024-09-12T03:36:46.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:46.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.40478.asok status 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T03:36:47.148 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "40478", 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5730, 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5730 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:47.149 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3947653254 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3947653254 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.5730 192.168.0.1:0/3947653254", 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/3947653254", 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 32, 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 64, 2024-09-12T03:36:47.150 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:36:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:36:47.151 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:36:47.151 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:36:47.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:47.162 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:36:47.162 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:47.168 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:36:47.168 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:47.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:47.168 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:47.222 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:36:47.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560ede0640 1 Processor -- start 2024-09-12T03:36:47.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560ede0640 1 -- start start 2024-09-12T03:36:47.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560ede0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f560815bec0 0x7f56080ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:47.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560ede0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56080af470 0x7f560806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:47.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560ede0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56080b3290 con 0x7f560815c2a0 2024-09-12T03:36:47.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560ede0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f56080b3570 con 0x7f56080af470 2024-09-12T03:36:47.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560ede0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f56080b3850 con 0x7f560815bec0 2024-09-12T03:36:47.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560d37d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56080af470 0x7f560806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:47.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560d37d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56080af470 0x7f560806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52714/0 (socket says 172.21.15.73:52714) 2024-09-12T03:36:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.382+0000 7f560d37d640 1 -- 172.21.15.73:0/581481861 learned_addr learned my addr 172.21.15.73:0/581481861 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560cb7c640 1 --2- 172.21.15.73:0/581481861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f560815bec0 0x7f56080ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560d37d640 1 -- 172.21.15.73:0/581481861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f560815bec0 msgr2=0x7f56080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560d37d640 1 --2- 172.21.15.73:0/581481861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f560815bec0 0x7f56080ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560d37d640 1 -- 172.21.15.73:0/581481861 >> v1:172.21.15.150:6789/0 conn(0x7f560815c2a0 legacy=0x7f56080aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:47.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560d37d640 1 -- 172.21.15.73:0/581481861 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56080b3b30 con 0x7f56080af470 2024-09-12T03:36:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560d37d640 1 --2- 172.21.15.73:0/581481861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56080af470 0x7f560806e000 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009870 tx=0x7f55f801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d5605d42002619 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f56077fe640 1 -- 172.21.15.73:0/581481861 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f80aa610 con 0x7f56080af470 2024-09-12T03:36:47.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f56077fe640 1 -- 172.21.15.73:0/581481861 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f80af070 con 0x7f56080af470 2024-09-12T03:36:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f56077fe640 1 -- 172.21.15.73:0/581481861 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f80aa9d0 con 0x7f56080af470 2024-09-12T03:36:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 -- 172.21.15.73:0/581481861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56080af470 msgr2=0x7f560806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 --2- 172.21.15.73:0/581481861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56080af470 0x7f560806e000 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009870 tx=0x7f55f801c4f0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 -- 172.21.15.73:0/581481861 shutdown_connections 2024-09-12T03:36:47.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 --2- 172.21.15.73:0/581481861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56080af470 0x7f560806e000 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 --2- 172.21.15.73:0/581481861 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f560815bec0 0x7f56080ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 -- 172.21.15.73:0/581481861 >> 172.21.15.73:0/581481861 conn(0x7f56080b1f90 msgr2=0x7f56080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 -- 172.21.15.73:0/581481861 shutdown_connections 2024-09-12T03:36:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.386+0000 7f560ede0640 1 -- 172.21.15.73:0/581481861 wait complete. 2024-09-12T03:36:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 Processor -- start 2024-09-12T03:36:47.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 -- start start 2024-09-12T03:36:47.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56080af470 0x7f56081544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f560815bec0 0x7f56081549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f560815c2a0 0x7f5608148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f560806ed50 con 0x7f560815c2a0 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56080ad740 con 0x7f560815bec0 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f560806eed0 con 0x7f56080af470 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f560815c2a0 0x7f5608148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f560815c2a0 0x7f5608148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52730/0 (socket says 172.21.15.73:52730) 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 -- 172.21.15.73:0/3207596593 learned_addr learned my addr 172.21.15.73:0/3207596593 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560cb7c640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56080af470 0x7f56081544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f5607fff640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f560815bec0 0x7f56081549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 -- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56080af470 msgr2=0x7f56081544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:47.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56080af470 0x7f56081544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 -- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f560815bec0 msgr2=0x7f56081549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f560815bec0 0x7f56081549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 -- 172.21.15.73:0/3207596593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560814bc80 con 0x7f560815c2a0 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560cb7c640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56080af470 0x7f56081544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f5607fff640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f560815bec0 0x7f56081549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560d37d640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f560815c2a0 0x7f5608148f00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f55f801aba0 tx=0x7f55f801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f56057fa640 1 -- 172.21.15.73:0/3207596593 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f80bd5f0 con 0x7f560815c2a0 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f56057fa640 1 -- 172.21.15.73:0/3207596593 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f80bd790 con 0x7f560815c2a0 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5608072620 con 0x7f560815c2a0 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f56057fa640 1 -- 172.21.15.73:0/3207596593 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f80bdb80 con 0x7f560815c2a0 2024-09-12T03:36:47.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56080b0e40 con 0x7f560815c2a0 2024-09-12T03:36:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560806e000 con 0x7f560815c2a0 2024-09-12T03:36:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.390+0000 7f56057fa640 1 -- 172.21.15.73:0/3207596593 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55f80b33f0 con 0x7f560815c2a0 2024-09-12T03:36:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.394+0000 7f56057fa640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f55ec0678c0 0x7f55ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.394+0000 7f560cb7c640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f55ec0678c0 0x7f55ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:47.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.394+0000 7f56057fa640 1 -- 172.21.15.73:0/3207596593 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f55f8120950 con 0x7f560815c2a0 2024-09-12T03:36:47.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.394+0000 7f560cb7c640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f55ec0678c0 0x7f55ec069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5600007330 tx=0x7f560000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:47.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.398+0000 7f56057fa640 1 -- 172.21.15.73:0/3207596593 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55f80c3060 con 0x7f560815c2a0 2024-09-12T03:36:47.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f560806fcd0 con 0x7f560815c2a0 2024-09-12T03:36:47.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f56057fa640 1 -- 172.21.15.73:0/3207596593 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) ==== 53+0+73 (secure 0 0 0) 0x7f55f80a7070 con 0x7f560815c2a0 2024-09-12T03:36:47.592 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:36:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f55ec0678c0 msgr2=0x7f55ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f55ec0678c0 0x7f55ec069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5600007330 tx=0x7f560000b040 comp rx=0 tx=0).stop 2024-09-12T03:36:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f560815c2a0 msgr2=0x7f5608148f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f560815c2a0 0x7f5608148f00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f55f801aba0 tx=0x7f55f801ad30 comp rx=0 tx=0).stop 2024-09-12T03:36:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 shutdown_connections 2024-09-12T03:36:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f55ec0678c0 0x7f55ec069d80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f560815c2a0 0x7f5608148f00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f560815bec0 0x7f56081549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 --2- 172.21.15.73:0/3207596593 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56080af470 0x7f56081544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:47.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 >> 172.21.15.73:0/3207596593 conn(0x7f56080b1f90 msgr2=0x7f560814f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:47.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 shutdown_connections 2024-09-12T03:36:47.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:47.590+0000 7f560ede0640 1 -- 172.21.15.73:0/3207596593 wait complete. 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:36:47.609 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:36:47.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:47.610 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:36:47.617 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:36:47.617 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:36:47.617 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:36:47.617 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.617 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:36:47.617 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.617 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42372sec preferred_lft 42372sec 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:36:47.618 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:36:47.619 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.620 INFO:teuthology.orchestra.run.smithi150.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:36:47.620 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:47.620 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:36:47.620 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:36:47.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:47.620 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:36:47.672 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:36:47.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:47.673 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:36:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:36:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:36:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:36:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:36:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:36:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:36:47.726 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:36:47.727 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:47.727 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:47.727 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:36:47.727 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:36:47.727 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:36:47.727 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:36:47.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:36:47.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:36:47.727 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:36:47.727 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:36:47.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:36:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:36:47.842 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:36:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:47.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:47.850 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:36:47.855 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:36:47.855 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:36:47.856 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:36:47.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:47.856 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:36:47.910 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:36:47.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:47.911 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:47.957 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:36:47.957 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:36:47.957 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:48.004 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:36:48.062 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:48.109 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:36:48.110 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:36:48.111 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:48.112 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:48.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:48.113 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:36:48.161 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:36:48.161 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T03:36:48.206 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:36:48.221 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:36:48.269 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:36:48.270 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:48.271 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:48.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:48.272 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:36:48.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:36:48.280+0000 7fc5e77ae580 -1 init, newargv = 0x5583b6f69ef0 newargc=15 2024-09-12T03:36:48.284 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35055]: starting ceph client 2024-09-12T03:36:48.291 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35055]: starting fuse 2024-09-12T03:36:49.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:36:49.406 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:36:49.454 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:36:49.455 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:36:49.456 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:49.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.457 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:36:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:36:49.501 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:36:49.501 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:36:49.502 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:36:49.503 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:36:49.503 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:36:49.625 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.35055.asok 2024-09-12T03:36:49.629 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:36:49.637 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35055.asok 2024-09-12T03:36:49.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.637 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35055.asok status 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "35055", 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:36:49.798 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4811, 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4811 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 4274072297 2024-09-12T03:36:49.799 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 4274072297 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4811 192.168.0.1:0/4274072297", 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/4274072297", 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 32, 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 64, 2024-09-12T03:36:49.800 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:36:49.801 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:36:49.801 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:36:49.801 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:36:49.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.813 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:36:49.813 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:49.819 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:36:49.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:49.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.820 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:49.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.873 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T03:36:49.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.888 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:49.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2024-09-12T03:36:49.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.939 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10K ./subdir) 2024-09-12T03:36:49.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:49.994 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.047 INFO:teuthology.orchestra.run.smithi073.stdout:10240 2024-09-12T03:36:50.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.047 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 100Ki ./subdir) 2024-09-12T03:36:50.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.104 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.157 INFO:teuthology.orchestra.run.smithi073.stdout:102400 2024-09-12T03:36:50.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.158 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 10M ./subdir) 2024-09-12T03:36:50.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.209 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.257 INFO:teuthology.orchestra.run.smithi073.stdout:10485760 2024-09-12T03:36:50.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.258 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 100Mi ./subdir) 2024-09-12T03:36:50.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.308 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.357 INFO:teuthology.orchestra.run.smithi073.stdout:104857600 2024-09-12T03:36:50.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.358 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 2G ./subdir) 2024-09-12T03:36:50.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.411 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.460 INFO:teuthology.orchestra.run.smithi073.stdout:2147483648 2024-09-12T03:36:50.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.461 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 4Gi ./subdir) 2024-09-12T03:36:50.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.515 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.566 INFO:teuthology.orchestra.run.smithi073.stdout:4294967296 2024-09-12T03:36:50.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.566 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1T ./subdir) 2024-09-12T03:36:50.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.621 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.670 INFO:teuthology.orchestra.run.smithi073.stdout:1099511627776 2024-09-12T03:36:50.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.670 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 2Ti ./subdir) 2024-09-12T03:36:50.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:50.725 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2024-09-12T03:36:50.775 INFO:teuthology.orchestra.run.smithi073.stdout:2199023255552 2024-09-12T03:36:50.775 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:36:50.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:36:50.868 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:36:50.906 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:36:50.906 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:50.906 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:36:50.906 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:50.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:36:51.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54c5483640 1 Processor -- start 2024-09-12T03:36:51.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54c5483640 1 -- start start 2024-09-12T03:36:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54c5483640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54c015bec0 0x7f54c00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54c5483640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c015c2a0 0x7f54c00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54c5483640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c00b3290 con 0x7f54c00af2a0 2024-09-12T03:36:51.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54c5483640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f54c00b3570 con 0x7f54c015bec0 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54c5483640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f54c00b3850 con 0x7f54c015c2a0 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54beffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54c015bec0 0x7f54c00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54bf7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f54c00af2a0 0x7f54c015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43572/0 (socket says 172.21.15.73:43572) 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54bf7fe640 1 -- 172.21.15.73:0/3694609943 learned_addr learned my addr 172.21.15.73:0/3694609943 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54be7fc640 1 --2- 172.21.15.73:0/3694609943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c015c2a0 0x7f54c00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54beffd640 1 -- 172.21.15.73:0/3694609943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c015c2a0 msgr2=0x7f54c00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54beffd640 1 --2- 172.21.15.73:0/3694609943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c015c2a0 0x7f54c00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54beffd640 1 -- 172.21.15.73:0/3694609943 >> v1:172.21.15.73:6789/0 conn(0x7f54c00af2a0 legacy=0x7f54c015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54bdffb640 1 -- 172.21.15.73:0/3694609943 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069209421 0 0) 0x7f54c00b3290 con 0x7f54c00af2a0 2024-09-12T03:36:51.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.082+0000 7f54beffd640 1 -- 172.21.15.73:0/3694609943 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c00b3b30 con 0x7f54c015bec0 2024-09-12T03:36:51.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54beffd640 1 --2- 172.21.15.73:0/3694609943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c00ad200 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f54b00097c0 tx=0x7f54b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0f99e096410ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:51.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54bdffb640 1 -- 172.21.15.73:0/3694609943 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b00a7070 con 0x7f54c015bec0 2024-09-12T03:36:51.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54bdffb640 1 -- 172.21.15.73:0/3694609943 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b00b0070 con 0x7f54c015bec0 2024-09-12T03:36:51.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54bdffb640 1 -- 172.21.15.73:0/3694609943 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b00ab890 con 0x7f54c015bec0 2024-09-12T03:36:51.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 -- 172.21.15.73:0/3694609943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 msgr2=0x7f54c00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 --2- 172.21.15.73:0/3694609943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c00ad200 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f54b00097c0 tx=0x7f54b001c470 comp rx=0 tx=0).stop 2024-09-12T03:36:51.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 -- 172.21.15.73:0/3694609943 shutdown_connections 2024-09-12T03:36:51.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 --2- 172.21.15.73:0/3694609943 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c015c2a0 0x7f54c00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 --2- 172.21.15.73:0/3694609943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c00ad200 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 -- 172.21.15.73:0/3694609943 >> 172.21.15.73:0/3694609943 conn(0x7f54c00b1f90 msgr2=0x7f54c00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:51.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 -- 172.21.15.73:0/3694609943 shutdown_connections 2024-09-12T03:36:51.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 -- 172.21.15.73:0/3694609943 wait complete. 2024-09-12T03:36:51.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 Processor -- start 2024-09-12T03:36:51.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.086+0000 7f54c5483640 1 -- start start 2024-09-12T03:36:51.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c00af2a0 0x7f54c0139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c013a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c015c2a0 0x7f54c013a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f54c00af6f0 con 0x7f54c015bec0 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f54c00ad740 con 0x7f54c015c2a0 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f54c0169000 con 0x7f54c00af2a0 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c013a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c013a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52762/0 (socket says 172.21.15.73:52762) 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 -- 172.21.15.73:0/3837987892 learned_addr learned my addr 172.21.15.73:0/3837987892 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54beffd640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c00af2a0 0x7f54c0139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54bf7fe640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c015c2a0 0x7f54c013a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 -- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c00af2a0 msgr2=0x7f54c0139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c00af2a0 0x7f54c0139cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 -- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c015c2a0 msgr2=0x7f54c013a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c015c2a0 0x7f54c013a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 -- 172.21.15.73:0/3837987892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c014e460 con 0x7f54c015bec0 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54be7fc640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c013a230 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d5f0 tx=0x7f54b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54a77fe640 1 -- 172.21.15.73:0/3837987892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b40125f0 con 0x7f54c015bec0 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54a77fe640 1 -- 172.21.15.73:0/3837987892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b4019070 con 0x7f54c015bec0 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c014e740 con 0x7f54c015bec0 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54a77fe640 1 -- 172.21.15.73:0/3837987892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b40129b0 con 0x7f54c015bec0 2024-09-12T03:36:51.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c014ed00 con 0x7f54c015bec0 2024-09-12T03:36:51.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c00b2c90 con 0x7f54c015bec0 2024-09-12T03:36:51.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54a77fe640 1 -- 172.21.15.73:0/3837987892 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54b4012b50 con 0x7f54c015bec0 2024-09-12T03:36:51.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54a77fe640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f54ac0678c0 0x7f54ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54beffd640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f54ac0678c0 0x7f54ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54a77fe640 1 -- 172.21.15.73:0/3837987892 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f54b40861f0 con 0x7f54c015bec0 2024-09-12T03:36:51.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.090+0000 7f54beffd640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f54ac0678c0 0x7f54ac069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f54b00af000 tx=0x7f54b00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:51.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.094+0000 7f54a77fe640 1 -- 172.21.15.73:0/3837987892 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f54c00b2c90 con 0x7f54c015bec0 2024-09-12T03:36:51.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.274+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f54c00ad200 con 0x7f54c015bec0 2024-09-12T03:36:51.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.274+0000 7f54a77fe640 1 -- 172.21.15.73:0/3837987892 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7f54b4056ba0 con 0x7f54c015bec0 2024-09-12T03:36:51.278 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:36:51.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f54ac0678c0 msgr2=0x7f54ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f54ac0678c0 0x7f54ac069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f54b00af000 tx=0x7f54b00a7000 comp rx=0 tx=0).stop 2024-09-12T03:36:51.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 msgr2=0x7f54c013a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c013a230 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d5f0 tx=0x7f54b400dab0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 shutdown_connections 2024-09-12T03:36:51.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f54ac0678c0 0x7f54ac069d80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54c015bec0 0x7f54c013a230 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54c015c2a0 0x7f54c013a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 --2- 172.21.15.73:0/3837987892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f54c00af2a0 0x7f54c0139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 >> 172.21.15.73:0/3837987892 conn(0x7f54c00b1f90 msgr2=0x7f54c0159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:51.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 shutdown_connections 2024-09-12T03:36:51.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.278+0000 7f54c5483640 1 -- 172.21.15.73:0/3837987892 wait complete. 2024-09-12T03:36:51.297 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:36:51.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:51.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T03:36:51.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[40478]: fuse finished with error 0 and tester_r 0 2024-09-12T03:36:51.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:36:51.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:51.309 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:36:51.435 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:51.435 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:36:51.435 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:51.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:36:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd989543640 1 Processor -- start 2024-09-12T03:36:51.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd989543640 1 -- start start 2024-09-12T03:36:51.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd989543640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd9841634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd989543640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9840b3290 0x7fd9840b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd989543640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98406e470 con 0x7fd9841630c0 2024-09-12T03:36:51.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd989543640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd98406fc20 con 0x7fd9840b3290 2024-09-12T03:36:51.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd989543640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd98406e750 con 0x7fd98406df70 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9827fc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd9841634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9837fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9840b3290 0x7fd9840b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd982ffd640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd9841630c0 0x7fd98406f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:42146/0 (socket says 172.21.15.73:42146) 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9837fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9840b3290 0x7fd9840b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:58426/0 (socket says 172.21.15.73:58426) 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9827fc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd9841634a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:43778/0 (socket says 172.21.15.73:43778) 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd982ffd640 1 -- 172.21.15.73:0/1518179059 learned_addr learned my addr 172.21.15.73:0/1518179059 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9837fe640 1 -- 172.21.15.73:0/1518179059 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 msgr2=0x7fd9841634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9837fe640 1 --2- 172.21.15.73:0/1518179059 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd9841634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9837fe640 1 -- 172.21.15.73:0/1518179059 >> v1:172.21.15.150:6789/0 conn(0x7fd9841630c0 legacy=0x7fd98406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.574+0000 7fd9837fe640 1 -- 172.21.15.73:0/1518179059 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98406ea30 con 0x7fd9840b3290 2024-09-12T03:36:51.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd9837fe640 1 --2- 172.21.15.73:0/1518179059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9840b3290 0x7fd9840b3720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009d90 tx=0x7fd97c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9cdfc9c3dd23895 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd981ffb640 1 -- 172.21.15.73:0/1518179059 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0b2070 con 0x7fd9840b3290 2024-09-12T03:36:51.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd981ffb640 1 -- 172.21.15.73:0/1518179059 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97c0a5830 con 0x7fd9840b3290 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd981ffb640 1 -- 172.21.15.73:0/1518179059 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a5c00 con 0x7fd9840b3290 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd989543640 1 -- 172.21.15.73:0/1518179059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9840b3290 msgr2=0x7fd9840b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd989543640 1 --2- 172.21.15.73:0/1518179059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9840b3290 0x7fd9840b3720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009d90 tx=0x7fd97c01c970 comp rx=0 tx=0).stop 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd989543640 1 -- 172.21.15.73:0/1518179059 shutdown_connections 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd989543640 1 --2- 172.21.15.73:0/1518179059 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd9841634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd989543640 1 --2- 172.21.15.73:0/1518179059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9840b3290 0x7fd9840b3720 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd989543640 1 -- 172.21.15.73:0/1518179059 >> 172.21.15.73:0/1518179059 conn(0x7fd9840b1f90 msgr2=0x7fd9840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.578+0000 7fd989543640 1 -- 172.21.15.73:0/1518179059 shutdown_connections 2024-09-12T03:36:51.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 -- 172.21.15.73:0/1518179059 wait complete. 2024-09-12T03:36:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 Processor -- start 2024-09-12T03:36:51.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 -- start start 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd98415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9840b3290 0x7fd98409d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9841630c0 0x7fd984072d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd98416f5f0 con 0x7fd9840b3290 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd98416f770 con 0x7fd9841630c0 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd98416f8f0 con 0x7fd98406df70 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9840b3290 0x7fd98409d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9840b3290 0x7fd98409d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52764/0 (socket says 172.21.15.73:52764) 2024-09-12T03:36:51.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 -- 172.21.15.73:0/1056165588 learned_addr learned my addr 172.21.15.73:0/1056165588 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9837fe640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9841630c0 0x7fd984072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd982ffd640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd98415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 -- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 msgr2=0x7fd98415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd98415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 -- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9841630c0 msgr2=0x7fd984072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9841630c0 0x7fd984072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 -- 172.21.15.73:0/1056165588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98415d3c0 con 0x7fd9840b3290 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd9827fc640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9840b3290 0x7fd98409d190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd97400e930 tx=0x7fd97400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:51.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd97b7fe640 1 -- 172.21.15.73:0/1056165588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd974017070 con 0x7fd9840b3290 2024-09-12T03:36:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd97b7fe640 1 -- 172.21.15.73:0/1056165588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd97400c9a0 con 0x7fd9840b3290 2024-09-12T03:36:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98415d6a0 con 0x7fd9840b3290 2024-09-12T03:36:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd97b7fe640 1 -- 172.21.15.73:0/1056165588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd97400cd50 con 0x7fd9840b3290 2024-09-12T03:36:51.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.582+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98415dc60 con 0x7fd9840b3290 2024-09-12T03:36:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.586+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9841634a0 con 0x7fd9840b3290 2024-09-12T03:36:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.586+0000 7fd97b7fe640 1 -- 172.21.15.73:0/1056165588 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd97401a070 con 0x7fd9840b3290 2024-09-12T03:36:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.586+0000 7fd97b7fe640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9640678c0 0x7fd964069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.586+0000 7fd97b7fe640 1 -- 172.21.15.73:0/1056165588 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fd974086170 con 0x7fd9840b3290 2024-09-12T03:36:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.586+0000 7fd982ffd640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9640678c0 0x7fd964069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:51.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.586+0000 7fd982ffd640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9640678c0 0x7fd964069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd98416ce90 tx=0x7fd96c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:51.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.590+0000 7fd97b7fe640 1 -- 172.21.15.73:0/1056165588 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd974056c50 con 0x7fd9840b3290 2024-09-12T03:36:51.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.758+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd984070080 con 0x7fd9840b3290 2024-09-12T03:36:51.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd97b7fe640 1 -- 172.21.15.73:0/1056165588 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v64) ==== 80+0+0 (secure 0 0 0) 0x7fd974056550 con 0x7fd9840b3290 2024-09-12T03:36:51.763 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:36:51.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9640678c0 msgr2=0x7fd964069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9640678c0 0x7fd964069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd98416ce90 tx=0x7fd96c009040 comp rx=0 tx=0).stop 2024-09-12T03:36:51.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9840b3290 msgr2=0x7fd98409d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:51.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9840b3290 0x7fd98409d190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd97400e930 tx=0x7fd97400edf0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 shutdown_connections 2024-09-12T03:36:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9640678c0 0x7fd964069d80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9840b3290 0x7fd98409d190 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9841630c0 0x7fd984072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 --2- 172.21.15.73:0/1056165588 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd98406df70 0x7fd98415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 >> 172.21.15.73:0/1056165588 conn(0x7fd9840b1f90 msgr2=0x7fd98415c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 shutdown_connections 2024-09-12T03:36:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:51.762+0000 7fd989543640 1 -- 172.21.15.73:0/1056165588 wait complete. 2024-09-12T03:36:51.781 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:36:51.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:51.781 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:36:51.794 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35055]: fuse finished with error 0 and tester_r 0 2024-09-12T03:36:51.796 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:36:51.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:51.796 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:36:51.880 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:51.880 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:36:51.880 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:51.886 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:36:51.886 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:36:51.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:51.887 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T03:36:51.934 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T03:36:51.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:51.936 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:36:51.936 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:36:51.936 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:36:51.943 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:36:51.944 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:36:51.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:36:51.944 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T03:36:51.992 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T03:36:51.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:36:51.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:52.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.118+0000 7f6cf1c84640 1 Processor -- start 2024-09-12T03:36:52.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.118+0000 7f6cf1c84640 1 -- start start 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cf1c84640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cec15c2a0 0x7f6cec0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cf1c84640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6cec0af2a0 0x7f6cec06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cf1c84640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cec0b3290 con 0x7f6cec15bec0 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cf1c84640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6cec0b3570 con 0x7f6cec15c2a0 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cf1c84640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6cec0b3850 con 0x7f6cec0af2a0 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cec15c2a0 0x7f6cec0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cec15c2a0 0x7f6cec0aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52768/0 (socket says 172.21.15.73:52768) 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 -- 172.21.15.73:0/3824872458 learned_addr learned my addr 172.21.15.73:0/3824872458 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:52.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 -- 172.21.15.73:0/3824872458 >> v2:172.21.15.150:3300/0 conn(0x7f6cec0af2a0 msgr2=0x7f6cec06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:52.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 --2- 172.21.15.73:0/3824872458 >> v2:172.21.15.150:3300/0 conn(0x7f6cec0af2a0 0x7f6cec06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 -- 172.21.15.73:0/3824872458 >> v1:172.21.15.150:6789/0 conn(0x7f6cec15bec0 legacy=0x7f6cec0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:52.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 -- 172.21.15.73:0/3824872458 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec0b3b30 con 0x7f6cec15c2a0 2024-09-12T03:36:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6ceaffd640 1 --2- 172.21.15.73:0/3824872458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec15c2a0 0x7f6cec0aed60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b2fb0 tx=0x7f6ce001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d110e8b215f9c064 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cea7fc640 1 -- 172.21.15.73:0/3824872458 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00aa610 con 0x7f6cec15c2a0 2024-09-12T03:36:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cea7fc640 1 -- 172.21.15.73:0/3824872458 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce00af070 con 0x7f6cec15c2a0 2024-09-12T03:36:52.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cea7fc640 1 -- 172.21.15.73:0/3824872458 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00aa9d0 con 0x7f6cec15c2a0 2024-09-12T03:36:52.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cf1c84640 1 -- 172.21.15.73:0/3824872458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec15c2a0 msgr2=0x7f6cec0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.122+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/3824872458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec15c2a0 0x7f6cec0aed60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b2fb0 tx=0x7f6ce001c4b0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- 172.21.15.73:0/3824872458 shutdown_connections 2024-09-12T03:36:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/3824872458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec15c2a0 0x7f6cec0aed60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/3824872458 >> v2:172.21.15.150:3300/0 conn(0x7f6cec0af2a0 0x7f6cec06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- 172.21.15.73:0/3824872458 >> 172.21.15.73:0/3824872458 conn(0x7f6cec0b1f90 msgr2=0x7f6cec0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- 172.21.15.73:0/3824872458 shutdown_connections 2024-09-12T03:36:52.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- 172.21.15.73:0/3824872458 wait complete. 2024-09-12T03:36:52.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 Processor -- start 2024-09-12T03:36:52.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- start start 2024-09-12T03:36:52.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec0af2a0 0x7f6cec1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cec15bec0 0x7f6cec15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cec15c2a0 0x7f6cec15e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec06ed50 con 0x7f6cec0af2a0 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec0af6f0 con 0x7f6cec15bec0 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6cec06eed0 con 0x7f6cec15c2a0 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec0af2a0 0x7f6cec1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec0af2a0 0x7f6cec1478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52778/0 (socket says 172.21.15.73:52778) 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 -- 172.21.15.73:0/4208160442 learned_addr learned my addr 172.21.15.73:0/4208160442 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cebfff640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cec15c2a0 0x7f6cec15e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceaffd640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cec15bec0 0x7f6cec15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 -- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cec15c2a0 msgr2=0x7f6cec15e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cec15c2a0 0x7f6cec15e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 -- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cec15bec0 msgr2=0x7f6cec15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cec15bec0 0x7f6cec15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 -- 172.21.15.73:0/4208160442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec165740 con 0x7f6cec0af2a0 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceaffd640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cec15bec0 0x7f6cec15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6ceb7fe640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec0af2a0 0x7f6cec1478c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c490 tx=0x7f6cdc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cd3fff640 1 -- 172.21.15.73:0/4208160442 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc017070 con 0x7f6cec0af2a0 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cd3fff640 1 -- 172.21.15.73:0/4208160442 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc003600 con 0x7f6cec0af2a0 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cec165a20 con 0x7f6cec0af2a0 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cd3fff640 1 -- 172.21.15.73:0/4208160442 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0039f0 con 0x7f6cec0af2a0 2024-09-12T03:36:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cec165fe0 con 0x7f6cec0af2a0 2024-09-12T03:36:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.126+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec06f210 con 0x7f6cec0af2a0 2024-09-12T03:36:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.130+0000 7f6cd3fff640 1 -- 172.21.15.73:0/4208160442 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6cdc01a070 con 0x7f6cec0af2a0 2024-09-12T03:36:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.130+0000 7f6cd3fff640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6cd80678c0 0x7f6cd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.130+0000 7f6cd3fff640 1 -- 172.21.15.73:0/4208160442 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f6cdc0851f0 con 0x7f6cec0af2a0 2024-09-12T03:36:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.130+0000 7f6ceaffd640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6cd80678c0 0x7f6cd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.130+0000 7f6ceaffd640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6cd80678c0 0x7f6cd8069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00ae000 tx=0x7f6ce00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.134+0000 7f6cd3fff640 1 -- 172.21.15.73:0/4208160442 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6cdc055c30 con 0x7f6cec0af2a0 2024-09-12T03:36:52.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cec06fcd0 con 0x7f6cec0af2a0 2024-09-12T03:36:52.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cd3fff640 1 -- 172.21.15.73:0/4208160442 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5227 (secure 0 0 0) 0x7f6cdc055530 con 0x7f6cec0af2a0 2024-09-12T03:36:52.331 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:52.332 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"btime":"2024-09-12T03:36:37:437965+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423262735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":423262735},{"type":"v1","addr":"172.21.15.150:6835","nonce":423262735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3010572042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3010572042},{"type":"v1","addr":"172.21.15.150:6833","nonce":3010572042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2140641329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2140641329},{"type":"v1","addr":"172.21.15.73:6836","nonce":2140641329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:33.751869+0000","modified":"2024-09-12T03:36:36.786974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2746514655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2746514655},{"type":"v1","addr":"172.21.15.73:6837","nonce":2746514655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5550,"qdb_cluster":[5550]},"id":4}]} 2024-09-12T03:36:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-09-12T03:36:52.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6cd80678c0 msgr2=0x7f6cd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6cd80678c0 0x7f6cd8069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00ae000 tx=0x7f6ce00a7000 comp rx=0 tx=0).stop 2024-09-12T03:36:52.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec0af2a0 msgr2=0x7f6cec1478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec0af2a0 0x7f6cec1478c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c490 tx=0x7f6cdc001e80 comp rx=0 tx=0).stop 2024-09-12T03:36:52.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 shutdown_connections 2024-09-12T03:36:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6cd80678c0 0x7f6cd8069d80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6cec15c2a0 0x7f6cec15e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cec15bec0 0x7f6cec15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 --2- 172.21.15.73:0/4208160442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cec0af2a0 0x7f6cec1478c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 >> 172.21.15.73:0/4208160442 conn(0x7f6cec0b1f90 msgr2=0x7f6cec155360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.330+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 shutdown_connections 2024-09-12T03:36:52.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.334+0000 7f6cf1c84640 1 -- 172.21.15.73:0/4208160442 wait complete. 2024-09-12T03:36:52.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:52.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900c627640 1 Processor -- start 2024-09-12T03:36:52.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900c627640 1 -- start start 2024-09-12T03:36:52.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900c627640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9004161a60 0x7f90040d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900c627640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90040cf620 0x7f900406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900c627640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90040d32b0 con 0x7f90040d2e90 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900c627640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f90040d0300 con 0x7f9004161a60 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900c627640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f90040cfab0 con 0x7f90040cf620 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f9009bc2640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f90040d2e90 0x7f90040cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43574/0 (socket says 172.21.15.73:43574) 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f9009bc2640 1 -- 172.21.15.73:0/1419438152 learned_addr learned my addr 172.21.15.73:0/1419438152 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900a3c3640 1 --2- 172.21.15.73:0/1419438152 >> v2:172.21.15.73:3300/0 conn(0x7f9004161a60 0x7f90040d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900abc4640 1 --2- 172.21.15.73:0/1419438152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90040cf620 0x7f900406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f90093c1640 1 -- 172.21.15.73:0/1419438152 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 492608174 0 0) 0x7f90040d32b0 con 0x7f90040d2e90 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f90093c1640 1 -- 172.21.15.73:0/1419438152 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ff0003530 con 0x7f90040d2e90 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900a3c3640 1 -- 172.21.15.73:0/1419438152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90040cf620 msgr2=0x7f900406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900a3c3640 1 --2- 172.21.15.73:0/1419438152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90040cf620 0x7f900406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900a3c3640 1 -- 172.21.15.73:0/1419438152 >> v1:172.21.15.73:6789/0 conn(0x7f90040d2e90 legacy=0x7f90040cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900a3c3640 1 -- 172.21.15.73:0/1419438152 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90040b0f60 con 0x7f9004161a60 2024-09-12T03:36:52.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.474+0000 7f900abc4640 1 --2- 172.21.15.73:0/1419438152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90040cf620 0x7f900406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:52.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900a3c3640 1 --2- 172.21.15.73:0/1419438152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9004161a60 0x7f90040d2950 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f90000097c0 tx=0x7f900001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341b609092549404 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f90093c1640 1 -- 172.21.15.73:0/1419438152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90000b1070 con 0x7f9004161a60 2024-09-12T03:36:52.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f90093c1640 1 -- 172.21.15.73:0/1419438152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90000a8050 con 0x7f9004161a60 2024-09-12T03:36:52.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f90093c1640 1 -- 172.21.15.73:0/1419438152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90000ac860 con 0x7f9004161a60 2024-09-12T03:36:52.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- 172.21.15.73:0/1419438152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9004161a60 msgr2=0x7f90040d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 --2- 172.21.15.73:0/1419438152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9004161a60 0x7f90040d2950 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f90000097c0 tx=0x7f900001c3e0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- 172.21.15.73:0/1419438152 shutdown_connections 2024-09-12T03:36:52.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 --2- 172.21.15.73:0/1419438152 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f90040cf620 0x7f900406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 --2- 172.21.15.73:0/1419438152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9004161a60 0x7f90040d2950 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- 172.21.15.73:0/1419438152 >> 172.21.15.73:0/1419438152 conn(0x7f900408bf90 msgr2=0x7f900409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:52.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- 172.21.15.73:0/1419438152 shutdown_connections 2024-09-12T03:36:52.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- 172.21.15.73:0/1419438152 wait complete. 2024-09-12T03:36:52.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 Processor -- start 2024-09-12T03:36:52.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- start start 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040cf620 0x7f90040ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90040d2e90 0x7f900415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9004161a60 0x7f90040b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f900406e400 con 0x7f90040d2e90 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f900406d190 con 0x7f90040cf620 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900c627640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f900406e580 con 0x7f9004161a60 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90040d2e90 0x7f900415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90040d2e90 0x7f900415fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52788/0 (socket says 172.21.15.73:52788) 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 -- 172.21.15.73:0/1335368311 learned_addr learned my addr 172.21.15.73:0/1335368311 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900a3c3640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040cf620 0x7f90040ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900abc4640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9004161a60 0x7f90040b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 -- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9004161a60 msgr2=0x7f90040b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9004161a60 0x7f90040b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 -- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040cf620 msgr2=0x7f90040ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040cf620 0x7f90040ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 -- 172.21.15.73:0/1335368311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90041f7200 con 0x7f90040d2e90 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f900a3c3640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040cf620 0x7f90040ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f9009bc2640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90040d2e90 0x7f900415fc30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c3c0 tx=0x7f8ff400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f8ffaffd640 1 -- 172.21.15.73:0/1335368311 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4017070 con 0x7f90040d2e90 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.478+0000 7f8ffaffd640 1 -- 172.21.15.73:0/1335368311 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4005cf0 con 0x7f90040d2e90 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90041f74e0 con 0x7f90040d2e90 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f8ffaffd640 1 -- 172.21.15.73:0/1335368311 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40072f0 con 0x7f90040d2e90 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041f7aa0 con 0x7f90040d2e90 2024-09-12T03:36:52.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900406d6b0 con 0x7f90040d2e90 2024-09-12T03:36:52.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f8ffaffd640 1 -- 172.21.15.73:0/1335368311 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ff401a070 con 0x7f90040d2e90 2024-09-12T03:36:52.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f8ffaffd640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fe80678c0 0x7f8fe8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f8ffaffd640 1 -- 172.21.15.73:0/1335368311 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f8ff40851d0 con 0x7f90040d2e90 2024-09-12T03:36:52.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f900a3c3640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fe80678c0 0x7f8fe8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.482+0000 7f900a3c3640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fe80678c0 0x7f8fe8069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f90000ae000 tx=0x7f90000a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.486+0000 7f8ffaffd640 1 -- 172.21.15.73:0/1335368311 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ff4055b80 con 0x7f90040d2e90 2024-09-12T03:36:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.682+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f900415b460 con 0x7f90040d2e90 2024-09-12T03:36:52.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.682+0000 7f8ffaffd640 1 -- 172.21.15.73:0/1335368311 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5227 (secure 0 0 0) 0x7f8ff4055480 con 0x7f90040d2e90 2024-09-12T03:36:52.685 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:52.685 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"btime":"2024-09-12T03:36:37:437965+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423262735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":423262735},{"type":"v1","addr":"172.21.15.150:6835","nonce":423262735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3010572042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3010572042},{"type":"v1","addr":"172.21.15.150:6833","nonce":3010572042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2140641329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2140641329},{"type":"v1","addr":"172.21.15.73:6836","nonce":2140641329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:33.751869+0000","modified":"2024-09-12T03:36:36.786974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2746514655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2746514655},{"type":"v1","addr":"172.21.15.73:6837","nonce":2746514655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5550,"qdb_cluster":[5550]},"id":4}]} 2024-09-12T03:36:52.686 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-09-12T03:36:52.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fe80678c0 msgr2=0x7f8fe8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fe80678c0 0x7f8fe8069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f90000ae000 tx=0x7f90000a7000 comp rx=0 tx=0).stop 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90040d2e90 msgr2=0x7f900415fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90040d2e90 0x7f900415fc30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c3c0 tx=0x7f8ff400c880 comp rx=0 tx=0).stop 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 shutdown_connections 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8fe80678c0 0x7f8fe8069d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90040d2e90 0x7f900415fc30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9004161a60 0x7f90040b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 --2- 172.21.15.73:0/1335368311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040cf620 0x7f90040ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 >> 172.21.15.73:0/1335368311 conn(0x7f900408bf90 msgr2=0x7f90040b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 shutdown_connections 2024-09-12T03:36:52.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.686+0000 7f900c627640 1 -- 172.21.15.73:0/1335368311 wait complete. 2024-09-12T03:36:52.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b3d4f0640 1 Processor -- start 2024-09-12T03:36:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b3d4f0640 1 -- start start 2024-09-12T03:36:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b3d4f0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b38067e30 0x7f6b38161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b3d4f0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b381623e0 0x7f6b380b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b3d4f0640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b380afbb0 con 0x7f6b3815e260 2024-09-12T03:36:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b3d4f0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6b38162830 con 0x7f6b381623e0 2024-09-12T03:36:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b3d4f0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6b380b0700 con 0x7f6b38067e30 2024-09-12T03:36:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b377fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b381623e0 0x7f6b380b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b377fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6b381623e0 0x7f6b380b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:58462/0 (socket says 172.21.15.73:58462) 2024-09-12T03:36:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b367fc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b38067e30 0x7f6b38161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b377fe640 1 -- 172.21.15.73:0/4251809148 learned_addr learned my addr 172.21.15.73:0/4251809148 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b36ffd640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6b3815e260 0x7f6b380afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:42166/0 (socket says 172.21.15.73:42166) 2024-09-12T03:36:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b367fc640 1 -- 172.21.15.73:0/4251809148 >> v2:172.21.15.150:3300/0 conn(0x7f6b381623e0 msgr2=0x7f6b380b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b367fc640 1 --2- 172.21.15.73:0/4251809148 >> v2:172.21.15.150:3300/0 conn(0x7f6b381623e0 0x7f6b380b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b367fc640 1 -- 172.21.15.73:0/4251809148 >> v1:172.21.15.150:6789/0 conn(0x7f6b3815e260 legacy=0x7f6b380afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b367fc640 1 -- 172.21.15.73:0/4251809148 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b380af310 con 0x7f6b38067e30 2024-09-12T03:36:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.826+0000 7f6b377fe640 1 --2- 172.21.15.73:0/4251809148 >> v2:172.21.15.150:3300/0 conn(0x7f6b381623e0 0x7f6b380b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:36:52.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b367fc640 1 --2- 172.21.15.73:0/4251809148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b38067e30 0x7f6b38161ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097c0 tx=0x7f6b2c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=466f5bca582a353c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b35ffb640 1 -- 172.21.15.73:0/4251809148 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0aa600 con 0x7f6b38067e30 2024-09-12T03:36:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b35ffb640 1 -- 172.21.15.73:0/4251809148 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0af070 con 0x7f6b38067e30 2024-09-12T03:36:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b35ffb640 1 -- 172.21.15.73:0/4251809148 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0aa9c0 con 0x7f6b38067e30 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/4251809148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b38067e30 msgr2=0x7f6b38161ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/4251809148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b38067e30 0x7f6b38161ea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0097c0 tx=0x7f6b2c01c4a0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/4251809148 shutdown_connections 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/4251809148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b38067e30 0x7f6b38161ea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/4251809148 >> v2:172.21.15.150:3300/0 conn(0x7f6b381623e0 0x7f6b380b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/4251809148 >> 172.21.15.73:0/4251809148 conn(0x7f6b38073580 msgr2=0x7f6b3806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/4251809148 shutdown_connections 2024-09-12T03:36:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/4251809148 wait complete. 2024-09-12T03:36:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 Processor -- start 2024-09-12T03:36:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.830+0000 7f6b3d4f0640 1 -- start start 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b38067e30 0x7f6b381568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b3815e260 0x7f6b38154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b381623e0 0x7f6b38152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b380b5090 con 0x7f6b38067e30 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6b380b4f10 con 0x7f6b3815e260 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6b380b5210 con 0x7f6b381623e0 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b38067e30 0x7f6b381568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b38067e30 0x7f6b381568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52798/0 (socket says 172.21.15.73:52798) 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 -- 172.21.15.73:0/2355026274 learned_addr learned my addr 172.21.15.73:0/2355026274 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b377fe640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b381623e0 0x7f6b38152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b367fc640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b3815e260 0x7f6b38154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 -- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b381623e0 msgr2=0x7f6b38152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b381623e0 0x7f6b38152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 -- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b3815e260 msgr2=0x7f6b38154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b3815e260 0x7f6b38154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 -- 172.21.15.73:0/2355026274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b381571c0 con 0x7f6b38067e30 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b377fe640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b381623e0 0x7f6b38152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b36ffd640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b38067e30 0x7f6b381568e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800c4c0 tx=0x7f6b2800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b1f7fe640 1 -- 172.21.15.73:0/2355026274 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28018070 con 0x7f6b38067e30 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b1f7fe640 1 -- 172.21.15.73:0/2355026274 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b28007480 con 0x7f6b38067e30 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b38156ee0 con 0x7f6b38067e30 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b1f7fe640 1 -- 172.21.15.73:0/2355026274 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b280047f0 con 0x7f6b38067e30 2024-09-12T03:36:52.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3815d0c0 con 0x7f6b38067e30 2024-09-12T03:36:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b38160a10 con 0x7f6b38067e30 2024-09-12T03:36:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b1f7fe640 1 -- 172.21.15.73:0/2355026274 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b28004990 con 0x7f6b38067e30 2024-09-12T03:36:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b1f7fe640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b240678f0 0x7f6b24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:52.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b1f7fe640 1 -- 172.21.15.73:0/2355026274 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f6b28084f70 con 0x7f6b38067e30 2024-09-12T03:36:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b367fc640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b240678f0 0x7f6b24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.834+0000 7f6b367fc640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b240678f0 0x7f6b24069db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0ae000 tx=0x7f6b2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:52.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:52.838+0000 7f6b1f7fe640 1 -- 172.21.15.73:0/2355026274 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b280552e0 con 0x7f6b38067e30 2024-09-12T03:36:53.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.002+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b38161ea0 con 0x7f6b38067e30 2024-09-12T03:36:53.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b1f7fe640 1 -- 172.21.15.73:0/2355026274 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16956 (secure 0 0 0) 0x7f6b280595e0 con 0x7f6b38067e30 2024-09-12T03:36:53.006 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:53.007 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":64,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:35.415084+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:31.428624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:32.740289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b240678f0 msgr2=0x7f6b24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b240678f0 0x7f6b24069db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0ae000 tx=0x7f6b2c008040 comp rx=0 tx=0).stop 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b38067e30 msgr2=0x7f6b381568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b38067e30 0x7f6b381568e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6b2800c4c0 tx=0x7f6b2800c980 comp rx=0 tx=0).stop 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 shutdown_connections 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6b240678f0 0x7f6b24069db0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6b381623e0 0x7f6b38152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b3815e260 0x7f6b38154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 --2- 172.21.15.73:0/2355026274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b38067e30 0x7f6b381568e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 >> 172.21.15.73:0/2355026274 conn(0x7f6b38073580 msgr2=0x7f6b38160db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 shutdown_connections 2024-09-12T03:36:53.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.006+0000 7f6b3d4f0640 1 -- 172.21.15.73:0/2355026274 wait complete. 2024-09-12T03:36:53.025 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:36:53.026 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.142+0000 7fbfd7143640 1 Processor -- start 2024-09-12T03:36:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.142+0000 7fbfd7143640 1 -- start start 2024-09-12T03:36:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd7143640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbfd015bec0 0x7fbfd00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd7143640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd00b3290 con 0x7fbfd00af470 2024-09-12T03:36:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd7143640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd00b3570 con 0x7fbfd015c2a0 2024-09-12T03:36:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd7143640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd00b3850 con 0x7fbfd015bec0 2024-09-12T03:36:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd4edf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbfd015bec0 0x7fbfd00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd56e0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbfd00af470 0x7fbfd006e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43584/0 (socket says 172.21.15.73:43584) 2024-09-12T03:36:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd56e0640 1 -- 172.21.15.73:0/2172600712 learned_addr learned my addr 172.21.15.73:0/2172600712 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd4edf640 1 -- 172.21.15.73:0/2172600712 >> v1:172.21.15.150:6789/0 conn(0x7fbfd015c2a0 legacy=0x7fbfd00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/2172600712 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1118530438 0 0) 0x7fbfd00b3290 con 0x7fbfd00af470 2024-09-12T03:36:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd4edf640 1 -- 172.21.15.73:0/2172600712 >> v1:172.21.15.73:6789/0 conn(0x7fbfd00af470 legacy=0x7fbfd006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd4edf640 1 -- 172.21.15.73:0/2172600712 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd00b3b30 con 0x7fbfd015bec0 2024-09-12T03:36:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfd4edf640 1 --2- 172.21.15.73:0/2172600712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd00ad200 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80097c0 tx=0x7fbfc801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18ea073cf5880da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/2172600712 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80ab430 con 0x7fbfd015bec0 2024-09-12T03:36:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/2172600712 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc80b0070 con 0x7fbfd015bec0 2024-09-12T03:36:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.146+0000 7fbfcf7fe640 1 -- 172.21.15.73:0/2172600712 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80ab7f0 con 0x7fbfd015bec0 2024-09-12T03:36:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- 172.21.15.73:0/2172600712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 msgr2=0x7fbfd00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 --2- 172.21.15.73:0/2172600712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd00ad200 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80097c0 tx=0x7fbfc801c430 comp rx=0 tx=0).stop 2024-09-12T03:36:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- 172.21.15.73:0/2172600712 shutdown_connections 2024-09-12T03:36:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 --2- 172.21.15.73:0/2172600712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd00ad200 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- 172.21.15.73:0/2172600712 >> 172.21.15.73:0/2172600712 conn(0x7fbfd00b1f90 msgr2=0x7fbfd00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- 172.21.15.73:0/2172600712 shutdown_connections 2024-09-12T03:36:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- 172.21.15.73:0/2172600712 wait complete. 2024-09-12T03:36:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 Processor -- start 2024-09-12T03:36:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- start start 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd00af470 0x7fbfd015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd013a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfd015c2a0 0x7fbfd014fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd006ef20 con 0x7fbfd015bec0 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd00ad740 con 0x7fbfd00af470 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd006f0a0 con 0x7fbfd015c2a0 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd013a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52816/0 (socket says 172.21.15.73:52816) 2024-09-12T03:36:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 -- 172.21.15.73:0/1557146045 learned_addr learned my addr 172.21.15.73:0/1557146045 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd56e0640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfd015c2a0 0x7fbfd014fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 -- 172.21.15.73:0/1557146045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfd015c2a0 msgr2=0x7fbfd014fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfd015c2a0 0x7fbfd014fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 -- 172.21.15.73:0/1557146045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd00af470 msgr2=0x7fbfd015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd00af470 0x7fbfd015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 -- 172.21.15.73:0/1557146045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd01502e0 con 0x7fbfd015bec0 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcffff640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd013a660 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800b9c0 tx=0x7fbfb800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcd7fa640 1 -- 172.21.15.73:0/1557146045 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800cba0 con 0x7fbfd015bec0 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcd7fa640 1 -- 172.21.15.73:0/1557146045 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb800cd40 con 0x7fbfd015bec0 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd014e360 con 0x7fbfd015bec0 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfcd7fa640 1 -- 172.21.15.73:0/1557146045 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8003bc0 con 0x7fbfd015bec0 2024-09-12T03:36:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.150+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd014e920 con 0x7fbfd015bec0 2024-09-12T03:36:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.154+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd00ad200 con 0x7fbfd015bec0 2024-09-12T03:36:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.154+0000 7fbfcd7fa640 1 -- 172.21.15.73:0/1557146045 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbfb8006d10 con 0x7fbfd015bec0 2024-09-12T03:36:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.154+0000 7fbfcd7fa640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfb00678f0 0x7fbfb0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.154+0000 7fbfcd7fa640 1 -- 172.21.15.73:0/1557146045 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fbfb80859a0 con 0x7fbfd015bec0 2024-09-12T03:36:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.154+0000 7fbfd4edf640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfb00678f0 0x7fbfb0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.154+0000 7fbfd4edf640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfb00678f0 0x7fbfb0069db0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80af000 tx=0x7fbfc8004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.158+0000 7fbfcd7fa640 1 -- 172.21.15.73:0/1557146045 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbfb80563e0 con 0x7fbfd015bec0 2024-09-12T03:36:53.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.358+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfd006fcd0 con 0x7fbfd015bec0 2024-09-12T03:36:53.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfcd7fa640 1 -- 172.21.15.73:0/1557146045 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5227 (secure 0 0 0) 0x7fbfb8055ce0 con 0x7fbfd015bec0 2024-09-12T03:36:53.362 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:53.362 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"btime":"2024-09-12T03:36:37:437965+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423262735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":423262735},{"type":"v1","addr":"172.21.15.150:6835","nonce":423262735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3010572042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3010572042},{"type":"v1","addr":"172.21.15.150:6833","nonce":3010572042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2140641329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2140641329},{"type":"v1","addr":"172.21.15.73:6836","nonce":2140641329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:33.751869+0000","modified":"2024-09-12T03:36:36.786974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2746514655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2746514655},{"type":"v1","addr":"172.21.15.73:6837","nonce":2746514655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5550,"qdb_cluster":[5550]},"id":4}]} 2024-09-12T03:36:53.363 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-09-12T03:36:53.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfb00678f0 msgr2=0x7fbfb0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfb00678f0 0x7fbfb0069db0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80af000 tx=0x7fbfc8004740 comp rx=0 tx=0).stop 2024-09-12T03:36:53.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 msgr2=0x7fbfd013a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd013a660 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800b9c0 tx=0x7fbfb800be80 comp rx=0 tx=0).stop 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 shutdown_connections 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbfb00678f0 0x7fbfb0069db0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbfd015bec0 0x7fbfd013a660 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbfd015c2a0 0x7fbfd014fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 --2- 172.21.15.73:0/1557146045 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbfd00af470 0x7fbfd015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 >> 172.21.15.73:0/1557146045 conn(0x7fbfd00b1f90 msgr2=0x7fbfd01597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 shutdown_connections 2024-09-12T03:36:53.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.362+0000 7fbfd7143640 1 -- 172.21.15.73:0/1557146045 wait complete. 2024-09-12T03:36:53.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:36:53.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbe728640 1 Processor -- start 2024-09-12T03:36:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbe728640 1 -- start start 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbe728640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fddb8161a60 0x7fddb80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbe728640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fddb80cf620 0x7fddb806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbe728640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddb80d32b0 con 0x7fddb80d2e90 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbe728640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fddb80d0300 con 0x7fddb8161a60 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbe728640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fddb80cfa90 con 0x7fddb80cf620 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddb7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fddb8161a60 0x7fddb80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddaffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fddb80d2e90 0x7fddb80cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43600/0 (socket says 172.21.15.73:43600) 2024-09-12T03:36:53.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddaffff640 1 -- 172.21.15.73:0/116197938 learned_addr learned my addr 172.21.15.73:0/116197938 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddbccc5640 1 --2- 172.21.15.73:0/116197938 >> v2:172.21.15.150:3300/0 conn(0x7fddb80cf620 0x7fddb806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddb7fff640 1 -- 172.21.15.73:0/116197938 >> v2:172.21.15.150:3300/0 conn(0x7fddb80cf620 msgr2=0x7fddb806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddb7fff640 1 --2- 172.21.15.73:0/116197938 >> v2:172.21.15.150:3300/0 conn(0x7fddb80cf620 0x7fddb806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddb77fe640 1 -- 172.21.15.73:0/116197938 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199691881 0 0) 0x7fddb80d32b0 con 0x7fddb80d2e90 2024-09-12T03:36:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddb7fff640 1 -- 172.21.15.73:0/116197938 >> v1:172.21.15.73:6789/0 conn(0x7fddb80d2e90 legacy=0x7fddb80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.502+0000 7fddb7fff640 1 -- 172.21.15.73:0/116197938 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb80b0f60 con 0x7fddb8161a60 2024-09-12T03:36:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb7fff640 1 --2- 172.21.15.73:0/116197938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb8161a60 0x7fddb80d2950 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fddb80ce950 tx=0x7fdda801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24967e0f960307cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb77fe640 1 -- 172.21.15.73:0/116197938 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80b1070 con 0x7fddb8161a60 2024-09-12T03:36:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb77fe640 1 -- 172.21.15.73:0/116197938 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda80ac620 con 0x7fddb8161a60 2024-09-12T03:36:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb77fe640 1 -- 172.21.15.73:0/116197938 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80ac9f0 con 0x7fddb8161a60 2024-09-12T03:36:53.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- 172.21.15.73:0/116197938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb8161a60 msgr2=0x7fddb80d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 --2- 172.21.15.73:0/116197938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb8161a60 0x7fddb80d2950 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fddb80ce950 tx=0x7fdda801c3c0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- 172.21.15.73:0/116197938 shutdown_connections 2024-09-12T03:36:53.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 --2- 172.21.15.73:0/116197938 >> v2:172.21.15.150:3300/0 conn(0x7fddb80cf620 0x7fddb806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 --2- 172.21.15.73:0/116197938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb8161a60 0x7fddb80d2950 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- 172.21.15.73:0/116197938 >> 172.21.15.73:0/116197938 conn(0x7fddb808bf90 msgr2=0x7fddb809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:53.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- 172.21.15.73:0/116197938 shutdown_connections 2024-09-12T03:36:53.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- 172.21.15.73:0/116197938 wait complete. 2024-09-12T03:36:53.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 Processor -- start 2024-09-12T03:36:53.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- start start 2024-09-12T03:36:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb80cf620 0x7fddb8158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb80d2e90 0x7fddb8156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddb8161a60 0x7fddb8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fddb806e400 con 0x7fddb80d2e90 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fddb806d190 con 0x7fddb80cf620 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fddb806e580 con 0x7fddb8161a60 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb80d2e90 0x7fddb8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb80d2e90 0x7fddb8156390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52840/0 (socket says 172.21.15.73:52840) 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 -- 172.21.15.73:0/1294636039 learned_addr learned my addr 172.21.15.73:0/1294636039 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb7fff640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb80cf620 0x7fddb8158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbccc5640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddb8161a60 0x7fddb8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 -- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddb8161a60 msgr2=0x7fddb8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddb8161a60 0x7fddb8158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 -- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb80cf620 msgr2=0x7fddb8158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb80cf620 0x7fddb8158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 -- 172.21.15.73:0/1294636039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb81568d0 con 0x7fddb80d2e90 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb7fff640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb80cf620 0x7fddb8158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddaffff640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb80d2e90 0x7fddb8156390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c4b0 tx=0x7fdda000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb57fa640 1 -- 172.21.15.73:0/1294636039 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0018070 con 0x7fddb80d2e90 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb57fa640 1 -- 172.21.15.73:0/1294636039 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda0007500 con 0x7fddb80d2e90 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddb57fa640 1 -- 172.21.15.73:0/1294636039 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0004a30 con 0x7fddb80d2e90 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb815f330 con 0x7fddb80d2e90 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.506+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb815fbd0 con 0x7fddb80d2e90 2024-09-12T03:36:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.510+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb815f500 con 0x7fddb80d2e90 2024-09-12T03:36:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.510+0000 7fddb57fa640 1 -- 172.21.15.73:0/1294636039 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdda001b070 con 0x7fddb80d2e90 2024-09-12T03:36:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.510+0000 7fddb57fa640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdd980678c0 0x7fdd98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.510+0000 7fddb57fa640 1 -- 172.21.15.73:0/1294636039 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fdda0085120 con 0x7fddb80d2e90 2024-09-12T03:36:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.510+0000 7fddb7fff640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdd980678c0 0x7fdd98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.510+0000 7fddb7fff640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdd980678c0 0x7fdd98069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdda80ae000 tx=0x7fdda80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.514+0000 7fddb57fa640 1 -- 172.21.15.73:0/1294636039 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fddb81568d0 con 0x7fddb80d2e90 2024-09-12T03:36:53.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.702+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddb806d6b0 con 0x7fddb80d2e90 2024-09-12T03:36:53.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddb57fa640 1 -- 172.21.15.73:0/1294636039 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5227 (secure 0 0 0) 0x7fdda0055a30 con 0x7fddb80d2e90 2024-09-12T03:36:53.708 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:53.708 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"btime":"2024-09-12T03:36:37:437965+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423262735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":423262735},{"type":"v1","addr":"172.21.15.150:6835","nonce":423262735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3010572042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3010572042},{"type":"v1","addr":"172.21.15.150:6833","nonce":3010572042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2140641329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2140641329},{"type":"v1","addr":"172.21.15.73:6836","nonce":2140641329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:36:33.751869+0000","modified":"2024-09-12T03:36:36.786974+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2746514655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2746514655},{"type":"v1","addr":"172.21.15.73:6837","nonce":2746514655}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5550,"qdb_cluster":[5550]},"id":4}]} 2024-09-12T03:36:53.709 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2024-09-12T03:36:53.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdd980678c0 msgr2=0x7fdd98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdd980678c0 0x7fdd98069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdda80ae000 tx=0x7fdda80a7000 comp rx=0 tx=0).stop 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb80d2e90 msgr2=0x7fddb8156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb80d2e90 0x7fddb8156390 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c4b0 tx=0x7fdda000c970 comp rx=0 tx=0).stop 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 shutdown_connections 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdd980678c0 0x7fdd98069d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fddb80d2e90 0x7fddb8156390 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fddb8161a60 0x7fddb8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 --2- 172.21.15.73:0/1294636039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fddb80cf620 0x7fddb8158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 >> 172.21.15.73:0/1294636039 conn(0x7fddb808bf90 msgr2=0x7fddb80b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 shutdown_connections 2024-09-12T03:36:53.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.706+0000 7fddbe728640 1 -- 172.21.15.73:0/1294636039 wait complete. 2024-09-12T03:36:53.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:53.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.842+0000 7fc90a6d7640 1 Processor -- start 2024-09-12T03:36:53.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.842+0000 7fc90a6d7640 1 -- start start 2024-09-12T03:36:53.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc90a6d7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90415c2a0 0x7fc9040aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc90a6d7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9040b3290 con 0x7fc90415bec0 2024-09-12T03:36:53.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc90a6d7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9040b3570 con 0x7fc9040af2a0 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc90a6d7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc9040b3850 con 0x7fc90415c2a0 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc90415bec0 0x7fc9040ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43604/0 (socket says 172.21.15.73:43604) 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 -- 172.21.15.73:0/2594414613 learned_addr learned my addr 172.21.15.73:0/2594414613 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc9037fe640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90415c2a0 0x7fc9040aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694595234 0 0) 0x7fc9040b3290 con 0x7fc90415bec0 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8ec003530 con 0x7fc90415bec0 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3336404951 0 0) 0x7fc8ec003530 con 0x7fc90415bec0 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90415c2a0 msgr2=0x7fc9040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90415c2a0 0x7fc9040aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 >> v1:172.21.15.150:6789/0 conn(0x7fc9040af2a0 legacy=0x7fc90406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9040b3b30 con 0x7fc90415bec0 2024-09-12T03:36:53.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fc8f4001680 con 0x7fc90415bec0 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 >> v1:172.21.15.73:6789/0 conn(0x7fc90415bec0 legacy=0x7fc9040ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ec0039f0 0x7fc8ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8ec004810 0x7fc8ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90415c2a0 0x7fc8ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc9040b3850 con 0x7fc8ec0039f0 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec00ba80 con 0x7fc8ec004810 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec00bc80 con 0x7fc90415c2a0 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ec0039f0 0x7fc8ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc9037fe640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8ec004810 0x7fc8ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 -- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90415c2a0 msgr2=0x7fc8ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90415c2a0 0x7fc8ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 -- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8ec004810 msgr2=0x7fc8ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8ec004810 0x7fc8ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.846+0000 7fc903fff640 1 -- 172.21.15.73:0/2594414613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec003530 con 0x7fc8ec0039f0 2024-09-12T03:36:53.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc903fff640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ec0039f0 0x7fc8ec003e10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400c190 tx=0x7fc8f401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6776f549c7e9361e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4007d00 con 0x7fc8ec0039f0 2024-09-12T03:36:53.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f40a9020 con 0x7fc8ec0039f0 2024-09-12T03:36:53.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc902ffd640 1 -- 172.21.15.73:0/2594414613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4005b20 con 0x7fc8ec0039f0 2024-09-12T03:36:53.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2594414613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ec0039f0 msgr2=0x7fc8ec003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc90a6d7640 1 --2- 172.21.15.73:0/2594414613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8ec0039f0 0x7fc8ec003e10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400c190 tx=0x7fc8f401cbf0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc908c74640 1 -- 172.21.15.73:0/2594414613 reap_dead start 2024-09-12T03:36:53.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2594414613 shutdown_connections 2024-09-12T03:36:53.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2594414613 >> 172.21.15.73:0/2594414613 conn(0x7fc9040b1f90 msgr2=0x7fc9040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:53.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2594414613 shutdown_connections 2024-09-12T03:36:53.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.850+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2594414613 wait complete. 2024-09-12T03:36:53.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 Processor -- start 2024-09-12T03:36:53.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 -- start start 2024-09-12T03:36:53.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc90414ae00 0x7fc90415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc90414b6e0 0x7fc9040b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90414b1e0 0x7fc9040b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc90406ef20 con 0x7fc90414ae00 2024-09-12T03:36:53.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc9040af6b0 con 0x7fc90414b6e0 2024-09-12T03:36:53.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc90406f0a0 con 0x7fc90414b1e0 2024-09-12T03:36:53.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc90414ae00 0x7fc90415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc90414ae00 0x7fc90415ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52862/0 (socket says 172.21.15.73:52862) 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 -- 172.21.15.73:0/2163190818 learned_addr learned my addr 172.21.15.73:0/2163190818 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc908c74640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90414b1e0 0x7fc9040b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc9037fe640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc90414b6e0 0x7fc9040b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 -- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90414b1e0 msgr2=0x7fc9040b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90414b1e0 0x7fc9040b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 -- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc90414b6e0 msgr2=0x7fc9040b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc90414b6e0 0x7fc9040b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 -- 172.21.15.73:0/2163190818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9041f89f0 con 0x7fc90414ae00 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc9037fe640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc90414b6e0 0x7fc9040b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc908c74640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90414b1e0 0x7fc9040b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:53.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc903fff640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc90414ae00 0x7fc90415ed40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40ab040 tx=0x7fc8ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc900ff9640 1 -- 172.21.15.73:0/2163190818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4004ab0 con 0x7fc90414ae00 2024-09-12T03:36:53.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc900ff9640 1 -- 172.21.15.73:0/2163190818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f4004c50 con 0x7fc90414ae00 2024-09-12T03:36:53.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9041f8cd0 con 0x7fc90414ae00 2024-09-12T03:36:53.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc900ff9640 1 -- 172.21.15.73:0/2163190818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40a57e0 con 0x7fc90414ae00 2024-09-12T03:36:53.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9041f9290 con 0x7fc90414ae00 2024-09-12T03:36:53.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.854+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90406e000 con 0x7fc90414ae00 2024-09-12T03:36:53.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.858+0000 7fc900ff9640 1 -- 172.21.15.73:0/2163190818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc8f40a5980 con 0x7fc90414ae00 2024-09-12T03:36:53.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.858+0000 7fc900ff9640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8f00678f0 0x7fc8f0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:53.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.858+0000 7fc9037fe640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8f00678f0 0x7fc8f0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:53.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.858+0000 7fc900ff9640 1 -- 172.21.15.73:0/2163190818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7fc8f411f580 con 0x7fc90414ae00 2024-09-12T03:36:53.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.858+0000 7fc9037fe640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8f00678f0 0x7fc8f0069db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc9040b1dc0 tx=0x7fc8f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:53.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:53.862+0000 7fc900ff9640 1 -- 172.21.15.73:0/2163190818 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc8f4016930 con 0x7fc90414ae00 2024-09-12T03:36:54.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.026+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc90406fcd0 con 0x7fc90414ae00 2024-09-12T03:36:54.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc900ff9640 1 -- 172.21.15.73:0/2163190818 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+16956 (secure 0 0 0) 0x7fc8f40eff10 con 0x7fc90414ae00 2024-09-12T03:36:54.032 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:54.032 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":64,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:35.415084+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:36:31.428624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-12T03:36:32.740289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8f00678f0 msgr2=0x7fc8f0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8f00678f0 0x7fc8f0069db0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc9040b1dc0 tx=0x7fc8f8008040 comp rx=0 tx=0).stop 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc90414ae00 msgr2=0x7fc90415ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc90414ae00 0x7fc90415ed40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40ab040 tx=0x7fc8ec005840 comp rx=0 tx=0).stop 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 shutdown_connections 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc8f00678f0 0x7fc8f0069db0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc90414b1e0 0x7fc9040b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc90414b6e0 0x7fc9040b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 --2- 172.21.15.73:0/2163190818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc90414ae00 0x7fc90415ed40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.030+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 >> 172.21.15.73:0/2163190818 conn(0x7fc9040b1f90 msgr2=0x7fc9040aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:54.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.034+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 shutdown_connections 2024-09-12T03:36:54.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.034+0000 7fc90a6d7640 1 -- 172.21.15.73:0/2163190818 wait complete. 2024-09-12T03:36:54.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:36:54.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a29e1e640 1 Processor -- start 2024-09-12T03:36:54.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a29e1e640 1 -- start start 2024-09-12T03:36:54.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a29e1e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2406fef0 0x7f3a2406e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a29e1e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a240b3d50 0x7f3a240b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a29e1e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2406ee50 con 0x7f3a24073e60 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a29e1e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3a240b46c0 con 0x7f3a240b3d50 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a29e1e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2406f130 con 0x7f3a2406fef0 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a23fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a240b3d50 0x7f3a240b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a23fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a240b3d50 0x7f3a240b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52878/0 (socket says 172.21.15.73:52878) 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a23fff640 1 -- 172.21.15.73:0/2920535776 learned_addr learned my addr 172.21.15.73:0/2920535776 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.170+0000 7f3a22ffd640 1 --2- 172.21.15.73:0/2920535776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2406fef0 0x7f3a2406e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a23fff640 1 -- 172.21.15.73:0/2920535776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2406fef0 msgr2=0x7f3a2406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a23fff640 1 --2- 172.21.15.73:0/2920535776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2406fef0 0x7f3a2406e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a23fff640 1 -- 172.21.15.73:0/2920535776 >> v1:172.21.15.150:6789/0 conn(0x7f3a24073e60 legacy=0x7f3a2415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a23fff640 1 -- 172.21.15.73:0/2920535776 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2406f410 con 0x7f3a240b3d50 2024-09-12T03:36:54.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a23fff640 1 --2- 172.21.15.73:0/2920535776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a240b3d50 0x7f3a240b4180 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009e50 tx=0x7f3a1c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c6fc4948a2ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a227fc640 1 -- 172.21.15.73:0/2920535776 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0a55f0 con 0x7f3a240b3d50 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a227fc640 1 -- 172.21.15.73:0/2920535776 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c0a5790 con 0x7f3a240b3d50 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a227fc640 1 -- 172.21.15.73:0/2920535776 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0a5b60 con 0x7f3a240b3d50 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 -- 172.21.15.73:0/2920535776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a240b3d50 msgr2=0x7f3a240b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/2920535776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a240b3d50 0x7f3a240b4180 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009e50 tx=0x7f3a1c01c960 comp rx=0 tx=0).stop 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 -- 172.21.15.73:0/2920535776 shutdown_connections 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/2920535776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a240b3d50 0x7f3a240b4180 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/2920535776 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a2406fef0 0x7f3a2406e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 -- 172.21.15.73:0/2920535776 >> 172.21.15.73:0/2920535776 conn(0x7f3a240b1f90 msgr2=0x7f3a240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 -- 172.21.15.73:0/2920535776 shutdown_connections 2024-09-12T03:36:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.174+0000 7f3a29e1e640 1 -- 172.21.15.73:0/2920535776 wait complete. 2024-09-12T03:36:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 Processor -- start 2024-09-12T03:36:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 -- start start 2024-09-12T03:36:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2406fef0 0x7f3a2414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a24073e60 0x7f3a24147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a240b3d50 0x7f3a24159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240729a0 con 0x7f3a2406fef0 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24072820 con 0x7f3a24073e60 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3a24072b20 con 0x7f3a240b3d50 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2406fef0 0x7f3a2414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2406fef0 0x7f3a2414bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52890/0 (socket says 172.21.15.73:52890) 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 -- 172.21.15.73:0/4164695624 learned_addr learned my addr 172.21.15.73:0/4164695624 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a22ffd640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a24073e60 0x7f3a24147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 -- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a240b3d50 msgr2=0x7f3a24159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a23fff640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a240b3d50 0x7f3a24159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a240b3d50 0x7f3a24159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 -- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a24073e60 msgr2=0x7f3a24147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a24073e60 0x7f3a24147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 -- 172.21.15.73:0/4164695624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a240b1d90 con 0x7f3a2406fef0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a22ffd640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a24073e60 0x7f3a24147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a237fe640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2406fef0 0x7f3a2414bf10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c480 tx=0x7f3a1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a0bfff640 1 -- 172.21.15.73:0/4164695624 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14012830 con 0x7f3a2406fef0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a0bfff640 1 -- 172.21.15.73:0/4164695624 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a14017070 con 0x7f3a2406fef0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a0bfff640 1 -- 172.21.15.73:0/4164695624 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14012c30 con 0x7f3a2406fef0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a240b1ab0 con 0x7f3a2406fef0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2414a500 con 0x7f3a2406fef0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2406e800 con 0x7f3a2406fef0 2024-09-12T03:36:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a0bfff640 1 -- 172.21.15.73:0/4164695624 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a1401c460 con 0x7f3a2406fef0 2024-09-12T03:36:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a0bfff640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3a100678c0 0x7f3a10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a0bfff640 1 -- 172.21.15.73:0/4164695624 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6101+0+0 (secure 0 0 0) 0x7f3a14085bb0 con 0x7f3a2406fef0 2024-09-12T03:36:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.178+0000 7f3a22ffd640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3a100678c0 0x7f3a10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.182+0000 7f3a22ffd640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3a100678c0 0x7f3a10069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a24158ca0 tx=0x7f3a18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.186+0000 7f3a0bfff640 1 -- 172.21.15.73:0/4164695624 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3a140565f0 con 0x7f3a2406fef0 2024-09-12T03:36:54.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.382+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3a24074ba0 con 0x7f3a2406fef0 2024-09-12T03:36:54.442 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T03:36:54.382+0000 7fe1c1027640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.386+0000 7f3a0bfff640 1 -- 172.21.15.73:0/4164695624 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f3a14055ef0 con 0x7f3a2406fef0 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.386+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3a100678c0 msgr2=0x7f3a10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.386+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3a100678c0 0x7f3a10069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3a24158ca0 tx=0x7f3a18008040 comp rx=0 tx=0).stop 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.386+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2406fef0 msgr2=0x7f3a2414bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.386+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2406fef0 0x7f3a2414bf10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400c480 tx=0x7f3a1400c940 comp rx=0 tx=0).stop 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 shutdown_connections 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3a100678c0 0x7f3a10069d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3a240b3d50 0x7f3a24159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a24073e60 0x7f3a24147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 --2- 172.21.15.73:0/4164695624 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a2406fef0 0x7f3a2414bf10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 >> 172.21.15.73:0/4164695624 conn(0x7f3a240b1f90 msgr2=0x7f3a241590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 shutdown_connections 2024-09-12T03:36:54.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.394+0000 7f3a29e1e640 1 -- 172.21.15.73:0/4164695624 wait complete. 2024-09-12T03:36:54.444 INFO:tasks.ceph.mds.a.smithi073.stderr: -3192> 2024-09-12T03:36:39.654+0000 7fbfdccdd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:36:54.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:36:54.445 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:36:54.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53fc91b640 1 Processor -- start 2024-09-12T03:36:54.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53fc91b640 1 -- start start 2024-09-12T03:36:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53fc91b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53f81587a0 0x7f53f80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53fc91b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f80b37d0 0x7f53f806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53fc91b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f806ec60 con 0x7f53f806e4b0 2024-09-12T03:36:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53fc91b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f53f806f870 con 0x7f53f81587a0 2024-09-12T03:36:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53fc91b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f53f80b3c10 con 0x7f53f80b37d0 2024-09-12T03:36:54.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53f659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f53f81587a0 0x7f53f80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53f6d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f53f806e4b0 0x7f53f8161e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43610/0 (socket says 172.21.15.73:43610) 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53f6d9d640 1 -- 172.21.15.73:0/2937233465 learned_addr learned my addr 172.21.15.73:0/2937233465 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.558+0000 7f53f5d9b640 1 --2- 172.21.15.73:0/2937233465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f80b37d0 0x7f53f806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f659c640 1 -- 172.21.15.73:0/2937233465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f80b37d0 msgr2=0x7f53f806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f659c640 1 --2- 172.21.15.73:0/2937233465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f80b37d0 0x7f53f806df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f659c640 1 -- 172.21.15.73:0/2937233465 >> v1:172.21.15.73:6789/0 conn(0x7f53f806e4b0 legacy=0x7f53f8161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f659c640 1 -- 172.21.15.73:0/2937233465 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f806ef40 con 0x7f53f81587a0 2024-09-12T03:36:54.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f559a640 1 -- 172.21.15.73:0/2937233465 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698852639 0 0) 0x7f53f806ec60 con 0x7f53f806e4b0 2024-09-12T03:36:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f659c640 1 --2- 172.21.15.73:0/2937233465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f81587a0 0x7f53f80b3290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f53e80097c0 tx=0x7f53e801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d988c357dda44c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f559a640 1 -- 172.21.15.73:0/2937233465 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80b2070 con 0x7f53f81587a0 2024-09-12T03:36:54.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f559a640 1 -- 172.21.15.73:0/2937233465 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e80ad640 con 0x7f53f81587a0 2024-09-12T03:36:54.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53f559a640 1 -- 172.21.15.73:0/2937233465 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e80ada10 con 0x7f53f81587a0 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 -- 172.21.15.73:0/2937233465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f81587a0 msgr2=0x7f53f80b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 --2- 172.21.15.73:0/2937233465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f81587a0 0x7f53f80b3290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f53e80097c0 tx=0x7f53e801c470 comp rx=0 tx=0).stop 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 -- 172.21.15.73:0/2937233465 shutdown_connections 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 --2- 172.21.15.73:0/2937233465 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f80b37d0 0x7f53f806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 --2- 172.21.15.73:0/2937233465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f81587a0 0x7f53f80b3290 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 -- 172.21.15.73:0/2937233465 >> 172.21.15.73:0/2937233465 conn(0x7f53f80b1f90 msgr2=0x7f53f80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 -- 172.21.15.73:0/2937233465 shutdown_connections 2024-09-12T03:36:54.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.562+0000 7f53fc91b640 1 -- 172.21.15.73:0/2937233465 wait complete. 2024-09-12T03:36:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 Processor -- start 2024-09-12T03:36:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 -- start start 2024-09-12T03:36:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f806e4b0 0x7f53f8145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f80b37d0 0x7f53f809c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f81587a0 0x7f53f8160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f53f8158b80 con 0x7f53f80b37d0 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f53f8073170 con 0x7f53f81587a0 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f53f81462e0 con 0x7f53f806e4b0 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f80b37d0 0x7f53f809c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f80b37d0 0x7f53f809c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52930/0 (socket says 172.21.15.73:52930) 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 -- 172.21.15.73:0/3422388213 learned_addr learned my addr 172.21.15.73:0/3422388213 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f659c640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f806e4b0 0x7f53f8145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f6d9d640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f81587a0 0x7f53f8160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 -- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f806e4b0 msgr2=0x7f53f8145cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f806e4b0 0x7f53f8145cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 -- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f81587a0 msgr2=0x7f53f8160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:54.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f81587a0 0x7f53f8160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 -- 172.21.15.73:0/3422388213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f81465c0 con 0x7f53f80b37d0 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f6d9d640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f81587a0 0x7f53f8160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53f5d9b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f80b37d0 0x7f53f809c690 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00d800 tx=0x7f53ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53e6ffd640 1 -- 172.21.15.73:0/3422388213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00b6c0 con 0x7f53f80b37d0 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53e6ffd640 1 -- 172.21.15.73:0/3422388213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec019070 con 0x7f53f80b37d0 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f81468a0 con 0x7f53f80b37d0 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53e6ffd640 1 -- 172.21.15.73:0/3422388213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00ba60 con 0x7f53f80b37d0 2024-09-12T03:36:54.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f8146e60 con 0x7f53f80b37d0 2024-09-12T03:36:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f8152830 con 0x7f53f80b37d0 2024-09-12T03:36:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53e6ffd640 1 -- 172.21.15.73:0/3422388213 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f53ec00bc00 con 0x7f53f80b37d0 2024-09-12T03:36:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.566+0000 7f53e6ffd640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53d80678c0 0x7f53d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.570+0000 7f53e6ffd640 1 -- 172.21.15.73:0/3422388213 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6187+0+0 (secure 0 0 0) 0x7f53ec086330 con 0x7f53f80b37d0 2024-09-12T03:36:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.570+0000 7f53f659c640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53d80678c0 0x7f53d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:54.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.570+0000 7f53f659c640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53d80678c0 0x7f53d8069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f53e80af000 tx=0x7f53e80a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:54.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.574+0000 7f53e6ffd640 1 -- 172.21.15.73:0/3422388213 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53ec056c90 con 0x7f53f80b37d0 2024-09-12T03:36:54.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:54.758+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f53f8070080 con 0x7f53f80b37d0 2024-09-12T03:36:55.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.386+0000 7f53e6ffd640 1 -- 172.21.15.73:0/3422388213 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f53ec056590 con 0x7f53f80b37d0 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53d80678c0 msgr2=0x7f53d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53d80678c0 0x7f53d8069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f53e80af000 tx=0x7f53e80a7070 comp rx=0 tx=0).stop 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f80b37d0 msgr2=0x7f53f809c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f80b37d0 0x7f53f809c690 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00d800 tx=0x7f53ec00dcc0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 shutdown_connections 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f53d80678c0 0x7f53d8069d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f80b37d0 0x7f53f809c690 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53f81587a0 0x7f53f8160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 --2- 172.21.15.73:0/3422388213 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f53f806e4b0 0x7f53f8145cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 >> 172.21.15.73:0/3422388213 conn(0x7f53f80b1f90 msgr2=0x7f53f8074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:55.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 shutdown_connections 2024-09-12T03:36:55.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.390+0000 7f53fc91b640 1 -- 172.21.15.73:0/3422388213 wait complete. 2024-09-12T03:36:55.413 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:36:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29deffb640 1 Processor -- start 2024-09-12T03:36:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29deffb640 1 -- start start 2024-09-12T03:36:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29deffb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29d815c2a0 0x7f29d80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29deffb640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29d80af2a0 0x7f29d806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29deffb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d80b3290 con 0x7f29d815bec0 2024-09-12T03:36:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29deffb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f29d80b3570 con 0x7f29d815c2a0 2024-09-12T03:36:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29deffb640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f29d80b3850 con 0x7f29d80af2a0 2024-09-12T03:36:55.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29d7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29d815c2a0 0x7f29d80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29dcd97640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f29d815bec0 0x7f29d80ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40830/0 (socket says 172.21.15.73:40830) 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29dcd97640 1 -- 172.21.15.73:0/432463735 learned_addr learned my addr 172.21.15.73:0/432463735 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29dd598640 1 --2- 172.21.15.73:0/432463735 >> v2:172.21.15.150:3300/0 conn(0x7f29d80af2a0 0x7f29d806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29d7fff640 1 -- 172.21.15.73:0/432463735 >> v2:172.21.15.150:3300/0 conn(0x7f29d80af2a0 msgr2=0x7f29d806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29d7fff640 1 --2- 172.21.15.73:0/432463735 >> v2:172.21.15.150:3300/0 conn(0x7f29d80af2a0 0x7f29d806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29d7fff640 1 -- 172.21.15.73:0/432463735 >> v1:172.21.15.73:6789/0 conn(0x7f29d815bec0 legacy=0x7f29d80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29d77fe640 1 -- 172.21.15.73:0/432463735 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104439839 0 0) 0x7f29d80b3290 con 0x7f29d815bec0 2024-09-12T03:36:55.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.542+0000 7f29d7fff640 1 -- 172.21.15.73:0/432463735 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d80b3b30 con 0x7f29d815c2a0 2024-09-12T03:36:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29d7fff640 1 --2- 172.21.15.73:0/432463735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d80aed60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f29d80b2fb0 tx=0x7f29c001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1149ad09b312ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29d77fe640 1 -- 172.21.15.73:0/432463735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c00ab650 con 0x7f29d815c2a0 2024-09-12T03:36:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29d77fe640 1 -- 172.21.15.73:0/432463735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c00b0070 con 0x7f29d815c2a0 2024-09-12T03:36:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29d77fe640 1 -- 172.21.15.73:0/432463735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c00aba10 con 0x7f29d815c2a0 2024-09-12T03:36:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 -- 172.21.15.73:0/432463735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 msgr2=0x7f29d80aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 --2- 172.21.15.73:0/432463735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d80aed60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f29d80b2fb0 tx=0x7f29c001c450 comp rx=0 tx=0).stop 2024-09-12T03:36:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 -- 172.21.15.73:0/432463735 shutdown_connections 2024-09-12T03:36:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 --2- 172.21.15.73:0/432463735 >> v2:172.21.15.150:3300/0 conn(0x7f29d80af2a0 0x7f29d806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 --2- 172.21.15.73:0/432463735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d80aed60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 -- 172.21.15.73:0/432463735 >> 172.21.15.73:0/432463735 conn(0x7f29d80b1f90 msgr2=0x7f29d80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 -- 172.21.15.73:0/432463735 shutdown_connections 2024-09-12T03:36:55.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 -- 172.21.15.73:0/432463735 wait complete. 2024-09-12T03:36:55.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 Processor -- start 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.546+0000 7f29deffb640 1 -- start start 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29d80af2a0 0x7f29d814ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29d815bec0 0x7f29d814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d8154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f29d806ed50 con 0x7f29d815c2a0 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f29d80af6b0 con 0x7f29d80af2a0 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f29d806eed0 con 0x7f29d815bec0 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d8154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d8154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34158/0 (socket says 172.21.15.73:34158) 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 -- 172.21.15.73:0/571851802 learned_addr learned my addr 172.21.15.73:0/571851802 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dcd97640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29d80af2a0 0x7f29d814ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:55.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29d7fff640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29d815bec0 0x7f29d814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 -- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29d815bec0 msgr2=0x7f29d814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29d815bec0 0x7f29d814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 -- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29d80af2a0 msgr2=0x7f29d814ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29d80af2a0 0x7f29d814ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 -- 172.21.15.73:0/571851802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d815d8d0 con 0x7f29d815c2a0 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dcd97640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29d80af2a0 0x7f29d814ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dd598640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d8154b90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c7f0 tx=0x7f29c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29d57fa640 1 -- 172.21.15.73:0/571851802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8015070 con 0x7f29d815c2a0 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29d57fa640 1 -- 172.21.15.73:0/571851802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c8004220 con 0x7f29d815c2a0 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29d57fa640 1 -- 172.21.15.73:0/571851802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8003620 con 0x7f29d815c2a0 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d8156490 con 0x7f29d815c2a0 2024-09-12T03:36:55.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d8156a50 con 0x7f29d815c2a0 2024-09-12T03:36:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d806f1d0 con 0x7f29d815c2a0 2024-09-12T03:36:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29d57fa640 1 -- 172.21.15.73:0/571851802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29c80039d0 con 0x7f29d815c2a0 2024-09-12T03:36:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29d57fa640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29b80678c0 0x7f29b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29d57fa640 1 -- 172.21.15.73:0/571851802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6187+0+0 (secure 0 0 0) 0x7f29c8085e30 con 0x7f29d815c2a0 2024-09-12T03:36:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.550+0000 7f29dcd97640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29b80678c0 0x7f29b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.554+0000 7f29dcd97640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29b80678c0 0x7f29b8069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007fd0 tx=0x7f29d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:55.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.558+0000 7f29d57fa640 1 -- 172.21.15.73:0/571851802 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29c80568e0 con 0x7f29d815c2a0 2024-09-12T03:36:55.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:55.710+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f29d806fcd0 con 0x7f29d815c2a0 2024-09-12T03:36:56.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.394+0000 7f29d57fa640 1 -- 172.21.15.73:0/571851802 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v66) ==== 181+0+0 (secure 0 0 0) 0x7f29c80561e0 con 0x7f29d815c2a0 2024-09-12T03:36:56.397 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:36:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.398+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29b80678c0 msgr2=0x7f29b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.398+0000 7f29deffb640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29b80678c0 0x7f29b8069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29d0007fd0 tx=0x7f29d0009040 comp rx=0 tx=0).stop 2024-09-12T03:36:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.398+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 msgr2=0x7f29d8154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:56.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.398+0000 7f29deffb640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d8154b90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c7f0 tx=0x7f29c800ccb0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 shutdown_connections 2024-09-12T03:36:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29b80678c0 0x7f29b8069d80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29d815c2a0 0x7f29d8154b90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29d815bec0 0x7f29d814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 --2- 172.21.15.73:0/571851802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29d80af2a0 0x7f29d814ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 >> 172.21.15.73:0/571851802 conn(0x7f29d80b1f90 msgr2=0x7f29d81597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:56.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 shutdown_connections 2024-09-12T03:36:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.402+0000 7f29deffb640 1 -- 172.21.15.73:0/571851802 wait complete. 2024-09-12T03:36:56.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:36:56.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba99f78640 1 Processor -- start 2024-09-12T03:36:56.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba99f78640 1 -- start start 2024-09-12T03:36:56.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba99f78640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba940aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:56.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba99f78640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba940af2a0 0x7fba9406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:56.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba99f78640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba940b3290 con 0x7fba9415bec0 2024-09-12T03:36:56.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba99f78640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fba940b3570 con 0x7fba940af2a0 2024-09-12T03:36:56.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba99f78640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fba940b3850 con 0x7fba9415c2a0 2024-09-12T03:36:56.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba93fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba940af2a0 0x7fba9406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba93fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba940af2a0 0x7fba9406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34162/0 (socket says 172.21.15.73:34162) 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba93fff640 1 -- 172.21.15.73:0/1768352711 learned_addr learned my addr 172.21.15.73:0/1768352711 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba92ffd640 1 --2- 172.21.15.73:0/1768352711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba940aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba93fff640 1 -- 172.21.15.73:0/1768352711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 msgr2=0x7fba940aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba93fff640 1 --2- 172.21.15.73:0/1768352711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba940aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba93fff640 1 -- 172.21.15.73:0/1768352711 >> v1:172.21.15.150:6789/0 conn(0x7fba9415bec0 legacy=0x7fba940ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba93fff640 1 -- 172.21.15.73:0/1768352711 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba940b3b30 con 0x7fba940af2a0 2024-09-12T03:36:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.546+0000 7fba92ffd640 1 --2- 172.21.15.73:0/1768352711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba940aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:56.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba93fff640 1 --2- 172.21.15.73:0/1768352711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba940af2a0 0x7fba9406e000 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009e50 tx=0x7fba8c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25c23be14f0493f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:56.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba927fc640 1 -- 172.21.15.73:0/1768352711 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0a5840 con 0x7fba940af2a0 2024-09-12T03:36:56.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba927fc640 1 -- 172.21.15.73:0/1768352711 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c0a59e0 con 0x7fba940af2a0 2024-09-12T03:36:56.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba927fc640 1 -- 172.21.15.73:0/1768352711 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0a5db0 con 0x7fba940af2a0 2024-09-12T03:36:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 -- 172.21.15.73:0/1768352711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba940af2a0 msgr2=0x7fba9406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 --2- 172.21.15.73:0/1768352711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba940af2a0 0x7fba9406e000 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009e50 tx=0x7fba8c01c9c0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 -- 172.21.15.73:0/1768352711 shutdown_connections 2024-09-12T03:36:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 --2- 172.21.15.73:0/1768352711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba940af2a0 0x7fba9406e000 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 --2- 172.21.15.73:0/1768352711 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba940aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 -- 172.21.15.73:0/1768352711 >> 172.21.15.73:0/1768352711 conn(0x7fba940b1f90 msgr2=0x7fba940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:56.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 -- 172.21.15.73:0/1768352711 shutdown_connections 2024-09-12T03:36:56.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.550+0000 7fba99f78640 1 -- 172.21.15.73:0/1768352711 wait complete. 2024-09-12T03:36:56.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 Processor -- start 2024-09-12T03:36:56.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 -- start start 2024-09-12T03:36:56.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba940af2a0 0x7fba9415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9415bec0 0x7fba9414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba94151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fba9406ed50 con 0x7fba9415bec0 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fba940afc90 con 0x7fba940af2a0 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fba9406eed0 con 0x7fba9415c2a0 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9415bec0 0x7fba9414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9415bec0 0x7fba9414a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34164/0 (socket says 172.21.15.73:34164) 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 -- 172.21.15.73:0/2467818592 learned_addr learned my addr 172.21.15.73:0/2467818592 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba937fe640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba940af2a0 0x7fba9415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba93fff640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba94151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 -- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 msgr2=0x7fba94151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:56.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba94151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 -- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba940af2a0 msgr2=0x7fba9415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba940af2a0 0x7fba9415a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 -- 172.21.15.73:0/2467818592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9414a630 con 0x7fba9415bec0 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba93fff640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba94151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba92ffd640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9415bec0 0x7fba9414a0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c7f0 tx=0x7fba8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba7bfff640 1 -- 172.21.15.73:0/2467818592 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88015070 con 0x7fba9415bec0 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba7bfff640 1 -- 172.21.15.73:0/2467818592 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba880077c0 con 0x7fba9415bec0 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba7bfff640 1 -- 172.21.15.73:0/2467818592 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88007bb0 con 0x7fba9415bec0 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9415a930 con 0x7fba9415bec0 2024-09-12T03:36:56.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9415aef0 con 0x7fba9415bec0 2024-09-12T03:36:56.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.554+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9414d2e0 con 0x7fba9415bec0 2024-09-12T03:36:56.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.558+0000 7fba7bfff640 1 -- 172.21.15.73:0/2467818592 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fba88018070 con 0x7fba9415bec0 2024-09-12T03:36:56.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.558+0000 7fba7bfff640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fba800678c0 0x7fba80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:56.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.558+0000 7fba7bfff640 1 -- 172.21.15.73:0/2467818592 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5749+0+0 (secure 0 0 0) 0x7fba88085e90 con 0x7fba9415bec0 2024-09-12T03:36:56.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.558+0000 7fba937fe640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fba800678c0 0x7fba80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:56.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.558+0000 7fba937fe640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fba800678c0 0x7fba80069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba84004e30 tx=0x7fba84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:56.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.562+0000 7fba7bfff640 1 -- 172.21.15.73:0/2467818592 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fba88056900 con 0x7fba9415bec0 2024-09-12T03:36:56.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:56.718+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fba9406e000 con 0x7fba9415bec0 2024-09-12T03:36:57.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.398+0000 7fba7bfff640 1 -- 172.21.15.73:0/2467818592 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v67) ==== 169+0+0 (secure 0 0 0) 0x7fba88056200 con 0x7fba9415bec0 2024-09-12T03:36:57.401 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T03:36:57.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fba800678c0 msgr2=0x7fba80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fba800678c0 0x7fba80069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba84004e30 tx=0x7fba84009040 comp rx=0 tx=0).stop 2024-09-12T03:36:57.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9415bec0 msgr2=0x7fba9414a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9415bec0 0x7fba9414a0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fba8800c7f0 tx=0x7fba8800ccb0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 shutdown_connections 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fba800678c0 0x7fba80069d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba9415bec0 0x7fba9414a0f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fba9415c2a0 0x7fba94151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 --2- 172.21.15.73:0/2467818592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba940af2a0 0x7fba9415a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 >> 172.21.15.73:0/2467818592 conn(0x7fba940b1f90 msgr2=0x7fba940afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 shutdown_connections 2024-09-12T03:36:57.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.402+0000 7fba99f78640 1 -- 172.21.15.73:0/2467818592 wait complete. 2024-09-12T03:36:57.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T03:36:57.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 Processor -- start 2024-09-12T03:36:57.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 -- start start 2024-09-12T03:36:57.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0f8073e60 0x7fa0f806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa0f806fef0 0x7fa0f815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806df70 0x7fa0f80b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f815bda0 con 0x7fa0f8073e60 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f806ee50 con 0x7fa0f806fef0 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0fc9ca640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f806f130 con 0x7fa0f806df70 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0f8073e60 0x7fa0f806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0f8073e60 0x7fa0f806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34178/0 (socket says 172.21.15.73:34178) 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 -- 172.21.15.73:0/4009769482 learned_addr learned my addr 172.21.15.73:0/4009769482 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f6d9d640 1 --2- 172.21.15.73:0/4009769482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806df70 0x7fa0f80b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f5d9b640 1 --2- 172.21.15.73:0/4009769482 >> v2:172.21.15.150:3300/0 conn(0x7fa0f806fef0 0x7fa0f815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 -- 172.21.15.73:0/4009769482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806df70 msgr2=0x7fa0f80b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:57.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 --2- 172.21.15.73:0/4009769482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806df70 0x7fa0f80b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 -- 172.21.15.73:0/4009769482 >> v2:172.21.15.150:3300/0 conn(0x7fa0f806fef0 msgr2=0x7fa0f815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 --2- 172.21.15.73:0/4009769482 >> v2:172.21.15.150:3300/0 conn(0x7fa0f806fef0 0x7fa0f815b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f659c640 1 -- 172.21.15.73:0/4009769482 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f806f410 con 0x7fa0f8073e60 2024-09-12T03:36:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.546+0000 7fa0f6d9d640 1 --2- 172.21.15.73:0/4009769482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806df70 0x7fa0f80b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0f659c640 1 --2- 172.21.15.73:0/4009769482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f8073e60 0x7fa0f806e800 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa0f81589e0 tx=0x7fa0ec01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dd640bb0327032 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:57.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0f559a640 1 -- 172.21.15.73:0/4009769482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0b4070 con 0x7fa0f8073e60 2024-09-12T03:36:57.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0f559a640 1 -- 172.21.15.73:0/4009769482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ec0a7a80 con 0x7fa0f8073e60 2024-09-12T03:36:57.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0f559a640 1 -- 172.21.15.73:0/4009769482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0a7e50 con 0x7fa0f8073e60 2024-09-12T03:36:57.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/4009769482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f8073e60 msgr2=0x7fa0f806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/4009769482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f8073e60 0x7fa0f806e800 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa0f81589e0 tx=0x7fa0ec01eb60 comp rx=0 tx=0).stop 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/4009769482 shutdown_connections 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/4009769482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806df70 0x7fa0f80b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/4009769482 >> v2:172.21.15.150:3300/0 conn(0x7fa0f806fef0 0x7fa0f815b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/4009769482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f8073e60 0x7fa0f806e800 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/4009769482 >> 172.21.15.73:0/4009769482 conn(0x7fa0f80b1f90 msgr2=0x7fa0f80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/4009769482 shutdown_connections 2024-09-12T03:36:57.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/4009769482 wait complete. 2024-09-12T03:36:57.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 Processor -- start 2024-09-12T03:36:57.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.550+0000 7fa0fc9ca640 1 -- start start 2024-09-12T03:36:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f806df70 0x7fa0f8155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806fef0 0x7fa0f8164990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8073e60 0x7fa0f8164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f815efa0 con 0x7fa0f806df70 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f815ee20 con 0x7fa0f8073e60 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f815f120 con 0x7fa0f806fef0 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f806df70 0x7fa0f8155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f806df70 0x7fa0f8155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34182/0 (socket says 172.21.15.73:34182) 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 -- 172.21.15.73:0/231081108 learned_addr learned my addr 172.21.15.73:0/231081108 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:57.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f5d9b640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806fef0 0x7fa0f8164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f6d9d640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8073e60 0x7fa0f8164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 -- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806fef0 msgr2=0x7fa0f8164990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806fef0 0x7fa0f8164990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 -- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8073e60 msgr2=0x7fa0f8164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8073e60 0x7fa0f8164ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 -- 172.21.15.73:0/231081108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f806eba0 con 0x7fa0f806df70 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f5d9b640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806fef0 0x7fa0f8164990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f659c640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f806df70 0x7fa0f8155430 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00b2c0 tx=0x7fa0ec01b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0e6ffd640 1 -- 172.21.15.73:0/231081108 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0bf070 con 0x7fa0f806df70 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0e6ffd640 1 -- 172.21.15.73:0/231081108 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ec0b6050 con 0x7fa0f806df70 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f809c840 con 0x7fa0f806df70 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0e6ffd640 1 -- 172.21.15.73:0/231081108 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0b4030 con 0x7fa0f806df70 2024-09-12T03:36:57.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f809cdc0 con 0x7fa0f806df70 2024-09-12T03:36:57.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f80b3d50 con 0x7fa0f806df70 2024-09-12T03:36:57.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0e6ffd640 1 -- 172.21.15.73:0/231081108 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0ec0c2070 con 0x7fa0f806df70 2024-09-12T03:36:57.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0e6ffd640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0d80678c0 0x7fa0d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0e6ffd640 1 -- 172.21.15.73:0/231081108 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fa0ec11fe50 con 0x7fa0f806df70 2024-09-12T03:36:57.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f5d9b640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0d80678c0 0x7fa0d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.554+0000 7fa0f5d9b640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0d80678c0 0x7fa0d8069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa0f81faba0 tx=0x7fa0e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:57.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.562+0000 7fa0e6ffd640 1 -- 172.21.15.73:0/231081108 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0ec0187e0 con 0x7fa0f806df70 2024-09-12T03:36:57.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.738+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa0f80723f0 con 0x7fa0f806df70 2024-09-12T03:36:57.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.742+0000 7fa0e6ffd640 1 -- 172.21.15.73:0/231081108 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fa0ec0f0b00 con 0x7fa0f806df70 2024-09-12T03:36:57.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.742+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0d80678c0 msgr2=0x7fa0d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.742+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0d80678c0 0x7fa0d8069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa0f81faba0 tx=0x7fa0e8008040 comp rx=0 tx=0).stop 2024-09-12T03:36:57.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.742+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f806df70 msgr2=0x7fa0f8155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.742+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f806df70 0x7fa0f8155430 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00b2c0 tx=0x7fa0ec01b900 comp rx=0 tx=0).stop 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 shutdown_connections 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa0d80678c0 0x7fa0d8069d80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa0f8073e60 0x7fa0f8164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa0f806fef0 0x7fa0f8164990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 --2- 172.21.15.73:0/231081108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0f806df70 0x7fa0f8155430 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 >> 172.21.15.73:0/231081108 conn(0x7fa0f80b1f90 msgr2=0x7fa0f8159d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 shutdown_connections 2024-09-12T03:36:57.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.746+0000 7fa0fc9ca640 1 -- 172.21.15.73:0/231081108 wait complete. 2024-09-12T03:36:57.762 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values' 2024-09-12T03:36:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c39ca9640 1 Processor -- start 2024-09-12T03:36:57.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c39ca9640 1 -- start start 2024-09-12T03:36:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c39ca9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 0x7f9c340ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c39ca9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c340b5d90 con 0x7f9c3415e600 2024-09-12T03:36:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c39ca9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c3415e9e0 con 0x7f9c340ae5b0 2024-09-12T03:36:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c39ca9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9c340aea60 con 0x7f9c3409aa00 2024-09-12T03:36:57.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c337fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9c3415e600 0x7f9c340b4120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40832/0 (socket says 172.21.15.73:40832) 2024-09-12T03:36:57.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c337fe640 1 -- 172.21.15.73:0/3097263952 learned_addr learned my addr 172.21.15.73:0/3097263952 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:57.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 0x7f9c340ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179120479 0 0) 0x7f9c340b5d90 con 0x7f9c3415e600 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c20003530 con 0x7f9c3415e600 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2177886818 0 0) 0x7f9c20003530 con 0x7f9c3415e600 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 msgr2=0x7f9c340ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 0x7f9c340ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 >> v1:172.21.15.150:6789/0 conn(0x7f9c340ae5b0 legacy=0x7f9c3406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c340b2910 con 0x7f9c3415e600 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f9c24001a00 con 0x7f9c3415e600 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 >> v1:172.21.15.73:6789/0 conn(0x7f9c3415e600 legacy=0x7f9c340b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 0x7f9c200039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c20004d50 0x7f9c200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2000ba80 con 0x7f9c20003f70 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2000bc30 con 0x7f9c20004d50 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2000be30 con 0x7f9c3409aa00 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c337fe640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 0x7f9c200039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c33fff640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c20004d50 0x7f9c200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c32ffd640 1 -- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 msgr2=0x7f9c200039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3409aa00 0x7f9c200039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c32ffd640 1 -- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c20004d50 msgr2=0x7f9c200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c20004d50 0x7f9c200051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.878+0000 7f9c32ffd640 1 -- 172.21.15.73:0/3097263952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c20003530 con 0x7f9c20003f70 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c20004810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009ae0 tx=0x7f9c1c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baed9a651eb35ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0b2070 con 0x7f9c20003f70 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0a5550 con 0x7f9c20003f70 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c327fc640 1 -- 172.21.15.73:0/3097263952 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0096b0 con 0x7f9c20003f70 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 -- 172.21.15.73:0/3097263952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 msgr2=0x7f9c20004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 --2- 172.21.15.73:0/3097263952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c20004810 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009ae0 tx=0x7f9c1c01ca70 comp rx=0 tx=0).stop 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c33fff640 1 -- 172.21.15.73:0/3097263952 reap_dead start 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 -- 172.21.15.73:0/3097263952 shutdown_connections 2024-09-12T03:36:57.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 -- 172.21.15.73:0/3097263952 >> 172.21.15.73:0/3097263952 conn(0x7f9c34073380 msgr2=0x7f9c340b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 -- 172.21.15.73:0/3097263952 shutdown_connections 2024-09-12T03:36:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 -- 172.21.15.73:0/3097263952 wait complete. 2024-09-12T03:36:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 Processor -- start 2024-09-12T03:36:57.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.882+0000 7f9c39ca9640 1 -- start start 2024-09-12T03:36:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c340cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c34151cd0 0x7f9c34160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3415ba20 0x7f9c3415bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9c340b4830 con 0x7f9c20003f70 2024-09-12T03:36:57.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9c340b2bf0 con 0x7f9c34151cd0 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9c340b0770 con 0x7f9c3415ba20 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c340cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c340cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34202/0 (socket says 172.21.15.73:34202) 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 -- 172.21.15.73:0/1708425075 learned_addr learned my addr 172.21.15.73:0/1708425075 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c34151cd0 0x7f9c34160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c33fff640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3415ba20 0x7f9c3415bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 -- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3415ba20 msgr2=0x7f9c3415bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3415ba20 0x7f9c3415bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 -- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c34151cd0 msgr2=0x7f9c34160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c34151cd0 0x7f9c34160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 -- 172.21.15.73:0/1708425075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c341564f0 con 0x7f9c20003f70 2024-09-12T03:36:57.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c34151cd0 0x7f9c34160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c337fe640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c340cbe10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9c24002240 tx=0x7f9c24011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c2bfff640 1 -- 172.21.15.73:0/1708425075 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24010040 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c2bfff640 1 -- 172.21.15.73:0/1708425075 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2401a070 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c34160c40 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c2bfff640 1 -- 172.21.15.73:0/1708425075 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400fda0 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c340cc740 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3415c3e0 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c2bfff640 1 -- 172.21.15.73:0/1708425075 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c2401f460 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c2bfff640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c140678c0 0x7f9c14069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c2bfff640 1 -- 172.21.15.73:0/1708425075 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f9c24088d40 con 0x7f9c20003f70 2024-09-12T03:36:57.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c140678c0 0x7f9c14069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:57.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.886+0000 7f9c32ffd640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c140678c0 0x7f9c14069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0af000 tx=0x7f9c1c0046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:57.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:57.890+0000 7f9c2bfff640 1 -- 172.21.15.73:0/1708425075 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9c341564f0 con 0x7f9c20003f70 2024-09-12T03:36:58.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.114+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]} v 0) -- 0x7f9c3406dde0 con 0x7f9c20003f70 2024-09-12T03:36:58.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.402+0000 7f9c2bfff640 1 -- 172.21.15.73:0/1708425075 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_human_readable_quota_values"]}]=0 v146) ==== 145+0+0 (secure 0 0 0) 0x7f9c240599f0 con 0x7f9c20003f70 2024-09-12T03:36:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c140678c0 msgr2=0x7f9c14069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c140678c0 0x7f9c14069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0af000 tx=0x7f9c1c0046d0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 msgr2=0x7f9c340cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c340cbe10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9c24002240 tx=0x7f9c24011ca0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 shutdown_connections 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9c140678c0 0x7f9c14069d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9c3415ba20 0x7f9c3415bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c34151cd0 0x7f9c34160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 --2- 172.21.15.73:0/1708425075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c20003f70 0x7f9c340cbe10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 >> 172.21.15.73:0/1708425075 conn(0x7f9c34073380 msgr2=0x7f9c3415ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 shutdown_connections 2024-09-12T03:36:58.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.406+0000 7f9c39ca9640 1 -- 172.21.15.73:0/1708425075 wait complete. 2024-09-12T03:36:58.428 INFO:tasks.cephfs_test_runner:test human-readable values for setting ceph.quota.max_bytes ... ok 2024-09-12T03:36:58.428 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_df (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2024-09-12T03:36:58.429 INFO:tasks.cephfs_test_runner:test_remote_update_df (tasks.cephfs.test_quota.TestQuota) 2024-09-12T03:36:58.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:36:58.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.550+0000 7f7e1a346640 1 Processor -- start 2024-09-12T03:36:58.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e1a346640 1 -- start start 2024-09-12T03:36:58.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e1a346640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e1406f010 0x7f7e14166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e1a346640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e140b3290 con 0x7f7e1415bec0 2024-09-12T03:36:58.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e1a346640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e140b3570 con 0x7f7e1415c2a0 2024-09-12T03:36:58.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e1a346640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7e140b3850 con 0x7f7e1406f010 2024-09-12T03:36:58.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e188e3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e1406f010 0x7f7e14166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e13fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7e1415bec0 0x7f7e140ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40840/0 (socket says 172.21.15.73:40840) 2024-09-12T03:36:58.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e13fff640 1 -- 172.21.15.73:0/2446057663 learned_addr learned my addr 172.21.15.73:0/2446057663 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:58.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e188e3640 1 -- 172.21.15.73:0/2446057663 >> v1:172.21.15.150:6789/0 conn(0x7f7e1415c2a0 legacy=0x7f7e140aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:58.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e188e3640 1 -- 172.21.15.73:0/2446057663 >> v1:172.21.15.73:6789/0 conn(0x7f7e1415bec0 legacy=0x7f7e140ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e12ffd640 1 -- 172.21.15.73:0/2446057663 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756477316 0 0) 0x7f7e140b3290 con 0x7f7e1415bec0 2024-09-12T03:36:58.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.554+0000 7f7e188e3640 1 -- 172.21.15.73:0/2446057663 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e140b3b30 con 0x7f7e1406f010 2024-09-12T03:36:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 --2- 172.21.15.73:0/2446057663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1406f010 0x7f7e14166ff0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009d90 tx=0x7f7e0c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de0658ef6d7f5d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e12ffd640 1 -- 172.21.15.73:0/2446057663 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0b2070 con 0x7f7e1406f010 2024-09-12T03:36:58.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e12ffd640 1 -- 172.21.15.73:0/2446057663 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0a58d0 con 0x7f7e1406f010 2024-09-12T03:36:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e12ffd640 1 -- 172.21.15.73:0/2446057663 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0a5ca0 con 0x7f7e1406f010 2024-09-12T03:36:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- 172.21.15.73:0/2446057663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1406f010 msgr2=0x7f7e14166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 --2- 172.21.15.73:0/2446057663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1406f010 0x7f7e14166ff0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009d90 tx=0x7f7e0c01c900 comp rx=0 tx=0).stop 2024-09-12T03:36:58.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- 172.21.15.73:0/2446057663 shutdown_connections 2024-09-12T03:36:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 --2- 172.21.15.73:0/2446057663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1406f010 0x7f7e14166ff0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- 172.21.15.73:0/2446057663 >> 172.21.15.73:0/2446057663 conn(0x7f7e140b1f90 msgr2=0x7f7e140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- 172.21.15.73:0/2446057663 shutdown_connections 2024-09-12T03:36:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- 172.21.15.73:0/2446057663 wait complete. 2024-09-12T03:36:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 Processor -- start 2024-09-12T03:36:58.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- start start 2024-09-12T03:36:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e1406f010 0x7f7e141528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1415bec0 0x7f7e14166460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1415c2a0 0x7f7e140728d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7e14169ed0 con 0x7f7e1415c2a0 2024-09-12T03:36:58.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7e14169d50 con 0x7f7e1406f010 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1416a050 con 0x7f7e1415bec0 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1415c2a0 0x7f7e140728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1415c2a0 0x7f7e140728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34218/0 (socket says 172.21.15.73:34218) 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 -- 172.21.15.73:0/482464786 learned_addr learned my addr 172.21.15.73:0/482464786 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 -- 172.21.15.73:0/482464786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1415bec0 msgr2=0x7f7e14166460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1415bec0 0x7f7e14166460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 -- 172.21.15.73:0/482464786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e1406f010 msgr2=0x7f7e141528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e1406f010 0x7f7e141528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 -- 172.21.15.73:0/482464786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e141653c0 con 0x7f7e1415c2a0 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e188e3640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1415c2a0 0x7f7e140728d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009d90 tx=0x7f7e0c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e10ff9640 1 -- 172.21.15.73:0/482464786 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0bd020 con 0x7f7e1415c2a0 2024-09-12T03:36:58.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e10ff9640 1 -- 172.21.15.73:0/482464786 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0ad740 con 0x7f7e1415c2a0 2024-09-12T03:36:58.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.558+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e141656a0 con 0x7f7e1415c2a0 2024-09-12T03:36:58.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e10ff9640 1 -- 172.21.15.73:0/482464786 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0b2040 con 0x7f7e1415c2a0 2024-09-12T03:36:58.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e14165c60 con 0x7f7e1415c2a0 2024-09-12T03:36:58.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e140ad200 con 0x7f7e1415c2a0 2024-09-12T03:36:58.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e10ff9640 1 -- 172.21.15.73:0/482464786 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e0c0c0020 con 0x7f7e1415c2a0 2024-09-12T03:36:58.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e10ff9640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7e000678c0 0x7f7e00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e13fff640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7e000678c0 0x7f7e00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e10ff9640 1 -- 172.21.15.73:0/482464786 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f7e0c120c20 con 0x7f7e1415c2a0 2024-09-12T03:36:58.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.562+0000 7f7e13fff640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7e000678c0 0x7f7e00069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7e080011f0 tx=0x7f7e08007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:58.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.566+0000 7f7e10ff9640 1 -- 172.21.15.73:0/482464786 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7e0c0c7030 con 0x7f7e1415c2a0 2024-09-12T03:36:58.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e140cf8d0 con 0x7f7e1415c2a0 2024-09-12T03:36:58.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e10ff9640 1 -- 172.21.15.73:0/482464786 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+13318 (secure 0 0 0) 0x7f7e0c016520 con 0x7f7e1415c2a0 2024-09-12T03:36:58.732 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:36:58.732 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":67,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:36:57.397850+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2746514655":"2024-09-13T03:36:54.385228+0000","172.21.15.73:6835/2746514655":"2024-09-13T03:36:54.385228+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7e000678c0 msgr2=0x7f7e00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7e000678c0 0x7f7e00069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7e080011f0 tx=0x7f7e08007930 comp rx=0 tx=0).stop 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1415c2a0 msgr2=0x7f7e140728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1415c2a0 0x7f7e140728d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009d90 tx=0x7f7e0c0196a0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 shutdown_connections 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7e000678c0 0x7f7e00069d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e1415c2a0 0x7f7e140728d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7e1415bec0 0x7f7e14166460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 --2- 172.21.15.73:0/482464786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7e1406f010 0x7f7e141528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.730+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 >> 172.21.15.73:0/482464786 conn(0x7f7e140b1f90 msgr2=0x7f7e14155050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:58.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.734+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 shutdown_connections 2024-09-12T03:36:58.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.734+0000 7f7e1a346640 1 -- 172.21.15.73:0/482464786 wait complete. 2024-09-12T03:36:58.752 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T03:34:25.956292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T03:36:58.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T03:36:58.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f920777a640 1 Processor -- start 2024-09-12T03:36:58.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f920777a640 1 -- start start 2024-09-12T03:36:58.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f920777a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f92001587a0 0x7f92000b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f920777a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920006ec60 con 0x7f920006e680 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f920777a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920006ef40 con 0x7f92000b37d0 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f920777a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f92000b3c40 con 0x7f92001587a0 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205d17640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f920006e680 0x7f9200072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40850/0 (socket says 172.21.15.73:40850) 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205d17640 1 -- 172.21.15.73:0/247779028 learned_addr learned my addr 172.21.15.73:0/247779028 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 --2- 172.21.15.73:0/247779028 >> v2:172.21.15.150:3300/0 conn(0x7f92001587a0 0x7f92000b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095056643 0 0) 0x7f920006ec60 con 0x7f920006e680 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ec003530 con 0x7f920006e680 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2148585817 0 0) 0x7f91ec003530 con 0x7f920006e680 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 >> v2:172.21.15.150:3300/0 conn(0x7f92001587a0 msgr2=0x7f92000b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 --2- 172.21.15.73:0/247779028 >> v2:172.21.15.150:3300/0 conn(0x7f92001587a0 0x7f92000b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 >> v1:172.21.15.150:6789/0 conn(0x7f92000b37d0 legacy=0x7f920006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920006f220 con 0x7f920006e680 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f91fc001680 con 0x7f920006e680 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 >> v1:172.21.15.73:6789/0 conn(0x7f920006e680 legacy=0x7f9200072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f91ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91ec004810 0x7f91ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91ec0051d0 0x7f91ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f92000b3c40 con 0x7f91ec0039c0 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec00c120 con 0x7f91ec004810 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f91ec00c320 con 0x7f91ec0051d0 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 --2- 172.21.15.73:0/247779028 >> v2:172.21.15.150:3300/0 conn(0x7f92001587a0 0x7f92000b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f91ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205d17640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91ec0051d0 0x7f91ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9204d15640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91ec004810 0x7f91ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 -- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91ec0051d0 msgr2=0x7f91ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:58.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f91ec0051d0 0x7f91ec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 -- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91ec004810 msgr2=0x7f91ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:58.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91ec004810 0x7f91ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205d17640 1 -- 172.21.15.73:0/247779028 reap_dead start 2024-09-12T03:36:58.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9205516640 1 -- 172.21.15.73:0/247779028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ec003530 con 0x7f91ec0039c0 2024-09-12T03:36:58.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.874+0000 7f9204d15640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91ec004810 0x7f91ec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f9205516640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f91ec003de0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f91f80073e0 tx=0x7f91f801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64f6175b1d4043f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80b2070 con 0x7f91ec0039c0 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f80a5c50 con 0x7f91ec0039c0 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f91f7fff640 1 -- 172.21.15.73:0/247779028 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8009c70 con 0x7f91ec0039c0 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 -- 172.21.15.73:0/247779028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 msgr2=0x7f91ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f91ec003de0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f91f80073e0 tx=0x7f91f801cee0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 -- 172.21.15.73:0/247779028 shutdown_connections 2024-09-12T03:36:58.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 --2- 172.21.15.73:0/247779028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f91ec003de0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 -- 172.21.15.73:0/247779028 >> 172.21.15.73:0/247779028 conn(0x7f92000b1f90 msgr2=0x7f92000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 -- 172.21.15.73:0/247779028 shutdown_connections 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 -- 172.21.15.73:0/247779028 wait complete. 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 Processor -- start 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.878+0000 7f920777a640 1 -- start start 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f92001616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f920014c930 0x7f92000998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9200160290 0x7f9200160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f92001627e0 con 0x7f91ec0039c0 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9200162660 con 0x7f9200160290 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9200162960 con 0x7f920014c930 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f92001616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f92001616e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34230/0 (socket says 172.21.15.73:34230) 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 -- 172.21.15.73:0/3713125805 learned_addr learned my addr 172.21.15.73:0/3713125805 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9204d15640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f920014c930 0x7f92000998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 -- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f920014c930 msgr2=0x7f92000998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f920014c930 0x7f92000998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205d17640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9200160290 0x7f9200160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 -- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9200160290 msgr2=0x7f9200160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9200160290 0x7f9200160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 -- 172.21.15.73:0/3713125805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92001539f0 con 0x7f91ec0039c0 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9205516640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f92001616e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f91f80073e0 tx=0x7f91f8019c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f91f5ffb640 1 -- 172.21.15.73:0/3713125805 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80b2040 con 0x7f91ec0039c0 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f91f5ffb640 1 -- 172.21.15.73:0/3713125805 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f80a5a50 con 0x7f91ec0039c0 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92001e9f70 con 0x7f91ec0039c0 2024-09-12T03:36:58.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f91f5ffb640 1 -- 172.21.15.73:0/3713125805 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f80add60 con 0x7f91ec0039c0 2024-09-12T03:36:58.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92001ea530 con 0x7f91ec0039c0 2024-09-12T03:36:58.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9200072160 con 0x7f91ec0039c0 2024-09-12T03:36:58.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f91f5ffb640 1 -- 172.21.15.73:0/3713125805 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91f80bf060 con 0x7f91ec0039c0 2024-09-12T03:36:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f91f5ffb640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91e40678f0 0x7f91e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f91f5ffb640 1 -- 172.21.15.73:0/3713125805 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f91f811fa30 con 0x7f91ec0039c0 2024-09-12T03:36:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9204d15640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91e40678f0 0x7f91e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:58.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.882+0000 7f9204d15640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91e40678f0 0x7f91e4069db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000c10 tx=0x7f91f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:58.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:58.886+0000 7f91f5ffb640 1 -- 172.21.15.73:0/3713125805 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91f8016bf0 con 0x7f91ec0039c0 2024-09-12T03:36:59.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.038+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9200070080 con 0x7f91ec0039c0 2024-09-12T03:36:59.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.038+0000 7f91f5ffb640 1 -- 172.21.15.73:0/3713125805 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f91f80f0770 con 0x7f91ec0039c0 2024-09-12T03:36:59.040 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91e40678f0 msgr2=0x7f91e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91e40678f0 0x7f91e4069db0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f91f0000c10 tx=0x7f91f0009040 comp rx=0 tx=0).stop 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 msgr2=0x7f92001616e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f92001616e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f91f80073e0 tx=0x7f91f8019c80 comp rx=0 tx=0).stop 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 shutdown_connections 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91e40678f0 0x7f91e4069db0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9200160290 0x7f9200160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f920014c930 0x7f92000998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 --2- 172.21.15.73:0/3713125805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91ec0039c0 0x7f92001616e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 >> 172.21.15.73:0/3713125805 conn(0x7f92000b1f90 msgr2=0x7f9200157710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 shutdown_connections 2024-09-12T03:36:59.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.042+0000 7f920777a640 1 -- 172.21.15.73:0/3713125805 wait complete. 2024-09-12T03:36:59.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2024-09-12T03:36:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 Processor -- start 2024-09-12T03:36:59.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 -- start start 2024-09-12T03:36:59.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ebc15c0c0 0x7f8ebc15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:59.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c9e0 0x7f8ebc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:59.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ebc0b5880 0x7f8ebc06d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8ebc0cd520 con 0x7f8ebc15c0c0 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8ebc0cd800 con 0x7f8ebc0b5880 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8ec0e5e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ebc0cdae0 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8eba59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ebc15c0c0 0x7f8ebc15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8eba59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ebc15c0c0 0x7f8ebc15c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34238/0 (socket says 172.21.15.73:34238) 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.170+0000 7f8eba59c640 1 -- 172.21.15.73:0/413465649 learned_addr learned my addr 172.21.15.73:0/413465649 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eb9d9b640 1 --2- 172.21.15.73:0/413465649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c9e0 0x7f8ebc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ebad9d640 1 --2- 172.21.15.73:0/413465649 >> v2:172.21.15.150:3300/0 conn(0x7f8ebc0b5880 0x7f8ebc06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eba59c640 1 -- 172.21.15.73:0/413465649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c9e0 msgr2=0x7f8ebc06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eba59c640 1 --2- 172.21.15.73:0/413465649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c9e0 0x7f8ebc06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eba59c640 1 -- 172.21.15.73:0/413465649 >> v2:172.21.15.150:3300/0 conn(0x7f8ebc0b5880 msgr2=0x7f8ebc06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:36:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eba59c640 1 --2- 172.21.15.73:0/413465649 >> v2:172.21.15.150:3300/0 conn(0x7f8ebc0b5880 0x7f8ebc06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eba59c640 1 -- 172.21.15.73:0/413465649 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc0cddc0 con 0x7f8ebc15c0c0 2024-09-12T03:36:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eba59c640 1 --2- 172.21.15.73:0/413465649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c0c0 0x7f8ebc15c4a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009870 tx=0x7f8eac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c987a7b4ada1ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:59.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eb959a640 1 -- 172.21.15.73:0/413465649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0aa430 con 0x7f8ebc15c0c0 2024-09-12T03:36:59.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eb959a640 1 -- 172.21.15.73:0/413465649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac0af070 con 0x7f8ebc15c0c0 2024-09-12T03:36:59.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8eb959a640 1 -- 172.21.15.73:0/413465649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0aa7f0 con 0x7f8ebc15c0c0 2024-09-12T03:36:59.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/413465649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c0c0 msgr2=0x7f8ebc15c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/413465649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c0c0 0x7f8ebc15c4a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009870 tx=0x7f8eac01c4f0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/413465649 shutdown_connections 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/413465649 >> v2:172.21.15.150:3300/0 conn(0x7f8ebc0b5880 0x7f8ebc06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/413465649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c9e0 0x7f8ebc06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/413465649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c0c0 0x7f8ebc15c4a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/413465649 >> 172.21.15.73:0/413465649 conn(0x7f8ebc072670 msgr2=0x7f8ebc072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/413465649 shutdown_connections 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.174+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/413465649 wait complete. 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 Processor -- start 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 -- start start 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0b5880 0x7f8ebc1f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c0c0 0x7f8ebc0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:59.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c9e0 0x7f8ebc156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc0cf160 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc0cefe0 con 0x7f8ebc0b5880 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ebc15fc60 con 0x7f8ebc15c0c0 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c9e0 0x7f8ebc156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c9e0 0x7f8ebc156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34250/0 (socket says 172.21.15.73:34250) 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 -- 172.21.15.73:0/2997010109 learned_addr learned my addr 172.21.15.73:0/2997010109 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8eba59c640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0b5880 0x7f8ebc1f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8eb9d9b640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c0c0 0x7f8ebc0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 -- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c0c0 msgr2=0x7f8ebc0b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:59.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c0c0 0x7f8ebc0b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 -- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0b5880 msgr2=0x7f8ebc1f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:36:59.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0b5880 0x7f8ebc1f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:36:59.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 -- 172.21.15.73:0/2997010109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc1587f0 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ebad9d640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c9e0 0x7f8ebc156750 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4007e30 tx=0x7f8eb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:59.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8eaaffd640 1 -- 172.21.15.73:0/2997010109 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4014620 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8eaaffd640 1 -- 172.21.15.73:0/2997010109 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb4019070 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc06e7a0 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8eaaffd640 1 -- 172.21.15.73:0/2997010109 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb4014a00 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc06ed60 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ebc15c4a0 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.178+0000 7f8eaaffd640 1 -- 172.21.15.73:0/2997010109 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8eb4014ba0 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.182+0000 7f8eaaffd640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e9c0678c0 0x7f8e9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:36:59.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.182+0000 7f8eaaffd640 1 -- 172.21.15.73:0/2997010109 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f8eb40864c0 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.182+0000 7f8eba59c640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e9c0678c0 0x7f8e9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:36:59.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.182+0000 7f8eba59c640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e9c0678c0 0x7f8e9c069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0ae000 tx=0x7f8eac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:36:59.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.186+0000 7f8eaaffd640 1 -- 172.21.15.73:0/2997010109 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ebc1587f0 con 0x7f8ebc15c9e0 2024-09-12T03:36:59.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:36:59.406+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) -- 0x7f8ebc156240 con 0x7f8ebc15c9e0 2024-09-12T03:37:00.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.414+0000 7f8eaaffd640 1 -- 172.21.15.73:0/2997010109 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v148) ==== 137+0+0 (secure 0 0 0) 0x7f8eb40570d0 con 0x7f8ebc15c9e0 2024-09-12T03:37:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e9c0678c0 msgr2=0x7f8e9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e9c0678c0 0x7f8e9c069d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0ae000 tx=0x7f8eac008040 comp rx=0 tx=0).stop 2024-09-12T03:37:00.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c9e0 msgr2=0x7f8ebc156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c9e0 0x7f8ebc156750 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4007e30 tx=0x7f8eb400e4b0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 shutdown_connections 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8e9c0678c0 0x7f8e9c069d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc15c9e0 0x7f8ebc156750 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc15c0c0 0x7f8ebc0b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 --2- 172.21.15.73:0/2997010109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0b5880 0x7f8ebc1f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 >> 172.21.15.73:0/2997010109 conn(0x7f8ebc072670 msgr2=0x7f8ebc15ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 shutdown_connections 2024-09-12T03:37:00.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.418+0000 7f8ec0e5e640 1 -- 172.21.15.73:0/2997010109 wait complete. 2024-09-12T03:37:00.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T03:37:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5d067d640 1 Processor -- start 2024-09-12T03:37:00.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5d067d640 1 -- start start 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5d067d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5c806f010 0x7fd5c8166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5d067d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c80b3290 con 0x7fd5c815bec0 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5d067d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c80b3570 con 0x7fd5c815c2a0 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5d067d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd5c80b3850 con 0x7fd5c806f010 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5ce419640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd5c815bec0 0x7fd5c80ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40852/0 (socket says 172.21.15.73:40852) 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5ce419640 1 -- 172.21.15.73:0/1101009194 learned_addr learned my addr 172.21.15.73:0/1101009194 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5cec1a640 1 --2- 172.21.15.73:0/1101009194 >> v2:172.21.15.73:3300/0 conn(0x7fd5c806f010 0x7fd5c8166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5cd417640 1 -- 172.21.15.73:0/1101009194 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090937132 0 0) 0x7fd5c80b3290 con 0x7fd5c815bec0 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5cd417640 1 -- 172.21.15.73:0/1101009194 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5b4003530 con 0x7fd5c815bec0 2024-09-12T03:37:00.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5cec1a640 1 -- 172.21.15.73:0/1101009194 >> v1:172.21.15.150:6789/0 conn(0x7fd5c815c2a0 legacy=0x7fd5c80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5cec1a640 1 -- 172.21.15.73:0/1101009194 >> v1:172.21.15.73:6789/0 conn(0x7fd5c815bec0 legacy=0x7fd5c80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.566+0000 7fd5cec1a640 1 -- 172.21.15.73:0/1101009194 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c80b3b30 con 0x7fd5c806f010 2024-09-12T03:37:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5cec1a640 1 --2- 172.21.15.73:0/1101009194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8166ff0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009d90 tx=0x7fd5c001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e015ce7ff04463 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5cd417640 1 -- 172.21.15.73:0/1101009194 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00b2070 con 0x7fd5c806f010 2024-09-12T03:37:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5cd417640 1 -- 172.21.15.73:0/1101009194 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c00a5910 con 0x7fd5c806f010 2024-09-12T03:37:00.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5cd417640 1 -- 172.21.15.73:0/1101009194 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00a5ce0 con 0x7fd5c806f010 2024-09-12T03:37:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- 172.21.15.73:0/1101009194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 msgr2=0x7fd5c8166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 --2- 172.21.15.73:0/1101009194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8166ff0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009d90 tx=0x7fd5c001c940 comp rx=0 tx=0).stop 2024-09-12T03:37:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- 172.21.15.73:0/1101009194 shutdown_connections 2024-09-12T03:37:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 --2- 172.21.15.73:0/1101009194 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8166ff0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- 172.21.15.73:0/1101009194 >> 172.21.15.73:0/1101009194 conn(0x7fd5c80b1f90 msgr2=0x7fd5c80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- 172.21.15.73:0/1101009194 shutdown_connections 2024-09-12T03:37:00.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- 172.21.15.73:0/1101009194 wait complete. 2024-09-12T03:37:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 Processor -- start 2024-09-12T03:37:00.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- start start 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c815bec0 0x7fd5c8157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c815c2a0 0x7fd5c81579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c8169ed0 con 0x7fd5c806f010 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c8169d50 con 0x7fd5c815bec0 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5d067d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c816a050 con 0x7fd5c815c2a0 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5ce419640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:00.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5ce419640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8099810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34278/0 (socket says 172.21.15.73:34278) 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.570+0000 7fd5ce419640 1 -- 172.21.15.73:0/940563503 learned_addr learned my addr 172.21.15.73:0/940563503 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5cdc18640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c815bec0 0x7fd5c8157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5cec1a640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c815c2a0 0x7fd5c81579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5ce419640 1 -- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c815c2a0 msgr2=0x7fd5c81579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5ce419640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c815c2a0 0x7fd5c81579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5ce419640 1 -- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c815bec0 msgr2=0x7fd5c8157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5ce419640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c815bec0 0x7fd5c8157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5ce419640 1 -- 172.21.15.73:0/940563503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c8157fb0 con 0x7fd5c806f010 2024-09-12T03:37:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5cdc18640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c815bec0 0x7fd5c8157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5ce419640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8099810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400c4d0 tx=0x7fd5c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5beffd640 1 -- 172.21.15.73:0/940563503 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4017070 con 0x7fd5c806f010 2024-09-12T03:37:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5beffd640 1 -- 172.21.15.73:0/940563503 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c4005cf0 con 0x7fd5c806f010 2024-09-12T03:37:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5beffd640 1 -- 172.21.15.73:0/940563503 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4007270 con 0x7fd5c806f010 2024-09-12T03:37:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c8158290 con 0x7fd5c806f010 2024-09-12T03:37:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c8158850 con 0x7fd5c806f010 2024-09-12T03:37:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c80b3290 con 0x7fd5c806f010 2024-09-12T03:37:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5beffd640 1 -- 172.21.15.73:0/940563503 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5c401a070 con 0x7fd5c806f010 2024-09-12T03:37:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5beffd640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5ac0678c0 0x7fd5ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5beffd640 1 -- 172.21.15.73:0/940563503 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7fd5c4084df0 con 0x7fd5c806f010 2024-09-12T03:37:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5cdc18640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5ac0678c0 0x7fd5ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.574+0000 7fd5cdc18640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5ac0678c0 0x7fd5ac069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80cf810 tx=0x7fd5b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.578+0000 7fd5beffd640 1 -- 172.21.15.73:0/940563503 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd5c40554e0 con 0x7fd5c806f010 2024-09-12T03:37:00.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.734+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd5c80b1c90 con 0x7fd5c806f010 2024-09-12T03:37:00.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5beffd640 1 -- 172.21.15.73:0/940563503 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fd5c40597e0 con 0x7fd5c806f010 2024-09-12T03:37:00.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5ac0678c0 msgr2=0x7fd5ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5ac0678c0 0x7fd5ac069d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80cf810 tx=0x7fd5b8009040 comp rx=0 tx=0).stop 2024-09-12T03:37:00.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 msgr2=0x7fd5c8099810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8099810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400c4d0 tx=0x7fd5c400c990 comp rx=0 tx=0).stop 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 shutdown_connections 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd5ac0678c0 0x7fd5ac069d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd5c815c2a0 0x7fd5c81579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5c815bec0 0x7fd5c8157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 --2- 172.21.15.73:0/940563503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5c806f010 0x7fd5c8099810 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 >> 172.21.15.73:0/940563503 conn(0x7fd5c80b1f90 msgr2=0x7fd5c80b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 shutdown_connections 2024-09-12T03:37:00.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:00.742+0000 7fd5d067d640 1 -- 172.21.15.73:0/940563503 wait complete. 2024-09-12T03:37:00.761 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:37:00.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:00.807 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:00.858 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:37:00.858 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:00.858 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:00.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:37:00.863 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:00.864 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:00.869 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:37:00.870 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:00.870 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:00.910 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:37:00.910 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:00.910 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:00.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:37:00.917 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T03:37:00.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f1886d59640 1 Processor -- start 2024-09-12T03:37:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f1886d59640 1 -- start start 2024-09-12T03:37:01.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f1886d59640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f188015e470 0x7f18800d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f1886d59640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f18800b38e0 0x7f18800d4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f1886d59640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18800d2b20 con 0x7f18800d4750 2024-09-12T03:37:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f1886d59640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f18800d3bc0 con 0x7f18800b38e0 2024-09-12T03:37:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f1886d59640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f18800d4ba0 con 0x7f188015e470 2024-09-12T03:37:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f187ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f18800b38e0 0x7f18800d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f187ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f18800b38e0 0x7f18800d4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34282/0 (socket says 172.21.15.73:34282) 2024-09-12T03:37:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f187ffff640 1 -- 172.21.15.73:0/1174469248 learned_addr learned my addr 172.21.15.73:0/1174469248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f187ffff640 1 -- 172.21.15.73:0/1174469248 >> v2:172.21.15.150:3300/0 conn(0x7f188015e470 msgr2=0x7f18800d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f187ffff640 1 --2- 172.21.15.73:0/1174469248 >> v2:172.21.15.150:3300/0 conn(0x7f188015e470 0x7f18800d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f187ffff640 1 -- 172.21.15.73:0/1174469248 >> v1:172.21.15.150:6789/0 conn(0x7f18800d4750 legacy=0x7f1880161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.078+0000 7f187ffff640 1 -- 172.21.15.73:0/1174469248 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18800d2e00 con 0x7f18800b38e0 2024-09-12T03:37:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f187ffff640 1 --2- 172.21.15.73:0/1174469248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18800b38e0 0x7f18800d4210 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f18800d2120 tx=0x7f186801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d7857545986cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f187f7fe640 1 -- 172.21.15.73:0/1174469248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18680b0070 con 0x7f18800b38e0 2024-09-12T03:37:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f187f7fe640 1 -- 172.21.15.73:0/1174469248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18680ab600 con 0x7f18800b38e0 2024-09-12T03:37:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f187f7fe640 1 -- 172.21.15.73:0/1174469248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18680ab9d0 con 0x7f18800b38e0 2024-09-12T03:37:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 -- 172.21.15.73:0/1174469248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18800b38e0 msgr2=0x7f18800d4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 --2- 172.21.15.73:0/1174469248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18800b38e0 0x7f18800d4210 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f18800d2120 tx=0x7f186801c450 comp rx=0 tx=0).stop 2024-09-12T03:37:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 -- 172.21.15.73:0/1174469248 shutdown_connections 2024-09-12T03:37:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 --2- 172.21.15.73:0/1174469248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18800b38e0 0x7f18800d4210 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 --2- 172.21.15.73:0/1174469248 >> v2:172.21.15.150:3300/0 conn(0x7f188015e470 0x7f18800d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 -- 172.21.15.73:0/1174469248 >> 172.21.15.73:0/1174469248 conn(0x7f188009d730 msgr2=0x7f188008bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:01.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 -- 172.21.15.73:0/1174469248 shutdown_connections 2024-09-12T03:37:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 -- 172.21.15.73:0/1174469248 wait complete. 2024-09-12T03:37:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 Processor -- start 2024-09-12T03:37:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.082+0000 7f1886d59640 1 -- start start 2024-09-12T03:37:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800b38e0 0x7f18801589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18800d4750 0x7f188015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188015e470 0x7f188015b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f188016b380 con 0x7f188015e470 2024-09-12T03:37:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f188016b200 con 0x7f18800b38e0 2024-09-12T03:37:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f188016b500 con 0x7f18800d4750 2024-09-12T03:37:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188015e470 0x7f188015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188015e470 0x7f188015b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34296/0 (socket says 172.21.15.73:34296) 2024-09-12T03:37:01.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 -- 172.21.15.73:0/2216176808 learned_addr learned my addr 172.21.15.73:0/2216176808 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1884af5640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800b38e0 0x7f18801589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f187ffff640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18800d4750 0x7f188015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 -- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18800d4750 msgr2=0x7f188015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18800d4750 0x7f188015b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 -- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800b38e0 msgr2=0x7f18801589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800b38e0 0x7f18801589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 -- 172.21.15.73:0/2216176808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188015eb20 con 0x7f188015e470 2024-09-12T03:37:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f18852f6640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188015e470 0x7f188015b850 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f187800c7b0 tx=0x7f187800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f187d7fa640 1 -- 172.21.15.73:0/2216176808 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878017070 con 0x7f188015e470 2024-09-12T03:37:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f187d7fa640 1 -- 172.21.15.73:0/2216176808 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1878003db0 con 0x7f188015e470 2024-09-12T03:37:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188015ee00 con 0x7f188015e470 2024-09-12T03:37:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f187d7fa640 1 -- 172.21.15.73:0/2216176808 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18780052b0 con 0x7f188015e470 2024-09-12T03:37:01.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18801600b0 con 0x7f188015e470 2024-09-12T03:37:01.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18800d4210 con 0x7f188015e470 2024-09-12T03:37:01.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f187d7fa640 1 -- 172.21.15.73:0/2216176808 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f187801a070 con 0x7f188015e470 2024-09-12T03:37:01.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f187d7fa640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f18600678c0 0x7f1860069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1884af5640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f18600678c0 0x7f1860069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f187d7fa640 1 -- 172.21.15.73:0/2216176808 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f18780851b0 con 0x7f188015e470 2024-09-12T03:37:01.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.086+0000 7f1884af5640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f18600678c0 0x7f1860069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f1870008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:01.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.090+0000 7f187d7fa640 1 -- 172.21.15.73:0/2216176808 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1878055e60 con 0x7f188015e470 2024-09-12T03:37:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.278+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1880160fb0 con 0x7f188015e470 2024-09-12T03:37:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.278+0000 7f187d7fa640 1 -- 172.21.15.73:0/2216176808 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+3914 (secure 0 0 0) 0x7f1878055760 con 0x7f188015e470 2024-09-12T03:37:01.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:01.281 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":34,"btime":"2024-09-12T03:36:55:387567+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/423262735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":423262735},{"type":"v1","addr":"172.21.15.150:6835","nonce":423262735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":5011,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3010572042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3010572042},{"type":"v1","addr":"172.21.15.150:6833","nonce":3010572042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/2140641329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2140641329},{"type":"v1","addr":"172.21.15.73:6836","nonce":2140641329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5805,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3177998049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3177998049},{"type":"v1","addr":"172.21.15.73:6837","nonce":3177998049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[]} 2024-09-12T03:37:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 34 2024-09-12T03:37:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f18600678c0 msgr2=0x7f1860069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f18600678c0 0x7f1860069d80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1870006fd0 tx=0x7f1870008040 comp rx=0 tx=0).stop 2024-09-12T03:37:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188015e470 msgr2=0x7f188015b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188015e470 0x7f188015b850 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f187800c7b0 tx=0x7f187800cc70 comp rx=0 tx=0).stop 2024-09-12T03:37:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 shutdown_connections 2024-09-12T03:37:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f18600678c0 0x7f1860069d80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f188015e470 0x7f188015b850 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f18800d4750 0x7f188015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 --2- 172.21.15.73:0/2216176808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18800b38e0 0x7f18801589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 >> 172.21.15.73:0/2216176808 conn(0x7f188009d730 msgr2=0x7f18800cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 shutdown_connections 2024-09-12T03:37:01.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.282+0000 7f1886d59640 1 -- 172.21.15.73:0/2216176808 wait complete. 2024-09-12T03:37:01.299 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T03:37:01.299 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T03:37:01.299 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:37:01.300 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:01.300 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T03:37:01.300 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T03:37:01.301 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:37:01.301 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:01.301 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T03:37:01.301 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T03:37:01.302 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:37:01.302 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:01.302 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T03:37:01.302 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T03:37:01.303 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:37:01.303 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:01.309 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:37:01.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T03:37:01.312 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:37:01.312 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T03:37:01.315 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:37:01.315 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T03:37:01.318 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:37:01.318 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T03:37:01.355 INFO:tasks.ceph.mds.a:Started 2024-09-12T03:37:01.355 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:01.356 INFO:tasks.ceph.mds.c:Started 2024-09-12T03:37:01.357 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:01.365 INFO:tasks.ceph.mds.b:Started 2024-09-12T03:37:01.366 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:01.367 INFO:tasks.ceph.mds.d:Started 2024-09-12T03:37:01.367 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:01.368 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T03:37:01.413 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:37:01.424 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:37:01.434 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:37:01.437 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-12T03:37:01.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.474+0000 7f8ae1bb4640 1 Processor -- start 2024-09-12T03:37:01.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.474+0000 7f8ae1bb4640 1 -- start start 2024-09-12T03:37:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8adc06c3d0 0x7f8adc09aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8adc0b40c0 0x7f8adc15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8adc0b5c90 con 0x7f8adc15e450 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8adc0b4860 con 0x7f8adc0b40c0 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8adc0b4580 con 0x7f8adc06c3d0 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8adc0b40c0 0x7f8adc15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8adc0b40c0 0x7f8adc15fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34350/0 (socket says 172.21.15.73:34350) 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 -- 172.21.15.73:0/1573502152 learned_addr learned my addr 172.21.15.73:0/1573502152 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 -- 172.21.15.73:0/1573502152 >> v2:172.21.15.150:3300/0 conn(0x7f8adc06c3d0 msgr2=0x7f8adc09aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 --2- 172.21.15.73:0/1573502152 >> v2:172.21.15.150:3300/0 conn(0x7f8adc06c3d0 0x7f8adc09aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 -- 172.21.15.73:0/1573502152 >> v1:172.21.15.150:6789/0 conn(0x7f8adc15e450 legacy=0x7f8adc06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:01.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 -- 172.21.15.73:0/1573502152 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc0b5f10 con 0x7f8adc0b40c0 2024-09-12T03:37:01.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8adbfff640 1 --2- 172.21.15.73:0/1573502152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc0b40c0 0x7f8adc15fc60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0b2d90 tx=0x7f8ad401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59652b829c83ff2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ada7fc640 1 -- 172.21.15.73:0/1573502152 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40a5510 con 0x7f8adc0b40c0 2024-09-12T03:37:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ada7fc640 1 -- 172.21.15.73:0/1573502152 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad40a56b0 con 0x7f8adc0b40c0 2024-09-12T03:37:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ada7fc640 1 -- 172.21.15.73:0/1573502152 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40a5a80 con 0x7f8adc0b40c0 2024-09-12T03:37:01.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/1573502152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc0b40c0 msgr2=0x7f8adc15fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/1573502152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc0b40c0 0x7f8adc15fc60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0b2d90 tx=0x7f8ad401c740 comp rx=0 tx=0).stop 2024-09-12T03:37:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/1573502152 shutdown_connections 2024-09-12T03:37:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/1573502152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc0b40c0 0x7f8adc15fc60 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/1573502152 >> v2:172.21.15.150:3300/0 conn(0x7f8adc06c3d0 0x7f8adc09aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/1573502152 >> 172.21.15.73:0/1573502152 conn(0x7f8adc0b6800 msgr2=0x7f8adc0b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/1573502152 shutdown_connections 2024-09-12T03:37:01.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.478+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/1573502152 wait complete. 2024-09-12T03:37:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 Processor -- start 2024-09-12T03:37:01.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 -- start start 2024-09-12T03:37:01.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc06c3d0 0x7f8adc15b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8adc0b40c0 0x7f8adc14d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8adc15e450 0x7f8adc14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc162d00 con 0x7f8adc06c3d0 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc162b80 con 0x7f8adc0b40c0 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8adc162e80 con 0x7f8adc15e450 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc06c3d0 0x7f8adc15b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc06c3d0 0x7f8adc15b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34358/0 (socket says 172.21.15.73:34358) 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 -- 172.21.15.73:0/4262414601 learned_addr learned my addr 172.21.15.73:0/4262414601 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adaffd640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8adc0b40c0 0x7f8adc14d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adbfff640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8adc15e450 0x7f8adc14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 -- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8adc15e450 msgr2=0x7f8adc14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8adc15e450 0x7f8adc14dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 -- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8adc0b40c0 msgr2=0x7f8adc14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8adc0b40c0 0x7f8adc14d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 -- 172.21.15.73:0/4262414601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc151a50 con 0x7f8adc06c3d0 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8adb7fe640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc06c3d0 0x7f8adc15b230 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00b410 tx=0x7f8acc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ac3fff640 1 -- 172.21.15.73:0/4262414601 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc015020 con 0x7f8adc06c3d0 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ac3fff640 1 -- 172.21.15.73:0/4262414601 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8acc011830 con 0x7f8adc06c3d0 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8adc151d30 con 0x7f8adc06c3d0 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ac3fff640 1 -- 172.21.15.73:0/4262414601 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc011c20 con 0x7f8adc06c3d0 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8adc1522f0 con 0x7f8adc06c3d0 2024-09-12T03:37:01.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8adc15fc60 con 0x7f8adc06c3d0 2024-09-12T03:37:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ac3fff640 1 -- 172.21.15.73:0/4262414601 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8acc018020 con 0x7f8adc06c3d0 2024-09-12T03:37:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.482+0000 7f8ac3fff640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ac80678c0 0x7f8ac8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.486+0000 7f8ac3fff640 1 -- 172.21.15.73:0/4262414601 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5335+0+0 (secure 0 0 0) 0x7f8acc085960 con 0x7f8adc06c3d0 2024-09-12T03:37:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.486+0000 7f8adaffd640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ac80678c0 0x7f8ac8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:01.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.486+0000 7f8adaffd640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ac80678c0 0x7f8ac8069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8adc1fa680 tx=0x7f8ad0009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:01.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.490+0000 7f8ac3fff640 1 -- 172.21.15.73:0/4262414601 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8acc01f020 con 0x7f8adc06c3d0 2024-09-12T03:37:01.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:01.646+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8adc06e7c0 con 0x7f8adc06c3d0 2024-09-12T03:37:02.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.430+0000 7f8ac3fff640 1 -- 172.21.15.73:0/4262414601 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) ==== 97+0+0 (secure 0 0 0) 0x7f8acc055fc0 con 0x7f8adc06c3d0 2024-09-12T03:37:02.434 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-09-12T03:37:02.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ac80678c0 msgr2=0x7f8ac8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ac80678c0 0x7f8ac8069d80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8adc1fa680 tx=0x7f8ad0009110 comp rx=0 tx=0).stop 2024-09-12T03:37:02.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc06c3d0 msgr2=0x7f8adc15b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc06c3d0 0x7f8adc15b230 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8acc00b410 tx=0x7f8acc00b8d0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 shutdown_connections 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ac80678c0 0x7f8ac8069d80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8adc15e450 0x7f8adc14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8adc0b40c0 0x7f8adc14d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 --2- 172.21.15.73:0/4262414601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8adc06c3d0 0x7f8adc15b230 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.434+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 >> 172.21.15.73:0/4262414601 conn(0x7f8adc0b6800 msgr2=0x7f8adc06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.438+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 shutdown_connections 2024-09-12T03:37:02.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.438+0000 7f8ae1bb4640 1 -- 172.21.15.73:0/4262414601 wait complete. 2024-09-12T03:37:02.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T03:37:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.626+0000 7f44935cc640 1 Processor -- start 2024-09-12T03:37:02.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.626+0000 7f44935cc640 1 -- start start 2024-09-12T03:37:02.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.626+0000 7f44935cc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f448c15c2a0 0x7f448c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.626+0000 7f44935cc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c0af2a0 0x7f448c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.626+0000 7f44935cc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f448c0b3290 con 0x7f448c15bec0 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.626+0000 7f44935cc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f448c0b3570 con 0x7f448c15c2a0 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.626+0000 7f44935cc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f448c0b3850 con 0x7f448c0af2a0 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4490b67640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f448c15c2a0 0x7f448c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4491368640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f448c15bec0 0x7f448c0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40882/0 (socket says 172.21.15.73:40882) 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4491368640 1 -- 172.21.15.73:0/3804614225 learned_addr learned my addr 172.21.15.73:0/3804614225 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:02.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4491b69640 1 --2- 172.21.15.73:0/3804614225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c0af2a0 0x7f448c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:02.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4490b67640 1 -- 172.21.15.73:0/3804614225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c0af2a0 msgr2=0x7f448c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:02.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4490b67640 1 --2- 172.21.15.73:0/3804614225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c0af2a0 0x7f448c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4490b67640 1 -- 172.21.15.73:0/3804614225 >> v1:172.21.15.73:6789/0 conn(0x7f448c15bec0 legacy=0x7f448c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4490b67640 1 -- 172.21.15.73:0/3804614225 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c0b3b30 con 0x7f448c15c2a0 2024-09-12T03:37:02.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4491b69640 1 --2- 172.21.15.73:0/3804614225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c0af2a0 0x7f448c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4490b67640 1 --2- 172.21.15.73:0/3804614225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c15c2a0 0x7f448c0aed60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f44880097c0 tx=0x7f448801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f2a9fc8d236ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4483fff640 1 -- 172.21.15.73:0/3804614225 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880a7070 con 0x7f448c15c2a0 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4483fff640 1 -- 172.21.15.73:0/3804614225 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44880b0070 con 0x7f448c15c2a0 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f4483fff640 1 -- 172.21.15.73:0/3804614225 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880ab890 con 0x7f448c15c2a0 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 -- 172.21.15.73:0/3804614225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c15c2a0 msgr2=0x7f448c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 --2- 172.21.15.73:0/3804614225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c15c2a0 0x7f448c0aed60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f44880097c0 tx=0x7f448801c470 comp rx=0 tx=0).stop 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 -- 172.21.15.73:0/3804614225 shutdown_connections 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 --2- 172.21.15.73:0/3804614225 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c0af2a0 0x7f448c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 --2- 172.21.15.73:0/3804614225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c15c2a0 0x7f448c0aed60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 -- 172.21.15.73:0/3804614225 >> 172.21.15.73:0/3804614225 conn(0x7f448c0b1f90 msgr2=0x7f448c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:02.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 -- 172.21.15.73:0/3804614225 shutdown_connections 2024-09-12T03:37:02.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.630+0000 7f44935cc640 1 -- 172.21.15.73:0/3804614225 wait complete. 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 Processor -- start 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 -- start start 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c0af2a0 0x7f448c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c15bec0 0x7f448c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448c15c2a0 0x7f448c14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f448c06ed50 con 0x7f448c0af2a0 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f448c0af6b0 con 0x7f448c15c2a0 2024-09-12T03:37:02.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f448c06eed0 con 0x7f448c15bec0 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c0af2a0 0x7f448c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c0af2a0 0x7f448c14d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34376/0 (socket says 172.21.15.73:34376) 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 -- 172.21.15.73:0/2666461247 learned_addr learned my addr 172.21.15.73:0/2666461247 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4490b67640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c15bec0 0x7f448c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491b69640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448c15c2a0 0x7f448c14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 -- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c15bec0 msgr2=0x7f448c14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c15bec0 0x7f448c14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 -- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448c15c2a0 msgr2=0x7f448c14a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448c15c2a0 0x7f448c14a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 -- 172.21.15.73:0/2666461247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c164000 con 0x7f448c0af2a0 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491b69640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448c15c2a0 0x7f448c14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4491368640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c0af2a0 0x7f448c14d370 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c420 tx=0x7f447c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4481ffb640 1 -- 172.21.15.73:0/2666461247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c017070 con 0x7f448c0af2a0 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4481ffb640 1 -- 172.21.15.73:0/2666461247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c005cf0 con 0x7f448c0af2a0 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448c14da70 con 0x7f448c0af2a0 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f4481ffb640 1 -- 172.21.15.73:0/2666461247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c0072f0 con 0x7f448c0af2a0 2024-09-12T03:37:02.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448c1645a0 con 0x7f448c0af2a0 2024-09-12T03:37:02.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.634+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448c06e000 con 0x7f448c0af2a0 2024-09-12T03:37:02.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.638+0000 7f4481ffb640 1 -- 172.21.15.73:0/2666461247 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f447c01a070 con 0x7f448c0af2a0 2024-09-12T03:37:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.638+0000 7f4481ffb640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44700678c0 0x7f4470069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.638+0000 7f4490b67640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44700678c0 0x7f4470069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.638+0000 7f4481ffb640 1 -- 172.21.15.73:0/2666461247 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f447c084d60 con 0x7f448c0af2a0 2024-09-12T03:37:02.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.638+0000 7f4490b67640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44700678c0 0x7f4470069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f44880af000 tx=0x7f44880b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:02.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.642+0000 7f4481ffb640 1 -- 172.21.15.73:0/2666461247 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f447c0554a0 con 0x7f448c0af2a0 2024-09-12T03:37:02.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.862+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f448c06fcd0 con 0x7f448c0af2a0 2024-09-12T03:37:02.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.862+0000 7f4481ffb640 1 -- 172.21.15.73:0/2666461247 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f447c0597a0 con 0x7f448c0af2a0 2024-09-12T03:37:02.865 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:02.865 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:37:02.865 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-09-12T03:37:02.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.865 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-09-12T03:37:02.865 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ==", 2024-09-12T03:37:02.865 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw==", 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.866 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA==", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:02.867 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ==", 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg==", 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw==", 2024-09-12T03:37:02.869 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig==", 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.870 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ==", 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.871 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A==", 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg==", 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.872 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ==", 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.873 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g==", 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg==", 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.874 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA==", 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:37:02.875 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw==", 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.876 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ==", 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQASYeJmw4+ENRAAkTAy3UFY3keAJJFJvyQaAA==", 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.877 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw==", 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.878 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA==", 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T03:37:02.879 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:37:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44700678c0 msgr2=0x7f4470069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44700678c0 0x7f4470069d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f44880af000 tx=0x7f44880b6040 comp rx=0 tx=0).stop 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c0af2a0 msgr2=0x7f448c14d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c0af2a0 0x7f448c14d370 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c420 tx=0x7f447c00c8e0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 shutdown_connections 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f44700678c0 0x7f4470069d80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f448c15c2a0 0x7f448c14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f448c15bec0 0x7f448c14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 --2- 172.21.15.73:0/2666461247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f448c0af2a0 0x7f448c14d370 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 >> 172.21.15.73:0/2666461247 conn(0x7f448c0b1f90 msgr2=0x7f448c1598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 shutdown_connections 2024-09-12T03:37:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:02.866+0000 7f44935cc640 1 -- 172.21.15.73:0/2666461247 wait complete. 2024-09-12T03:37:02.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T03:37:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fafc02640 1 Processor -- start 2024-09-12T03:37:03.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fafc02640 1 -- start start 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fafc02640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fa80af8d0 0x7f8fa806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fafc02640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa806eec0 0x7f8fa80b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fafc02640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa806f400 con 0x7f8fa80b3b00 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fafc02640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa8072120 con 0x7f8fa80af8d0 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fafc02640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa806f6e0 con 0x7f8fa806eec0 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fa80af8d0 0x7f8fa806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fa80af8d0 0x7f8fa806e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34382/0 (socket says 172.21.15.73:34382) 2024-09-12T03:37:03.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 -- 172.21.15.73:0/2158685817 learned_addr learned my addr 172.21.15.73:0/2158685817 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 -- 172.21.15.73:0/2158685817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa806eec0 msgr2=0x7f8fa80b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 --2- 172.21.15.73:0/2158685817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa806eec0 0x7f8fa80b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 -- 172.21.15.73:0/2158685817 >> v1:172.21.15.150:6789/0 conn(0x7f8fa80b3b00 legacy=0x7f8fa815def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:03.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 -- 172.21.15.73:0/2158685817 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa8072370 con 0x7f8fa80af8d0 2024-09-12T03:37:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.002+0000 7f8fad99e640 1 --2- 172.21.15.73:0/2158685817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa80af8d0 0x7f8fa806e980 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8f98006fd0 tx=0x7f8f9801e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ab81d20505bd80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fac99c640 1 -- 172.21.15.73:0/2158685817 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f980ad070 con 0x7f8fa80af8d0 2024-09-12T03:37:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fac99c640 1 -- 172.21.15.73:0/2158685817 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f98004230 con 0x7f8fa80af8d0 2024-09-12T03:37:03.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fac99c640 1 -- 172.21.15.73:0/2158685817 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f98003620 con 0x7f8fa80af8d0 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- 172.21.15.73:0/2158685817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa80af8d0 msgr2=0x7f8fa806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 --2- 172.21.15.73:0/2158685817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa80af8d0 0x7f8fa806e980 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8f98006fd0 tx=0x7f8f9801e890 comp rx=0 tx=0).stop 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- 172.21.15.73:0/2158685817 shutdown_connections 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 --2- 172.21.15.73:0/2158685817 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa806eec0 0x7f8fa80b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 --2- 172.21.15.73:0/2158685817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa80af8d0 0x7f8fa806e980 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- 172.21.15.73:0/2158685817 >> 172.21.15.73:0/2158685817 conn(0x7f8fa80b1f90 msgr2=0x7f8fa80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- 172.21.15.73:0/2158685817 shutdown_connections 2024-09-12T03:37:03.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- 172.21.15.73:0/2158685817 wait complete. 2024-09-12T03:37:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 Processor -- start 2024-09-12T03:37:03.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- start start 2024-09-12T03:37:03.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa806eec0 0x7f8fa80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fa80af8d0 0x7f8fa8163430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa80b3b00 0x7f8fa8163970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa8167410 con 0x7f8fa806eec0 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa8167290 con 0x7f8fa80af8d0 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa8167590 con 0x7f8fa80b3b00 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa806eec0 0x7f8fa80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa806eec0 0x7f8fa80cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34390/0 (socket says 172.21.15.73:34390) 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 -- 172.21.15.73:0/1537770773 learned_addr learned my addr 172.21.15.73:0/1537770773 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fae19f640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa80b3b00 0x7f8fa8163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad19d640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fa80af8d0 0x7f8fa8163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 -- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa80b3b00 msgr2=0x7f8fa8163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa80b3b00 0x7f8fa8163970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 -- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fa80af8d0 msgr2=0x7f8fa8163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fa80af8d0 0x7f8fa8163430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 -- 172.21.15.73:0/1537770773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa809d6f0 con 0x7f8fa806eec0 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fad99e640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa806eec0 0x7f8fa80cfb00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8f9801cf40 tx=0x7f8f9801b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8f9e7fc640 1 -- 172.21.15.73:0/1537770773 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f980be070 con 0x7f8fa806eec0 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8f9e7fc640 1 -- 172.21.15.73:0/1537770773 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f980a7520 con 0x7f8fa806eec0 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8f9e7fc640 1 -- 172.21.15.73:0/1537770773 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f980ad040 con 0x7f8fa806eec0 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa809d9d0 con 0x7f8fa806eec0 2024-09-12T03:37:03.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.006+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa809df90 con 0x7f8fa806eec0 2024-09-12T03:37:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.010+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa80008e0 con 0x7f8fa806eec0 2024-09-12T03:37:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.010+0000 7f8f9e7fc640 1 -- 172.21.15.73:0/1537770773 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f980c1070 con 0x7f8fa806eec0 2024-09-12T03:37:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.010+0000 7f8f9e7fc640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f8c0678c0 0x7f8f8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.010+0000 7f8f9e7fc640 1 -- 172.21.15.73:0/1537770773 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f8f9811faf0 con 0x7f8fa806eec0 2024-09-12T03:37:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.010+0000 7f8fad19d640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f8c0678c0 0x7f8f8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.010+0000 7f8fad19d640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f8c0678c0 0x7f8f8c069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fa809e4d0 tx=0x7f8fa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:03.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.014+0000 7f8f9e7fc640 1 -- 172.21.15.73:0/1537770773 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f980185a0 con 0x7f8fa806eec0 2024-09-12T03:37:03.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8fa81f7250 con 0x7f8fa806eec0 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8f9e7fc640 1 -- 172.21.15.73:0/1537770773 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f8f980f07f0 con 0x7f8fa806eec0 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:03.179 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T03:37:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f8c0678c0 msgr2=0x7f8f8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f8c0678c0 0x7f8f8c069d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fa809e4d0 tx=0x7f8fa4008040 comp rx=0 tx=0).stop 2024-09-12T03:37:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa806eec0 msgr2=0x7f8fa80cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa806eec0 0x7f8fa80cfb00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8f9801cf40 tx=0x7f8f9801b630 comp rx=0 tx=0).stop 2024-09-12T03:37:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 shutdown_connections 2024-09-12T03:37:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8f8c0678c0 0x7f8f8c069d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8fa80b3b00 0x7f8fa8163970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fa80af8d0 0x7f8fa8163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 --2- 172.21.15.73:0/1537770773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa806eec0 0x7f8fa80cfb00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 >> 172.21.15.73:0/1537770773 conn(0x7f8fa80b1f90 msgr2=0x7f8fa80d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 shutdown_connections 2024-09-12T03:37:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.178+0000 7f8fafc02640 1 -- 172.21.15.73:0/1537770773 wait complete. 2024-09-12T03:37:03.198 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T03:37:03.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T03:37:03.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.318+0000 7f6ab8614640 1 Processor -- start 2024-09-12T03:37:03.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.318+0000 7f6ab8614640 1 -- start start 2024-09-12T03:37:03.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab8614640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6ab006fef0 0x7f6ab006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab8614640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6ab00b3d50 0x7f6ab00b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab8614640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ab006ee50 con 0x7f6ab0073e60 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab8614640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab00b46c0 con 0x7f6ab00b3d50 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab8614640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6ab006f130 con 0x7f6ab006fef0 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab63b0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6ab0073e60 0x7f6ab015b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40894/0 (socket says 172.21.15.73:40894) 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab63b0640 1 -- 172.21.15.73:0/4169003348 learned_addr learned my addr 172.21.15.73:0/4169003348 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab6bb1640 1 --2- 172.21.15.73:0/4169003348 >> v2:172.21.15.73:3300/0 conn(0x7f6ab00b3d50 0x7f6ab00b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab5baf640 1 --2- 172.21.15.73:0/4169003348 >> v2:172.21.15.150:3300/0 conn(0x7f6ab006fef0 0x7f6ab006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab53ae640 1 -- 172.21.15.73:0/4169003348 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156019911 0 0) 0x7f6ab006ee50 con 0x7f6ab0073e60 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab53ae640 1 -- 172.21.15.73:0/4169003348 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a9c003530 con 0x7f6ab0073e60 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab6bb1640 1 -- 172.21.15.73:0/4169003348 >> v2:172.21.15.150:3300/0 conn(0x7f6ab006fef0 msgr2=0x7f6ab006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab6bb1640 1 --2- 172.21.15.73:0/4169003348 >> v2:172.21.15.150:3300/0 conn(0x7f6ab006fef0 0x7f6ab006e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab6bb1640 1 -- 172.21.15.73:0/4169003348 >> v1:172.21.15.73:6789/0 conn(0x7f6ab0073e60 legacy=0x7f6ab015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab53ae640 1 -- 172.21.15.73:0/4169003348 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1123271199 0 0) 0x7f6a9c003530 con 0x7f6ab0073e60 2024-09-12T03:37:03.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab6bb1640 1 -- 172.21.15.73:0/4169003348 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab006f410 con 0x7f6ab00b3d50 2024-09-12T03:37:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.322+0000 7f6ab6bb1640 1 --2- 172.21.15.73:0/4169003348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab00b3d50 0x7f6ab00b4180 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00afe90 tx=0x7f6aa801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea74cc940a76a169 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab53ae640 1 -- 172.21.15.73:0/4169003348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80ac070 con 0x7f6ab00b3d50 2024-09-12T03:37:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab53ae640 1 -- 172.21.15.73:0/4169003348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa80a6420 con 0x7f6ab00b3d50 2024-09-12T03:37:03.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab53ae640 1 -- 172.21.15.73:0/4169003348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac001680 con 0x7f6ab00b3d50 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- 172.21.15.73:0/4169003348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab00b3d50 msgr2=0x7f6ab00b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 --2- 172.21.15.73:0/4169003348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab00b3d50 0x7f6ab00b4180 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6ab00afe90 tx=0x7f6aa801c7c0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- 172.21.15.73:0/4169003348 shutdown_connections 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 --2- 172.21.15.73:0/4169003348 >> v2:172.21.15.150:3300/0 conn(0x7f6ab006fef0 0x7f6ab006e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 --2- 172.21.15.73:0/4169003348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab00b3d50 0x7f6ab00b4180 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- 172.21.15.73:0/4169003348 >> 172.21.15.73:0/4169003348 conn(0x7f6ab00b1f90 msgr2=0x7f6ab00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- 172.21.15.73:0/4169003348 shutdown_connections 2024-09-12T03:37:03.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- 172.21.15.73:0/4169003348 wait complete. 2024-09-12T03:37:03.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 Processor -- start 2024-09-12T03:37:03.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- start start 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006fef0 0x7f6ab014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab0073e60 0x7f6ab009d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ab00b3d50 0x7f6ab0151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab00729a0 con 0x7f6ab0073e60 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab0072820 con 0x7f6ab006fef0 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab0072b20 con 0x7f6ab00b3d50 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab0073e60 0x7f6ab009d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab0073e60 0x7f6ab009d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34406/0 (socket says 172.21.15.73:34406) 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 -- 172.21.15.73:0/1044754207 learned_addr learned my addr 172.21.15.73:0/1044754207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:03.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab63b0640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006fef0 0x7f6ab014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab6bb1640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ab00b3d50 0x7f6ab0151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 -- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ab00b3d50 msgr2=0x7f6ab0151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ab00b3d50 0x7f6ab0151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 -- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006fef0 msgr2=0x7f6ab014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006fef0 0x7f6ab014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 -- 172.21.15.73:0/1044754207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab009c440 con 0x7f6ab0073e60 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab5baf640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab0073e60 0x7f6ab009d4e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000e870 tx=0x7f6aa000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6aa6ffd640 1 -- 172.21.15.73:0/1044754207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0017070 con 0x7f6ab0073e60 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6aa6ffd640 1 -- 172.21.15.73:0/1044754207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa000c940 con 0x7f6ab0073e60 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab009c720 con 0x7f6ab0073e60 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6aa6ffd640 1 -- 172.21.15.73:0/1044754207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa000cd10 con 0x7f6ab0073e60 2024-09-12T03:37:03.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.326+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab009cce0 con 0x7f6ab0073e60 2024-09-12T03:37:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.330+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab006e800 con 0x7f6ab0073e60 2024-09-12T03:37:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.330+0000 7f6aa6ffd640 1 -- 172.21.15.73:0/1044754207 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6aa001a070 con 0x7f6ab0073e60 2024-09-12T03:37:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.330+0000 7f6aa6ffd640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6a940678c0 0x7f6a94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:03.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.330+0000 7f6ab63b0640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6a940678c0 0x7f6a94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.330+0000 7f6aa6ffd640 1 -- 172.21.15.73:0/1044754207 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f6aa0085d70 con 0x7f6ab0073e60 2024-09-12T03:37:03.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.330+0000 7f6ab63b0640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6a940678c0 0x7f6a94069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0011f0 tx=0x7f6aac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:03.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.334+0000 7f6aa6ffd640 1 -- 172.21.15.73:0/1044754207 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6aa0056a70 con 0x7f6ab0073e60 2024-09-12T03:37:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:03.490+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6ab00723f0 con 0x7f6ab0073e60 2024-09-12T03:37:04.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.442+0000 7f6aa6ffd640 1 -- 172.21.15.73:0/1044754207 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f6aa0056370 con 0x7f6ab0073e60 2024-09-12T03:37:04.445 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T03:37:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.446+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6a940678c0 msgr2=0x7f6a94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.446+0000 7f6ab8614640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6a940678c0 0x7f6a94069d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0011f0 tx=0x7f6aac009040 comp rx=0 tx=0).stop 2024-09-12T03:37:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.446+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab0073e60 msgr2=0x7f6ab009d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:04.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.446+0000 7f6ab8614640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab0073e60 0x7f6ab009d4e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000e870 tx=0x7f6aa000ed30 comp rx=0 tx=0).stop 2024-09-12T03:37:04.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 shutdown_connections 2024-09-12T03:37:04.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6a940678c0 0x7f6a94069d80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6ab0073e60 0x7f6ab009d4e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6ab00b3d50 0x7f6ab0151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 --2- 172.21.15.73:0/1044754207 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6ab006fef0 0x7f6ab014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 >> 172.21.15.73:0/1044754207 conn(0x7f6ab00b1f90 msgr2=0x7f6ab00afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:04.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 shutdown_connections 2024-09-12T03:37:04.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.450+0000 7f6ab8614640 1 -- 172.21.15.73:0/1044754207 wait complete. 2024-09-12T03:37:04.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T03:37:04.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3278c14640 1 Processor -- start 2024-09-12T03:37:04.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3278c14640 1 -- start start 2024-09-12T03:37:04.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3278c14640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:04.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3278c14640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3274073100 0x7f32740ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:04.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3278c14640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32740cd190 con 0x7f32740cdfd0 2024-09-12T03:37:04.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3278c14640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f32740ce8d0 con 0x7f3274073100 2024-09-12T03:37:04.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3278c14640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f32740cebb0 con 0x7f32740cc870 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3271d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3274073100 0x7f32740ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3271d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3274073100 0x7f32740ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34408/0 (socket says 172.21.15.73:34408) 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3271d9b640 1 -- 172.21.15.73:0/974003538 learned_addr learned my addr 172.21.15.73:0/974003538 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f327259c640 1 --2- 172.21.15.73:0/974003538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3271d9b640 1 -- 172.21.15.73:0/974003538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 msgr2=0x7f32740cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3271d9b640 1 --2- 172.21.15.73:0/974003538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3271d9b640 1 -- 172.21.15.73:0/974003538 >> v1:172.21.15.150:6789/0 conn(0x7f32740cdfd0 legacy=0x7f327406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:04.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.602+0000 7f3271d9b640 1 -- 172.21.15.73:0/974003538 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32740cee90 con 0x7f3274073100 2024-09-12T03:37:04.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3271d9b640 1 --2- 172.21.15.73:0/974003538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f32740ccc50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3268009870 tx=0x7f326801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1e01b9af923281 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:04.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f327159a640 1 -- 172.21.15.73:0/974003538 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32680aa610 con 0x7f3274073100 2024-09-12T03:37:04.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f327159a640 1 -- 172.21.15.73:0/974003538 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32680af070 con 0x7f3274073100 2024-09-12T03:37:04.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f327159a640 1 -- 172.21.15.73:0/974003538 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32680aa9d0 con 0x7f3274073100 2024-09-12T03:37:04.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 -- 172.21.15.73:0/974003538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 msgr2=0x7f32740ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:04.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 --2- 172.21.15.73:0/974003538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f32740ccc50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3268009870 tx=0x7f326801c4f0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 -- 172.21.15.73:0/974003538 shutdown_connections 2024-09-12T03:37:04.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 --2- 172.21.15.73:0/974003538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f32740ccc50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 --2- 172.21.15.73:0/974003538 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 -- 172.21.15.73:0/974003538 >> 172.21.15.73:0/974003538 conn(0x7f32740b1c80 msgr2=0x7f32740b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:04.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 -- 172.21.15.73:0/974003538 shutdown_connections 2024-09-12T03:37:04.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 -- 172.21.15.73:0/974003538 wait complete. 2024-09-12T03:37:04.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 Processor -- start 2024-09-12T03:37:04.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.606+0000 7f3278c14640 1 -- start start 2024-09-12T03:37:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f3274140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32740cdfd0 0x7f327415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f32740ce600 con 0x7f3274073100 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f32740ce480 con 0x7f32740cdfd0 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3274169190 con 0x7f32740cc870 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f3274140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f3274140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34420/0 (socket says 172.21.15.73:34420) 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 -- 172.21.15.73:0/1370914154 learned_addr learned my addr 172.21.15.73:0/1370914154 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3272d9d640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32740cdfd0 0x7f327415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3271d9b640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 -- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 msgr2=0x7f32740b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 -- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32740cdfd0 msgr2=0x7f327415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32740cdfd0 0x7f327415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 -- 172.21.15.73:0/1370914154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32741426b0 con 0x7f3274073100 2024-09-12T03:37:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f327259c640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f3274140a80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f326400c7f0 tx=0x7f326400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3262ffd640 1 -- 172.21.15.73:0/1370914154 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264015070 con 0x7f3274073100 2024-09-12T03:37:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3262ffd640 1 -- 172.21.15.73:0/1370914154 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3264004240 con 0x7f3274073100 2024-09-12T03:37:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3274142990 con 0x7f3274073100 2024-09-12T03:37:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3262ffd640 1 -- 172.21.15.73:0/1370914154 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264003620 con 0x7f3274073100 2024-09-12T03:37:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32741422d0 con 0x7f3274073100 2024-09-12T03:37:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32740ccc50 con 0x7f3274073100 2024-09-12T03:37:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3262ffd640 1 -- 172.21.15.73:0/1370914154 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f32640039d0 con 0x7f3274073100 2024-09-12T03:37:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3262ffd640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f32540678c0 0x7f3254069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3262ffd640 1 -- 172.21.15.73:0/1370914154 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5619+0+0 (secure 0 0 0) 0x7f3264086020 con 0x7f3274073100 2024-09-12T03:37:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3271d9b640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f32540678c0 0x7f3254069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:04.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.610+0000 7f3271d9b640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f32540678c0 0x7f3254069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f32680ae000 tx=0x7f3268004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:04.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.614+0000 7f3262ffd640 1 -- 172.21.15.73:0/1370914154 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3264056d20 con 0x7f3274073100 2024-09-12T03:37:04.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:04.766+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f327413fd30 con 0x7f3274073100 2024-09-12T03:37:05.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.446+0000 7f3262ffd640 1 -- 172.21.15.73:0/1370914154 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f3264056620 con 0x7f3274073100 2024-09-12T03:37:05.449 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T03:37:05.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.450+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f32540678c0 msgr2=0x7f3254069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:05.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.450+0000 7f3278c14640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f32540678c0 0x7f3254069d80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f32680ae000 tx=0x7f3268004740 comp rx=0 tx=0).stop 2024-09-12T03:37:05.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.450+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 msgr2=0x7f3274140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:05.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.450+0000 7f3278c14640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f3274140a80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f326400c7f0 tx=0x7f326400ccb0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 shutdown_connections 2024-09-12T03:37:05.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f32540678c0 0x7f3254069d80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32740cdfd0 0x7f327415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f32740cc870 0x7f32740b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 --2- 172.21.15.73:0/1370914154 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3274073100 0x7f3274140a80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 >> 172.21.15.73:0/1370914154 conn(0x7f32740b1c80 msgr2=0x7f327406de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:05.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 shutdown_connections 2024-09-12T03:37:05.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.454+0000 7f3278c14640 1 -- 172.21.15.73:0/1370914154 wait complete. 2024-09-12T03:37:05.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T03:37:05.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d66e9640 1 Processor -- start 2024-09-12T03:37:05.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d66e9640 1 -- start start 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d66e9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 0x7f33d00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d66e9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f33d00af470 0x7f33d006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d66e9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d00b3290 con 0x7f33d015c2a0 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d66e9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f33d00b3570 con 0x7f33d00af470 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d66e9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f33d00b3850 con 0x7f33d015bec0 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33c77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f33d015c2a0 0x7f33d00aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58112/0 (socket says 172.21.15.73:58112) 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33c77fe640 1 -- 172.21.15.73:0/2568698352 learned_addr learned my addr 172.21.15.73:0/2568698352 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957328745 0 0) 0x7f33d00b3290 con 0x7f33d015c2a0 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cffff640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 0x7f33d00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33bc003530 con 0x7f33d015c2a0 2024-09-12T03:37:05.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d4c86640 1 --2- 172.21.15.73:0/2568698352 >> v2:172.21.15.150:3300/0 conn(0x7f33d00af470 0x7f33d006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1954897323 0 0) 0x7f33bc003530 con 0x7f33d015c2a0 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 msgr2=0x7f33d00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 0x7f33d00ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 >> v2:172.21.15.150:3300/0 conn(0x7f33d00af470 msgr2=0x7f33d006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 --2- 172.21.15.73:0/2568698352 >> v2:172.21.15.150:3300/0 conn(0x7f33d00af470 0x7f33d006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d00b3b30 con 0x7f33d015c2a0 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f33b8001680 con 0x7f33d015c2a0 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 >> v1:172.21.15.73:6789/0 conn(0x7f33d015c2a0 legacy=0x7f33d00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33bc0039c0 0x7f33bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 0x7f33bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33bc004d50 0x7f33bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00b3570 con 0x7f33bc004d50 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00b3850 con 0x7f33bc0039c0 2024-09-12T03:37:05.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc00ba80 con 0x7f33d015bec0 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d4c86640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33bc004d50 0x7f33bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33c77fe640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 0x7f33bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33cffff640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33bc0039c0 0x7f33bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d4c86640 1 -- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 msgr2=0x7f33bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d4c86640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33d015bec0 0x7f33bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d4c86640 1 -- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33bc0039c0 msgr2=0x7f33bc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d4c86640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33bc0039c0 0x7f33bc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.610+0000 7f33d4c86640 1 -- 172.21.15.73:0/2568698352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc003530 con 0x7f33bc004d50 2024-09-12T03:37:05.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d4c86640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33bc004d50 0x7f33bc0051d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f33c8007390 tx=0x7f33c801ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e5027652781c65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:05.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c80b2070 con 0x7f33bc004d50 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c80a5d80 con 0x7f33bc004d50 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33cf7fe640 1 -- 172.21.15.73:0/2568698352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8009be0 con 0x7f33bc004d50 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 -- 172.21.15.73:0/2568698352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33bc004d50 msgr2=0x7f33bc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 --2- 172.21.15.73:0/2568698352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33bc004d50 0x7f33bc0051d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f33c8007390 tx=0x7f33c801ce80 comp rx=0 tx=0).stop 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d4c86640 1 -- 172.21.15.73:0/2568698352 reap_dead start 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 -- 172.21.15.73:0/2568698352 shutdown_connections 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 -- 172.21.15.73:0/2568698352 >> 172.21.15.73:0/2568698352 conn(0x7f33d00b1f90 msgr2=0x7f33d00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:05.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 -- 172.21.15.73:0/2568698352 shutdown_connections 2024-09-12T03:37:05.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 -- 172.21.15.73:0/2568698352 wait complete. 2024-09-12T03:37:05.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 Processor -- start 2024-09-12T03:37:05.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.614+0000 7f33d66e9640 1 -- start start 2024-09-12T03:37:05.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33bc004d50 0x7f33d009a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d009cf90 0x7f33d01f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33d015a5a0 0x7f33d015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00afc90 con 0x7f33d015a5a0 2024-09-12T03:37:05.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00b40f0 con 0x7f33d009cf90 2024-09-12T03:37:05.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f33d00ad200 con 0x7f33bc004d50 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33d015a5a0 0x7f33d015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33d015a5a0 0x7f33d015aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39562/0 (socket says 172.21.15.73:39562) 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 -- 172.21.15.73:0/802300392 learned_addr learned my addr 172.21.15.73:0/802300392 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cffff640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33bc004d50 0x7f33d009a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33c77fe640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d009cf90 0x7f33d01f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 -- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33bc004d50 msgr2=0x7f33d009a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33bc004d50 0x7f33d009a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 -- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d009cf90 msgr2=0x7f33d01f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d009cf90 0x7f33d01f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 -- 172.21.15.73:0/802300392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d009d800 con 0x7f33d015a5a0 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d4c86640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33d015a5a0 0x7f33d015aa50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f33c80b0040 tx=0x7f33bc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cd7fa640 1 -- 172.21.15.73:0/802300392 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c80b2040 con 0x7f33d015a5a0 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cd7fa640 1 -- 172.21.15.73:0/802300392 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c80a5b80 con 0x7f33d015a5a0 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d009dae0 con 0x7f33d015a5a0 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cd7fa640 1 -- 172.21.15.73:0/802300392 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8009be0 con 0x7f33d015a5a0 2024-09-12T03:37:05.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d009e0a0 con 0x7f33d015a5a0 2024-09-12T03:37:05.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d00ad5c0 con 0x7f33d015a5a0 2024-09-12T03:37:05.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cd7fa640 1 -- 172.21.15.73:0/802300392 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33c80b53c0 con 0x7f33d015a5a0 2024-09-12T03:37:05.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cd7fa640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33b00678f0 0x7f33b0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:05.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cffff640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33b00678f0 0x7f33b0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:05.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cd7fa640 1 -- 172.21.15.73:0/802300392 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6001+0+0 (secure 0 0 0) 0x7f33c811fd20 con 0x7f33d015a5a0 2024-09-12T03:37:05.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.618+0000 7f33cffff640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33b00678f0 0x7f33b0069db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f33c000d9b0 tx=0x7f33c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:05.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.626+0000 7f33cd7fa640 1 -- 172.21.15.73:0/802300392 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f33c8016b90 con 0x7f33d015a5a0 2024-09-12T03:37:05.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:05.822+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f33d006fcd0 con 0x7f33d015a5a0 2024-09-12T03:37:06.515 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 11 and data pool 12 2024-09-12T03:37:06.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.514+0000 7f33cd7fa640 1 -- 172.21.15.73:0/802300392 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v37) ==== 174+0+0 (secure 0 0 0) 0x7f33c80f00e0 con 0x7f33d015a5a0 2024-09-12T03:37:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33b00678f0 msgr2=0x7f33b0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33b00678f0 0x7f33b0069db0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f33c000d9b0 tx=0x7f33c0008040 comp rx=0 tx=0).stop 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33d015a5a0 msgr2=0x7f33d015aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33d015a5a0 0x7f33d015aa50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f33c80b0040 tx=0x7f33bc005840 comp rx=0 tx=0).stop 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 shutdown_connections 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f33b00678f0 0x7f33b0069db0 secure :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f33c000d9b0 tx=0x7f33c0008040 comp rx=0 tx=0).stop 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33d015a5a0 0x7f33d015aa50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33d009cf90 0x7f33d01f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 --2- 172.21.15.73:0/802300392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f33bc004d50 0x7f33d009a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.522+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 >> 172.21.15.73:0/802300392 conn(0x7f33d00b1f90 msgr2=0x7f33d00d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:06.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.526+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 shutdown_connections 2024-09-12T03:37:06.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.530+0000 7f33d66e9640 1 -- 172.21.15.73:0/802300392 wait complete. 2024-09-12T03:37:06.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:06.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9f49f9640 1 Processor -- start 2024-09-12T03:37:06.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9f49f9640 1 -- start start 2024-09-12T03:37:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9f49f9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff9f0070020 0x7ff9f015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9f49f9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9f015f1d0 0x7ff9f00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:06.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9f49f9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f00aede0 con 0x7ff9f01520a0 2024-09-12T03:37:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9f49f9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f0152480 con 0x7ff9f015f1d0 2024-09-12T03:37:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9f49f9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f015fa10 con 0x7ff9f0070020 2024-09-12T03:37:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9eed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9f015f1d0 0x7ff9f00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9eed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9f015f1d0 0x7ff9f00adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39568/0 (socket says 172.21.15.73:39568) 2024-09-12T03:37:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9eed9d640 1 -- 172.21.15.73:0/2584929597 learned_addr learned my addr 172.21.15.73:0/2584929597 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:06.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9eed9d640 1 -- 172.21.15.73:0/2584929597 >> v2:172.21.15.150:3300/0 conn(0x7ff9f0070020 msgr2=0x7ff9f015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:06.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9eed9d640 1 --2- 172.21.15.73:0/2584929597 >> v2:172.21.15.150:3300/0 conn(0x7ff9f0070020 0x7ff9f015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9eed9d640 1 -- 172.21.15.73:0/2584929597 >> v1:172.21.15.150:6789/0 conn(0x7ff9f01520a0 legacy=0x7ff9f006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:06.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.678+0000 7ff9eed9d640 1 -- 172.21.15.73:0/2584929597 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f0074250 con 0x7ff9f015f1d0 2024-09-12T03:37:06.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9eed9d640 1 --2- 172.21.15.73:0/2584929597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f015f1d0 0x7ff9f00adc80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff9f006e510 tx=0x7ff9e801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5c8049dc66ca70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:06.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9ed59a640 1 -- 172.21.15.73:0/2584929597 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80aa610 con 0x7ff9f015f1d0 2024-09-12T03:37:06.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9ed59a640 1 -- 172.21.15.73:0/2584929597 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e80af070 con 0x7ff9f015f1d0 2024-09-12T03:37:06.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9ed59a640 1 -- 172.21.15.73:0/2584929597 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80aa9d0 con 0x7ff9f015f1d0 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- 172.21.15.73:0/2584929597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f015f1d0 msgr2=0x7ff9f00adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/2584929597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f015f1d0 0x7ff9f00adc80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff9f006e510 tx=0x7ff9e801c4b0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- 172.21.15.73:0/2584929597 shutdown_connections 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/2584929597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f015f1d0 0x7ff9f00adc80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/2584929597 >> v2:172.21.15.150:3300/0 conn(0x7ff9f0070020 0x7ff9f015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- 172.21.15.73:0/2584929597 >> 172.21.15.73:0/2584929597 conn(0x7ff9f00b1f90 msgr2=0x7ff9f00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- 172.21.15.73:0/2584929597 shutdown_connections 2024-09-12T03:37:06.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- 172.21.15.73:0/2584929597 wait complete. 2024-09-12T03:37:06.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 Processor -- start 2024-09-12T03:37:06.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- start start 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9f0070020 0x7ff9f0154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f01520a0 0x7ff9f01fa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9f015f1d0 0x7ff9f0152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f015f680 con 0x7ff9f01520a0 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0073d30 con 0x7ff9f015f1d0 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f0167f10 con 0x7ff9f0070020 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f01520a0 0x7ff9f01fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:06.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f01520a0 0x7ff9f01fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39572/0 (socket says 172.21.15.73:39572) 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 -- 172.21.15.73:0/1033909764 learned_addr learned my addr 172.21.15.73:0/1033909764 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9ee59c640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9f0070020 0x7ff9f0154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9eed9d640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9f015f1d0 0x7ff9f0152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 -- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9f0070020 msgr2=0x7ff9f0154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9f0070020 0x7ff9f0154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 -- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9f015f1d0 msgr2=0x7ff9f0152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9f015f1d0 0x7ff9f0152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 -- 172.21.15.73:0/1033909764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00afe00 con 0x7ff9f01520a0 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9edd9b640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f01520a0 0x7ff9f01fa590 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800b420 tx=0x7ff9d800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9e6ffd640 1 -- 172.21.15.73:0/1033909764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8011830 con 0x7ff9f01520a0 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9e6ffd640 1 -- 172.21.15.73:0/1033909764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d8016070 con 0x7ff9f01520a0 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f0154f90 con 0x7ff9f01520a0 2024-09-12T03:37:06.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9e6ffd640 1 -- 172.21.15.73:0/1033909764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8011c30 con 0x7ff9f01520a0 2024-09-12T03:37:06.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.682+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f0155550 con 0x7ff9f01520a0 2024-09-12T03:37:06.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.686+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f015ec90 con 0x7ff9f01520a0 2024-09-12T03:37:06.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.686+0000 7ff9e6ffd640 1 -- 172.21.15.73:0/1033909764 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff9d801b460 con 0x7ff9f01520a0 2024-09-12T03:37:06.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.686+0000 7ff9e6ffd640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff9d00678c0 0x7ff9d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:06.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.686+0000 7ff9e6ffd640 1 -- 172.21.15.73:0/1033909764 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7ff9d8085a80 con 0x7ff9f01520a0 2024-09-12T03:37:06.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.686+0000 7ff9ee59c640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff9d00678c0 0x7ff9d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:06.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.686+0000 7ff9ee59c640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff9d00678c0 0x7ff9d0069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0165ed0 tx=0x7ff9e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:06.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.690+0000 7ff9e6ffd640 1 -- 172.21.15.73:0/1033909764 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff9d80564c0 con 0x7ff9f01520a0 2024-09-12T03:37:06.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.854+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9f006e540 con 0x7ff9f01520a0 2024-09-12T03:37:06.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.854+0000 7ff9e6ffd640 1 -- 172.21.15.73:0/1033909764 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17030 (secure 0 0 0) 0x7ff9d8055dc0 con 0x7ff9f01520a0 2024-09-12T03:37:06.858 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:06.858 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":74,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:05.827119+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:03.529153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:04.805186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:06.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff9d00678c0 msgr2=0x7ff9d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:06.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff9d00678c0 0x7ff9d0069d80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0165ed0 tx=0x7ff9e0009040 comp rx=0 tx=0).stop 2024-09-12T03:37:06.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f01520a0 msgr2=0x7ff9f01fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:06.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f01520a0 0x7ff9f01fa590 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800b420 tx=0x7ff9d800b8e0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 shutdown_connections 2024-09-12T03:37:06.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff9d00678c0 0x7ff9d0069d80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f01520a0 0x7ff9f01fa590 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff9f015f1d0 0x7ff9f0152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 --2- 172.21.15.73:0/1033909764 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff9f0070020 0x7ff9f0154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:06.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 >> 172.21.15.73:0/1033909764 conn(0x7ff9f00b1f90 msgr2=0x7ff9f0159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:06.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 shutdown_connections 2024-09-12T03:37:06.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.858+0000 7ff9f49f9640 1 -- 172.21.15.73:0/1033909764 wait complete. 2024-09-12T03:37:06.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:07.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.998+0000 7f915bd1b640 1 Processor -- start 2024-09-12T03:37:07.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:06.998+0000 7f915bd1b640 1 -- start start 2024-09-12T03:37:07.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915bd1b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f915415bec0 0x7f91540ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915bd1b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91540af470 0x7f915406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915bd1b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91540b3290 con 0x7f915415c2a0 2024-09-12T03:37:07.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915bd1b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f91540b3570 con 0x7f91540af470 2024-09-12T03:37:07.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915bd1b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f91540b3850 con 0x7f915415bec0 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91540af470 0x7f915406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91540af470 0x7f915406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39574/0 (socket says 172.21.15.73:39574) 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 -- 172.21.15.73:0/3918162674 learned_addr learned my addr 172.21.15.73:0/3918162674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f9159ab7640 1 --2- 172.21.15.73:0/3918162674 >> v2:172.21.15.150:3300/0 conn(0x7f915415bec0 0x7f91540ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 -- 172.21.15.73:0/3918162674 >> v2:172.21.15.150:3300/0 conn(0x7f915415bec0 msgr2=0x7f91540ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 --2- 172.21.15.73:0/3918162674 >> v2:172.21.15.150:3300/0 conn(0x7f915415bec0 0x7f91540ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 -- 172.21.15.73:0/3918162674 >> v1:172.21.15.150:6789/0 conn(0x7f915415c2a0 legacy=0x7f91540aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 -- 172.21.15.73:0/3918162674 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91540b3b30 con 0x7f91540af470 2024-09-12T03:37:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f9159ab7640 1 --2- 172.21.15.73:0/3918162674 >> v2:172.21.15.150:3300/0 conn(0x7f915415bec0 0x7f91540ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f915a2b8640 1 --2- 172.21.15.73:0/3918162674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f915406e000 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9154071710 tx=0x7f914c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef438e7cbba8fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f9158ab5640 1 -- 172.21.15.73:0/3918162674 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c0a5840 con 0x7f91540af470 2024-09-12T03:37:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f9158ab5640 1 -- 172.21.15.73:0/3918162674 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914c0a59e0 con 0x7f91540af470 2024-09-12T03:37:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.002+0000 7f9158ab5640 1 -- 172.21.15.73:0/3918162674 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914c0a5db0 con 0x7f91540af470 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/3918162674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 msgr2=0x7f915406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 --2- 172.21.15.73:0/3918162674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f915406e000 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9154071710 tx=0x7f914c01c980 comp rx=0 tx=0).stop 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/3918162674 shutdown_connections 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 --2- 172.21.15.73:0/3918162674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f915406e000 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 --2- 172.21.15.73:0/3918162674 >> v2:172.21.15.150:3300/0 conn(0x7f915415bec0 0x7f91540ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/3918162674 >> 172.21.15.73:0/3918162674 conn(0x7f91540b1f90 msgr2=0x7f91540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/3918162674 shutdown_connections 2024-09-12T03:37:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/3918162674 wait complete. 2024-09-12T03:37:07.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 Processor -- start 2024-09-12T03:37:07.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- start start 2024-09-12T03:37:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f91541558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f915415bec0 0x7f91540b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f915415c2a0 0x7f91541540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f915406ed50 con 0x7f91540af470 2024-09-12T03:37:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f91540ad740 con 0x7f915415bec0 2024-09-12T03:37:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f915406eed0 con 0x7f915415c2a0 2024-09-12T03:37:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f91541558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f91541558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39576/0 (socket says 172.21.15.73:39576) 2024-09-12T03:37:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 -- 172.21.15.73:0/1359484008 learned_addr learned my addr 172.21.15.73:0/1359484008 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f91592b6640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f915415bec0 0x7f91540b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 -- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f915415c2a0 msgr2=0x7f91541540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915a2b8640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f915415c2a0 0x7f91541540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f915415c2a0 0x7f91541540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 -- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f915415bec0 msgr2=0x7f91540b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f915415bec0 0x7f91540b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 -- 172.21.15.73:0/1359484008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915414d4c0 con 0x7f91540af470 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f9159ab7640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f91541558e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f914400c7c0 tx=0x7f914400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f914a7fc640 1 -- 172.21.15.73:0/1359484008 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144007a30 con 0x7f91540af470 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f914a7fc640 1 -- 172.21.15.73:0/1359484008 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144007bd0 con 0x7f91540af470 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915414eef0 con 0x7f91540af470 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f914a7fc640 1 -- 172.21.15.73:0/1359484008 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91440113f0 con 0x7f91540af470 2024-09-12T03:37:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915414d140 con 0x7f91540af470 2024-09-12T03:37:07.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.006+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f915406f260 con 0x7f91540af470 2024-09-12T03:37:07.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.010+0000 7f914a7fc640 1 -- 172.21.15.73:0/1359484008 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9144011590 con 0x7f91540af470 2024-09-12T03:37:07.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.010+0000 7f914a7fc640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91380678c0 0x7f9138069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.010+0000 7f914a7fc640 1 -- 172.21.15.73:0/1359484008 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f91440860c0 con 0x7f91540af470 2024-09-12T03:37:07.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.010+0000 7f91592b6640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91380678c0 0x7f9138069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.010+0000 7f91592b6640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91380678c0 0x7f9138069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f91540740f0 tx=0x7f9150008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.014+0000 7f914a7fc640 1 -- 172.21.15.73:0/1359484008 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9144015020 con 0x7f91540af470 2024-09-12T03:37:07.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.178+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9154075140 con 0x7f91540af470 2024-09-12T03:37:07.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.178+0000 7f914a7fc640 1 -- 172.21.15.73:0/1359484008 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17030 (secure 0 0 0) 0x7f91440569e0 con 0x7f91540af470 2024-09-12T03:37:07.181 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:07.181 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":74,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:05.827119+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:03.529153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:04.805186+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91380678c0 msgr2=0x7f9138069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91380678c0 0x7f9138069d80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f91540740f0 tx=0x7f9150008040 comp rx=0 tx=0).stop 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 msgr2=0x7f91541558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f91541558e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f914400c7c0 tx=0x7f914400cc80 comp rx=0 tx=0).stop 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 shutdown_connections 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f91380678c0 0x7f9138069d80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f915415c2a0 0x7f91541540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f915415bec0 0x7f91540b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 --2- 172.21.15.73:0/1359484008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91540af470 0x7f91541558e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 >> 172.21.15.73:0/1359484008 conn(0x7f91540b1f90 msgr2=0x7f915414fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:07.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 shutdown_connections 2024-09-12T03:37:07.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.182+0000 7f915bd1b640 1 -- 172.21.15.73:0/1359484008 wait complete. 2024-09-12T03:37:07.200 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T03:37:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b32d2b640 1 Processor -- start 2024-09-12T03:37:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b32d2b640 1 -- start start 2024-09-12T03:37:07.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b32d2b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 0x7f2b2c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b32d2b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2c0d0300 con 0x7f2b2c161a60 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b32d2b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2c0b0f60 con 0x7f2b2c0cf450 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b32d2b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c0cfd40 con 0x7f2b2c0d3060 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2b2c161a60 0x7f2b2c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58118/0 (socket says 172.21.15.73:58118) 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 -- 172.21.15.73:0/2101315539 learned_addr learned my addr 172.21.15.73:0/2101315539 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282251460 0 0) 0x7f2b20001120 con 0x7f2b2c161a60 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b1c003530 con 0x7f2b2c161a60 2024-09-12T03:37:07.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2bfff640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 0x7f2b2c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1656737488 0 0) 0x7f2b1c003530 con 0x7f2b2c161a60 2024-09-12T03:37:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 msgr2=0x7f2b2c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 0x7f2b2c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 >> v1:172.21.15.150:6789/0 conn(0x7f2b2c0cf450 legacy=0x7f2b2c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c0d0020 con 0x7f2b2c161a60 2024-09-12T03:37:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f2b20001850 con 0x7f2b2c161a60 2024-09-12T03:37:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 >> v1:172.21.15.73:6789/0 conn(0x7f2b2c161a60 legacy=0x7f2b2c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b1c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1c004810 0x7f2b1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 0x7f2b1c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c0cfd40 con 0x7f2b1c0039f0 2024-09-12T03:37:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1c00bb00 con 0x7f2b1c004810 2024-09-12T03:37:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1c00bd00 con 0x7f2b2c0d3060 2024-09-12T03:37:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b1c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b2bfff640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1c004810 0x7f2b1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b312c8640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 0x7f2b1c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 -- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 msgr2=0x7f2b1c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:07.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c0d3060 0x7f2b1c005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 -- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1c004810 msgr2=0x7f2b1c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:07.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b1c004810 0x7f2b1c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.326+0000 7f2b30ac7640 1 -- 172.21.15.73:0/2101315539 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1c003530 con 0x7f2b1c0039f0 2024-09-12T03:37:07.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b1c003e10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000c4c0 tx=0x7f2b2001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be972d5573e8abe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:07.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000c0e0 con 0x7f2b1c0039f0 2024-09-12T03:37:07.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b200a9070 con 0x7f2b1c0039f0 2024-09-12T03:37:07.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b2b7fe640 1 -- 172.21.15.73:0/2101315539 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b200a5d90 con 0x7f2b1c0039f0 2024-09-12T03:37:07.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- 172.21.15.73:0/2101315539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 msgr2=0x7f2b1c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 --2- 172.21.15.73:0/2101315539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b1c003e10 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000c4c0 tx=0x7f2b2001cc50 comp rx=0 tx=0).stop 2024-09-12T03:37:07.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b312c8640 1 -- 172.21.15.73:0/2101315539 reap_dead start 2024-09-12T03:37:07.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- 172.21.15.73:0/2101315539 shutdown_connections 2024-09-12T03:37:07.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- 172.21.15.73:0/2101315539 >> 172.21.15.73:0/2101315539 conn(0x7f2b2c08bf90 msgr2=0x7f2b2c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:07.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- 172.21.15.73:0/2101315539 shutdown_connections 2024-09-12T03:37:07.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- 172.21.15.73:0/2101315539 wait complete. 2024-09-12T03:37:07.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 Processor -- start 2024-09-12T03:37:07.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- start start 2024-09-12T03:37:07.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b2c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c14d770 0x7f2b2c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b2c0b16c0 0x7f2b2c163540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c16a0a0 con 0x7f2b1c0039f0 2024-09-12T03:37:07.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c169f20 con 0x7f2b2c0b16c0 2024-09-12T03:37:07.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b32d2b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c16a220 con 0x7f2b2c14d770 2024-09-12T03:37:07.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b2c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b2c0cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39594/0 (socket says 172.21.15.73:39594) 2024-09-12T03:37:07.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 -- 172.21.15.73:0/1964781472 learned_addr learned my addr 172.21.15.73:0/1964781472 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:07.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b2bfff640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c14d770 0x7f2b2c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b312c8640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b2c0b16c0 0x7f2b2c163540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 -- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c14d770 msgr2=0x7f2b2c0b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c14d770 0x7f2b2c0b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 -- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b2c0b16c0 msgr2=0x7f2b2c163540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:07.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b2c0b16c0 0x7f2b2c163540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:07.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 -- 172.21.15.73:0/1964781472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c14dbf0 con 0x7f2b1c0039f0 2024-09-12T03:37:07.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.330+0000 7f2b30ac7640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b2c0cbd20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2b20001b50 tx=0x7f2b1c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:07.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b297fa640 1 -- 172.21.15.73:0/1964781472 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b200011e0 con 0x7f2b1c0039f0 2024-09-12T03:37:07.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b297fa640 1 -- 172.21.15.73:0/1964781472 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b200a5930 con 0x7f2b1c0039f0 2024-09-12T03:37:07.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b297fa640 1 -- 172.21.15.73:0/1964781472 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b200047f0 con 0x7f2b1c0039f0 2024-09-12T03:37:07.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c167030 con 0x7f2b1c0039f0 2024-09-12T03:37:07.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1675f0 con 0x7f2b1c0039f0 2024-09-12T03:37:07.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c06d6b0 con 0x7f2b1c0039f0 2024-09-12T03:37:07.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b297fa640 1 -- 172.21.15.73:0/1964781472 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b20004990 con 0x7f2b1c0039f0 2024-09-12T03:37:07.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b297fa640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2b10067a60 0x7f2b10069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:07.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b297fa640 1 -- 172.21.15.73:0/1964781472 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f2b2011f820 con 0x7f2b1c0039f0 2024-09-12T03:37:07.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b2bfff640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2b10067a60 0x7f2b10069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:07.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.334+0000 7f2b2bfff640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2b10067a60 0x7f2b10069f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c169e50 tx=0x7f2b18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:07.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.338+0000 7f2b297fa640 1 -- 172.21.15.73:0/1964781472 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2b2c0d0300 con 0x7f2b1c0039f0 2024-09-12T03:37:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:07.538+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2b2c0d2a60 con 0x7f2b1c0039f0 2024-09-12T03:37:07.631 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:37:07.634 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:37:08.439 INFO:tasks.ceph.mds.c.smithi073.stderr:2024-09-12T03:37:08.438+0000 7f89dd82d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:37:08.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.530+0000 7f2b297fa640 1 -- 172.21.15.73:0/1964781472 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) ==== 118+0+0 (secure 0 0 0) 0x7f2b200f01d0 con 0x7f2b1c0039f0 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2b10067a60 msgr2=0x7f2b10069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2b10067a60 0x7f2b10069f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c169e50 tx=0x7f2b18008040 comp rx=0 tx=0).stop 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 msgr2=0x7f2b2c0cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b2c0cbd20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2b20001b50 tx=0x7f2b1c005840 comp rx=0 tx=0).stop 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 shutdown_connections 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2b10067a60 0x7f2b10069f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b2c0b16c0 0x7f2b2c163540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2b2c14d770 0x7f2b2c0b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 --2- 172.21.15.73:0/1964781472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b1c0039f0 0x7f2b2c0cbd20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 >> 172.21.15.73:0/1964781472 conn(0x7f2b2c08bf90 msgr2=0x7f2b2c0b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 shutdown_connections 2024-09-12T03:37:08.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.534+0000 7f2b32d2b640 1 -- 172.21.15.73:0/1964781472 wait complete. 2024-09-12T03:37:08.557 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T03:37:08.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T03:37:08.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.682+0000 7fe361ff4640 1 Processor -- start 2024-09-12T03:37:08.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.682+0000 7fe361ff4640 1 -- start start 2024-09-12T03:37:08.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe361ff4640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe35c15c2a0 0x7fe35c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe361ff4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 0x7fe35c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe361ff4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35c0b3290 con 0x7fe35c15bec0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe361ff4640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe35c0b3570 con 0x7fe35c15c2a0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe361ff4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe35c0b3850 con 0x7fe35c0af2a0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe35c15bec0 0x7fe35c0ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58130/0 (socket says 172.21.15.73:58130) 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35b7fe640 1 -- 172.21.15.73:0/2766720739 learned_addr learned my addr 172.21.15.73:0/2766720739 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104070425 0 0) 0x7fe35c0b3290 con 0x7fe35c15bec0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe348003530 con 0x7fe35c15bec0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35bfff640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 0x7fe35c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35affd640 1 --2- 172.21.15.73:0/2766720739 >> v2:172.21.15.150:3300/0 conn(0x7fe35c15c2a0 0x7fe35c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4187239229 0 0) 0x7fe348003530 con 0x7fe35c15bec0 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 msgr2=0x7fe35c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:08.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 0x7fe35c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 >> v2:172.21.15.150:3300/0 conn(0x7fe35c15c2a0 msgr2=0x7fe35c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 --2- 172.21.15.73:0/2766720739 >> v2:172.21.15.150:3300/0 conn(0x7fe35c15c2a0 0x7fe35c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35c0b3b30 con 0x7fe35c15bec0 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fe34c001680 con 0x7fe35c15bec0 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 >> v1:172.21.15.73:6789/0 conn(0x7fe35c15bec0 legacy=0x7fe35c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 0x7fe3480039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003ff0 0x7fe348004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe348004d50 0x7fe3480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c0b3570 con 0x7fe348004d50 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c0b3850 con 0x7fe348003ff0 2024-09-12T03:37:08.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe34800fee0 con 0x7fe35c0af2a0 2024-09-12T03:37:08.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35bfff640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe348004d50 0x7fe3480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35affd640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003ff0 0x7fe348004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35b7fe640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 0x7fe3480039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35bfff640 1 -- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 msgr2=0x7fe3480039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35bfff640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe35c0af2a0 0x7fe3480039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35bfff640 1 -- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003ff0 msgr2=0x7fe348004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35bfff640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe348003ff0 0x7fe348004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.686+0000 7fe35bfff640 1 -- 172.21.15.73:0/2766720739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe348003530 con 0x7fe348004d50 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35bfff640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe348004d50 0x7fe3480051d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe35400ba10 tx=0x7fe35401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4790d27fcc471e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3540ae070 con 0x7fe348004d50 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540a9660 con 0x7fe348004d50 2024-09-12T03:37:08.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35a7fc640 1 -- 172.21.15.73:0/2766720739 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35400b5e0 con 0x7fe348004d50 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- 172.21.15.73:0/2766720739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe348004d50 msgr2=0x7fe3480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 --2- 172.21.15.73:0/2766720739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe348004d50 0x7fe3480051d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe35400ba10 tx=0x7fe35401c680 comp rx=0 tx=0).stop 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35bfff640 1 -- 172.21.15.73:0/2766720739 reap_dead start 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- 172.21.15.73:0/2766720739 shutdown_connections 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- 172.21.15.73:0/2766720739 >> 172.21.15.73:0/2766720739 conn(0x7fe35c0b1f90 msgr2=0x7fe35c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- 172.21.15.73:0/2766720739 shutdown_connections 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- 172.21.15.73:0/2766720739 wait complete. 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 Processor -- start 2024-09-12T03:37:08.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- start start 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe348004d50 0x7fe35c071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe35c073a60 0x7fe35c0992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe35c154830 0x7fe35c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c0af730 con 0x7fe35c073a60 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe35c0b40f0 con 0x7fe35c154830 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe361ff4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe35c0afc90 con 0x7fe348004d50 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe35c073a60 0x7fe35c0992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe35c073a60 0x7fe35c0992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39614/0 (socket says 172.21.15.73:39614) 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 -- 172.21.15.73:0/319888026 learned_addr learned my addr 172.21.15.73:0/319888026 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35bfff640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe35c154830 0x7fe35c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35b7fe640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe348004d50 0x7fe35c071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 -- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe348004d50 msgr2=0x7fe35c071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe348004d50 0x7fe35c071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 -- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe35c154830 msgr2=0x7fe35c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe35c154830 0x7fe35c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.690+0000 7fe35affd640 1 -- 172.21.15.73:0/319888026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35c073ec0 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe35affd640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe35c073a60 0x7fe35c0992c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe344007130 tx=0x7fe344007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe353fff640 1 -- 172.21.15.73:0/319888026 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344014610 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe353fff640 1 -- 172.21.15.73:0/319888026 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344019070 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35c072e90 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe353fff640 1 -- 172.21.15.73:0/319888026 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440149d0 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35c0728d0 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35c0aed60 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe353fff640 1 -- 172.21.15.73:0/319888026 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe344014b70 con 0x7fe35c073a60 2024-09-12T03:37:08.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe353fff640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe33c0678f0 0x7fe33c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:08.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe353fff640 1 -- 172.21.15.73:0/319888026 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fe3440874a0 con 0x7fe35c073a60 2024-09-12T03:37:08.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe35b7fe640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe33c0678f0 0x7fe33c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:08.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.694+0000 7fe35b7fe640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe33c0678f0 0x7fe33c069db0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe34c001060 tx=0x7fe34c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:08.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.698+0000 7fe353fff640 1 -- 172.21.15.73:0/319888026 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe344057f30 con 0x7fe35c073a60 2024-09-12T03:37:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:08.890+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe35c0b25c0 con 0x7fe35c073a60 2024-09-12T03:37:09.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.534+0000 7fe353fff640 1 -- 172.21.15.73:0/319888026 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) ==== 122+0+0 (secure 0 0 0) 0x7fe344057830 con 0x7fe35c073a60 2024-09-12T03:37:09.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.534+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe33c0678f0 msgr2=0x7fe33c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:09.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.534+0000 7fe361ff4640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe33c0678f0 0x7fe33c069db0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe34c001060 tx=0x7fe34c009040 comp rx=0 tx=0).stop 2024-09-12T03:37:09.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.534+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe35c073a60 msgr2=0x7fe35c0992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:09.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.534+0000 7fe361ff4640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe35c073a60 0x7fe35c0992c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe344007130 tx=0x7fe344007700 comp rx=0 tx=0).stop 2024-09-12T03:37:09.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 shutdown_connections 2024-09-12T03:37:09.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe33c0678f0 0x7fe33c069db0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe35c073a60 0x7fe35c0992c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe35c154830 0x7fe35c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 --2- 172.21.15.73:0/319888026 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe348004d50 0x7fe35c071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 >> 172.21.15.73:0/319888026 conn(0x7fe35c0b1f90 msgr2=0x7fe35c0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:09.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 shutdown_connections 2024-09-12T03:37:09.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.538+0000 7fe361ff4640 1 -- 172.21.15.73:0/319888026 wait complete. 2024-09-12T03:37:09.560 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T03:37:09.560 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.678+0000 7f387c77e640 1 Processor -- start 2024-09-12T03:37:09.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.678+0000 7f387c77e640 1 -- start start 2024-09-12T03:37:09.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387c77e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f38741457a0 0x7f38740d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387c77e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38740b4510 0x7f38740d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387c77e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38740d27a0 con 0x7f38740cf800 2024-09-12T03:37:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387c77e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f38740d2a80 con 0x7f38740b4510 2024-09-12T03:37:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387c77e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f38740d2d60 con 0x7f38741457a0 2024-09-12T03:37:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38740b4510 0x7f38740d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38740b4510 0x7f38740d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39624/0 (socket says 172.21.15.73:39624) 2024-09-12T03:37:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 -- 172.21.15.73:0/3624741830 learned_addr learned my addr 172.21.15.73:0/3624741830 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 -- 172.21.15.73:0/3624741830 >> v2:172.21.15.150:3300/0 conn(0x7f38741457a0 msgr2=0x7f38740d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387a51a640 1 --2- 172.21.15.73:0/3624741830 >> v2:172.21.15.150:3300/0 conn(0x7f38741457a0 0x7f38740d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 --2- 172.21.15.73:0/3624741830 >> v2:172.21.15.150:3300/0 conn(0x7f38741457a0 0x7f38740d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 -- 172.21.15.73:0/3624741830 >> v1:172.21.15.150:6789/0 conn(0x7f38740cf800 legacy=0x7f38740b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 -- 172.21.15.73:0/3624741830 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38740d01f0 con 0x7f38740b4510 2024-09-12T03:37:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387ad1b640 1 --2- 172.21.15.73:0/3624741830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38740b4510 0x7f38740d0710 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e50 tx=0x7f386c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d190b917a28feebe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f3879518640 1 -- 172.21.15.73:0/3624741830 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0a55e0 con 0x7f38740b4510 2024-09-12T03:37:09.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f3879518640 1 -- 172.21.15.73:0/3624741830 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c0a5780 con 0x7f38740b4510 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f3879518640 1 -- 172.21.15.73:0/3624741830 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0a5b50 con 0x7f38740b4510 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387c77e640 1 -- 172.21.15.73:0/3624741830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38740b4510 msgr2=0x7f38740d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.682+0000 7f387c77e640 1 --2- 172.21.15.73:0/3624741830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38740b4510 0x7f38740d0710 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f386c009e50 tx=0x7f386c01c920 comp rx=0 tx=0).stop 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- 172.21.15.73:0/3624741830 shutdown_connections 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 --2- 172.21.15.73:0/3624741830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38740b4510 0x7f38740d0710 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 --2- 172.21.15.73:0/3624741830 >> v2:172.21.15.150:3300/0 conn(0x7f38741457a0 0x7f38740d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- 172.21.15.73:0/3624741830 >> 172.21.15.73:0/3624741830 conn(0x7f387406bcc0 msgr2=0x7f387406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- 172.21.15.73:0/3624741830 shutdown_connections 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- 172.21.15.73:0/3624741830 wait complete. 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 Processor -- start 2024-09-12T03:37:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- start start 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38740b4510 0x7f387415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38740cf800 0x7f3874138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38741457a0 0x7f38741669f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f38741690b0 con 0x7f38741457a0 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f38740d1670 con 0x7f38740b4510 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3874169230 con 0x7f38740cf800 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38741457a0 0x7f38741669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38741457a0 0x7f38741669f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39632/0 (socket says 172.21.15.73:39632) 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 -- 172.21.15.73:0/2188942579 learned_addr learned my addr 172.21.15.73:0/2188942579 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387a51a640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38740b4510 0x7f387415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f3879d19640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38740cf800 0x7f3874138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 -- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38740cf800 msgr2=0x7f3874138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38740cf800 0x7f3874138e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 -- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38740b4510 msgr2=0x7f387415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38740b4510 0x7f387415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 -- 172.21.15.73:0/2188942579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3874144bf0 con 0x7f38741457a0 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387a51a640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38740b4510 0x7f387415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387ad1b640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38741457a0 0x7f38741669f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f386c0af040 tx=0x7f386c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f386affd640 1 -- 172.21.15.73:0/2188942579 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0bc020 con 0x7f38741457a0 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f386affd640 1 -- 172.21.15.73:0/2188942579 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c0b8670 con 0x7f38741457a0 2024-09-12T03:37:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387415d730 con 0x7f38741457a0 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f386affd640 1 -- 172.21.15.73:0/2188942579 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c009510 con 0x7f38741457a0 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387415dcf0 con 0x7f38741457a0 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.686+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38740d0710 con 0x7f38741457a0 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.690+0000 7f386affd640 1 -- 172.21.15.73:0/2188942579 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f386c0bf020 con 0x7f38741457a0 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.690+0000 7f386affd640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f38580678c0 0x7f3858069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.690+0000 7f386affd640 1 -- 172.21.15.73:0/2188942579 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f386c120e10 con 0x7f38741457a0 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.690+0000 7f387a51a640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f38580678c0 0x7f3858069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.690+0000 7f387a51a640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f38580678c0 0x7f3858069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3870006fd0 tx=0x7f3870008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:09.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.694+0000 7f386affd640 1 -- 172.21.15.73:0/2188942579 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f386c0c6030 con 0x7f38741457a0 2024-09-12T03:37:09.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.886+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f387415dec0 con 0x7f38741457a0 2024-09-12T03:37:09.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.886+0000 7f386affd640 1 -- 172.21.15.73:0/2188942579 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5222 (secure 0 0 0) 0x7f386c0165a0 con 0x7f38741457a0 2024-09-12T03:37:09.890 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:09.890 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-12T03:37:09:534051+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/703389966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":703389966},{"type":"v1","addr":"172.21.15.150:6833","nonce":703389966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/624796455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":624796455},{"type":"v1","addr":"172.21.15.150:6835","nonce":624796455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3527064235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3527064235},{"type":"v1","addr":"172.21.15.73:6835","nonce":3527064235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:05.827803+0000","modified":"2024-09-12T03:37:08.894254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/585196866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":585196866},{"type":"v1","addr":"172.21.15.73:6837","nonce":585196866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5892,"qdb_cluster":[5892]},"id":5}]} 2024-09-12T03:37:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f38580678c0 msgr2=0x7f3858069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f38580678c0 0x7f3858069d80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3870006fd0 tx=0x7f3870008040 comp rx=0 tx=0).stop 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38741457a0 msgr2=0x7f38741669f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38741457a0 0x7f38741669f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f386c0af040 tx=0x7f386c0196c0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 shutdown_connections 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f38580678c0 0x7f3858069d80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38741457a0 0x7f38741669f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f38740cf800 0x7f3874138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 --2- 172.21.15.73:0/2188942579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f38740b4510 0x7f387415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 >> 172.21.15.73:0/2188942579 conn(0x7f387406bcc0 msgr2=0x7f387415ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 shutdown_connections 2024-09-12T03:37:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:09.890+0000 7f387c77e640 1 -- 172.21.15.73:0/2188942579 wait complete. 2024-09-12T03:37:09.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:10.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.010+0000 7f8ca6cce640 1 Processor -- start 2024-09-12T03:37:10.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.010+0000 7f8ca6cce640 1 -- start start 2024-09-12T03:37:10.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca6cce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca6cce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ca00b4340 0x7f8ca00d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca6cce640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca00d27a0 con 0x7f8ca01457a0 2024-09-12T03:37:10.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca6cce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8ca00b47b0 con 0x7f8ca00b4340 2024-09-12T03:37:10.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca6cce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca00d2a80 con 0x7f8ca00cf800 2024-09-12T03:37:10.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ca00b4340 0x7f8ca00d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ca00b4340 0x7f8ca00d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39638/0 (socket says 172.21.15.73:39638) 2024-09-12T03:37:10.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 -- 172.21.15.73:0/3558647382 learned_addr learned my addr 172.21.15.73:0/3558647382 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:10.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8c9ffff640 1 --2- 172.21.15.73:0/3558647382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 -- 172.21.15.73:0/3558647382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 msgr2=0x7f8ca00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:10.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 --2- 172.21.15.73:0/3558647382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca00b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 -- 172.21.15.73:0/3558647382 >> v1:172.21.15.150:6789/0 conn(0x7f8ca01457a0 legacy=0x7f8ca00d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 -- 172.21.15.73:0/3558647382 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00d2d60 con 0x7f8ca00b4340 2024-09-12T03:37:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8ca526b640 1 --2- 172.21.15.73:0/3558647382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca00b4340 0x7f8ca00d0710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009e50 tx=0x7f8c9801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4438f29edd9163 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8c9f7fe640 1 -- 172.21.15.73:0/3558647382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c980a5660 con 0x7f8ca00b4340 2024-09-12T03:37:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8c9f7fe640 1 -- 172.21.15.73:0/3558647382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c980a5800 con 0x7f8ca00b4340 2024-09-12T03:37:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.014+0000 7f8c9f7fe640 1 -- 172.21.15.73:0/3558647382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c980a5bd0 con 0x7f8ca00b4340 2024-09-12T03:37:10.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- 172.21.15.73:0/3558647382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca00b4340 msgr2=0x7f8ca00d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/3558647382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca00b4340 0x7f8ca00d0710 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8c98009e50 tx=0x7f8c9801c9a0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- 172.21.15.73:0/3558647382 shutdown_connections 2024-09-12T03:37:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/3558647382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca00b4340 0x7f8ca00d0710 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/3558647382 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- 172.21.15.73:0/3558647382 >> 172.21.15.73:0/3558647382 conn(0x7f8ca006bcc0 msgr2=0x7f8ca006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:10.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- 172.21.15.73:0/3558647382 shutdown_connections 2024-09-12T03:37:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- 172.21.15.73:0/3558647382 wait complete. 2024-09-12T03:37:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 Processor -- start 2024-09-12T03:37:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- start start 2024-09-12T03:37:10.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00b4340 0x7f8ca00cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca01428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca01457a0 0x7f8ca0142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca01690b0 con 0x7f8ca01457a0 2024-09-12T03:37:10.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca00d1670 con 0x7f8ca00b4340 2024-09-12T03:37:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ca0169230 con 0x7f8ca00cf800 2024-09-12T03:37:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca01457a0 0x7f8ca0142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca01457a0 0x7f8ca0142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39652/0 (socket says 172.21.15.73:39652) 2024-09-12T03:37:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 -- 172.21.15.73:0/1375849590 learned_addr learned my addr 172.21.15.73:0/1375849590 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:10.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8c9ffff640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca01428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca4a6a640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00b4340 0x7f8ca00cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 -- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 msgr2=0x7f8ca01428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca01428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 -- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00b4340 msgr2=0x7f8ca00cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00b4340 0x7f8ca00cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 -- 172.21.15.73:0/1375849590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca00b3510 con 0x7f8ca01457a0 2024-09-12T03:37:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca526b640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca01457a0 0x7f8ca0142df0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8c980af040 tx=0x7f8c98019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8c9d7fa640 1 -- 172.21.15.73:0/1375849590 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c980bc020 con 0x7f8ca01457a0 2024-09-12T03:37:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8c9d7fa640 1 -- 172.21.15.73:0/1375849590 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c980b8670 con 0x7f8ca01457a0 2024-09-12T03:37:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca006e220 con 0x7f8ca01457a0 2024-09-12T03:37:10.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8c9d7fa640 1 -- 172.21.15.73:0/1375849590 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98009510 con 0x7f8ca01457a0 2024-09-12T03:37:10.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.018+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca006e7a0 con 0x7f8ca01457a0 2024-09-12T03:37:10.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.022+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca00d0710 con 0x7f8ca01457a0 2024-09-12T03:37:10.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.022+0000 7f8c9d7fa640 1 -- 172.21.15.73:0/1375849590 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8c980bf020 con 0x7f8ca01457a0 2024-09-12T03:37:10.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.022+0000 7f8c9d7fa640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.022+0000 7f8c9d7fa640 1 -- 172.21.15.73:0/1375849590 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8c98121240 con 0x7f8ca01457a0 2024-09-12T03:37:10.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.022+0000 7f8ca4a6a640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.022+0000 7f8ca4a6a640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8c8c0678c0 0x7f8c8c069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8c90000f70 tx=0x7f8c90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.026+0000 7f8c9d7fa640 1 -- 172.21.15.73:0/1375849590 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8c980c6030 con 0x7f8ca01457a0 2024-09-12T03:37:10.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.178+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ca00d2180 con 0x7f8ca01457a0 2024-09-12T03:37:10.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.178+0000 7f8c9d7fa640 1 -- 172.21.15.73:0/1375849590 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17017 (secure 0 0 0) 0x7f8c98016620 con 0x7f8ca01457a0 2024-09-12T03:37:10.181 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:10.181 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":75,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:07.479673+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:03.529153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:04.805186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:10.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8c8c0678c0 msgr2=0x7f8c8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8c8c0678c0 0x7f8c8c069d80 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8c90000f70 tx=0x7f8c90009040 comp rx=0 tx=0).stop 2024-09-12T03:37:10.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca01457a0 msgr2=0x7f8ca0142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca01457a0 0x7f8ca0142df0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8c980af040 tx=0x7f8c98019740 comp rx=0 tx=0).stop 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 shutdown_connections 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8c8c0678c0 0x7f8c8c069d80 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ca01457a0 0x7f8ca0142df0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ca00cf800 0x7f8ca01428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 --2- 172.21.15.73:0/1375849590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ca00b4340 0x7f8ca00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 >> 172.21.15.73:0/1375849590 conn(0x7f8ca006bcc0 msgr2=0x7f8ca00b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 shutdown_connections 2024-09-12T03:37:10.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.182+0000 7f8ca6cce640 1 -- 172.21.15.73:0/1375849590 wait complete. 2024-09-12T03:37:10.200 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:37:10.200 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:10.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8c0651640 1 Processor -- start 2024-09-12T03:37:10.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8c0651640 1 -- start start 2024-09-12T03:37:10.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8c0651640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b815bec0 0x7fb8b80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8c0651640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8b80af470 0x7fb8b806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8c0651640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b80b3290 con 0x7fb8b815c2a0 2024-09-12T03:37:10.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8c0651640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b80b3570 con 0x7fb8b80af470 2024-09-12T03:37:10.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8c0651640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b80b3850 con 0x7fb8b815bec0 2024-09-12T03:37:10.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bebee640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8b80af470 0x7fb8b806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8be3ed640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b815bec0 0x7fb8b80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bebee640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8b80af470 0x7fb8b806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:33426/0 (socket says 172.21.15.73:33426) 2024-09-12T03:37:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bebee640 1 -- 172.21.15.73:0/4130365183 learned_addr learned my addr 172.21.15.73:0/4130365183 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bdbec640 1 --1- 172.21.15.73:0/4130365183 >> v1:172.21.15.150:6789/0 conn(0x7fb8b815c2a0 0x7fb8b80aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:43262/0 (socket says 172.21.15.73:43262) 2024-09-12T03:37:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bebee640 1 -- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b815bec0 msgr2=0x7fb8b80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bebee640 1 --2- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b815bec0 0x7fb8b80ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bebee640 1 -- 172.21.15.73:0/4130365183 >> v1:172.21.15.150:6789/0 conn(0x7fb8b815c2a0 legacy=0x7fb8b80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8bebee640 1 -- 172.21.15.73:0/4130365183 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b80b3b30 con 0x7fb8b80af470 2024-09-12T03:37:10.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.310+0000 7fb8be3ed640 1 --2- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b815bec0 0x7fb8b80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:37:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8bebee640 1 --2- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b80af470 0x7fb8b806e000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009e50 tx=0x7fb8b001ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=292282cf0cea6a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8bd3eb640 1 -- 172.21.15.73:0/4130365183 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00a58d0 con 0x7fb8b80af470 2024-09-12T03:37:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8bd3eb640 1 -- 172.21.15.73:0/4130365183 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b00a5a70 con 0x7fb8b80af470 2024-09-12T03:37:10.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8bd3eb640 1 -- 172.21.15.73:0/4130365183 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b00a5e40 con 0x7fb8b80af470 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b80af470 msgr2=0x7fb8b806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 --2- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b80af470 0x7fb8b806e000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009e50 tx=0x7fb8b001ca00 comp rx=0 tx=0).stop 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- 172.21.15.73:0/4130365183 shutdown_connections 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 --2- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b80af470 0x7fb8b806e000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 --2- 172.21.15.73:0/4130365183 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b815bec0 0x7fb8b80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- 172.21.15.73:0/4130365183 >> 172.21.15.73:0/4130365183 conn(0x7fb8b80b1f90 msgr2=0x7fb8b80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- 172.21.15.73:0/4130365183 shutdown_connections 2024-09-12T03:37:10.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- 172.21.15.73:0/4130365183 wait complete. 2024-09-12T03:37:10.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 Processor -- start 2024-09-12T03:37:10.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- start start 2024-09-12T03:37:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b80af470 0x7fb8b814ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b815bec0 0x7fb8b8147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b815c2a0 0x7fb8b80b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b806ed50 con 0x7fb8b815bec0 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b80ad740 con 0x7fb8b815c2a0 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8c0651640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b806eed0 con 0x7fb8b80af470 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8bdbec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b815bec0 0x7fb8b8147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8bdbec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b815bec0 0x7fb8b8147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39662/0 (socket says 172.21.15.73:39662) 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.314+0000 7fb8bdbec640 1 -- 172.21.15.73:0/3852966247 learned_addr learned my addr 172.21.15.73:0/3852966247 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8bdbec640 1 -- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b80af470 msgr2=0x7fb8b814ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8bebee640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b815c2a0 0x7fb8b80b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8be3ed640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b80af470 0x7fb8b814ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8bdbec640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b80af470 0x7fb8b814ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8bdbec640 1 -- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b815c2a0 msgr2=0x7fb8b80b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8bdbec640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b815c2a0 0x7fb8b80b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8bdbec640 1 -- 172.21.15.73:0/3852966247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b814d670 con 0x7fb8b815bec0 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8bdbec640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b815bec0 0x7fb8b8147b60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c310 tx=0x7fb8a800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8aeffd640 1 -- 172.21.15.73:0/3852966247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80074e0 con 0x7fb8b815bec0 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b80732d0 con 0x7fb8b815bec0 2024-09-12T03:37:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8aeffd640 1 -- 172.21.15.73:0/3852966247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8007680 con 0x7fb8b815bec0 2024-09-12T03:37:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8aeffd640 1 -- 172.21.15.73:0/3852966247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8004a30 con 0x7fb8b815bec0 2024-09-12T03:37:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b814abb0 con 0x7fb8b815bec0 2024-09-12T03:37:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b806e000 con 0x7fb8b815bec0 2024-09-12T03:37:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8aeffd640 1 -- 172.21.15.73:0/3852966247 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb8a801a020 con 0x7fb8b815bec0 2024-09-12T03:37:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8aeffd640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb89c0678c0 0x7fb89c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8aeffd640 1 -- 172.21.15.73:0/3852966247 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fb8a8085600 con 0x7fb8b815bec0 2024-09-12T03:37:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8be3ed640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb89c0678c0 0x7fb89c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.318+0000 7fb8be3ed640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb89c0678c0 0x7fb89c069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009580 tx=0x7fb8b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.322+0000 7fb8aeffd640 1 -- 172.21.15.73:0/3852966247 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb8a8055f30 con 0x7fb8b815bec0 2024-09-12T03:37:10.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.474+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8b806fcd0 con 0x7fb89c0678c0 2024-09-12T03:37:10.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8aeffd640 1 -- 172.21.15.73:0/3852966247 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250242 (secure 0 0 0) 0x7fb8b806fcd0 con 0x7fb89c0678c0 2024-09-12T03:37:10.489 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:10.490 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:10.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb89c0678c0 msgr2=0x7fb89c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb89c0678c0 0x7fb89c069d80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009580 tx=0x7fb8b4008040 comp rx=0 tx=0).stop 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b815bec0 msgr2=0x7fb8b8147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b815bec0 0x7fb8b8147b60 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c310 tx=0x7fb8a800c7d0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 shutdown_connections 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb89c0678c0 0x7fb89c069d80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b815bec0 0x7fb8b8147b60 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8b815c2a0 0x7fb8b80b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.486+0000 7fb8c0651640 1 --2- 172.21.15.73:0/3852966247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb8b80af470 0x7fb8b814ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.490+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 >> 172.21.15.73:0/3852966247 conn(0x7fb8b80b1f90 msgr2=0x7fb8b8074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.490+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 shutdown_connections 2024-09-12T03:37:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.490+0000 7fb8c0651640 1 -- 172.21.15.73:0/3852966247 wait complete. 2024-09-12T03:37:10.505 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T03:37:09.834453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249424,"kb_used_data":8208,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725296,"statfs":{"total":773094113280,"available":772838703104,"internally_reserved":0,"allocated":8404992,"data_stored":4428247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":246795827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.387368"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490484+0000","last_change":"2024-09-12T03:37:06.514437+0000","last_active":"2024-09-12T03:37:07.490484+0000","last_peered":"2024-09-12T03:37:07.490484+0000","last_clean":"2024-09-12T03:37:07.490484+0000","last_became_active":"2024-09-12T03:37:06.513608+0000","last_became_peered":"2024-09-12T03:37:06.513608+0000","last_unstale":"2024-09-12T03:37:07.490484+0000","last_undegraded":"2024-09-12T03:37:07.490484+0000","last_fullsized":"2024-09-12T03:37:07.490484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:14.954094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463676+0000","last_change":"2024-09-12T03:37:05.463676+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463676+0000","last_undegraded":"2024-09-12T03:37:05.463676+0000","last_fullsized":"2024-09-12T03:37:05.463676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.540703+0000","last_change":"2024-09-12T03:37:06.537800+0000","last_active":"2024-09-12T03:37:06.540703+0000","last_peered":"2024-09-12T03:37:06.540703+0000","last_clean":"2024-09-12T03:37:06.540703+0000","last_became_active":"2024-09-12T03:37:06.537380+0000","last_became_peered":"2024-09-12T03:37:06.537380+0000","last_unstale":"2024-09-12T03:37:06.540703+0000","last_undegraded":"2024-09-12T03:37:06.540703+0000","last_fullsized":"2024-09-12T03:37:06.540703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:02.077400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736298+0000","last_change":"2024-09-12T03:37:06.502862+0000","last_active":"2024-09-12T03:37:07.736298+0000","last_peered":"2024-09-12T03:37:07.736298+0000","last_clean":"2024-09-12T03:37:07.736298+0000","last_became_active":"2024-09-12T03:37:06.502106+0000","last_became_peered":"2024-09-12T03:37:06.502106+0000","last_unstale":"2024-09-12T03:37:07.736298+0000","last_undegraded":"2024-09-12T03:37:07.736298+0000","last_fullsized":"2024-09-12T03:37:07.736298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525735+0000","last_change":"2024-09-12T03:37:06.510258+0000","last_active":"2024-09-12T03:37:07.525735+0000","last_peered":"2024-09-12T03:37:07.525735+0000","last_clean":"2024-09-12T03:37:07.525735+0000","last_became_active":"2024-09-12T03:37:06.509410+0000","last_became_peered":"2024-09-12T03:37:06.509410+0000","last_unstale":"2024-09-12T03:37:07.525735+0000","last_undegraded":"2024-09-12T03:37:07.525735+0000","last_fullsized":"2024-09-12T03:37:07.525735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:00.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490171+0000","last_change":"2024-09-12T03:37:06.531549+0000","last_active":"2024-09-12T03:37:07.490171+0000","last_peered":"2024-09-12T03:37:07.490171+0000","last_clean":"2024-09-12T03:37:07.490171+0000","last_became_active":"2024-09-12T03:37:06.530951+0000","last_became_peered":"2024-09-12T03:37:06.530951+0000","last_unstale":"2024-09-12T03:37:07.490171+0000","last_undegraded":"2024-09-12T03:37:07.490171+0000","last_fullsized":"2024-09-12T03:37:07.490171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:39.887489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.475592+0000","last_change":"2024-09-12T03:37:05.475592+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.475592+0000","last_undegraded":"2024-09-12T03:37:05.475592+0000","last_fullsized":"2024-09-12T03:37:05.475592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524109+0000","last_change":"2024-09-12T03:37:06.516755+0000","last_active":"2024-09-12T03:37:07.524109+0000","last_peered":"2024-09-12T03:37:07.524109+0000","last_clean":"2024-09-12T03:37:07.524109+0000","last_became_active":"2024-09-12T03:37:06.515980+0000","last_became_peered":"2024-09-12T03:37:06.515980+0000","last_unstale":"2024-09-12T03:37:07.524109+0000","last_undegraded":"2024-09-12T03:37:07.524109+0000","last_fullsized":"2024-09-12T03:37:07.524109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:11.002245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536002+0000","last_change":"2024-09-12T03:37:06.523408+0000","last_active":"2024-09-12T03:37:06.536002+0000","last_peered":"2024-09-12T03:37:06.536002+0000","last_clean":"2024-09-12T03:37:06.536002+0000","last_became_active":"2024-09-12T03:37:06.522698+0000","last_became_peered":"2024-09-12T03:37:06.522698+0000","last_unstale":"2024-09-12T03:37:06.536002+0000","last_undegraded":"2024-09-12T03:37:06.536002+0000","last_fullsized":"2024-09-12T03:37:06.536002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.051078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736249+0000","last_change":"2024-09-12T03:37:06.531047+0000","last_active":"2024-09-12T03:37:07.736249+0000","last_peered":"2024-09-12T03:37:07.736249+0000","last_clean":"2024-09-12T03:37:07.736249+0000","last_became_active":"2024-09-12T03:37:06.530313+0000","last_became_peered":"2024-09-12T03:37:06.530313+0000","last_unstale":"2024-09-12T03:37:07.736249+0000","last_undegraded":"2024-09-12T03:37:07.736249+0000","last_fullsized":"2024-09-12T03:37:07.736249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:50.907872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463757+0000","last_change":"2024-09-12T03:37:05.463757+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463757+0000","last_undegraded":"2024-09-12T03:37:05.463757+0000","last_fullsized":"2024-09-12T03:37:05.463757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736293+0000","last_change":"2024-09-12T03:37:06.527826+0000","last_active":"2024-09-12T03:37:07.736293+0000","last_peered":"2024-09-12T03:37:07.736293+0000","last_clean":"2024-09-12T03:37:07.736293+0000","last_became_active":"2024-09-12T03:37:06.527024+0000","last_became_peered":"2024-09-12T03:37:06.527024+0000","last_unstale":"2024-09-12T03:37:07.736293+0000","last_undegraded":"2024-09-12T03:37:07.736293+0000","last_fullsized":"2024-09-12T03:37:07.736293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:37.906427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525835+0000","last_change":"2024-09-12T03:37:06.520117+0000","last_active":"2024-09-12T03:37:07.525835+0000","last_peered":"2024-09-12T03:37:07.525835+0000","last_clean":"2024-09-12T03:37:07.525835+0000","last_became_active":"2024-09-12T03:37:06.519404+0000","last_became_peered":"2024-09-12T03:37:06.519404+0000","last_unstale":"2024-09-12T03:37:07.525835+0000","last_undegraded":"2024-09-12T03:37:07.525835+0000","last_fullsized":"2024-09-12T03:37:07.525835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:13.557412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490257+0000","last_change":"2024-09-12T03:37:06.531349+0000","last_active":"2024-09-12T03:37:07.490257+0000","last_peered":"2024-09-12T03:37:07.490257+0000","last_clean":"2024-09-12T03:37:07.490257+0000","last_became_active":"2024-09-12T03:37:06.530817+0000","last_became_peered":"2024-09-12T03:37:06.530817+0000","last_unstale":"2024-09-12T03:37:07.490257+0000","last_undegraded":"2024-09-12T03:37:07.490257+0000","last_fullsized":"2024-09-12T03:37:07.490257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:35.000985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463836+0000","last_change":"2024-09-12T03:37:05.463836+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463836+0000","last_undegraded":"2024-09-12T03:37:05.463836+0000","last_fullsized":"2024-09-12T03:37:05.463836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489610+0000","last_change":"2024-09-12T03:37:06.514904+0000","last_active":"2024-09-12T03:37:07.489610+0000","last_peered":"2024-09-12T03:37:07.489610+0000","last_clean":"2024-09-12T03:37:07.489610+0000","last_became_active":"2024-09-12T03:37:06.514039+0000","last_became_peered":"2024-09-12T03:37:06.514039+0000","last_unstale":"2024-09-12T03:37:07.489610+0000","last_undegraded":"2024-09-12T03:37:07.489610+0000","last_fullsized":"2024-09-12T03:37:07.489610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.632530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526403+0000","last_change":"2024-09-12T03:37:06.532098+0000","last_active":"2024-09-12T03:37:07.526403+0000","last_peered":"2024-09-12T03:37:07.526403+0000","last_clean":"2024-09-12T03:37:07.526403+0000","last_became_active":"2024-09-12T03:37:06.531862+0000","last_became_peered":"2024-09-12T03:37:06.531862+0000","last_unstale":"2024-09-12T03:37:07.526403+0000","last_undegraded":"2024-09-12T03:37:07.526403+0000","last_fullsized":"2024-09-12T03:37:07.526403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.841005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.510047+0000","last_change":"2024-09-12T03:37:06.504175+0000","last_active":"2024-09-12T03:37:06.510047+0000","last_peered":"2024-09-12T03:37:06.510047+0000","last_clean":"2024-09-12T03:37:06.510047+0000","last_became_active":"2024-09-12T03:37:06.503252+0000","last_became_peered":"2024-09-12T03:37:06.503252+0000","last_unstale":"2024-09-12T03:37:06.510047+0000","last_undegraded":"2024-09-12T03:37:06.510047+0000","last_fullsized":"2024-09-12T03:37:06.510047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:07.426916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490185+0000","last_change":"2024-09-12T03:37:06.522629+0000","last_active":"2024-09-12T03:37:07.490185+0000","last_peered":"2024-09-12T03:37:07.490185+0000","last_clean":"2024-09-12T03:37:07.490185+0000","last_became_active":"2024-09-12T03:37:06.522349+0000","last_became_peered":"2024-09-12T03:37:06.522349+0000","last_unstale":"2024-09-12T03:37:07.490185+0000","last_undegraded":"2024-09-12T03:37:07.490185+0000","last_fullsized":"2024-09-12T03:37:07.490185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:18.204607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525939+0000","last_change":"2024-09-12T03:37:06.505805+0000","last_active":"2024-09-12T03:37:07.525939+0000","last_peered":"2024-09-12T03:37:07.525939+0000","last_clean":"2024-09-12T03:37:07.525939+0000","last_became_active":"2024-09-12T03:37:06.504970+0000","last_became_peered":"2024-09-12T03:37:06.504970+0000","last_unstale":"2024-09-12T03:37:07.525939+0000","last_undegraded":"2024-09-12T03:37:07.525939+0000","last_fullsized":"2024-09-12T03:37:07.525939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:33.899192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509640+0000","last_change":"2024-09-12T03:37:06.500401+0000","last_active":"2024-09-12T03:37:06.509640+0000","last_peered":"2024-09-12T03:37:06.509640+0000","last_clean":"2024-09-12T03:37:06.509640+0000","last_became_active":"2024-09-12T03:37:06.499636+0000","last_became_peered":"2024-09-12T03:37:06.499636+0000","last_unstale":"2024-09-12T03:37:06.509640+0000","last_undegraded":"2024-09-12T03:37:06.509640+0000","last_fullsized":"2024-09-12T03:37:06.509640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:28.462827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524890+0000","last_change":"2024-09-12T03:37:06.543601+0000","last_active":"2024-09-12T03:37:07.524890+0000","last_peered":"2024-09-12T03:37:07.524890+0000","last_clean":"2024-09-12T03:37:07.524890+0000","last_became_active":"2024-09-12T03:37:06.542384+0000","last_became_peered":"2024-09-12T03:37:06.542384+0000","last_unstale":"2024-09-12T03:37:07.524890+0000","last_undegraded":"2024-09-12T03:37:07.524890+0000","last_fullsized":"2024-09-12T03:37:07.524890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.149213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.499591+0000","last_change":"2024-09-12T03:37:06.497773+0000","last_active":"2024-09-12T03:37:06.499591+0000","last_peered":"2024-09-12T03:37:06.499591+0000","last_clean":"2024-09-12T03:37:06.499591+0000","last_became_active":"2024-09-12T03:37:06.496867+0000","last_became_peered":"2024-09-12T03:37:06.496867+0000","last_unstale":"2024-09-12T03:37:06.499591+0000","last_undegraded":"2024-09-12T03:37:06.499591+0000","last_fullsized":"2024-09-12T03:37:06.499591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.164141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464286+0000","last_change":"2024-09-12T03:37:05.464286+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464286+0000","last_undegraded":"2024-09-12T03:37:05.464286+0000","last_fullsized":"2024-09-12T03:37:05.464286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461931+0000","last_change":"2024-09-12T03:37:05.461931+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461931+0000","last_undegraded":"2024-09-12T03:37:05.461931+0000","last_fullsized":"2024-09-12T03:37:05.461931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736116+0000","last_change":"2024-09-12T03:37:06.527918+0000","last_active":"2024-09-12T03:37:07.736116+0000","last_peered":"2024-09-12T03:37:07.736116+0000","last_clean":"2024-09-12T03:37:07.736116+0000","last_became_active":"2024-09-12T03:37:06.527243+0000","last_became_peered":"2024-09-12T03:37:06.527243+0000","last_unstale":"2024-09-12T03:37:07.736116+0000","last_undegraded":"2024-09-12T03:37:07.736116+0000","last_fullsized":"2024-09-12T03:37:07.736116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:32.967011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489935+0000","last_change":"2024-09-12T03:37:06.513491+0000","last_active":"2024-09-12T03:37:07.489935+0000","last_peered":"2024-09-12T03:37:07.489935+0000","last_clean":"2024-09-12T03:37:07.489935+0000","last_became_active":"2024-09-12T03:37:06.508794+0000","last_became_peered":"2024-09-12T03:37:06.508794+0000","last_unstale":"2024-09-12T03:37:07.489935+0000","last_undegraded":"2024-09-12T03:37:07.489935+0000","last_fullsized":"2024-09-12T03:37:07.489935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.834025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526079+0000","last_change":"2024-09-12T03:37:06.493731+0000","last_active":"2024-09-12T03:37:07.526079+0000","last_peered":"2024-09-12T03:37:07.526079+0000","last_clean":"2024-09-12T03:37:07.526079+0000","last_became_active":"2024-09-12T03:37:06.492963+0000","last_became_peered":"2024-09-12T03:37:06.492963+0000","last_unstale":"2024-09-12T03:37:07.526079+0000","last_undegraded":"2024-09-12T03:37:07.526079+0000","last_fullsized":"2024-09-12T03:37:07.526079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:40.752488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.462360+0000","last_change":"2024-09-12T03:37:05.462360+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.462360+0000","last_undegraded":"2024-09-12T03:37:05.462360+0000","last_fullsized":"2024-09-12T03:37:05.462360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489520+0000","last_change":"2024-09-12T03:37:06.538257+0000","last_active":"2024-09-12T03:37:07.489520+0000","last_peered":"2024-09-12T03:37:07.489520+0000","last_clean":"2024-09-12T03:37:07.489520+0000","last_became_active":"2024-09-12T03:37:06.537464+0000","last_became_peered":"2024-09-12T03:37:06.537464+0000","last_unstale":"2024-09-12T03:37:07.489520+0000","last_undegraded":"2024-09-12T03:37:07.489520+0000","last_fullsized":"2024-09-12T03:37:07.489520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:47.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537849+0000","last_change":"2024-09-12T03:37:06.529226+0000","last_active":"2024-09-12T03:37:06.537849+0000","last_peered":"2024-09-12T03:37:06.537849+0000","last_clean":"2024-09-12T03:37:06.537849+0000","last_became_active":"2024-09-12T03:37:06.528961+0000","last_became_peered":"2024-09-12T03:37:06.528961+0000","last_unstale":"2024-09-12T03:37:06.537849+0000","last_undegraded":"2024-09-12T03:37:06.537849+0000","last_fullsized":"2024-09-12T03:37:06.537849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:29.822067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490040+0000","last_change":"2024-09-12T03:37:06.520303+0000","last_active":"2024-09-12T03:37:07.490040+0000","last_peered":"2024-09-12T03:37:07.490040+0000","last_clean":"2024-09-12T03:37:07.490040+0000","last_became_active":"2024-09-12T03:37:06.514601+0000","last_became_peered":"2024-09-12T03:37:06.514601+0000","last_unstale":"2024-09-12T03:37:07.490040+0000","last_undegraded":"2024-09-12T03:37:07.490040+0000","last_fullsized":"2024-09-12T03:37:07.490040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:02.773931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509950+0000","last_change":"2024-09-12T03:37:06.503918+0000","last_active":"2024-09-12T03:37:06.509950+0000","last_peered":"2024-09-12T03:37:06.509950+0000","last_clean":"2024-09-12T03:37:06.509950+0000","last_became_active":"2024-09-12T03:37:06.503138+0000","last_became_peered":"2024-09-12T03:37:06.503138+0000","last_unstale":"2024-09-12T03:37:06.509950+0000","last_undegraded":"2024-09-12T03:37:06.509950+0000","last_fullsized":"2024-09-12T03:37:06.509950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:12.810601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526469+0000","last_change":"2024-09-12T03:37:05.472634+0000","last_active":"2024-09-12T03:37:07.526469+0000","last_peered":"2024-09-12T03:37:07.526469+0000","last_clean":"2024-09-12T03:37:07.526469+0000","last_became_active":"2024-09-12T03:37:05.472206+0000","last_became_peered":"2024-09-12T03:37:05.472206+0000","last_unstale":"2024-09-12T03:37:07.526469+0000","last_undegraded":"2024-09-12T03:37:07.526469+0000","last_fullsized":"2024-09-12T03:37:07.526469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:29.832710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461497+0000","last_change":"2024-09-12T03:37:05.461497+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461497+0000","last_undegraded":"2024-09-12T03:37:05.461497+0000","last_fullsized":"2024-09-12T03:37:05.461497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490508+0000","last_change":"2024-09-12T03:37:05.500119+0000","last_active":"2024-09-12T03:37:07.490508+0000","last_peered":"2024-09-12T03:37:07.490508+0000","last_clean":"2024-09-12T03:37:07.490508+0000","last_became_active":"2024-09-12T03:37:05.499397+0000","last_became_peered":"2024-09-12T03:37:05.499397+0000","last_unstale":"2024-09-12T03:37:07.490508+0000","last_undegraded":"2024-09-12T03:37:07.490508+0000","last_fullsized":"2024-09-12T03:37:07.490508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:49.894769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.543034+0000","last_change":"2024-09-12T03:37:06.533084+0000","last_active":"2024-09-12T03:37:06.543034+0000","last_peered":"2024-09-12T03:37:06.543034+0000","last_clean":"2024-09-12T03:37:06.543034+0000","last_became_active":"2024-09-12T03:37:06.532362+0000","last_became_peered":"2024-09-12T03:37:06.532362+0000","last_unstale":"2024-09-12T03:37:06.543034+0000","last_undegraded":"2024-09-12T03:37:06.543034+0000","last_fullsized":"2024-09-12T03:37:06.543034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:51.545805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490159+0000","last_change":"2024-09-12T03:37:05.503226+0000","last_active":"2024-09-12T03:37:07.490159+0000","last_peered":"2024-09-12T03:37:07.490159+0000","last_clean":"2024-09-12T03:37:07.490159+0000","last_became_active":"2024-09-12T03:37:05.499243+0000","last_became_peered":"2024-09-12T03:37:05.499243+0000","last_unstale":"2024-09-12T03:37:07.490159+0000","last_undegraded":"2024-09-12T03:37:07.490159+0000","last_fullsized":"2024-09-12T03:37:07.490159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:31.953907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509254+0000","last_change":"2024-09-12T03:37:06.500139+0000","last_active":"2024-09-12T03:37:06.509254+0000","last_peered":"2024-09-12T03:37:06.509254+0000","last_clean":"2024-09-12T03:37:06.509254+0000","last_became_active":"2024-09-12T03:37:06.498715+0000","last_became_peered":"2024-09-12T03:37:06.498715+0000","last_unstale":"2024-09-12T03:37:06.509254+0000","last_undegraded":"2024-09-12T03:37:06.509254+0000","last_fullsized":"2024-09-12T03:37:06.509254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:54.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.502121+0000","last_change":"2024-09-12T03:37:05.499938+0000","last_active":"2024-09-12T03:37:05.502121+0000","last_peered":"2024-09-12T03:37:05.502121+0000","last_clean":"2024-09-12T03:37:05.502121+0000","last_became_active":"2024-09-12T03:37:05.499502+0000","last_became_peered":"2024-09-12T03:37:05.499502+0000","last_unstale":"2024-09-12T03:37:05.502121+0000","last_undegraded":"2024-09-12T03:37:05.502121+0000","last_fullsized":"2024-09-12T03:37:05.502121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:00.462693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463663+0000","last_change":"2024-09-12T03:37:05.463663+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463663+0000","last_undegraded":"2024-09-12T03:37:05.463663+0000","last_fullsized":"2024-09-12T03:37:05.463663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.548588+0000","last_change":"2024-09-12T03:37:05.494187+0000","last_active":"2024-09-12T03:37:06.548588+0000","last_peered":"2024-09-12T03:37:06.548588+0000","last_clean":"2024-09-12T03:37:06.548588+0000","last_became_active":"2024-09-12T03:37:05.493427+0000","last_became_peered":"2024-09-12T03:37:05.493427+0000","last_unstale":"2024-09-12T03:37:06.548588+0000","last_undegraded":"2024-09-12T03:37:06.548588+0000","last_fullsized":"2024-09-12T03:37:06.548588+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.568721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461977+0000","last_change":"2024-09-12T03:37:05.461977+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461977+0000","last_undegraded":"2024-09-12T03:37:05.461977+0000","last_fullsized":"2024-09-12T03:37:05.461977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735804+0000","last_change":"2024-09-12T03:37:05.475494+0000","last_active":"2024-09-12T03:37:07.735804+0000","last_peered":"2024-09-12T03:37:07.735804+0000","last_clean":"2024-09-12T03:37:07.735804+0000","last_became_active":"2024-09-12T03:37:05.474778+0000","last_became_peered":"2024-09-12T03:37:05.474778+0000","last_unstale":"2024-09-12T03:37:07.735804+0000","last_undegraded":"2024-09-12T03:37:07.735804+0000","last_fullsized":"2024-09-12T03:37:07.735804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.185281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536045+0000","last_change":"2024-09-12T03:37:06.523174+0000","last_active":"2024-09-12T03:37:06.536045+0000","last_peered":"2024-09-12T03:37:06.536045+0000","last_clean":"2024-09-12T03:37:06.536045+0000","last_became_active":"2024-09-12T03:37:06.522469+0000","last_became_peered":"2024-09-12T03:37:06.522469+0000","last_unstale":"2024-09-12T03:37:06.536045+0000","last_undegraded":"2024-09-12T03:37:06.536045+0000","last_fullsized":"2024-09-12T03:37:06.536045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:51.550177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.493779+0000","last_change":"2024-09-12T03:37:05.493173+0000","last_active":"2024-09-12T03:37:05.493779+0000","last_peered":"2024-09-12T03:37:05.493779+0000","last_clean":"2024-09-12T03:37:05.493779+0000","last_became_active":"2024-09-12T03:37:05.492841+0000","last_became_peered":"2024-09-12T03:37:05.492841+0000","last_unstale":"2024-09-12T03:37:05.493779+0000","last_undegraded":"2024-09-12T03:37:05.493779+0000","last_fullsized":"2024-09-12T03:37:05.493779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:05.221145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.465212+0000","last_change":"2024-09-12T03:37:05.465212+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.465212+0000","last_undegraded":"2024-09-12T03:37:05.465212+0000","last_fullsized":"2024-09-12T03:37:05.465212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524122+0000","last_change":"2024-09-12T03:37:05.481678+0000","last_active":"2024-09-12T03:37:07.524122+0000","last_peered":"2024-09-12T03:37:07.524122+0000","last_clean":"2024-09-12T03:37:07.524122+0000","last_became_active":"2024-09-12T03:37:05.481386+0000","last_became_peered":"2024-09-12T03:37:05.481386+0000","last_unstale":"2024-09-12T03:37:07.524122+0000","last_undegraded":"2024-09-12T03:37:07.524122+0000","last_fullsized":"2024-09-12T03:37:07.524122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.008960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461373+0000","last_change":"2024-09-12T03:37:05.461373+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461373+0000","last_undegraded":"2024-09-12T03:37:05.461373+0000","last_fullsized":"2024-09-12T03:37:05.461373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490322+0000","last_change":"2024-09-12T03:37:05.502676+0000","last_active":"2024-09-12T03:37:07.490322+0000","last_peered":"2024-09-12T03:37:07.490322+0000","last_clean":"2024-09-12T03:37:07.490322+0000","last_became_active":"2024-09-12T03:37:05.500422+0000","last_became_peered":"2024-09-12T03:37:05.500422+0000","last_unstale":"2024-09-12T03:37:07.490322+0000","last_undegraded":"2024-09-12T03:37:07.490322+0000","last_fullsized":"2024-09-12T03:37:07.490322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.951815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736193+0000","last_change":"2024-09-12T03:37:06.503404+0000","last_active":"2024-09-12T03:37:07.736193+0000","last_peered":"2024-09-12T03:37:07.736193+0000","last_clean":"2024-09-12T03:37:07.736193+0000","last_became_active":"2024-09-12T03:37:06.501502+0000","last_became_peered":"2024-09-12T03:37:06.501502+0000","last_unstale":"2024-09-12T03:37:07.736193+0000","last_undegraded":"2024-09-12T03:37:07.736193+0000","last_fullsized":"2024-09-12T03:37:07.736193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:44.036902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736206+0000","last_change":"2024-09-12T03:37:05.484198+0000","last_active":"2024-09-12T03:37:07.736206+0000","last_peered":"2024-09-12T03:37:07.736206+0000","last_clean":"2024-09-12T03:37:07.736206+0000","last_became_active":"2024-09-12T03:37:05.483437+0000","last_became_peered":"2024-09-12T03:37:05.483437+0000","last_unstale":"2024-09-12T03:37:07.736206+0000","last_undegraded":"2024-09-12T03:37:07.736206+0000","last_fullsized":"2024-09-12T03:37:07.736206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:57.022689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490642+0000","last_change":"2024-09-12T03:37:06.531132+0000","last_active":"2024-09-12T03:37:07.490642+0000","last_peered":"2024-09-12T03:37:07.490642+0000","last_clean":"2024-09-12T03:37:07.490642+0000","last_became_active":"2024-09-12T03:37:06.530579+0000","last_became_peered":"2024-09-12T03:37:06.530579+0000","last_unstale":"2024-09-12T03:37:07.490642+0000","last_undegraded":"2024-09-12T03:37:07.490642+0000","last_fullsized":"2024-09-12T03:37:07.490642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526095+0000","last_change":"2024-09-12T03:37:05.467252+0000","last_active":"2024-09-12T03:37:07.526095+0000","last_peered":"2024-09-12T03:37:07.526095+0000","last_clean":"2024-09-12T03:37:07.526095+0000","last_became_active":"2024-09-12T03:37:05.466976+0000","last_became_peered":"2024-09-12T03:37:05.466976+0000","last_unstale":"2024-09-12T03:37:07.526095+0000","last_undegraded":"2024-09-12T03:37:07.526095+0000","last_fullsized":"2024-09-12T03:37:07.526095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:52.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537737+0000","last_change":"2024-09-12T03:37:06.532029+0000","last_active":"2024-09-12T03:37:06.537737+0000","last_peered":"2024-09-12T03:37:06.537737+0000","last_clean":"2024-09-12T03:37:06.537737+0000","last_became_active":"2024-09-12T03:37:06.531754+0000","last_became_peered":"2024-09-12T03:37:06.531754+0000","last_unstale":"2024-09-12T03:37:06.537737+0000","last_undegraded":"2024-09-12T03:37:06.537737+0000","last_fullsized":"2024-09-12T03:37:06.537737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:34.296632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.491781+0000","last_change":"2024-09-12T03:37:05.486509+0000","last_active":"2024-09-12T03:37:05.491781+0000","last_peered":"2024-09-12T03:37:05.491781+0000","last_clean":"2024-09-12T03:37:05.491781+0000","last_became_active":"2024-09-12T03:37:05.485863+0000","last_became_peered":"2024-09-12T03:37:05.485863+0000","last_unstale":"2024-09-12T03:37:05.491781+0000","last_undegraded":"2024-09-12T03:37:05.491781+0000","last_fullsized":"2024-09-12T03:37:05.491781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:17.964169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736503+0000","last_change":"2024-09-12T03:37:06.524797+0000","last_active":"2024-09-12T03:37:07.736503+0000","last_peered":"2024-09-12T03:37:07.736503+0000","last_clean":"2024-09-12T03:37:07.736503+0000","last_became_active":"2024-09-12T03:37:06.524051+0000","last_became_peered":"2024-09-12T03:37:06.524051+0000","last_unstale":"2024-09-12T03:37:07.736503+0000","last_undegraded":"2024-09-12T03:37:07.736503+0000","last_fullsized":"2024-09-12T03:37:07.736503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735820+0000","last_change":"2024-09-12T03:37:05.484324+0000","last_active":"2024-09-12T03:37:07.735820+0000","last_peered":"2024-09-12T03:37:07.735820+0000","last_clean":"2024-09-12T03:37:07.735820+0000","last_became_active":"2024-09-12T03:37:05.483498+0000","last_became_peered":"2024-09-12T03:37:05.483498+0000","last_unstale":"2024-09-12T03:37:07.735820+0000","last_undegraded":"2024-09-12T03:37:07.735820+0000","last_fullsized":"2024-09-12T03:37:07.735820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.465918+0000","last_change":"2024-09-12T03:37:05.465918+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.465918+0000","last_undegraded":"2024-09-12T03:37:05.465918+0000","last_fullsized":"2024-09-12T03:37:05.465918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489421+0000","last_change":"2024-09-12T03:37:05.500057+0000","last_active":"2024-09-12T03:37:07.489421+0000","last_peered":"2024-09-12T03:37:07.489421+0000","last_clean":"2024-09-12T03:37:07.489421+0000","last_became_active":"2024-09-12T03:37:05.499311+0000","last_became_peered":"2024-09-12T03:37:05.499311+0000","last_unstale":"2024-09-12T03:37:07.489421+0000","last_undegraded":"2024-09-12T03:37:07.489421+0000","last_fullsized":"2024-09-12T03:37:07.489421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:29.673134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.462036+0000","last_change":"2024-09-12T03:37:05.462036+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.462036+0000","last_undegraded":"2024-09-12T03:37:05.462036+0000","last_fullsized":"2024-09-12T03:37:05.462036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524346+0000","last_change":"2024-09-12T03:37:05.473264+0000","last_active":"2024-09-12T03:37:07.524346+0000","last_peered":"2024-09-12T03:37:07.524346+0000","last_clean":"2024-09-12T03:37:07.524346+0000","last_became_active":"2024-09-12T03:37:05.472961+0000","last_became_peered":"2024-09-12T03:37:05.472961+0000","last_unstale":"2024-09-12T03:37:07.524346+0000","last_undegraded":"2024-09-12T03:37:07.524346+0000","last_fullsized":"2024-09-12T03:37:07.524346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:08.526759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464140+0000","last_change":"2024-09-12T03:37:05.464140+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464140+0000","last_undegraded":"2024-09-12T03:37:05.464140+0000","last_fullsized":"2024-09-12T03:37:05.464140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.489884+0000","last_change":"2024-09-12T03:37:05.487121+0000","last_active":"2024-09-12T03:37:05.489884+0000","last_peered":"2024-09-12T03:37:05.489884+0000","last_clean":"2024-09-12T03:37:05.489884+0000","last_became_active":"2024-09-12T03:37:05.486606+0000","last_became_peered":"2024-09-12T03:37:05.486606+0000","last_unstale":"2024-09-12T03:37:05.489884+0000","last_undegraded":"2024-09-12T03:37:05.489884+0000","last_fullsized":"2024-09-12T03:37:05.489884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:22.110425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489543+0000","last_change":"2024-09-12T03:37:06.523220+0000","last_active":"2024-09-12T03:37:07.489543+0000","last_peered":"2024-09-12T03:37:07.489543+0000","last_clean":"2024-09-12T03:37:07.489543+0000","last_became_active":"2024-09-12T03:37:06.522654+0000","last_became_peered":"2024-09-12T03:37:06.522654+0000","last_unstale":"2024-09-12T03:37:07.489543+0000","last_undegraded":"2024-09-12T03:37:07.489543+0000","last_fullsized":"2024-09-12T03:37:07.489543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490664+0000","last_change":"2024-09-12T03:37:05.504584+0000","last_active":"2024-09-12T03:37:07.490664+0000","last_peered":"2024-09-12T03:37:07.490664+0000","last_clean":"2024-09-12T03:37:07.490664+0000","last_became_active":"2024-09-12T03:37:05.504027+0000","last_became_peered":"2024-09-12T03:37:05.504027+0000","last_unstale":"2024-09-12T03:37:07.490664+0000","last_undegraded":"2024-09-12T03:37:07.490664+0000","last_fullsized":"2024-09-12T03:37:07.490664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:36.893323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524199+0000","last_change":"2024-09-12T03:37:06.529939+0000","last_active":"2024-09-12T03:37:07.524199+0000","last_peered":"2024-09-12T03:37:07.524199+0000","last_clean":"2024-09-12T03:37:07.524199+0000","last_became_active":"2024-09-12T03:37:06.529695+0000","last_became_peered":"2024-09-12T03:37:06.529695+0000","last_unstale":"2024-09-12T03:37:07.524199+0000","last_undegraded":"2024-09-12T03:37:07.524199+0000","last_fullsized":"2024-09-12T03:37:07.524199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:31.343811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.547797+0000","last_change":"2024-09-12T03:37:05.482266+0000","last_active":"2024-09-12T03:37:06.547797+0000","last_peered":"2024-09-12T03:37:06.547797+0000","last_clean":"2024-09-12T03:37:06.547797+0000","last_became_active":"2024-09-12T03:37:05.481642+0000","last_became_peered":"2024-09-12T03:37:05.481642+0000","last_unstale":"2024-09-12T03:37:06.547797+0000","last_undegraded":"2024-09-12T03:37:06.547797+0000","last_fullsized":"2024-09-12T03:37:06.547797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:45.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525240+0000","last_change":"2024-09-12T03:37:06.513529+0000","last_active":"2024-09-12T03:37:07.525240+0000","last_peered":"2024-09-12T03:37:07.525240+0000","last_clean":"2024-09-12T03:37:07.525240+0000","last_became_active":"2024-09-12T03:37:06.512794+0000","last_became_peered":"2024-09-12T03:37:06.512794+0000","last_unstale":"2024-09-12T03:37:07.525240+0000","last_undegraded":"2024-09-12T03:37:07.525240+0000","last_fullsized":"2024-09-12T03:37:07.525240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:44.645938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526174+0000","last_change":"2024-09-12T03:37:05.482661+0000","last_active":"2024-09-12T03:37:07.526174+0000","last_peered":"2024-09-12T03:37:07.526174+0000","last_clean":"2024-09-12T03:37:07.526174+0000","last_became_active":"2024-09-12T03:37:05.482383+0000","last_became_peered":"2024-09-12T03:37:05.482383+0000","last_unstale":"2024-09-12T03:37:07.526174+0000","last_undegraded":"2024-09-12T03:37:07.526174+0000","last_fullsized":"2024-09-12T03:37:07.526174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:10.781273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489983+0000","last_change":"2024-09-12T03:37:06.524850+0000","last_active":"2024-09-12T03:37:07.489983+0000","last_peered":"2024-09-12T03:37:07.489983+0000","last_clean":"2024-09-12T03:37:07.489983+0000","last_became_active":"2024-09-12T03:37:06.524667+0000","last_became_peered":"2024-09-12T03:37:06.524667+0000","last_unstale":"2024-09-12T03:37:07.489983+0000","last_undegraded":"2024-09-12T03:37:07.489983+0000","last_fullsized":"2024-09-12T03:37:07.489983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:52.329645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.497387+0000","last_change":"2024-09-12T03:37:05.473843+0000","last_active":"2024-09-12T03:37:06.497387+0000","last_peered":"2024-09-12T03:37:06.497387+0000","last_clean":"2024-09-12T03:37:06.497387+0000","last_became_active":"2024-09-12T03:37:05.473434+0000","last_became_peered":"2024-09-12T03:37:05.473434+0000","last_unstale":"2024-09-12T03:37:06.497387+0000","last_undegraded":"2024-09-12T03:37:06.497387+0000","last_fullsized":"2024-09-12T03:37:06.497387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:03.854469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460985+0000","last_change":"2024-09-12T03:37:05.460985+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460985+0000","last_undegraded":"2024-09-12T03:37:05.460985+0000","last_fullsized":"2024-09-12T03:37:05.460985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489811+0000","last_change":"2024-09-12T03:37:05.468431+0000","last_active":"2024-09-12T03:37:07.489811+0000","last_peered":"2024-09-12T03:37:07.489811+0000","last_clean":"2024-09-12T03:37:07.489811+0000","last_became_active":"2024-09-12T03:37:05.467975+0000","last_became_peered":"2024-09-12T03:37:05.467975+0000","last_unstale":"2024-09-12T03:37:07.489811+0000","last_undegraded":"2024-09-12T03:37:07.489811+0000","last_fullsized":"2024-09-12T03:37:07.489811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:45.853956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460553+0000","last_change":"2024-09-12T03:37:05.460553+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460553+0000","last_undegraded":"2024-09-12T03:37:05.460553+0000","last_fullsized":"2024-09-12T03:37:05.460553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489828+0000","last_change":"2024-09-12T03:37:05.486564+0000","last_active":"2024-09-12T03:37:07.489828+0000","last_peered":"2024-09-12T03:37:07.489828+0000","last_clean":"2024-09-12T03:37:07.489828+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.489828+0000","last_undegraded":"2024-09-12T03:37:07.489828+0000","last_fullsized":"2024-09-12T03:37:07.489828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:15.007890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463213+0000","last_change":"2024-09-12T03:37:05.463213+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463213+0000","last_undegraded":"2024-09-12T03:37:05.463213+0000","last_fullsized":"2024-09-12T03:37:05.463213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489733+0000","last_change":"2024-09-12T03:37:05.486727+0000","last_active":"2024-09-12T03:37:07.489733+0000","last_peered":"2024-09-12T03:37:07.489733+0000","last_clean":"2024-09-12T03:37:07.489733+0000","last_became_active":"2024-09-12T03:37:05.486147+0000","last_became_peered":"2024-09-12T03:37:05.486147+0000","last_unstale":"2024-09-12T03:37:07.489733+0000","last_undegraded":"2024-09-12T03:37:07.489733+0000","last_fullsized":"2024-09-12T03:37:07.489733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.039642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542699+0000","last_change":"2024-09-12T03:37:06.529021+0000","last_active":"2024-09-12T03:37:06.542699+0000","last_peered":"2024-09-12T03:37:06.542699+0000","last_clean":"2024-09-12T03:37:06.542699+0000","last_became_active":"2024-09-12T03:37:06.528314+0000","last_became_peered":"2024-09-12T03:37:06.528314+0000","last_unstale":"2024-09-12T03:37:06.542699+0000","last_undegraded":"2024-09-12T03:37:06.542699+0000","last_fullsized":"2024-09-12T03:37:06.542699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:18.263844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735928+0000","last_change":"2024-09-12T03:37:05.468166+0000","last_active":"2024-09-12T03:37:07.735928+0000","last_peered":"2024-09-12T03:37:07.735928+0000","last_clean":"2024-09-12T03:37:07.735928+0000","last_became_active":"2024-09-12T03:37:05.467379+0000","last_became_peered":"2024-09-12T03:37:05.467379+0000","last_unstale":"2024-09-12T03:37:07.735928+0000","last_undegraded":"2024-09-12T03:37:07.735928+0000","last_fullsized":"2024-09-12T03:37:07.735928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:19.886719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.469142+0000","last_change":"2024-09-12T03:37:05.469142+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.469142+0000","last_undegraded":"2024-09-12T03:37:05.469142+0000","last_fullsized":"2024-09-12T03:37:05.469142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.474190+0000","last_change":"2024-09-12T03:37:05.469039+0000","last_active":"2024-09-12T03:37:05.474190+0000","last_peered":"2024-09-12T03:37:05.474190+0000","last_clean":"2024-09-12T03:37:05.474190+0000","last_became_active":"2024-09-12T03:37:05.468116+0000","last_became_peered":"2024-09-12T03:37:05.468116+0000","last_unstale":"2024-09-12T03:37:05.474190+0000","last_undegraded":"2024-09-12T03:37:05.474190+0000","last_fullsized":"2024-09-12T03:37:05.474190+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:10.018840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542992+0000","last_change":"2024-09-12T03:37:06.532084+0000","last_active":"2024-09-12T03:37:06.542992+0000","last_peered":"2024-09-12T03:37:06.542992+0000","last_clean":"2024-09-12T03:37:06.542992+0000","last_became_active":"2024-09-12T03:37:06.531460+0000","last_became_peered":"2024-09-12T03:37:06.531460+0000","last_unstale":"2024-09-12T03:37:06.542992+0000","last_undegraded":"2024-09-12T03:37:06.542992+0000","last_fullsized":"2024-09-12T03:37:06.542992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.111098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490457+0000","last_change":"2024-09-12T03:37:05.504695+0000","last_active":"2024-09-12T03:37:07.490457+0000","last_peered":"2024-09-12T03:37:07.490457+0000","last_clean":"2024-09-12T03:37:07.490457+0000","last_became_active":"2024-09-12T03:37:05.503970+0000","last_became_peered":"2024-09-12T03:37:05.503970+0000","last_unstale":"2024-09-12T03:37:07.490457+0000","last_undegraded":"2024-09-12T03:37:07.490457+0000","last_fullsized":"2024-09-12T03:37:07.490457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460703+0000","last_change":"2024-09-12T03:37:05.460703+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460703+0000","last_undegraded":"2024-09-12T03:37:05.460703+0000","last_fullsized":"2024-09-12T03:37:05.460703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489771+0000","last_change":"2024-09-12T03:37:05.502764+0000","last_active":"2024-09-12T03:37:07.489771+0000","last_peered":"2024-09-12T03:37:07.489771+0000","last_clean":"2024-09-12T03:37:07.489771+0000","last_became_active":"2024-09-12T03:37:05.499370+0000","last_became_peered":"2024-09-12T03:37:05.499370+0000","last_unstale":"2024-09-12T03:37:07.489771+0000","last_undegraded":"2024-09-12T03:37:07.489771+0000","last_fullsized":"2024-09-12T03:37:07.489771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:32.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.468071+0000","last_change":"2024-09-12T03:37:05.468071+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.468071+0000","last_undegraded":"2024-09-12T03:37:05.468071+0000","last_fullsized":"2024-09-12T03:37:05.468071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.501138+0000","last_change":"2024-09-12T03:37:05.496667+0000","last_active":"2024-09-12T03:37:05.501138+0000","last_peered":"2024-09-12T03:37:05.501138+0000","last_clean":"2024-09-12T03:37:05.501138+0000","last_became_active":"2024-09-12T03:37:05.493460+0000","last_became_peered":"2024-09-12T03:37:05.493460+0000","last_unstale":"2024-09-12T03:37:05.501138+0000","last_undegraded":"2024-09-12T03:37:05.501138+0000","last_fullsized":"2024-09-12T03:37:05.501138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:15.747603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464786+0000","last_change":"2024-09-12T03:37:05.464786+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464786+0000","last_undegraded":"2024-09-12T03:37:05.464786+0000","last_fullsized":"2024-09-12T03:37:05.464786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525488+0000","last_change":"2024-09-12T03:37:05.473252+0000","last_active":"2024-09-12T03:37:07.525488+0000","last_peered":"2024-09-12T03:37:07.525488+0000","last_clean":"2024-09-12T03:37:07.525488+0000","last_became_active":"2024-09-12T03:37:05.472943+0000","last_became_peered":"2024-09-12T03:37:05.472943+0000","last_unstale":"2024-09-12T03:37:07.525488+0000","last_undegraded":"2024-09-12T03:37:07.525488+0000","last_fullsized":"2024-09-12T03:37:07.525488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.445282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.533602+0000","last_change":"2024-09-12T03:37:06.527704+0000","last_active":"2024-09-12T03:37:06.533602+0000","last_peered":"2024-09-12T03:37:06.533602+0000","last_clean":"2024-09-12T03:37:06.533602+0000","last_became_active":"2024-09-12T03:37:06.527397+0000","last_became_peered":"2024-09-12T03:37:06.527397+0000","last_unstale":"2024-09-12T03:37:06.533602+0000","last_undegraded":"2024-09-12T03:37:06.533602+0000","last_fullsized":"2024-09-12T03:37:06.533602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:48.117214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.491340+0000","last_change":"2024-09-12T03:37:05.485037+0000","last_active":"2024-09-12T03:37:05.491340+0000","last_peered":"2024-09-12T03:37:05.491340+0000","last_clean":"2024-09-12T03:37:05.491340+0000","last_became_active":"2024-09-12T03:37:05.480275+0000","last_became_peered":"2024-09-12T03:37:05.480275+0000","last_unstale":"2024-09-12T03:37:05.491340+0000","last_undegraded":"2024-09-12T03:37:05.491340+0000","last_fullsized":"2024-09-12T03:37:05.491340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:04.169799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.522903+0000","last_change":"2024-09-12T03:37:06.520045+0000","last_active":"2024-09-12T03:37:06.522903+0000","last_peered":"2024-09-12T03:37:06.522903+0000","last_clean":"2024-09-12T03:37:06.522903+0000","last_became_active":"2024-09-12T03:37:06.519644+0000","last_became_peered":"2024-09-12T03:37:06.519644+0000","last_unstale":"2024-09-12T03:37:06.522903+0000","last_undegraded":"2024-09-12T03:37:06.522903+0000","last_fullsized":"2024-09-12T03:37:06.522903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:33.320891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.496993+0000","last_change":"2024-09-12T03:37:05.476302+0000","last_active":"2024-09-12T03:37:06.496993+0000","last_peered":"2024-09-12T03:37:06.496993+0000","last_clean":"2024-09-12T03:37:06.496993+0000","last_became_active":"2024-09-12T03:37:05.476014+0000","last_became_peered":"2024-09-12T03:37:05.476014+0000","last_unstale":"2024-09-12T03:37:06.496993+0000","last_undegraded":"2024-09-12T03:37:06.496993+0000","last_fullsized":"2024-09-12T03:37:06.496993+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.302276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490326+0000","last_change":"2024-09-12T03:37:06.514906+0000","last_active":"2024-09-12T03:37:07.490326+0000","last_peered":"2024-09-12T03:37:07.490326+0000","last_clean":"2024-09-12T03:37:07.490326+0000","last_became_active":"2024-09-12T03:37:06.514221+0000","last_became_peered":"2024-09-12T03:37:06.514221+0000","last_unstale":"2024-09-12T03:37:07.490326+0000","last_undegraded":"2024-09-12T03:37:07.490326+0000","last_fullsized":"2024-09-12T03:37:07.490326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:47.249428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490559+0000","last_change":"2024-09-12T03:37:05.486679+0000","last_active":"2024-09-12T03:37:07.490559+0000","last_peered":"2024-09-12T03:37:07.490559+0000","last_clean":"2024-09-12T03:37:07.490559+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.490559+0000","last_undegraded":"2024-09-12T03:37:07.490559+0000","last_fullsized":"2024-09-12T03:37:07.490559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490179+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:07.490179+0000","last_peered":"2024-09-12T03:37:07.490179+0000","last_clean":"2024-09-12T03:37:07.490179+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:07.490179+0000","last_undegraded":"2024-09-12T03:37:07.490179+0000","last_fullsized":"2024-09-12T03:37:07.490179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1507328,"data_stored":1003572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":913408,"data_stored":413216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":408206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":901120,"data_stored":407072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":909312,"data_stored":407232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":905216,"data_stored":406602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":884736,"data_stored":399323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1466368,"data_stored":983024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:10.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:10.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86bd3e0640 1 Processor -- start 2024-09-12T03:37:10.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86bd3e0640 1 -- start start 2024-09-12T03:37:10.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86bd3e0640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f86b8073e60 0x7f86b806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86bd3e0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86b806fef0 0x7f86b815b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86bd3e0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b815bda0 con 0x7f86b80b3d50 2024-09-12T03:37:10.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86bd3e0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f86b806ee50 con 0x7f86b806fef0 2024-09-12T03:37:10.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86bd3e0640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f86b806f130 con 0x7f86b8073e60 2024-09-12T03:37:10.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86b67fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86b806fef0 0x7f86b815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86b77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86b80b3d50 0x7f86b80b4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58132/0 (socket says 172.21.15.73:58132) 2024-09-12T03:37:10.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86b77fe640 1 -- 172.21.15.73:0/2486785577 learned_addr learned my addr 172.21.15.73:0/2486785577 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:10.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86b67fc640 1 -- 172.21.15.73:0/2486785577 >> v2:172.21.15.150:3300/0 conn(0x7f86b8073e60 msgr2=0x7f86b806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:10.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86b67fc640 1 --2- 172.21.15.73:0/2486785577 >> v2:172.21.15.150:3300/0 conn(0x7f86b8073e60 0x7f86b806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86b67fc640 1 -- 172.21.15.73:0/2486785577 >> v1:172.21.15.73:6789/0 conn(0x7f86b80b3d50 legacy=0x7f86b80b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.662+0000 7f86b67fc640 1 -- 172.21.15.73:0/2486785577 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b806f410 con 0x7f86b806fef0 2024-09-12T03:37:10.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b67fc640 1 --2- 172.21.15.73:0/2486785577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806fef0 0x7f86b815b860 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f86b8070340 tx=0x7f86ac01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9257fa2a52747171 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b5ffb640 1 -- 172.21.15.73:0/2486785577 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0b0070 con 0x7f86b806fef0 2024-09-12T03:37:10.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b5ffb640 1 -- 172.21.15.73:0/2486785577 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac0ab600 con 0x7f86b806fef0 2024-09-12T03:37:10.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b5ffb640 1 -- 172.21.15.73:0/2486785577 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0ab9d0 con 0x7f86b806fef0 2024-09-12T03:37:10.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- 172.21.15.73:0/2486785577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806fef0 msgr2=0x7f86b815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/2486785577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806fef0 0x7f86b815b860 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f86b8070340 tx=0x7f86ac01c3d0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- 172.21.15.73:0/2486785577 shutdown_connections 2024-09-12T03:37:10.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/2486785577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806fef0 0x7f86b815b860 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/2486785577 >> v2:172.21.15.150:3300/0 conn(0x7f86b8073e60 0x7f86b806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- 172.21.15.73:0/2486785577 >> 172.21.15.73:0/2486785577 conn(0x7f86b80b1f90 msgr2=0x7f86b80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:10.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- 172.21.15.73:0/2486785577 shutdown_connections 2024-09-12T03:37:10.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- 172.21.15.73:0/2486785577 wait complete. 2024-09-12T03:37:10.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 Processor -- start 2024-09-12T03:37:10.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- start start 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86b806fef0 0x7f86b8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86b8073e60 0x7f86b8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b80b3d50 0x7f86b8073420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f86b80729a0 con 0x7f86b80b3d50 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f86b8072820 con 0x7f86b806fef0 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f86b8072b20 con 0x7f86b8073e60 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b80b3d50 0x7f86b8073420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b80b3d50 0x7f86b8073420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39668/0 (socket says 172.21.15.73:39668) 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 -- 172.21.15.73:0/3495751120 learned_addr learned my addr 172.21.15.73:0/3495751120 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 -- 172.21.15.73:0/3495751120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86b8073e60 msgr2=0x7f86b8072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86b8073e60 0x7f86b8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 -- 172.21.15.73:0/3495751120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86b806fef0 msgr2=0x7f86b8154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86b806fef0 0x7f86b8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 -- 172.21.15.73:0/3495751120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b814fa60 con 0x7f86b80b3d50 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86b77fe640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b80b3d50 0x7f86b8073420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f86b000caa0 tx=0x7f86b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f869f7fe640 1 -- 172.21.15.73:0/3495751120 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0017070 con 0x7f86b80b3d50 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f869f7fe640 1 -- 172.21.15.73:0/3495751120 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b000ac00 con 0x7f86b80b3d50 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b814fd40 con 0x7f86b80b3d50 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f869f7fe640 1 -- 172.21.15.73:0/3495751120 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0012400 con 0x7f86b80b3d50 2024-09-12T03:37:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.666+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b8150300 con 0x7f86b80b3d50 2024-09-12T03:37:10.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.670+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b815b860 con 0x7f86b80b3d50 2024-09-12T03:37:10.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.670+0000 7f869f7fe640 1 -- 172.21.15.73:0/3495751120 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f86b001a070 con 0x7f86b80b3d50 2024-09-12T03:37:10.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.670+0000 7f869f7fe640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86a40678c0 0x7f86a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:10.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.670+0000 7f86b6ffd640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86a40678c0 0x7f86a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:10.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.670+0000 7f869f7fe640 1 -- 172.21.15.73:0/3495751120 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f86b0085b20 con 0x7f86b80b3d50 2024-09-12T03:37:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.670+0000 7f86b6ffd640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86a40678c0 0x7f86a4069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009730 tx=0x7f86a8006ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:10.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.674+0000 7f869f7fe640 1 -- 172.21.15.73:0/3495751120 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f86b0056560 con 0x7f86b80b3d50 2024-09-12T03:37:10.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.830+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86b8157c70 con 0x7f86a40678c0 2024-09-12T03:37:10.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.846+0000 7f869f7fe640 1 -- 172.21.15.73:0/3495751120 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250242 (secure 0 0 0) 0x7f86b8157c70 con 0x7f86a40678c0 2024-09-12T03:37:10.851 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:10.853 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:10.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86a40678c0 msgr2=0x7f86a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86a40678c0 0x7f86a4069d80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009730 tx=0x7f86a8006ca0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b80b3d50 msgr2=0x7f86b8073420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b80b3d50 0x7f86b8073420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f86b000caa0 tx=0x7f86b000cf60 comp rx=0 tx=0).stop 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 shutdown_connections 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f86a40678c0 0x7f86a4069d80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b80b3d50 0x7f86b8073420 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f86b8073e60 0x7f86b8072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 --2- 172.21.15.73:0/3495751120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86b806fef0 0x7f86b8154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 >> 172.21.15.73:0/3495751120 conn(0x7f86b80b1f90 msgr2=0x7f86b80b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 shutdown_connections 2024-09-12T03:37:10.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:10.854+0000 7f86bd3e0640 1 -- 172.21.15.73:0/3495751120 wait complete. 2024-09-12T03:37:10.871 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T03:37:09.834453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249424,"kb_used_data":8208,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725296,"statfs":{"total":773094113280,"available":772838703104,"internally_reserved":0,"allocated":8404992,"data_stored":4428247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":246795827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.387368"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490484+0000","last_change":"2024-09-12T03:37:06.514437+0000","last_active":"2024-09-12T03:37:07.490484+0000","last_peered":"2024-09-12T03:37:07.490484+0000","last_clean":"2024-09-12T03:37:07.490484+0000","last_became_active":"2024-09-12T03:37:06.513608+0000","last_became_peered":"2024-09-12T03:37:06.513608+0000","last_unstale":"2024-09-12T03:37:07.490484+0000","last_undegraded":"2024-09-12T03:37:07.490484+0000","last_fullsized":"2024-09-12T03:37:07.490484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:14.954094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463676+0000","last_change":"2024-09-12T03:37:05.463676+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463676+0000","last_undegraded":"2024-09-12T03:37:05.463676+0000","last_fullsized":"2024-09-12T03:37:05.463676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.540703+0000","last_change":"2024-09-12T03:37:06.537800+0000","last_active":"2024-09-12T03:37:06.540703+0000","last_peered":"2024-09-12T03:37:06.540703+0000","last_clean":"2024-09-12T03:37:06.540703+0000","last_became_active":"2024-09-12T03:37:06.537380+0000","last_became_peered":"2024-09-12T03:37:06.537380+0000","last_unstale":"2024-09-12T03:37:06.540703+0000","last_undegraded":"2024-09-12T03:37:06.540703+0000","last_fullsized":"2024-09-12T03:37:06.540703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:02.077400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736298+0000","last_change":"2024-09-12T03:37:06.502862+0000","last_active":"2024-09-12T03:37:07.736298+0000","last_peered":"2024-09-12T03:37:07.736298+0000","last_clean":"2024-09-12T03:37:07.736298+0000","last_became_active":"2024-09-12T03:37:06.502106+0000","last_became_peered":"2024-09-12T03:37:06.502106+0000","last_unstale":"2024-09-12T03:37:07.736298+0000","last_undegraded":"2024-09-12T03:37:07.736298+0000","last_fullsized":"2024-09-12T03:37:07.736298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525735+0000","last_change":"2024-09-12T03:37:06.510258+0000","last_active":"2024-09-12T03:37:07.525735+0000","last_peered":"2024-09-12T03:37:07.525735+0000","last_clean":"2024-09-12T03:37:07.525735+0000","last_became_active":"2024-09-12T03:37:06.509410+0000","last_became_peered":"2024-09-12T03:37:06.509410+0000","last_unstale":"2024-09-12T03:37:07.525735+0000","last_undegraded":"2024-09-12T03:37:07.525735+0000","last_fullsized":"2024-09-12T03:37:07.525735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:00.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490171+0000","last_change":"2024-09-12T03:37:06.531549+0000","last_active":"2024-09-12T03:37:07.490171+0000","last_peered":"2024-09-12T03:37:07.490171+0000","last_clean":"2024-09-12T03:37:07.490171+0000","last_became_active":"2024-09-12T03:37:06.530951+0000","last_became_peered":"2024-09-12T03:37:06.530951+0000","last_unstale":"2024-09-12T03:37:07.490171+0000","last_undegraded":"2024-09-12T03:37:07.490171+0000","last_fullsized":"2024-09-12T03:37:07.490171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:39.887489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.475592+0000","last_change":"2024-09-12T03:37:05.475592+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.475592+0000","last_undegraded":"2024-09-12T03:37:05.475592+0000","last_fullsized":"2024-09-12T03:37:05.475592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524109+0000","last_change":"2024-09-12T03:37:06.516755+0000","last_active":"2024-09-12T03:37:07.524109+0000","last_peered":"2024-09-12T03:37:07.524109+0000","last_clean":"2024-09-12T03:37:07.524109+0000","last_became_active":"2024-09-12T03:37:06.515980+0000","last_became_peered":"2024-09-12T03:37:06.515980+0000","last_unstale":"2024-09-12T03:37:07.524109+0000","last_undegraded":"2024-09-12T03:37:07.524109+0000","last_fullsized":"2024-09-12T03:37:07.524109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:11.002245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536002+0000","last_change":"2024-09-12T03:37:06.523408+0000","last_active":"2024-09-12T03:37:06.536002+0000","last_peered":"2024-09-12T03:37:06.536002+0000","last_clean":"2024-09-12T03:37:06.536002+0000","last_became_active":"2024-09-12T03:37:06.522698+0000","last_became_peered":"2024-09-12T03:37:06.522698+0000","last_unstale":"2024-09-12T03:37:06.536002+0000","last_undegraded":"2024-09-12T03:37:06.536002+0000","last_fullsized":"2024-09-12T03:37:06.536002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.051078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736249+0000","last_change":"2024-09-12T03:37:06.531047+0000","last_active":"2024-09-12T03:37:07.736249+0000","last_peered":"2024-09-12T03:37:07.736249+0000","last_clean":"2024-09-12T03:37:07.736249+0000","last_became_active":"2024-09-12T03:37:06.530313+0000","last_became_peered":"2024-09-12T03:37:06.530313+0000","last_unstale":"2024-09-12T03:37:07.736249+0000","last_undegraded":"2024-09-12T03:37:07.736249+0000","last_fullsized":"2024-09-12T03:37:07.736249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:50.907872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463757+0000","last_change":"2024-09-12T03:37:05.463757+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463757+0000","last_undegraded":"2024-09-12T03:37:05.463757+0000","last_fullsized":"2024-09-12T03:37:05.463757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736293+0000","last_change":"2024-09-12T03:37:06.527826+0000","last_active":"2024-09-12T03:37:07.736293+0000","last_peered":"2024-09-12T03:37:07.736293+0000","last_clean":"2024-09-12T03:37:07.736293+0000","last_became_active":"2024-09-12T03:37:06.527024+0000","last_became_peered":"2024-09-12T03:37:06.527024+0000","last_unstale":"2024-09-12T03:37:07.736293+0000","last_undegraded":"2024-09-12T03:37:07.736293+0000","last_fullsized":"2024-09-12T03:37:07.736293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:37.906427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525835+0000","last_change":"2024-09-12T03:37:06.520117+0000","last_active":"2024-09-12T03:37:07.525835+0000","last_peered":"2024-09-12T03:37:07.525835+0000","last_clean":"2024-09-12T03:37:07.525835+0000","last_became_active":"2024-09-12T03:37:06.519404+0000","last_became_peered":"2024-09-12T03:37:06.519404+0000","last_unstale":"2024-09-12T03:37:07.525835+0000","last_undegraded":"2024-09-12T03:37:07.525835+0000","last_fullsized":"2024-09-12T03:37:07.525835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:13.557412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490257+0000","last_change":"2024-09-12T03:37:06.531349+0000","last_active":"2024-09-12T03:37:07.490257+0000","last_peered":"2024-09-12T03:37:07.490257+0000","last_clean":"2024-09-12T03:37:07.490257+0000","last_became_active":"2024-09-12T03:37:06.530817+0000","last_became_peered":"2024-09-12T03:37:06.530817+0000","last_unstale":"2024-09-12T03:37:07.490257+0000","last_undegraded":"2024-09-12T03:37:07.490257+0000","last_fullsized":"2024-09-12T03:37:07.490257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:35.000985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463836+0000","last_change":"2024-09-12T03:37:05.463836+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463836+0000","last_undegraded":"2024-09-12T03:37:05.463836+0000","last_fullsized":"2024-09-12T03:37:05.463836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489610+0000","last_change":"2024-09-12T03:37:06.514904+0000","last_active":"2024-09-12T03:37:07.489610+0000","last_peered":"2024-09-12T03:37:07.489610+0000","last_clean":"2024-09-12T03:37:07.489610+0000","last_became_active":"2024-09-12T03:37:06.514039+0000","last_became_peered":"2024-09-12T03:37:06.514039+0000","last_unstale":"2024-09-12T03:37:07.489610+0000","last_undegraded":"2024-09-12T03:37:07.489610+0000","last_fullsized":"2024-09-12T03:37:07.489610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.632530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526403+0000","last_change":"2024-09-12T03:37:06.532098+0000","last_active":"2024-09-12T03:37:07.526403+0000","last_peered":"2024-09-12T03:37:07.526403+0000","last_clean":"2024-09-12T03:37:07.526403+0000","last_became_active":"2024-09-12T03:37:06.531862+0000","last_became_peered":"2024-09-12T03:37:06.531862+0000","last_unstale":"2024-09-12T03:37:07.526403+0000","last_undegraded":"2024-09-12T03:37:07.526403+0000","last_fullsized":"2024-09-12T03:37:07.526403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.841005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.510047+0000","last_change":"2024-09-12T03:37:06.504175+0000","last_active":"2024-09-12T03:37:06.510047+0000","last_peered":"2024-09-12T03:37:06.510047+0000","last_clean":"2024-09-12T03:37:06.510047+0000","last_became_active":"2024-09-12T03:37:06.503252+0000","last_became_peered":"2024-09-12T03:37:06.503252+0000","last_unstale":"2024-09-12T03:37:06.510047+0000","last_undegraded":"2024-09-12T03:37:06.510047+0000","last_fullsized":"2024-09-12T03:37:06.510047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:07.426916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490185+0000","last_change":"2024-09-12T03:37:06.522629+0000","last_active":"2024-09-12T03:37:07.490185+0000","last_peered":"2024-09-12T03:37:07.490185+0000","last_clean":"2024-09-12T03:37:07.490185+0000","last_became_active":"2024-09-12T03:37:06.522349+0000","last_became_peered":"2024-09-12T03:37:06.522349+0000","last_unstale":"2024-09-12T03:37:07.490185+0000","last_undegraded":"2024-09-12T03:37:07.490185+0000","last_fullsized":"2024-09-12T03:37:07.490185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:18.204607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525939+0000","last_change":"2024-09-12T03:37:06.505805+0000","last_active":"2024-09-12T03:37:07.525939+0000","last_peered":"2024-09-12T03:37:07.525939+0000","last_clean":"2024-09-12T03:37:07.525939+0000","last_became_active":"2024-09-12T03:37:06.504970+0000","last_became_peered":"2024-09-12T03:37:06.504970+0000","last_unstale":"2024-09-12T03:37:07.525939+0000","last_undegraded":"2024-09-12T03:37:07.525939+0000","last_fullsized":"2024-09-12T03:37:07.525939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:33.899192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509640+0000","last_change":"2024-09-12T03:37:06.500401+0000","last_active":"2024-09-12T03:37:06.509640+0000","last_peered":"2024-09-12T03:37:06.509640+0000","last_clean":"2024-09-12T03:37:06.509640+0000","last_became_active":"2024-09-12T03:37:06.499636+0000","last_became_peered":"2024-09-12T03:37:06.499636+0000","last_unstale":"2024-09-12T03:37:06.509640+0000","last_undegraded":"2024-09-12T03:37:06.509640+0000","last_fullsized":"2024-09-12T03:37:06.509640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:28.462827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524890+0000","last_change":"2024-09-12T03:37:06.543601+0000","last_active":"2024-09-12T03:37:07.524890+0000","last_peered":"2024-09-12T03:37:07.524890+0000","last_clean":"2024-09-12T03:37:07.524890+0000","last_became_active":"2024-09-12T03:37:06.542384+0000","last_became_peered":"2024-09-12T03:37:06.542384+0000","last_unstale":"2024-09-12T03:37:07.524890+0000","last_undegraded":"2024-09-12T03:37:07.524890+0000","last_fullsized":"2024-09-12T03:37:07.524890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.149213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.499591+0000","last_change":"2024-09-12T03:37:06.497773+0000","last_active":"2024-09-12T03:37:06.499591+0000","last_peered":"2024-09-12T03:37:06.499591+0000","last_clean":"2024-09-12T03:37:06.499591+0000","last_became_active":"2024-09-12T03:37:06.496867+0000","last_became_peered":"2024-09-12T03:37:06.496867+0000","last_unstale":"2024-09-12T03:37:06.499591+0000","last_undegraded":"2024-09-12T03:37:06.499591+0000","last_fullsized":"2024-09-12T03:37:06.499591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.164141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464286+0000","last_change":"2024-09-12T03:37:05.464286+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464286+0000","last_undegraded":"2024-09-12T03:37:05.464286+0000","last_fullsized":"2024-09-12T03:37:05.464286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461931+0000","last_change":"2024-09-12T03:37:05.461931+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461931+0000","last_undegraded":"2024-09-12T03:37:05.461931+0000","last_fullsized":"2024-09-12T03:37:05.461931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736116+0000","last_change":"2024-09-12T03:37:06.527918+0000","last_active":"2024-09-12T03:37:07.736116+0000","last_peered":"2024-09-12T03:37:07.736116+0000","last_clean":"2024-09-12T03:37:07.736116+0000","last_became_active":"2024-09-12T03:37:06.527243+0000","last_became_peered":"2024-09-12T03:37:06.527243+0000","last_unstale":"2024-09-12T03:37:07.736116+0000","last_undegraded":"2024-09-12T03:37:07.736116+0000","last_fullsized":"2024-09-12T03:37:07.736116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:32.967011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489935+0000","last_change":"2024-09-12T03:37:06.513491+0000","last_active":"2024-09-12T03:37:07.489935+0000","last_peered":"2024-09-12T03:37:07.489935+0000","last_clean":"2024-09-12T03:37:07.489935+0000","last_became_active":"2024-09-12T03:37:06.508794+0000","last_became_peered":"2024-09-12T03:37:06.508794+0000","last_unstale":"2024-09-12T03:37:07.489935+0000","last_undegraded":"2024-09-12T03:37:07.489935+0000","last_fullsized":"2024-09-12T03:37:07.489935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.834025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526079+0000","last_change":"2024-09-12T03:37:06.493731+0000","last_active":"2024-09-12T03:37:07.526079+0000","last_peered":"2024-09-12T03:37:07.526079+0000","last_clean":"2024-09-12T03:37:07.526079+0000","last_became_active":"2024-09-12T03:37:06.492963+0000","last_became_peered":"2024-09-12T03:37:06.492963+0000","last_unstale":"2024-09-12T03:37:07.526079+0000","last_undegraded":"2024-09-12T03:37:07.526079+0000","last_fullsized":"2024-09-12T03:37:07.526079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:40.752488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.462360+0000","last_change":"2024-09-12T03:37:05.462360+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.462360+0000","last_undegraded":"2024-09-12T03:37:05.462360+0000","last_fullsized":"2024-09-12T03:37:05.462360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489520+0000","last_change":"2024-09-12T03:37:06.538257+0000","last_active":"2024-09-12T03:37:07.489520+0000","last_peered":"2024-09-12T03:37:07.489520+0000","last_clean":"2024-09-12T03:37:07.489520+0000","last_became_active":"2024-09-12T03:37:06.537464+0000","last_became_peered":"2024-09-12T03:37:06.537464+0000","last_unstale":"2024-09-12T03:37:07.489520+0000","last_undegraded":"2024-09-12T03:37:07.489520+0000","last_fullsized":"2024-09-12T03:37:07.489520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:47.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537849+0000","last_change":"2024-09-12T03:37:06.529226+0000","last_active":"2024-09-12T03:37:06.537849+0000","last_peered":"2024-09-12T03:37:06.537849+0000","last_clean":"2024-09-12T03:37:06.537849+0000","last_became_active":"2024-09-12T03:37:06.528961+0000","last_became_peered":"2024-09-12T03:37:06.528961+0000","last_unstale":"2024-09-12T03:37:06.537849+0000","last_undegraded":"2024-09-12T03:37:06.537849+0000","last_fullsized":"2024-09-12T03:37:06.537849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:29.822067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490040+0000","last_change":"2024-09-12T03:37:06.520303+0000","last_active":"2024-09-12T03:37:07.490040+0000","last_peered":"2024-09-12T03:37:07.490040+0000","last_clean":"2024-09-12T03:37:07.490040+0000","last_became_active":"2024-09-12T03:37:06.514601+0000","last_became_peered":"2024-09-12T03:37:06.514601+0000","last_unstale":"2024-09-12T03:37:07.490040+0000","last_undegraded":"2024-09-12T03:37:07.490040+0000","last_fullsized":"2024-09-12T03:37:07.490040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:02.773931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509950+0000","last_change":"2024-09-12T03:37:06.503918+0000","last_active":"2024-09-12T03:37:06.509950+0000","last_peered":"2024-09-12T03:37:06.509950+0000","last_clean":"2024-09-12T03:37:06.509950+0000","last_became_active":"2024-09-12T03:37:06.503138+0000","last_became_peered":"2024-09-12T03:37:06.503138+0000","last_unstale":"2024-09-12T03:37:06.509950+0000","last_undegraded":"2024-09-12T03:37:06.509950+0000","last_fullsized":"2024-09-12T03:37:06.509950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:12.810601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526469+0000","last_change":"2024-09-12T03:37:05.472634+0000","last_active":"2024-09-12T03:37:07.526469+0000","last_peered":"2024-09-12T03:37:07.526469+0000","last_clean":"2024-09-12T03:37:07.526469+0000","last_became_active":"2024-09-12T03:37:05.472206+0000","last_became_peered":"2024-09-12T03:37:05.472206+0000","last_unstale":"2024-09-12T03:37:07.526469+0000","last_undegraded":"2024-09-12T03:37:07.526469+0000","last_fullsized":"2024-09-12T03:37:07.526469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:29.832710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461497+0000","last_change":"2024-09-12T03:37:05.461497+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461497+0000","last_undegraded":"2024-09-12T03:37:05.461497+0000","last_fullsized":"2024-09-12T03:37:05.461497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490508+0000","last_change":"2024-09-12T03:37:05.500119+0000","last_active":"2024-09-12T03:37:07.490508+0000","last_peered":"2024-09-12T03:37:07.490508+0000","last_clean":"2024-09-12T03:37:07.490508+0000","last_became_active":"2024-09-12T03:37:05.499397+0000","last_became_peered":"2024-09-12T03:37:05.499397+0000","last_unstale":"2024-09-12T03:37:07.490508+0000","last_undegraded":"2024-09-12T03:37:07.490508+0000","last_fullsized":"2024-09-12T03:37:07.490508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:49.894769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.543034+0000","last_change":"2024-09-12T03:37:06.533084+0000","last_active":"2024-09-12T03:37:06.543034+0000","last_peered":"2024-09-12T03:37:06.543034+0000","last_clean":"2024-09-12T03:37:06.543034+0000","last_became_active":"2024-09-12T03:37:06.532362+0000","last_became_peered":"2024-09-12T03:37:06.532362+0000","last_unstale":"2024-09-12T03:37:06.543034+0000","last_undegraded":"2024-09-12T03:37:06.543034+0000","last_fullsized":"2024-09-12T03:37:06.543034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:51.545805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490159+0000","last_change":"2024-09-12T03:37:05.503226+0000","last_active":"2024-09-12T03:37:07.490159+0000","last_peered":"2024-09-12T03:37:07.490159+0000","last_clean":"2024-09-12T03:37:07.490159+0000","last_became_active":"2024-09-12T03:37:05.499243+0000","last_became_peered":"2024-09-12T03:37:05.499243+0000","last_unstale":"2024-09-12T03:37:07.490159+0000","last_undegraded":"2024-09-12T03:37:07.490159+0000","last_fullsized":"2024-09-12T03:37:07.490159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:31.953907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509254+0000","last_change":"2024-09-12T03:37:06.500139+0000","last_active":"2024-09-12T03:37:06.509254+0000","last_peered":"2024-09-12T03:37:06.509254+0000","last_clean":"2024-09-12T03:37:06.509254+0000","last_became_active":"2024-09-12T03:37:06.498715+0000","last_became_peered":"2024-09-12T03:37:06.498715+0000","last_unstale":"2024-09-12T03:37:06.509254+0000","last_undegraded":"2024-09-12T03:37:06.509254+0000","last_fullsized":"2024-09-12T03:37:06.509254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:54.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.502121+0000","last_change":"2024-09-12T03:37:05.499938+0000","last_active":"2024-09-12T03:37:05.502121+0000","last_peered":"2024-09-12T03:37:05.502121+0000","last_clean":"2024-09-12T03:37:05.502121+0000","last_became_active":"2024-09-12T03:37:05.499502+0000","last_became_peered":"2024-09-12T03:37:05.499502+0000","last_unstale":"2024-09-12T03:37:05.502121+0000","last_undegraded":"2024-09-12T03:37:05.502121+0000","last_fullsized":"2024-09-12T03:37:05.502121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:00.462693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463663+0000","last_change":"2024-09-12T03:37:05.463663+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463663+0000","last_undegraded":"2024-09-12T03:37:05.463663+0000","last_fullsized":"2024-09-12T03:37:05.463663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.548588+0000","last_change":"2024-09-12T03:37:05.494187+0000","last_active":"2024-09-12T03:37:06.548588+0000","last_peered":"2024-09-12T03:37:06.548588+0000","last_clean":"2024-09-12T03:37:06.548588+0000","last_became_active":"2024-09-12T03:37:05.493427+0000","last_became_peered":"2024-09-12T03:37:05.493427+0000","last_unstale":"2024-09-12T03:37:06.548588+0000","last_undegraded":"2024-09-12T03:37:06.548588+0000","last_fullsized":"2024-09-12T03:37:06.548588+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.568721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461977+0000","last_change":"2024-09-12T03:37:05.461977+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461977+0000","last_undegraded":"2024-09-12T03:37:05.461977+0000","last_fullsized":"2024-09-12T03:37:05.461977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735804+0000","last_change":"2024-09-12T03:37:05.475494+0000","last_active":"2024-09-12T03:37:07.735804+0000","last_peered":"2024-09-12T03:37:07.735804+0000","last_clean":"2024-09-12T03:37:07.735804+0000","last_became_active":"2024-09-12T03:37:05.474778+0000","last_became_peered":"2024-09-12T03:37:05.474778+0000","last_unstale":"2024-09-12T03:37:07.735804+0000","last_undegraded":"2024-09-12T03:37:07.735804+0000","last_fullsized":"2024-09-12T03:37:07.735804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.185281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536045+0000","last_change":"2024-09-12T03:37:06.523174+0000","last_active":"2024-09-12T03:37:06.536045+0000","last_peered":"2024-09-12T03:37:06.536045+0000","last_clean":"2024-09-12T03:37:06.536045+0000","last_became_active":"2024-09-12T03:37:06.522469+0000","last_became_peered":"2024-09-12T03:37:06.522469+0000","last_unstale":"2024-09-12T03:37:06.536045+0000","last_undegraded":"2024-09-12T03:37:06.536045+0000","last_fullsized":"2024-09-12T03:37:06.536045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:51.550177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.493779+0000","last_change":"2024-09-12T03:37:05.493173+0000","last_active":"2024-09-12T03:37:05.493779+0000","last_peered":"2024-09-12T03:37:05.493779+0000","last_clean":"2024-09-12T03:37:05.493779+0000","last_became_active":"2024-09-12T03:37:05.492841+0000","last_became_peered":"2024-09-12T03:37:05.492841+0000","last_unstale":"2024-09-12T03:37:05.493779+0000","last_undegraded":"2024-09-12T03:37:05.493779+0000","last_fullsized":"2024-09-12T03:37:05.493779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:05.221145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.465212+0000","last_change":"2024-09-12T03:37:05.465212+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.465212+0000","last_undegraded":"2024-09-12T03:37:05.465212+0000","last_fullsized":"2024-09-12T03:37:05.465212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524122+0000","last_change":"2024-09-12T03:37:05.481678+0000","last_active":"2024-09-12T03:37:07.524122+0000","last_peered":"2024-09-12T03:37:07.524122+0000","last_clean":"2024-09-12T03:37:07.524122+0000","last_became_active":"2024-09-12T03:37:05.481386+0000","last_became_peered":"2024-09-12T03:37:05.481386+0000","last_unstale":"2024-09-12T03:37:07.524122+0000","last_undegraded":"2024-09-12T03:37:07.524122+0000","last_fullsized":"2024-09-12T03:37:07.524122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.008960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461373+0000","last_change":"2024-09-12T03:37:05.461373+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461373+0000","last_undegraded":"2024-09-12T03:37:05.461373+0000","last_fullsized":"2024-09-12T03:37:05.461373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490322+0000","last_change":"2024-09-12T03:37:05.502676+0000","last_active":"2024-09-12T03:37:07.490322+0000","last_peered":"2024-09-12T03:37:07.490322+0000","last_clean":"2024-09-12T03:37:07.490322+0000","last_became_active":"2024-09-12T03:37:05.500422+0000","last_became_peered":"2024-09-12T03:37:05.500422+0000","last_unstale":"2024-09-12T03:37:07.490322+0000","last_undegraded":"2024-09-12T03:37:07.490322+0000","last_fullsized":"2024-09-12T03:37:07.490322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.951815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736193+0000","last_change":"2024-09-12T03:37:06.503404+0000","last_active":"2024-09-12T03:37:07.736193+0000","last_peered":"2024-09-12T03:37:07.736193+0000","last_clean":"2024-09-12T03:37:07.736193+0000","last_became_active":"2024-09-12T03:37:06.501502+0000","last_became_peered":"2024-09-12T03:37:06.501502+0000","last_unstale":"2024-09-12T03:37:07.736193+0000","last_undegraded":"2024-09-12T03:37:07.736193+0000","last_fullsized":"2024-09-12T03:37:07.736193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:44.036902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736206+0000","last_change":"2024-09-12T03:37:05.484198+0000","last_active":"2024-09-12T03:37:07.736206+0000","last_peered":"2024-09-12T03:37:07.736206+0000","last_clean":"2024-09-12T03:37:07.736206+0000","last_became_active":"2024-09-12T03:37:05.483437+0000","last_became_peered":"2024-09-12T03:37:05.483437+0000","last_unstale":"2024-09-12T03:37:07.736206+0000","last_undegraded":"2024-09-12T03:37:07.736206+0000","last_fullsized":"2024-09-12T03:37:07.736206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:57.022689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490642+0000","last_change":"2024-09-12T03:37:06.531132+0000","last_active":"2024-09-12T03:37:07.490642+0000","last_peered":"2024-09-12T03:37:07.490642+0000","last_clean":"2024-09-12T03:37:07.490642+0000","last_became_active":"2024-09-12T03:37:06.530579+0000","last_became_peered":"2024-09-12T03:37:06.530579+0000","last_unstale":"2024-09-12T03:37:07.490642+0000","last_undegraded":"2024-09-12T03:37:07.490642+0000","last_fullsized":"2024-09-12T03:37:07.490642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526095+0000","last_change":"2024-09-12T03:37:05.467252+0000","last_active":"2024-09-12T03:37:07.526095+0000","last_peered":"2024-09-12T03:37:07.526095+0000","last_clean":"2024-09-12T03:37:07.526095+0000","last_became_active":"2024-09-12T03:37:05.466976+0000","last_became_peered":"2024-09-12T03:37:05.466976+0000","last_unstale":"2024-09-12T03:37:07.526095+0000","last_undegraded":"2024-09-12T03:37:07.526095+0000","last_fullsized":"2024-09-12T03:37:07.526095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:52.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537737+0000","last_change":"2024-09-12T03:37:06.532029+0000","last_active":"2024-09-12T03:37:06.537737+0000","last_peered":"2024-09-12T03:37:06.537737+0000","last_clean":"2024-09-12T03:37:06.537737+0000","last_became_active":"2024-09-12T03:37:06.531754+0000","last_became_peered":"2024-09-12T03:37:06.531754+0000","last_unstale":"2024-09-12T03:37:06.537737+0000","last_undegraded":"2024-09-12T03:37:06.537737+0000","last_fullsized":"2024-09-12T03:37:06.537737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:34.296632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.491781+0000","last_change":"2024-09-12T03:37:05.486509+0000","last_active":"2024-09-12T03:37:05.491781+0000","last_peered":"2024-09-12T03:37:05.491781+0000","last_clean":"2024-09-12T03:37:05.491781+0000","last_became_active":"2024-09-12T03:37:05.485863+0000","last_became_peered":"2024-09-12T03:37:05.485863+0000","last_unstale":"2024-09-12T03:37:05.491781+0000","last_undegraded":"2024-09-12T03:37:05.491781+0000","last_fullsized":"2024-09-12T03:37:05.491781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:17.964169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736503+0000","last_change":"2024-09-12T03:37:06.524797+0000","last_active":"2024-09-12T03:37:07.736503+0000","last_peered":"2024-09-12T03:37:07.736503+0000","last_clean":"2024-09-12T03:37:07.736503+0000","last_became_active":"2024-09-12T03:37:06.524051+0000","last_became_peered":"2024-09-12T03:37:06.524051+0000","last_unstale":"2024-09-12T03:37:07.736503+0000","last_undegraded":"2024-09-12T03:37:07.736503+0000","last_fullsized":"2024-09-12T03:37:07.736503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735820+0000","last_change":"2024-09-12T03:37:05.484324+0000","last_active":"2024-09-12T03:37:07.735820+0000","last_peered":"2024-09-12T03:37:07.735820+0000","last_clean":"2024-09-12T03:37:07.735820+0000","last_became_active":"2024-09-12T03:37:05.483498+0000","last_became_peered":"2024-09-12T03:37:05.483498+0000","last_unstale":"2024-09-12T03:37:07.735820+0000","last_undegraded":"2024-09-12T03:37:07.735820+0000","last_fullsized":"2024-09-12T03:37:07.735820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.465918+0000","last_change":"2024-09-12T03:37:05.465918+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.465918+0000","last_undegraded":"2024-09-12T03:37:05.465918+0000","last_fullsized":"2024-09-12T03:37:05.465918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489421+0000","last_change":"2024-09-12T03:37:05.500057+0000","last_active":"2024-09-12T03:37:07.489421+0000","last_peered":"2024-09-12T03:37:07.489421+0000","last_clean":"2024-09-12T03:37:07.489421+0000","last_became_active":"2024-09-12T03:37:05.499311+0000","last_became_peered":"2024-09-12T03:37:05.499311+0000","last_unstale":"2024-09-12T03:37:07.489421+0000","last_undegraded":"2024-09-12T03:37:07.489421+0000","last_fullsized":"2024-09-12T03:37:07.489421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:29.673134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.462036+0000","last_change":"2024-09-12T03:37:05.462036+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.462036+0000","last_undegraded":"2024-09-12T03:37:05.462036+0000","last_fullsized":"2024-09-12T03:37:05.462036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524346+0000","last_change":"2024-09-12T03:37:05.473264+0000","last_active":"2024-09-12T03:37:07.524346+0000","last_peered":"2024-09-12T03:37:07.524346+0000","last_clean":"2024-09-12T03:37:07.524346+0000","last_became_active":"2024-09-12T03:37:05.472961+0000","last_became_peered":"2024-09-12T03:37:05.472961+0000","last_unstale":"2024-09-12T03:37:07.524346+0000","last_undegraded":"2024-09-12T03:37:07.524346+0000","last_fullsized":"2024-09-12T03:37:07.524346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:08.526759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464140+0000","last_change":"2024-09-12T03:37:05.464140+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464140+0000","last_undegraded":"2024-09-12T03:37:05.464140+0000","last_fullsized":"2024-09-12T03:37:05.464140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.489884+0000","last_change":"2024-09-12T03:37:05.487121+0000","last_active":"2024-09-12T03:37:05.489884+0000","last_peered":"2024-09-12T03:37:05.489884+0000","last_clean":"2024-09-12T03:37:05.489884+0000","last_became_active":"2024-09-12T03:37:05.486606+0000","last_became_peered":"2024-09-12T03:37:05.486606+0000","last_unstale":"2024-09-12T03:37:05.489884+0000","last_undegraded":"2024-09-12T03:37:05.489884+0000","last_fullsized":"2024-09-12T03:37:05.489884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:22.110425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489543+0000","last_change":"2024-09-12T03:37:06.523220+0000","last_active":"2024-09-12T03:37:07.489543+0000","last_peered":"2024-09-12T03:37:07.489543+0000","last_clean":"2024-09-12T03:37:07.489543+0000","last_became_active":"2024-09-12T03:37:06.522654+0000","last_became_peered":"2024-09-12T03:37:06.522654+0000","last_unstale":"2024-09-12T03:37:07.489543+0000","last_undegraded":"2024-09-12T03:37:07.489543+0000","last_fullsized":"2024-09-12T03:37:07.489543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490664+0000","last_change":"2024-09-12T03:37:05.504584+0000","last_active":"2024-09-12T03:37:07.490664+0000","last_peered":"2024-09-12T03:37:07.490664+0000","last_clean":"2024-09-12T03:37:07.490664+0000","last_became_active":"2024-09-12T03:37:05.504027+0000","last_became_peered":"2024-09-12T03:37:05.504027+0000","last_unstale":"2024-09-12T03:37:07.490664+0000","last_undegraded":"2024-09-12T03:37:07.490664+0000","last_fullsized":"2024-09-12T03:37:07.490664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:36.893323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524199+0000","last_change":"2024-09-12T03:37:06.529939+0000","last_active":"2024-09-12T03:37:07.524199+0000","last_peered":"2024-09-12T03:37:07.524199+0000","last_clean":"2024-09-12T03:37:07.524199+0000","last_became_active":"2024-09-12T03:37:06.529695+0000","last_became_peered":"2024-09-12T03:37:06.529695+0000","last_unstale":"2024-09-12T03:37:07.524199+0000","last_undegraded":"2024-09-12T03:37:07.524199+0000","last_fullsized":"2024-09-12T03:37:07.524199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:31.343811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.547797+0000","last_change":"2024-09-12T03:37:05.482266+0000","last_active":"2024-09-12T03:37:06.547797+0000","last_peered":"2024-09-12T03:37:06.547797+0000","last_clean":"2024-09-12T03:37:06.547797+0000","last_became_active":"2024-09-12T03:37:05.481642+0000","last_became_peered":"2024-09-12T03:37:05.481642+0000","last_unstale":"2024-09-12T03:37:06.547797+0000","last_undegraded":"2024-09-12T03:37:06.547797+0000","last_fullsized":"2024-09-12T03:37:06.547797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:45.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525240+0000","last_change":"2024-09-12T03:37:06.513529+0000","last_active":"2024-09-12T03:37:07.525240+0000","last_peered":"2024-09-12T03:37:07.525240+0000","last_clean":"2024-09-12T03:37:07.525240+0000","last_became_active":"2024-09-12T03:37:06.512794+0000","last_became_peered":"2024-09-12T03:37:06.512794+0000","last_unstale":"2024-09-12T03:37:07.525240+0000","last_undegraded":"2024-09-12T03:37:07.525240+0000","last_fullsized":"2024-09-12T03:37:07.525240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:44.645938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526174+0000","last_change":"2024-09-12T03:37:05.482661+0000","last_active":"2024-09-12T03:37:07.526174+0000","last_peered":"2024-09-12T03:37:07.526174+0000","last_clean":"2024-09-12T03:37:07.526174+0000","last_became_active":"2024-09-12T03:37:05.482383+0000","last_became_peered":"2024-09-12T03:37:05.482383+0000","last_unstale":"2024-09-12T03:37:07.526174+0000","last_undegraded":"2024-09-12T03:37:07.526174+0000","last_fullsized":"2024-09-12T03:37:07.526174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:10.781273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489983+0000","last_change":"2024-09-12T03:37:06.524850+0000","last_active":"2024-09-12T03:37:07.489983+0000","last_peered":"2024-09-12T03:37:07.489983+0000","last_clean":"2024-09-12T03:37:07.489983+0000","last_became_active":"2024-09-12T03:37:06.524667+0000","last_became_peered":"2024-09-12T03:37:06.524667+0000","last_unstale":"2024-09-12T03:37:07.489983+0000","last_undegraded":"2024-09-12T03:37:07.489983+0000","last_fullsized":"2024-09-12T03:37:07.489983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:52.329645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.497387+0000","last_change":"2024-09-12T03:37:05.473843+0000","last_active":"2024-09-12T03:37:06.497387+0000","last_peered":"2024-09-12T03:37:06.497387+0000","last_clean":"2024-09-12T03:37:06.497387+0000","last_became_active":"2024-09-12T03:37:05.473434+0000","last_became_peered":"2024-09-12T03:37:05.473434+0000","last_unstale":"2024-09-12T03:37:06.497387+0000","last_undegraded":"2024-09-12T03:37:06.497387+0000","last_fullsized":"2024-09-12T03:37:06.497387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:03.854469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460985+0000","last_change":"2024-09-12T03:37:05.460985+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460985+0000","last_undegraded":"2024-09-12T03:37:05.460985+0000","last_fullsized":"2024-09-12T03:37:05.460985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489811+0000","last_change":"2024-09-12T03:37:05.468431+0000","last_active":"2024-09-12T03:37:07.489811+0000","last_peered":"2024-09-12T03:37:07.489811+0000","last_clean":"2024-09-12T03:37:07.489811+0000","last_became_active":"2024-09-12T03:37:05.467975+0000","last_became_peered":"2024-09-12T03:37:05.467975+0000","last_unstale":"2024-09-12T03:37:07.489811+0000","last_undegraded":"2024-09-12T03:37:07.489811+0000","last_fullsized":"2024-09-12T03:37:07.489811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:45.853956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460553+0000","last_change":"2024-09-12T03:37:05.460553+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460553+0000","last_undegraded":"2024-09-12T03:37:05.460553+0000","last_fullsized":"2024-09-12T03:37:05.460553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489828+0000","last_change":"2024-09-12T03:37:05.486564+0000","last_active":"2024-09-12T03:37:07.489828+0000","last_peered":"2024-09-12T03:37:07.489828+0000","last_clean":"2024-09-12T03:37:07.489828+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.489828+0000","last_undegraded":"2024-09-12T03:37:07.489828+0000","last_fullsized":"2024-09-12T03:37:07.489828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:15.007890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463213+0000","last_change":"2024-09-12T03:37:05.463213+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463213+0000","last_undegraded":"2024-09-12T03:37:05.463213+0000","last_fullsized":"2024-09-12T03:37:05.463213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489733+0000","last_change":"2024-09-12T03:37:05.486727+0000","last_active":"2024-09-12T03:37:07.489733+0000","last_peered":"2024-09-12T03:37:07.489733+0000","last_clean":"2024-09-12T03:37:07.489733+0000","last_became_active":"2024-09-12T03:37:05.486147+0000","last_became_peered":"2024-09-12T03:37:05.486147+0000","last_unstale":"2024-09-12T03:37:07.489733+0000","last_undegraded":"2024-09-12T03:37:07.489733+0000","last_fullsized":"2024-09-12T03:37:07.489733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.039642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542699+0000","last_change":"2024-09-12T03:37:06.529021+0000","last_active":"2024-09-12T03:37:06.542699+0000","last_peered":"2024-09-12T03:37:06.542699+0000","last_clean":"2024-09-12T03:37:06.542699+0000","last_became_active":"2024-09-12T03:37:06.528314+0000","last_became_peered":"2024-09-12T03:37:06.528314+0000","last_unstale":"2024-09-12T03:37:06.542699+0000","last_undegraded":"2024-09-12T03:37:06.542699+0000","last_fullsized":"2024-09-12T03:37:06.542699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:18.263844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735928+0000","last_change":"2024-09-12T03:37:05.468166+0000","last_active":"2024-09-12T03:37:07.735928+0000","last_peered":"2024-09-12T03:37:07.735928+0000","last_clean":"2024-09-12T03:37:07.735928+0000","last_became_active":"2024-09-12T03:37:05.467379+0000","last_became_peered":"2024-09-12T03:37:05.467379+0000","last_unstale":"2024-09-12T03:37:07.735928+0000","last_undegraded":"2024-09-12T03:37:07.735928+0000","last_fullsized":"2024-09-12T03:37:07.735928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:19.886719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.469142+0000","last_change":"2024-09-12T03:37:05.469142+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.469142+0000","last_undegraded":"2024-09-12T03:37:05.469142+0000","last_fullsized":"2024-09-12T03:37:05.469142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.474190+0000","last_change":"2024-09-12T03:37:05.469039+0000","last_active":"2024-09-12T03:37:05.474190+0000","last_peered":"2024-09-12T03:37:05.474190+0000","last_clean":"2024-09-12T03:37:05.474190+0000","last_became_active":"2024-09-12T03:37:05.468116+0000","last_became_peered":"2024-09-12T03:37:05.468116+0000","last_unstale":"2024-09-12T03:37:05.474190+0000","last_undegraded":"2024-09-12T03:37:05.474190+0000","last_fullsized":"2024-09-12T03:37:05.474190+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:10.018840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542992+0000","last_change":"2024-09-12T03:37:06.532084+0000","last_active":"2024-09-12T03:37:06.542992+0000","last_peered":"2024-09-12T03:37:06.542992+0000","last_clean":"2024-09-12T03:37:06.542992+0000","last_became_active":"2024-09-12T03:37:06.531460+0000","last_became_peered":"2024-09-12T03:37:06.531460+0000","last_unstale":"2024-09-12T03:37:06.542992+0000","last_undegraded":"2024-09-12T03:37:06.542992+0000","last_fullsized":"2024-09-12T03:37:06.542992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.111098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490457+0000","last_change":"2024-09-12T03:37:05.504695+0000","last_active":"2024-09-12T03:37:07.490457+0000","last_peered":"2024-09-12T03:37:07.490457+0000","last_clean":"2024-09-12T03:37:07.490457+0000","last_became_active":"2024-09-12T03:37:05.503970+0000","last_became_peered":"2024-09-12T03:37:05.503970+0000","last_unstale":"2024-09-12T03:37:07.490457+0000","last_undegraded":"2024-09-12T03:37:07.490457+0000","last_fullsized":"2024-09-12T03:37:07.490457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460703+0000","last_change":"2024-09-12T03:37:05.460703+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460703+0000","last_undegraded":"2024-09-12T03:37:05.460703+0000","last_fullsized":"2024-09-12T03:37:05.460703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489771+0000","last_change":"2024-09-12T03:37:05.502764+0000","last_active":"2024-09-12T03:37:07.489771+0000","last_peered":"2024-09-12T03:37:07.489771+0000","last_clean":"2024-09-12T03:37:07.489771+0000","last_became_active":"2024-09-12T03:37:05.499370+0000","last_became_peered":"2024-09-12T03:37:05.499370+0000","last_unstale":"2024-09-12T03:37:07.489771+0000","last_undegraded":"2024-09-12T03:37:07.489771+0000","last_fullsized":"2024-09-12T03:37:07.489771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:32.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.468071+0000","last_change":"2024-09-12T03:37:05.468071+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.468071+0000","last_undegraded":"2024-09-12T03:37:05.468071+0000","last_fullsized":"2024-09-12T03:37:05.468071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.501138+0000","last_change":"2024-09-12T03:37:05.496667+0000","last_active":"2024-09-12T03:37:05.501138+0000","last_peered":"2024-09-12T03:37:05.501138+0000","last_clean":"2024-09-12T03:37:05.501138+0000","last_became_active":"2024-09-12T03:37:05.493460+0000","last_became_peered":"2024-09-12T03:37:05.493460+0000","last_unstale":"2024-09-12T03:37:05.501138+0000","last_undegraded":"2024-09-12T03:37:05.501138+0000","last_fullsized":"2024-09-12T03:37:05.501138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:15.747603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464786+0000","last_change":"2024-09-12T03:37:05.464786+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464786+0000","last_undegraded":"2024-09-12T03:37:05.464786+0000","last_fullsized":"2024-09-12T03:37:05.464786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525488+0000","last_change":"2024-09-12T03:37:05.473252+0000","last_active":"2024-09-12T03:37:07.525488+0000","last_peered":"2024-09-12T03:37:07.525488+0000","last_clean":"2024-09-12T03:37:07.525488+0000","last_became_active":"2024-09-12T03:37:05.472943+0000","last_became_peered":"2024-09-12T03:37:05.472943+0000","last_unstale":"2024-09-12T03:37:07.525488+0000","last_undegraded":"2024-09-12T03:37:07.525488+0000","last_fullsized":"2024-09-12T03:37:07.525488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.445282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.533602+0000","last_change":"2024-09-12T03:37:06.527704+0000","last_active":"2024-09-12T03:37:06.533602+0000","last_peered":"2024-09-12T03:37:06.533602+0000","last_clean":"2024-09-12T03:37:06.533602+0000","last_became_active":"2024-09-12T03:37:06.527397+0000","last_became_peered":"2024-09-12T03:37:06.527397+0000","last_unstale":"2024-09-12T03:37:06.533602+0000","last_undegraded":"2024-09-12T03:37:06.533602+0000","last_fullsized":"2024-09-12T03:37:06.533602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:48.117214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.491340+0000","last_change":"2024-09-12T03:37:05.485037+0000","last_active":"2024-09-12T03:37:05.491340+0000","last_peered":"2024-09-12T03:37:05.491340+0000","last_clean":"2024-09-12T03:37:05.491340+0000","last_became_active":"2024-09-12T03:37:05.480275+0000","last_became_peered":"2024-09-12T03:37:05.480275+0000","last_unstale":"2024-09-12T03:37:05.491340+0000","last_undegraded":"2024-09-12T03:37:05.491340+0000","last_fullsized":"2024-09-12T03:37:05.491340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:04.169799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.522903+0000","last_change":"2024-09-12T03:37:06.520045+0000","last_active":"2024-09-12T03:37:06.522903+0000","last_peered":"2024-09-12T03:37:06.522903+0000","last_clean":"2024-09-12T03:37:06.522903+0000","last_became_active":"2024-09-12T03:37:06.519644+0000","last_became_peered":"2024-09-12T03:37:06.519644+0000","last_unstale":"2024-09-12T03:37:06.522903+0000","last_undegraded":"2024-09-12T03:37:06.522903+0000","last_fullsized":"2024-09-12T03:37:06.522903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:33.320891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.496993+0000","last_change":"2024-09-12T03:37:05.476302+0000","last_active":"2024-09-12T03:37:06.496993+0000","last_peered":"2024-09-12T03:37:06.496993+0000","last_clean":"2024-09-12T03:37:06.496993+0000","last_became_active":"2024-09-12T03:37:05.476014+0000","last_became_peered":"2024-09-12T03:37:05.476014+0000","last_unstale":"2024-09-12T03:37:06.496993+0000","last_undegraded":"2024-09-12T03:37:06.496993+0000","last_fullsized":"2024-09-12T03:37:06.496993+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.302276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490326+0000","last_change":"2024-09-12T03:37:06.514906+0000","last_active":"2024-09-12T03:37:07.490326+0000","last_peered":"2024-09-12T03:37:07.490326+0000","last_clean":"2024-09-12T03:37:07.490326+0000","last_became_active":"2024-09-12T03:37:06.514221+0000","last_became_peered":"2024-09-12T03:37:06.514221+0000","last_unstale":"2024-09-12T03:37:07.490326+0000","last_undegraded":"2024-09-12T03:37:07.490326+0000","last_fullsized":"2024-09-12T03:37:07.490326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:47.249428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490559+0000","last_change":"2024-09-12T03:37:05.486679+0000","last_active":"2024-09-12T03:37:07.490559+0000","last_peered":"2024-09-12T03:37:07.490559+0000","last_clean":"2024-09-12T03:37:07.490559+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.490559+0000","last_undegraded":"2024-09-12T03:37:07.490559+0000","last_fullsized":"2024-09-12T03:37:07.490559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490179+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:07.490179+0000","last_peered":"2024-09-12T03:37:07.490179+0000","last_clean":"2024-09-12T03:37:07.490179+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:07.490179+0000","last_undegraded":"2024-09-12T03:37:07.490179+0000","last_fullsized":"2024-09-12T03:37:07.490179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1507328,"data_stored":1003572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":913408,"data_stored":413216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":408206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":901120,"data_stored":407072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":909312,"data_stored":407232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":905216,"data_stored":406602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":884736,"data_stored":399323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1466368,"data_stored":983024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:10.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e9db0640 1 Processor -- start 2024-09-12T03:37:11.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e9db0640 1 -- start start 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e9db0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35e40adad0 0x7f35e415f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e9db0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e40aee70 0x7f35e4154d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e9db0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e40af300 con 0x7f35e40adeb0 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e9db0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f35e40af5e0 con 0x7f35e40adad0 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e9db0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f35e40af8c0 con 0x7f35e40aee70 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35e40adad0 0x7f35e415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f35e40adeb0 0x7f35e40cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58136/0 (socket says 172.21.15.73:58136) 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e3fff640 1 -- 172.21.15.73:0/2243737667 learned_addr learned my addr 172.21.15.73:0/2243737667 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e2ffd640 1 --2- 172.21.15.73:0/2243737667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e40aee70 0x7f35e4154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e37fe640 1 -- 172.21.15.73:0/2243737667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e40aee70 msgr2=0x7f35e4154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:11.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e37fe640 1 --2- 172.21.15.73:0/2243737667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e40aee70 0x7f35e4154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e27fc640 1 -- 172.21.15.73:0/2243737667 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893696008 0 0) 0x7f35e40af300 con 0x7f35e40adeb0 2024-09-12T03:37:11.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e37fe640 1 -- 172.21.15.73:0/2243737667 >> v1:172.21.15.73:6789/0 conn(0x7f35e40adeb0 legacy=0x7f35e40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.034+0000 7f35e37fe640 1 -- 172.21.15.73:0/2243737667 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e40afba0 con 0x7f35e40adad0 2024-09-12T03:37:11.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e37fe640 1 --2- 172.21.15.73:0/2243737667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adad0 0x7f35e415f320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f35d40097c0 tx=0x7f35d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336f765ce7ca85f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e27fc640 1 -- 172.21.15.73:0/2243737667 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d40b0070 con 0x7f35e40adad0 2024-09-12T03:37:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e27fc640 1 -- 172.21.15.73:0/2243737667 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d40ab600 con 0x7f35e40adad0 2024-09-12T03:37:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e27fc640 1 -- 172.21.15.73:0/2243737667 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d40ab9d0 con 0x7f35e40adad0 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 -- 172.21.15.73:0/2243737667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adad0 msgr2=0x7f35e415f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 --2- 172.21.15.73:0/2243737667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adad0 0x7f35e415f320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f35d40097c0 tx=0x7f35d401c4a0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 -- 172.21.15.73:0/2243737667 shutdown_connections 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 --2- 172.21.15.73:0/2243737667 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e40aee70 0x7f35e4154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 --2- 172.21.15.73:0/2243737667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adad0 0x7f35e415f320 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 -- 172.21.15.73:0/2243737667 >> 172.21.15.73:0/2243737667 conn(0x7f35e40736d0 msgr2=0x7f35e406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 -- 172.21.15.73:0/2243737667 shutdown_connections 2024-09-12T03:37:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 -- 172.21.15.73:0/2243737667 wait complete. 2024-09-12T03:37:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 Processor -- start 2024-09-12T03:37:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.038+0000 7f35e9db0640 1 -- start start 2024-09-12T03:37:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e40adad0 0x7f35e415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adeb0 0x7f35e41582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e415b6c0 0x7f35e4153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f35e40b03a0 con 0x7f35e40adeb0 2024-09-12T03:37:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f35e40b0520 con 0x7f35e40adad0 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f35e406f070 con 0x7f35e415b6c0 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adeb0 0x7f35e41582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adeb0 0x7f35e41582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39682/0 (socket says 172.21.15.73:39682) 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 -- 172.21.15.73:0/3184736788 learned_addr learned my addr 172.21.15.73:0/3184736788 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 -- 172.21.15.73:0/3184736788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e415b6c0 msgr2=0x7f35e4153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e415b6c0 0x7f35e4153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 -- 172.21.15.73:0/3184736788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e40adad0 msgr2=0x7f35e415a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e40adad0 0x7f35e415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 -- 172.21.15.73:0/3184736788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e415a620 con 0x7f35e40adeb0 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e2ffd640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adeb0 0x7f35e41582f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00d5f0 tx=0x7f35cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35dbfff640 1 -- 172.21.15.73:0/3184736788 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0125f0 con 0x7f35e40adeb0 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35dbfff640 1 -- 172.21.15.73:0/3184736788 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc019070 con 0x7f35e40adeb0 2024-09-12T03:37:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35dbfff640 1 -- 172.21.15.73:0/3184736788 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0129b0 con 0x7f35e40adeb0 2024-09-12T03:37:11.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e415a900 con 0x7f35e40adeb0 2024-09-12T03:37:11.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e415b1a0 con 0x7f35e40adeb0 2024-09-12T03:37:11.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e415aad0 con 0x7f35e40adeb0 2024-09-12T03:37:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35dbfff640 1 -- 172.21.15.73:0/3184736788 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f35cc012b50 con 0x7f35e40adeb0 2024-09-12T03:37:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35dbfff640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f35c40678c0 0x7f35c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e37fe640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f35c40678c0 0x7f35c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35dbfff640 1 -- 172.21.15.73:0/3184736788 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f35cc086260 con 0x7f35e40adeb0 2024-09-12T03:37:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.042+0000 7f35e37fe640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f35c40678c0 0x7f35c4069d80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f35d40ad000 tx=0x7f35d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.046+0000 7f35dbfff640 1 -- 172.21.15.73:0/3184736788 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f35cc056c10 con 0x7f35e40adeb0 2024-09-12T03:37:11.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.202+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35e406f3f0 con 0x7f35c40678c0 2024-09-12T03:37:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.210+0000 7f35dbfff640 1 -- 172.21.15.73:0/3184736788 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250242 (secure 0 0 0) 0x7f35e406f3f0 con 0x7f35c40678c0 2024-09-12T03:37:11.215 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:11.217 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:11.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f35c40678c0 msgr2=0x7f35c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f35c40678c0 0x7f35c4069d80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f35d40ad000 tx=0x7f35d4008040 comp rx=0 tx=0).stop 2024-09-12T03:37:11.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adeb0 msgr2=0x7f35e41582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adeb0 0x7f35e41582f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00d5f0 tx=0x7f35cc00dab0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 shutdown_connections 2024-09-12T03:37:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f35c40678c0 0x7f35c4069d80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35e40adeb0 0x7f35e41582f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f35e415b6c0 0x7f35e4153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 --2- 172.21.15.73:0/3184736788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f35e40adad0 0x7f35e415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.214+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 >> 172.21.15.73:0/3184736788 conn(0x7f35e40736d0 msgr2=0x7f35e415eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.218+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 shutdown_connections 2024-09-12T03:37:11.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.218+0000 7f35e9db0640 1 -- 172.21.15.73:0/3184736788 wait complete. 2024-09-12T03:37:11.233 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T03:37:09.834453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249424,"kb_used_data":8208,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725296,"statfs":{"total":773094113280,"available":772838703104,"internally_reserved":0,"allocated":8404992,"data_stored":4428247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":246795827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.387368"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490484+0000","last_change":"2024-09-12T03:37:06.514437+0000","last_active":"2024-09-12T03:37:07.490484+0000","last_peered":"2024-09-12T03:37:07.490484+0000","last_clean":"2024-09-12T03:37:07.490484+0000","last_became_active":"2024-09-12T03:37:06.513608+0000","last_became_peered":"2024-09-12T03:37:06.513608+0000","last_unstale":"2024-09-12T03:37:07.490484+0000","last_undegraded":"2024-09-12T03:37:07.490484+0000","last_fullsized":"2024-09-12T03:37:07.490484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:14.954094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463676+0000","last_change":"2024-09-12T03:37:05.463676+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463676+0000","last_undegraded":"2024-09-12T03:37:05.463676+0000","last_fullsized":"2024-09-12T03:37:05.463676+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.540703+0000","last_change":"2024-09-12T03:37:06.537800+0000","last_active":"2024-09-12T03:37:06.540703+0000","last_peered":"2024-09-12T03:37:06.540703+0000","last_clean":"2024-09-12T03:37:06.540703+0000","last_became_active":"2024-09-12T03:37:06.537380+0000","last_became_peered":"2024-09-12T03:37:06.537380+0000","last_unstale":"2024-09-12T03:37:06.540703+0000","last_undegraded":"2024-09-12T03:37:06.540703+0000","last_fullsized":"2024-09-12T03:37:06.540703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:02.077400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736298+0000","last_change":"2024-09-12T03:37:06.502862+0000","last_active":"2024-09-12T03:37:07.736298+0000","last_peered":"2024-09-12T03:37:07.736298+0000","last_clean":"2024-09-12T03:37:07.736298+0000","last_became_active":"2024-09-12T03:37:06.502106+0000","last_became_peered":"2024-09-12T03:37:06.502106+0000","last_unstale":"2024-09-12T03:37:07.736298+0000","last_undegraded":"2024-09-12T03:37:07.736298+0000","last_fullsized":"2024-09-12T03:37:07.736298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525735+0000","last_change":"2024-09-12T03:37:06.510258+0000","last_active":"2024-09-12T03:37:07.525735+0000","last_peered":"2024-09-12T03:37:07.525735+0000","last_clean":"2024-09-12T03:37:07.525735+0000","last_became_active":"2024-09-12T03:37:06.509410+0000","last_became_peered":"2024-09-12T03:37:06.509410+0000","last_unstale":"2024-09-12T03:37:07.525735+0000","last_undegraded":"2024-09-12T03:37:07.525735+0000","last_fullsized":"2024-09-12T03:37:07.525735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:00.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490171+0000","last_change":"2024-09-12T03:37:06.531549+0000","last_active":"2024-09-12T03:37:07.490171+0000","last_peered":"2024-09-12T03:37:07.490171+0000","last_clean":"2024-09-12T03:37:07.490171+0000","last_became_active":"2024-09-12T03:37:06.530951+0000","last_became_peered":"2024-09-12T03:37:06.530951+0000","last_unstale":"2024-09-12T03:37:07.490171+0000","last_undegraded":"2024-09-12T03:37:07.490171+0000","last_fullsized":"2024-09-12T03:37:07.490171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:39.887489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.475592+0000","last_change":"2024-09-12T03:37:05.475592+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.475592+0000","last_undegraded":"2024-09-12T03:37:05.475592+0000","last_fullsized":"2024-09-12T03:37:05.475592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524109+0000","last_change":"2024-09-12T03:37:06.516755+0000","last_active":"2024-09-12T03:37:07.524109+0000","last_peered":"2024-09-12T03:37:07.524109+0000","last_clean":"2024-09-12T03:37:07.524109+0000","last_became_active":"2024-09-12T03:37:06.515980+0000","last_became_peered":"2024-09-12T03:37:06.515980+0000","last_unstale":"2024-09-12T03:37:07.524109+0000","last_undegraded":"2024-09-12T03:37:07.524109+0000","last_fullsized":"2024-09-12T03:37:07.524109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:11.002245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536002+0000","last_change":"2024-09-12T03:37:06.523408+0000","last_active":"2024-09-12T03:37:06.536002+0000","last_peered":"2024-09-12T03:37:06.536002+0000","last_clean":"2024-09-12T03:37:06.536002+0000","last_became_active":"2024-09-12T03:37:06.522698+0000","last_became_peered":"2024-09-12T03:37:06.522698+0000","last_unstale":"2024-09-12T03:37:06.536002+0000","last_undegraded":"2024-09-12T03:37:06.536002+0000","last_fullsized":"2024-09-12T03:37:06.536002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.051078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736249+0000","last_change":"2024-09-12T03:37:06.531047+0000","last_active":"2024-09-12T03:37:07.736249+0000","last_peered":"2024-09-12T03:37:07.736249+0000","last_clean":"2024-09-12T03:37:07.736249+0000","last_became_active":"2024-09-12T03:37:06.530313+0000","last_became_peered":"2024-09-12T03:37:06.530313+0000","last_unstale":"2024-09-12T03:37:07.736249+0000","last_undegraded":"2024-09-12T03:37:07.736249+0000","last_fullsized":"2024-09-12T03:37:07.736249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:50.907872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463757+0000","last_change":"2024-09-12T03:37:05.463757+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463757+0000","last_undegraded":"2024-09-12T03:37:05.463757+0000","last_fullsized":"2024-09-12T03:37:05.463757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736293+0000","last_change":"2024-09-12T03:37:06.527826+0000","last_active":"2024-09-12T03:37:07.736293+0000","last_peered":"2024-09-12T03:37:07.736293+0000","last_clean":"2024-09-12T03:37:07.736293+0000","last_became_active":"2024-09-12T03:37:06.527024+0000","last_became_peered":"2024-09-12T03:37:06.527024+0000","last_unstale":"2024-09-12T03:37:07.736293+0000","last_undegraded":"2024-09-12T03:37:07.736293+0000","last_fullsized":"2024-09-12T03:37:07.736293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:37.906427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525835+0000","last_change":"2024-09-12T03:37:06.520117+0000","last_active":"2024-09-12T03:37:07.525835+0000","last_peered":"2024-09-12T03:37:07.525835+0000","last_clean":"2024-09-12T03:37:07.525835+0000","last_became_active":"2024-09-12T03:37:06.519404+0000","last_became_peered":"2024-09-12T03:37:06.519404+0000","last_unstale":"2024-09-12T03:37:07.525835+0000","last_undegraded":"2024-09-12T03:37:07.525835+0000","last_fullsized":"2024-09-12T03:37:07.525835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:13.557412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490257+0000","last_change":"2024-09-12T03:37:06.531349+0000","last_active":"2024-09-12T03:37:07.490257+0000","last_peered":"2024-09-12T03:37:07.490257+0000","last_clean":"2024-09-12T03:37:07.490257+0000","last_became_active":"2024-09-12T03:37:06.530817+0000","last_became_peered":"2024-09-12T03:37:06.530817+0000","last_unstale":"2024-09-12T03:37:07.490257+0000","last_undegraded":"2024-09-12T03:37:07.490257+0000","last_fullsized":"2024-09-12T03:37:07.490257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:35.000985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463836+0000","last_change":"2024-09-12T03:37:05.463836+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463836+0000","last_undegraded":"2024-09-12T03:37:05.463836+0000","last_fullsized":"2024-09-12T03:37:05.463836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489610+0000","last_change":"2024-09-12T03:37:06.514904+0000","last_active":"2024-09-12T03:37:07.489610+0000","last_peered":"2024-09-12T03:37:07.489610+0000","last_clean":"2024-09-12T03:37:07.489610+0000","last_became_active":"2024-09-12T03:37:06.514039+0000","last_became_peered":"2024-09-12T03:37:06.514039+0000","last_unstale":"2024-09-12T03:37:07.489610+0000","last_undegraded":"2024-09-12T03:37:07.489610+0000","last_fullsized":"2024-09-12T03:37:07.489610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.632530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526403+0000","last_change":"2024-09-12T03:37:06.532098+0000","last_active":"2024-09-12T03:37:07.526403+0000","last_peered":"2024-09-12T03:37:07.526403+0000","last_clean":"2024-09-12T03:37:07.526403+0000","last_became_active":"2024-09-12T03:37:06.531862+0000","last_became_peered":"2024-09-12T03:37:06.531862+0000","last_unstale":"2024-09-12T03:37:07.526403+0000","last_undegraded":"2024-09-12T03:37:07.526403+0000","last_fullsized":"2024-09-12T03:37:07.526403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.841005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.510047+0000","last_change":"2024-09-12T03:37:06.504175+0000","last_active":"2024-09-12T03:37:06.510047+0000","last_peered":"2024-09-12T03:37:06.510047+0000","last_clean":"2024-09-12T03:37:06.510047+0000","last_became_active":"2024-09-12T03:37:06.503252+0000","last_became_peered":"2024-09-12T03:37:06.503252+0000","last_unstale":"2024-09-12T03:37:06.510047+0000","last_undegraded":"2024-09-12T03:37:06.510047+0000","last_fullsized":"2024-09-12T03:37:06.510047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:07.426916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490185+0000","last_change":"2024-09-12T03:37:06.522629+0000","last_active":"2024-09-12T03:37:07.490185+0000","last_peered":"2024-09-12T03:37:07.490185+0000","last_clean":"2024-09-12T03:37:07.490185+0000","last_became_active":"2024-09-12T03:37:06.522349+0000","last_became_peered":"2024-09-12T03:37:06.522349+0000","last_unstale":"2024-09-12T03:37:07.490185+0000","last_undegraded":"2024-09-12T03:37:07.490185+0000","last_fullsized":"2024-09-12T03:37:07.490185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:18.204607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525939+0000","last_change":"2024-09-12T03:37:06.505805+0000","last_active":"2024-09-12T03:37:07.525939+0000","last_peered":"2024-09-12T03:37:07.525939+0000","last_clean":"2024-09-12T03:37:07.525939+0000","last_became_active":"2024-09-12T03:37:06.504970+0000","last_became_peered":"2024-09-12T03:37:06.504970+0000","last_unstale":"2024-09-12T03:37:07.525939+0000","last_undegraded":"2024-09-12T03:37:07.525939+0000","last_fullsized":"2024-09-12T03:37:07.525939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:33.899192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509640+0000","last_change":"2024-09-12T03:37:06.500401+0000","last_active":"2024-09-12T03:37:06.509640+0000","last_peered":"2024-09-12T03:37:06.509640+0000","last_clean":"2024-09-12T03:37:06.509640+0000","last_became_active":"2024-09-12T03:37:06.499636+0000","last_became_peered":"2024-09-12T03:37:06.499636+0000","last_unstale":"2024-09-12T03:37:06.509640+0000","last_undegraded":"2024-09-12T03:37:06.509640+0000","last_fullsized":"2024-09-12T03:37:06.509640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:28.462827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524890+0000","last_change":"2024-09-12T03:37:06.543601+0000","last_active":"2024-09-12T03:37:07.524890+0000","last_peered":"2024-09-12T03:37:07.524890+0000","last_clean":"2024-09-12T03:37:07.524890+0000","last_became_active":"2024-09-12T03:37:06.542384+0000","last_became_peered":"2024-09-12T03:37:06.542384+0000","last_unstale":"2024-09-12T03:37:07.524890+0000","last_undegraded":"2024-09-12T03:37:07.524890+0000","last_fullsized":"2024-09-12T03:37:07.524890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.149213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.499591+0000","last_change":"2024-09-12T03:37:06.497773+0000","last_active":"2024-09-12T03:37:06.499591+0000","last_peered":"2024-09-12T03:37:06.499591+0000","last_clean":"2024-09-12T03:37:06.499591+0000","last_became_active":"2024-09-12T03:37:06.496867+0000","last_became_peered":"2024-09-12T03:37:06.496867+0000","last_unstale":"2024-09-12T03:37:06.499591+0000","last_undegraded":"2024-09-12T03:37:06.499591+0000","last_fullsized":"2024-09-12T03:37:06.499591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.164141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464286+0000","last_change":"2024-09-12T03:37:05.464286+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464286+0000","last_undegraded":"2024-09-12T03:37:05.464286+0000","last_fullsized":"2024-09-12T03:37:05.464286+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461931+0000","last_change":"2024-09-12T03:37:05.461931+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461931+0000","last_undegraded":"2024-09-12T03:37:05.461931+0000","last_fullsized":"2024-09-12T03:37:05.461931+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736116+0000","last_change":"2024-09-12T03:37:06.527918+0000","last_active":"2024-09-12T03:37:07.736116+0000","last_peered":"2024-09-12T03:37:07.736116+0000","last_clean":"2024-09-12T03:37:07.736116+0000","last_became_active":"2024-09-12T03:37:06.527243+0000","last_became_peered":"2024-09-12T03:37:06.527243+0000","last_unstale":"2024-09-12T03:37:07.736116+0000","last_undegraded":"2024-09-12T03:37:07.736116+0000","last_fullsized":"2024-09-12T03:37:07.736116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:32.967011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489935+0000","last_change":"2024-09-12T03:37:06.513491+0000","last_active":"2024-09-12T03:37:07.489935+0000","last_peered":"2024-09-12T03:37:07.489935+0000","last_clean":"2024-09-12T03:37:07.489935+0000","last_became_active":"2024-09-12T03:37:06.508794+0000","last_became_peered":"2024-09-12T03:37:06.508794+0000","last_unstale":"2024-09-12T03:37:07.489935+0000","last_undegraded":"2024-09-12T03:37:07.489935+0000","last_fullsized":"2024-09-12T03:37:07.489935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.834025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526079+0000","last_change":"2024-09-12T03:37:06.493731+0000","last_active":"2024-09-12T03:37:07.526079+0000","last_peered":"2024-09-12T03:37:07.526079+0000","last_clean":"2024-09-12T03:37:07.526079+0000","last_became_active":"2024-09-12T03:37:06.492963+0000","last_became_peered":"2024-09-12T03:37:06.492963+0000","last_unstale":"2024-09-12T03:37:07.526079+0000","last_undegraded":"2024-09-12T03:37:07.526079+0000","last_fullsized":"2024-09-12T03:37:07.526079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:40.752488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.462360+0000","last_change":"2024-09-12T03:37:05.462360+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.462360+0000","last_undegraded":"2024-09-12T03:37:05.462360+0000","last_fullsized":"2024-09-12T03:37:05.462360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489520+0000","last_change":"2024-09-12T03:37:06.538257+0000","last_active":"2024-09-12T03:37:07.489520+0000","last_peered":"2024-09-12T03:37:07.489520+0000","last_clean":"2024-09-12T03:37:07.489520+0000","last_became_active":"2024-09-12T03:37:06.537464+0000","last_became_peered":"2024-09-12T03:37:06.537464+0000","last_unstale":"2024-09-12T03:37:07.489520+0000","last_undegraded":"2024-09-12T03:37:07.489520+0000","last_fullsized":"2024-09-12T03:37:07.489520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:47.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537849+0000","last_change":"2024-09-12T03:37:06.529226+0000","last_active":"2024-09-12T03:37:06.537849+0000","last_peered":"2024-09-12T03:37:06.537849+0000","last_clean":"2024-09-12T03:37:06.537849+0000","last_became_active":"2024-09-12T03:37:06.528961+0000","last_became_peered":"2024-09-12T03:37:06.528961+0000","last_unstale":"2024-09-12T03:37:06.537849+0000","last_undegraded":"2024-09-12T03:37:06.537849+0000","last_fullsized":"2024-09-12T03:37:06.537849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:29.822067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490040+0000","last_change":"2024-09-12T03:37:06.520303+0000","last_active":"2024-09-12T03:37:07.490040+0000","last_peered":"2024-09-12T03:37:07.490040+0000","last_clean":"2024-09-12T03:37:07.490040+0000","last_became_active":"2024-09-12T03:37:06.514601+0000","last_became_peered":"2024-09-12T03:37:06.514601+0000","last_unstale":"2024-09-12T03:37:07.490040+0000","last_undegraded":"2024-09-12T03:37:07.490040+0000","last_fullsized":"2024-09-12T03:37:07.490040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:02.773931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509950+0000","last_change":"2024-09-12T03:37:06.503918+0000","last_active":"2024-09-12T03:37:06.509950+0000","last_peered":"2024-09-12T03:37:06.509950+0000","last_clean":"2024-09-12T03:37:06.509950+0000","last_became_active":"2024-09-12T03:37:06.503138+0000","last_became_peered":"2024-09-12T03:37:06.503138+0000","last_unstale":"2024-09-12T03:37:06.509950+0000","last_undegraded":"2024-09-12T03:37:06.509950+0000","last_fullsized":"2024-09-12T03:37:06.509950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:12.810601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526469+0000","last_change":"2024-09-12T03:37:05.472634+0000","last_active":"2024-09-12T03:37:07.526469+0000","last_peered":"2024-09-12T03:37:07.526469+0000","last_clean":"2024-09-12T03:37:07.526469+0000","last_became_active":"2024-09-12T03:37:05.472206+0000","last_became_peered":"2024-09-12T03:37:05.472206+0000","last_unstale":"2024-09-12T03:37:07.526469+0000","last_undegraded":"2024-09-12T03:37:07.526469+0000","last_fullsized":"2024-09-12T03:37:07.526469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:29.832710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461497+0000","last_change":"2024-09-12T03:37:05.461497+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461497+0000","last_undegraded":"2024-09-12T03:37:05.461497+0000","last_fullsized":"2024-09-12T03:37:05.461497+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490508+0000","last_change":"2024-09-12T03:37:05.500119+0000","last_active":"2024-09-12T03:37:07.490508+0000","last_peered":"2024-09-12T03:37:07.490508+0000","last_clean":"2024-09-12T03:37:07.490508+0000","last_became_active":"2024-09-12T03:37:05.499397+0000","last_became_peered":"2024-09-12T03:37:05.499397+0000","last_unstale":"2024-09-12T03:37:07.490508+0000","last_undegraded":"2024-09-12T03:37:07.490508+0000","last_fullsized":"2024-09-12T03:37:07.490508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:49.894769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.543034+0000","last_change":"2024-09-12T03:37:06.533084+0000","last_active":"2024-09-12T03:37:06.543034+0000","last_peered":"2024-09-12T03:37:06.543034+0000","last_clean":"2024-09-12T03:37:06.543034+0000","last_became_active":"2024-09-12T03:37:06.532362+0000","last_became_peered":"2024-09-12T03:37:06.532362+0000","last_unstale":"2024-09-12T03:37:06.543034+0000","last_undegraded":"2024-09-12T03:37:06.543034+0000","last_fullsized":"2024-09-12T03:37:06.543034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:51.545805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490159+0000","last_change":"2024-09-12T03:37:05.503226+0000","last_active":"2024-09-12T03:37:07.490159+0000","last_peered":"2024-09-12T03:37:07.490159+0000","last_clean":"2024-09-12T03:37:07.490159+0000","last_became_active":"2024-09-12T03:37:05.499243+0000","last_became_peered":"2024-09-12T03:37:05.499243+0000","last_unstale":"2024-09-12T03:37:07.490159+0000","last_undegraded":"2024-09-12T03:37:07.490159+0000","last_fullsized":"2024-09-12T03:37:07.490159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:31.953907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509254+0000","last_change":"2024-09-12T03:37:06.500139+0000","last_active":"2024-09-12T03:37:06.509254+0000","last_peered":"2024-09-12T03:37:06.509254+0000","last_clean":"2024-09-12T03:37:06.509254+0000","last_became_active":"2024-09-12T03:37:06.498715+0000","last_became_peered":"2024-09-12T03:37:06.498715+0000","last_unstale":"2024-09-12T03:37:06.509254+0000","last_undegraded":"2024-09-12T03:37:06.509254+0000","last_fullsized":"2024-09-12T03:37:06.509254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:54.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.502121+0000","last_change":"2024-09-12T03:37:05.499938+0000","last_active":"2024-09-12T03:37:05.502121+0000","last_peered":"2024-09-12T03:37:05.502121+0000","last_clean":"2024-09-12T03:37:05.502121+0000","last_became_active":"2024-09-12T03:37:05.499502+0000","last_became_peered":"2024-09-12T03:37:05.499502+0000","last_unstale":"2024-09-12T03:37:05.502121+0000","last_undegraded":"2024-09-12T03:37:05.502121+0000","last_fullsized":"2024-09-12T03:37:05.502121+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:00.462693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463663+0000","last_change":"2024-09-12T03:37:05.463663+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463663+0000","last_undegraded":"2024-09-12T03:37:05.463663+0000","last_fullsized":"2024-09-12T03:37:05.463663+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.548588+0000","last_change":"2024-09-12T03:37:05.494187+0000","last_active":"2024-09-12T03:37:06.548588+0000","last_peered":"2024-09-12T03:37:06.548588+0000","last_clean":"2024-09-12T03:37:06.548588+0000","last_became_active":"2024-09-12T03:37:05.493427+0000","last_became_peered":"2024-09-12T03:37:05.493427+0000","last_unstale":"2024-09-12T03:37:06.548588+0000","last_undegraded":"2024-09-12T03:37:06.548588+0000","last_fullsized":"2024-09-12T03:37:06.548588+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.568721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461977+0000","last_change":"2024-09-12T03:37:05.461977+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461977+0000","last_undegraded":"2024-09-12T03:37:05.461977+0000","last_fullsized":"2024-09-12T03:37:05.461977+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735804+0000","last_change":"2024-09-12T03:37:05.475494+0000","last_active":"2024-09-12T03:37:07.735804+0000","last_peered":"2024-09-12T03:37:07.735804+0000","last_clean":"2024-09-12T03:37:07.735804+0000","last_became_active":"2024-09-12T03:37:05.474778+0000","last_became_peered":"2024-09-12T03:37:05.474778+0000","last_unstale":"2024-09-12T03:37:07.735804+0000","last_undegraded":"2024-09-12T03:37:07.735804+0000","last_fullsized":"2024-09-12T03:37:07.735804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.185281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536045+0000","last_change":"2024-09-12T03:37:06.523174+0000","last_active":"2024-09-12T03:37:06.536045+0000","last_peered":"2024-09-12T03:37:06.536045+0000","last_clean":"2024-09-12T03:37:06.536045+0000","last_became_active":"2024-09-12T03:37:06.522469+0000","last_became_peered":"2024-09-12T03:37:06.522469+0000","last_unstale":"2024-09-12T03:37:06.536045+0000","last_undegraded":"2024-09-12T03:37:06.536045+0000","last_fullsized":"2024-09-12T03:37:06.536045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:51.550177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.493779+0000","last_change":"2024-09-12T03:37:05.493173+0000","last_active":"2024-09-12T03:37:05.493779+0000","last_peered":"2024-09-12T03:37:05.493779+0000","last_clean":"2024-09-12T03:37:05.493779+0000","last_became_active":"2024-09-12T03:37:05.492841+0000","last_became_peered":"2024-09-12T03:37:05.492841+0000","last_unstale":"2024-09-12T03:37:05.493779+0000","last_undegraded":"2024-09-12T03:37:05.493779+0000","last_fullsized":"2024-09-12T03:37:05.493779+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:50:05.221145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.465212+0000","last_change":"2024-09-12T03:37:05.465212+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.465212+0000","last_undegraded":"2024-09-12T03:37:05.465212+0000","last_fullsized":"2024-09-12T03:37:05.465212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524122+0000","last_change":"2024-09-12T03:37:05.481678+0000","last_active":"2024-09-12T03:37:07.524122+0000","last_peered":"2024-09-12T03:37:07.524122+0000","last_clean":"2024-09-12T03:37:07.524122+0000","last_became_active":"2024-09-12T03:37:05.481386+0000","last_became_peered":"2024-09-12T03:37:05.481386+0000","last_unstale":"2024-09-12T03:37:07.524122+0000","last_undegraded":"2024-09-12T03:37:07.524122+0000","last_fullsized":"2024-09-12T03:37:07.524122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.008960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.461373+0000","last_change":"2024-09-12T03:37:05.461373+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.461373+0000","last_undegraded":"2024-09-12T03:37:05.461373+0000","last_fullsized":"2024-09-12T03:37:05.461373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490322+0000","last_change":"2024-09-12T03:37:05.502676+0000","last_active":"2024-09-12T03:37:07.490322+0000","last_peered":"2024-09-12T03:37:07.490322+0000","last_clean":"2024-09-12T03:37:07.490322+0000","last_became_active":"2024-09-12T03:37:05.500422+0000","last_became_peered":"2024-09-12T03:37:05.500422+0000","last_unstale":"2024-09-12T03:37:07.490322+0000","last_undegraded":"2024-09-12T03:37:07.490322+0000","last_fullsized":"2024-09-12T03:37:07.490322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.951815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736193+0000","last_change":"2024-09-12T03:37:06.503404+0000","last_active":"2024-09-12T03:37:07.736193+0000","last_peered":"2024-09-12T03:37:07.736193+0000","last_clean":"2024-09-12T03:37:07.736193+0000","last_became_active":"2024-09-12T03:37:06.501502+0000","last_became_peered":"2024-09-12T03:37:06.501502+0000","last_unstale":"2024-09-12T03:37:07.736193+0000","last_undegraded":"2024-09-12T03:37:07.736193+0000","last_fullsized":"2024-09-12T03:37:07.736193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:44.036902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736206+0000","last_change":"2024-09-12T03:37:05.484198+0000","last_active":"2024-09-12T03:37:07.736206+0000","last_peered":"2024-09-12T03:37:07.736206+0000","last_clean":"2024-09-12T03:37:07.736206+0000","last_became_active":"2024-09-12T03:37:05.483437+0000","last_became_peered":"2024-09-12T03:37:05.483437+0000","last_unstale":"2024-09-12T03:37:07.736206+0000","last_undegraded":"2024-09-12T03:37:07.736206+0000","last_fullsized":"2024-09-12T03:37:07.736206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:57.022689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490642+0000","last_change":"2024-09-12T03:37:06.531132+0000","last_active":"2024-09-12T03:37:07.490642+0000","last_peered":"2024-09-12T03:37:07.490642+0000","last_clean":"2024-09-12T03:37:07.490642+0000","last_became_active":"2024-09-12T03:37:06.530579+0000","last_became_peered":"2024-09-12T03:37:06.530579+0000","last_unstale":"2024-09-12T03:37:07.490642+0000","last_undegraded":"2024-09-12T03:37:07.490642+0000","last_fullsized":"2024-09-12T03:37:07.490642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526095+0000","last_change":"2024-09-12T03:37:05.467252+0000","last_active":"2024-09-12T03:37:07.526095+0000","last_peered":"2024-09-12T03:37:07.526095+0000","last_clean":"2024-09-12T03:37:07.526095+0000","last_became_active":"2024-09-12T03:37:05.466976+0000","last_became_peered":"2024-09-12T03:37:05.466976+0000","last_unstale":"2024-09-12T03:37:07.526095+0000","last_undegraded":"2024-09-12T03:37:07.526095+0000","last_fullsized":"2024-09-12T03:37:07.526095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:52.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537737+0000","last_change":"2024-09-12T03:37:06.532029+0000","last_active":"2024-09-12T03:37:06.537737+0000","last_peered":"2024-09-12T03:37:06.537737+0000","last_clean":"2024-09-12T03:37:06.537737+0000","last_became_active":"2024-09-12T03:37:06.531754+0000","last_became_peered":"2024-09-12T03:37:06.531754+0000","last_unstale":"2024-09-12T03:37:06.537737+0000","last_undegraded":"2024-09-12T03:37:06.537737+0000","last_fullsized":"2024-09-12T03:37:06.537737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:34.296632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.491781+0000","last_change":"2024-09-12T03:37:05.486509+0000","last_active":"2024-09-12T03:37:05.491781+0000","last_peered":"2024-09-12T03:37:05.491781+0000","last_clean":"2024-09-12T03:37:05.491781+0000","last_became_active":"2024-09-12T03:37:05.485863+0000","last_became_peered":"2024-09-12T03:37:05.485863+0000","last_unstale":"2024-09-12T03:37:05.491781+0000","last_undegraded":"2024-09-12T03:37:05.491781+0000","last_fullsized":"2024-09-12T03:37:05.491781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:17.964169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736503+0000","last_change":"2024-09-12T03:37:06.524797+0000","last_active":"2024-09-12T03:37:07.736503+0000","last_peered":"2024-09-12T03:37:07.736503+0000","last_clean":"2024-09-12T03:37:07.736503+0000","last_became_active":"2024-09-12T03:37:06.524051+0000","last_became_peered":"2024-09-12T03:37:06.524051+0000","last_unstale":"2024-09-12T03:37:07.736503+0000","last_undegraded":"2024-09-12T03:37:07.736503+0000","last_fullsized":"2024-09-12T03:37:07.736503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735820+0000","last_change":"2024-09-12T03:37:05.484324+0000","last_active":"2024-09-12T03:37:07.735820+0000","last_peered":"2024-09-12T03:37:07.735820+0000","last_clean":"2024-09-12T03:37:07.735820+0000","last_became_active":"2024-09-12T03:37:05.483498+0000","last_became_peered":"2024-09-12T03:37:05.483498+0000","last_unstale":"2024-09-12T03:37:07.735820+0000","last_undegraded":"2024-09-12T03:37:07.735820+0000","last_fullsized":"2024-09-12T03:37:07.735820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.465918+0000","last_change":"2024-09-12T03:37:05.465918+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.465918+0000","last_undegraded":"2024-09-12T03:37:05.465918+0000","last_fullsized":"2024-09-12T03:37:05.465918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489421+0000","last_change":"2024-09-12T03:37:05.500057+0000","last_active":"2024-09-12T03:37:07.489421+0000","last_peered":"2024-09-12T03:37:07.489421+0000","last_clean":"2024-09-12T03:37:07.489421+0000","last_became_active":"2024-09-12T03:37:05.499311+0000","last_became_peered":"2024-09-12T03:37:05.499311+0000","last_unstale":"2024-09-12T03:37:07.489421+0000","last_undegraded":"2024-09-12T03:37:07.489421+0000","last_fullsized":"2024-09-12T03:37:07.489421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:29.673134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.462036+0000","last_change":"2024-09-12T03:37:05.462036+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.462036+0000","last_undegraded":"2024-09-12T03:37:05.462036+0000","last_fullsized":"2024-09-12T03:37:05.462036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524346+0000","last_change":"2024-09-12T03:37:05.473264+0000","last_active":"2024-09-12T03:37:07.524346+0000","last_peered":"2024-09-12T03:37:07.524346+0000","last_clean":"2024-09-12T03:37:07.524346+0000","last_became_active":"2024-09-12T03:37:05.472961+0000","last_became_peered":"2024-09-12T03:37:05.472961+0000","last_unstale":"2024-09-12T03:37:07.524346+0000","last_undegraded":"2024-09-12T03:37:07.524346+0000","last_fullsized":"2024-09-12T03:37:07.524346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:08.526759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464140+0000","last_change":"2024-09-12T03:37:05.464140+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464140+0000","last_undegraded":"2024-09-12T03:37:05.464140+0000","last_fullsized":"2024-09-12T03:37:05.464140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.489884+0000","last_change":"2024-09-12T03:37:05.487121+0000","last_active":"2024-09-12T03:37:05.489884+0000","last_peered":"2024-09-12T03:37:05.489884+0000","last_clean":"2024-09-12T03:37:05.489884+0000","last_became_active":"2024-09-12T03:37:05.486606+0000","last_became_peered":"2024-09-12T03:37:05.486606+0000","last_unstale":"2024-09-12T03:37:05.489884+0000","last_undegraded":"2024-09-12T03:37:05.489884+0000","last_fullsized":"2024-09-12T03:37:05.489884+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:22.110425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489543+0000","last_change":"2024-09-12T03:37:06.523220+0000","last_active":"2024-09-12T03:37:07.489543+0000","last_peered":"2024-09-12T03:37:07.489543+0000","last_clean":"2024-09-12T03:37:07.489543+0000","last_became_active":"2024-09-12T03:37:06.522654+0000","last_became_peered":"2024-09-12T03:37:06.522654+0000","last_unstale":"2024-09-12T03:37:07.489543+0000","last_undegraded":"2024-09-12T03:37:07.489543+0000","last_fullsized":"2024-09-12T03:37:07.489543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490664+0000","last_change":"2024-09-12T03:37:05.504584+0000","last_active":"2024-09-12T03:37:07.490664+0000","last_peered":"2024-09-12T03:37:07.490664+0000","last_clean":"2024-09-12T03:37:07.490664+0000","last_became_active":"2024-09-12T03:37:05.504027+0000","last_became_peered":"2024-09-12T03:37:05.504027+0000","last_unstale":"2024-09-12T03:37:07.490664+0000","last_undegraded":"2024-09-12T03:37:07.490664+0000","last_fullsized":"2024-09-12T03:37:07.490664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:36.893323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524199+0000","last_change":"2024-09-12T03:37:06.529939+0000","last_active":"2024-09-12T03:37:07.524199+0000","last_peered":"2024-09-12T03:37:07.524199+0000","last_clean":"2024-09-12T03:37:07.524199+0000","last_became_active":"2024-09-12T03:37:06.529695+0000","last_became_peered":"2024-09-12T03:37:06.529695+0000","last_unstale":"2024-09-12T03:37:07.524199+0000","last_undegraded":"2024-09-12T03:37:07.524199+0000","last_fullsized":"2024-09-12T03:37:07.524199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:31.343811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.547797+0000","last_change":"2024-09-12T03:37:05.482266+0000","last_active":"2024-09-12T03:37:06.547797+0000","last_peered":"2024-09-12T03:37:06.547797+0000","last_clean":"2024-09-12T03:37:06.547797+0000","last_became_active":"2024-09-12T03:37:05.481642+0000","last_became_peered":"2024-09-12T03:37:05.481642+0000","last_unstale":"2024-09-12T03:37:06.547797+0000","last_undegraded":"2024-09-12T03:37:06.547797+0000","last_fullsized":"2024-09-12T03:37:06.547797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:45.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525240+0000","last_change":"2024-09-12T03:37:06.513529+0000","last_active":"2024-09-12T03:37:07.525240+0000","last_peered":"2024-09-12T03:37:07.525240+0000","last_clean":"2024-09-12T03:37:07.525240+0000","last_became_active":"2024-09-12T03:37:06.512794+0000","last_became_peered":"2024-09-12T03:37:06.512794+0000","last_unstale":"2024-09-12T03:37:07.525240+0000","last_undegraded":"2024-09-12T03:37:07.525240+0000","last_fullsized":"2024-09-12T03:37:07.525240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:44.645938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526174+0000","last_change":"2024-09-12T03:37:05.482661+0000","last_active":"2024-09-12T03:37:07.526174+0000","last_peered":"2024-09-12T03:37:07.526174+0000","last_clean":"2024-09-12T03:37:07.526174+0000","last_became_active":"2024-09-12T03:37:05.482383+0000","last_became_peered":"2024-09-12T03:37:05.482383+0000","last_unstale":"2024-09-12T03:37:07.526174+0000","last_undegraded":"2024-09-12T03:37:07.526174+0000","last_fullsized":"2024-09-12T03:37:07.526174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:10.781273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489983+0000","last_change":"2024-09-12T03:37:06.524850+0000","last_active":"2024-09-12T03:37:07.489983+0000","last_peered":"2024-09-12T03:37:07.489983+0000","last_clean":"2024-09-12T03:37:07.489983+0000","last_became_active":"2024-09-12T03:37:06.524667+0000","last_became_peered":"2024-09-12T03:37:06.524667+0000","last_unstale":"2024-09-12T03:37:07.489983+0000","last_undegraded":"2024-09-12T03:37:07.489983+0000","last_fullsized":"2024-09-12T03:37:07.489983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:52.329645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.497387+0000","last_change":"2024-09-12T03:37:05.473843+0000","last_active":"2024-09-12T03:37:06.497387+0000","last_peered":"2024-09-12T03:37:06.497387+0000","last_clean":"2024-09-12T03:37:06.497387+0000","last_became_active":"2024-09-12T03:37:05.473434+0000","last_became_peered":"2024-09-12T03:37:05.473434+0000","last_unstale":"2024-09-12T03:37:06.497387+0000","last_undegraded":"2024-09-12T03:37:06.497387+0000","last_fullsized":"2024-09-12T03:37:06.497387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:03.854469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460985+0000","last_change":"2024-09-12T03:37:05.460985+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460985+0000","last_undegraded":"2024-09-12T03:37:05.460985+0000","last_fullsized":"2024-09-12T03:37:05.460985+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489811+0000","last_change":"2024-09-12T03:37:05.468431+0000","last_active":"2024-09-12T03:37:07.489811+0000","last_peered":"2024-09-12T03:37:07.489811+0000","last_clean":"2024-09-12T03:37:07.489811+0000","last_became_active":"2024-09-12T03:37:05.467975+0000","last_became_peered":"2024-09-12T03:37:05.467975+0000","last_unstale":"2024-09-12T03:37:07.489811+0000","last_undegraded":"2024-09-12T03:37:07.489811+0000","last_fullsized":"2024-09-12T03:37:07.489811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:45.853956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460553+0000","last_change":"2024-09-12T03:37:05.460553+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460553+0000","last_undegraded":"2024-09-12T03:37:05.460553+0000","last_fullsized":"2024-09-12T03:37:05.460553+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489828+0000","last_change":"2024-09-12T03:37:05.486564+0000","last_active":"2024-09-12T03:37:07.489828+0000","last_peered":"2024-09-12T03:37:07.489828+0000","last_clean":"2024-09-12T03:37:07.489828+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.489828+0000","last_undegraded":"2024-09-12T03:37:07.489828+0000","last_fullsized":"2024-09-12T03:37:07.489828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:15.007890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.463213+0000","last_change":"2024-09-12T03:37:05.463213+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.463213+0000","last_undegraded":"2024-09-12T03:37:05.463213+0000","last_fullsized":"2024-09-12T03:37:05.463213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489733+0000","last_change":"2024-09-12T03:37:05.486727+0000","last_active":"2024-09-12T03:37:07.489733+0000","last_peered":"2024-09-12T03:37:07.489733+0000","last_clean":"2024-09-12T03:37:07.489733+0000","last_became_active":"2024-09-12T03:37:05.486147+0000","last_became_peered":"2024-09-12T03:37:05.486147+0000","last_unstale":"2024-09-12T03:37:07.489733+0000","last_undegraded":"2024-09-12T03:37:07.489733+0000","last_fullsized":"2024-09-12T03:37:07.489733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.039642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542699+0000","last_change":"2024-09-12T03:37:06.529021+0000","last_active":"2024-09-12T03:37:06.542699+0000","last_peered":"2024-09-12T03:37:06.542699+0000","last_clean":"2024-09-12T03:37:06.542699+0000","last_became_active":"2024-09-12T03:37:06.528314+0000","last_became_peered":"2024-09-12T03:37:06.528314+0000","last_unstale":"2024-09-12T03:37:06.542699+0000","last_undegraded":"2024-09-12T03:37:06.542699+0000","last_fullsized":"2024-09-12T03:37:06.542699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:18.263844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735928+0000","last_change":"2024-09-12T03:37:05.468166+0000","last_active":"2024-09-12T03:37:07.735928+0000","last_peered":"2024-09-12T03:37:07.735928+0000","last_clean":"2024-09-12T03:37:07.735928+0000","last_became_active":"2024-09-12T03:37:05.467379+0000","last_became_peered":"2024-09-12T03:37:05.467379+0000","last_unstale":"2024-09-12T03:37:07.735928+0000","last_undegraded":"2024-09-12T03:37:07.735928+0000","last_fullsized":"2024-09-12T03:37:07.735928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:19.886719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.469142+0000","last_change":"2024-09-12T03:37:05.469142+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.469142+0000","last_undegraded":"2024-09-12T03:37:05.469142+0000","last_fullsized":"2024-09-12T03:37:05.469142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.474190+0000","last_change":"2024-09-12T03:37:05.469039+0000","last_active":"2024-09-12T03:37:05.474190+0000","last_peered":"2024-09-12T03:37:05.474190+0000","last_clean":"2024-09-12T03:37:05.474190+0000","last_became_active":"2024-09-12T03:37:05.468116+0000","last_became_peered":"2024-09-12T03:37:05.468116+0000","last_unstale":"2024-09-12T03:37:05.474190+0000","last_undegraded":"2024-09-12T03:37:05.474190+0000","last_fullsized":"2024-09-12T03:37:05.474190+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:10.018840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542992+0000","last_change":"2024-09-12T03:37:06.532084+0000","last_active":"2024-09-12T03:37:06.542992+0000","last_peered":"2024-09-12T03:37:06.542992+0000","last_clean":"2024-09-12T03:37:06.542992+0000","last_became_active":"2024-09-12T03:37:06.531460+0000","last_became_peered":"2024-09-12T03:37:06.531460+0000","last_unstale":"2024-09-12T03:37:06.542992+0000","last_undegraded":"2024-09-12T03:37:06.542992+0000","last_fullsized":"2024-09-12T03:37:06.542992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.111098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490457+0000","last_change":"2024-09-12T03:37:05.504695+0000","last_active":"2024-09-12T03:37:07.490457+0000","last_peered":"2024-09-12T03:37:07.490457+0000","last_clean":"2024-09-12T03:37:07.490457+0000","last_became_active":"2024-09-12T03:37:05.503970+0000","last_became_peered":"2024-09-12T03:37:05.503970+0000","last_unstale":"2024-09-12T03:37:07.490457+0000","last_undegraded":"2024-09-12T03:37:07.490457+0000","last_fullsized":"2024-09-12T03:37:07.490457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.460703+0000","last_change":"2024-09-12T03:37:05.460703+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.460703+0000","last_undegraded":"2024-09-12T03:37:05.460703+0000","last_fullsized":"2024-09-12T03:37:05.460703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489771+0000","last_change":"2024-09-12T03:37:05.502764+0000","last_active":"2024-09-12T03:37:07.489771+0000","last_peered":"2024-09-12T03:37:07.489771+0000","last_clean":"2024-09-12T03:37:07.489771+0000","last_became_active":"2024-09-12T03:37:05.499370+0000","last_became_peered":"2024-09-12T03:37:05.499370+0000","last_unstale":"2024-09-12T03:37:07.489771+0000","last_undegraded":"2024-09-12T03:37:07.489771+0000","last_fullsized":"2024-09-12T03:37:07.489771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:32.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.468071+0000","last_change":"2024-09-12T03:37:05.468071+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.468071+0000","last_undegraded":"2024-09-12T03:37:05.468071+0000","last_fullsized":"2024-09-12T03:37:05.468071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.501138+0000","last_change":"2024-09-12T03:37:05.496667+0000","last_active":"2024-09-12T03:37:05.501138+0000","last_peered":"2024-09-12T03:37:05.501138+0000","last_clean":"2024-09-12T03:37:05.501138+0000","last_became_active":"2024-09-12T03:37:05.493460+0000","last_became_peered":"2024-09-12T03:37:05.493460+0000","last_unstale":"2024-09-12T03:37:05.501138+0000","last_undegraded":"2024-09-12T03:37:05.501138+0000","last_fullsized":"2024-09-12T03:37:05.501138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:15.747603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":73,"state":"creating+peering","last_fresh":"2024-09-12T03:37:05.464786+0000","last_change":"2024-09-12T03:37:05.464786+0000","last_active":"2024-09-12T03:37:05.445854+0000","last_peered":"2024-09-12T03:37:05.445854+0000","last_clean":"2024-09-12T03:37:05.445854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:05.464786+0000","last_undegraded":"2024-09-12T03:37:05.464786+0000","last_fullsized":"2024-09-12T03:37:05.464786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525488+0000","last_change":"2024-09-12T03:37:05.473252+0000","last_active":"2024-09-12T03:37:07.525488+0000","last_peered":"2024-09-12T03:37:07.525488+0000","last_clean":"2024-09-12T03:37:07.525488+0000","last_became_active":"2024-09-12T03:37:05.472943+0000","last_became_peered":"2024-09-12T03:37:05.472943+0000","last_unstale":"2024-09-12T03:37:07.525488+0000","last_undegraded":"2024-09-12T03:37:07.525488+0000","last_fullsized":"2024-09-12T03:37:07.525488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.445282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.533602+0000","last_change":"2024-09-12T03:37:06.527704+0000","last_active":"2024-09-12T03:37:06.533602+0000","last_peered":"2024-09-12T03:37:06.533602+0000","last_clean":"2024-09-12T03:37:06.533602+0000","last_became_active":"2024-09-12T03:37:06.527397+0000","last_became_peered":"2024-09-12T03:37:06.527397+0000","last_unstale":"2024-09-12T03:37:06.533602+0000","last_undegraded":"2024-09-12T03:37:06.533602+0000","last_fullsized":"2024-09-12T03:37:06.533602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:48.117214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-12T03:37:05.491340+0000","last_change":"2024-09-12T03:37:05.485037+0000","last_active":"2024-09-12T03:37:05.491340+0000","last_peered":"2024-09-12T03:37:05.491340+0000","last_clean":"2024-09-12T03:37:05.491340+0000","last_became_active":"2024-09-12T03:37:05.480275+0000","last_became_peered":"2024-09-12T03:37:05.480275+0000","last_unstale":"2024-09-12T03:37:05.491340+0000","last_undegraded":"2024-09-12T03:37:05.491340+0000","last_fullsized":"2024-09-12T03:37:05.491340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:04.169799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.522903+0000","last_change":"2024-09-12T03:37:06.520045+0000","last_active":"2024-09-12T03:37:06.522903+0000","last_peered":"2024-09-12T03:37:06.522903+0000","last_clean":"2024-09-12T03:37:06.522903+0000","last_became_active":"2024-09-12T03:37:06.519644+0000","last_became_peered":"2024-09-12T03:37:06.519644+0000","last_unstale":"2024-09-12T03:37:06.522903+0000","last_undegraded":"2024-09-12T03:37:06.522903+0000","last_fullsized":"2024-09-12T03:37:06.522903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:33.320891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.496993+0000","last_change":"2024-09-12T03:37:05.476302+0000","last_active":"2024-09-12T03:37:06.496993+0000","last_peered":"2024-09-12T03:37:06.496993+0000","last_clean":"2024-09-12T03:37:06.496993+0000","last_became_active":"2024-09-12T03:37:05.476014+0000","last_became_peered":"2024-09-12T03:37:05.476014+0000","last_unstale":"2024-09-12T03:37:06.496993+0000","last_undegraded":"2024-09-12T03:37:06.496993+0000","last_fullsized":"2024-09-12T03:37:06.496993+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.302276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490326+0000","last_change":"2024-09-12T03:37:06.514906+0000","last_active":"2024-09-12T03:37:07.490326+0000","last_peered":"2024-09-12T03:37:07.490326+0000","last_clean":"2024-09-12T03:37:07.490326+0000","last_became_active":"2024-09-12T03:37:06.514221+0000","last_became_peered":"2024-09-12T03:37:06.514221+0000","last_unstale":"2024-09-12T03:37:07.490326+0000","last_undegraded":"2024-09-12T03:37:07.490326+0000","last_fullsized":"2024-09-12T03:37:07.490326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:47.249428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490559+0000","last_change":"2024-09-12T03:37:05.486679+0000","last_active":"2024-09-12T03:37:07.490559+0000","last_peered":"2024-09-12T03:37:07.490559+0000","last_clean":"2024-09-12T03:37:07.490559+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.490559+0000","last_undegraded":"2024-09-12T03:37:07.490559+0000","last_fullsized":"2024-09-12T03:37:07.490559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490179+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:07.490179+0000","last_peered":"2024-09-12T03:37:07.490179+0000","last_clean":"2024-09-12T03:37:07.490179+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:07.490179+0000","last_undegraded":"2024-09-12T03:37:07.490179+0000","last_fullsized":"2024-09-12T03:37:07.490179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1507328,"data_stored":1003572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":913408,"data_stored":413216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":408206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":901120,"data_stored":407072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":909312,"data_stored":407232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":905216,"data_stored":406602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":884736,"data_stored":399323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1466368,"data_stored":983024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:11.237 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3e is not active+clean 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.463676+0000', 'last_change': '2024-09-12T03:37:05.463676+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.463676+0000', 'last_undegraded': '2024-09-12T03:37:05.463676+0000', 'last_fullsized': '2024-09-12T03:37:05.463676+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.475592+0000', 'last_change': '2024-09-12T03:37:05.475592+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.475592+0000', 'last_undegraded': '2024-09-12T03:37:05.475592+0000', 'last_fullsized': '2024-09-12T03:37:05.475592+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:PG 12.35 is not active+clean 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.463757+0000', 'last_change': '2024-09-12T03:37:05.463757+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.463757+0000', 'last_undegraded': '2024-09-12T03:37:05.463757+0000', 'last_fullsized': '2024-09-12T03:37:05.463757+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:PG 12.31 is not active+clean 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.463836+0000', 'last_change': '2024-09-12T03:37:05.463836+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.463836+0000', 'last_undegraded': '2024-09-12T03:37:05.463836+0000', 'last_fullsized': '2024-09-12T03:37:05.463836+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:PG 12.28 is not active+clean 2024-09-12T03:37:11.238 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.464286+0000', 'last_change': '2024-09-12T03:37:05.464286+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.464286+0000', 'last_undegraded': '2024-09-12T03:37:05.464286+0000', 'last_fullsized': '2024-09-12T03:37:05.464286+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:PG 12.27 is not active+clean 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.461931+0000', 'last_change': '2024-09-12T03:37:05.461931+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.461931+0000', 'last_undegraded': '2024-09-12T03:37:05.461931+0000', 'last_fullsized': '2024-09-12T03:37:05.461931+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:PG 12.23 is not active+clean 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.462360+0000', 'last_change': '2024-09-12T03:37:05.462360+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.462360+0000', 'last_undegraded': '2024-09-12T03:37:05.462360+0000', 'last_fullsized': '2024-09-12T03:37:05.462360+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:PG 12.19 is not active+clean 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.461497+0000', 'last_change': '2024-09-12T03:37:05.461497+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.461497+0000', 'last_undegraded': '2024-09-12T03:37:05.461497+0000', 'last_fullsized': '2024-09-12T03:37:05.461497+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1c is not active+clean 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.463663+0000', 'last_change': '2024-09-12T03:37:05.463663+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.463663+0000', 'last_undegraded': '2024-09-12T03:37:05.463663+0000', 'last_fullsized': '2024-09-12T03:37:05.463663+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1d is not active+clean 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.461977+0000', 'last_change': '2024-09-12T03:37:05.461977+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.461977+0000', 'last_undegraded': '2024-09-12T03:37:05.461977+0000', 'last_fullsized': '2024-09-12T03:37:05.461977+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.239 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.465212+0000', 'last_change': '2024-09-12T03:37:05.465212+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.465212+0000', 'last_undegraded': '2024-09-12T03:37:05.465212+0000', 'last_fullsized': '2024-09-12T03:37:05.465212+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:PG 12.10 is not active+clean 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.461373+0000', 'last_change': '2024-09-12T03:37:05.461373+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.461373+0000', 'last_undegraded': '2024-09-12T03:37:05.461373+0000', 'last_fullsized': '2024-09-12T03:37:05.461373+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.465918+0000', 'last_change': '2024-09-12T03:37:05.465918+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.465918+0000', 'last_undegraded': '2024-09-12T03:37:05.465918+0000', 'last_fullsized': '2024-09-12T03:37:05.465918+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.462036+0000', 'last_change': '2024-09-12T03:37:05.462036+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.462036+0000', 'last_undegraded': '2024-09-12T03:37:05.462036+0000', 'last_fullsized': '2024-09-12T03:37:05.462036+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.464140+0000', 'last_change': '2024-09-12T03:37:05.464140+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.464140+0000', 'last_undegraded': '2024-09-12T03:37:05.464140+0000', 'last_fullsized': '2024-09-12T03:37:05.464140+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:PG 12.c is not active+clean 2024-09-12T03:37:11.240 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.460985+0000', 'last_change': '2024-09-12T03:37:05.460985+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.460985+0000', 'last_undegraded': '2024-09-12T03:37:05.460985+0000', 'last_fullsized': '2024-09-12T03:37:05.460985+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:PG 12.e is not active+clean 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.460553+0000', 'last_change': '2024-09-12T03:37:05.460553+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.460553+0000', 'last_undegraded': '2024-09-12T03:37:05.460553+0000', 'last_fullsized': '2024-09-12T03:37:05.460553+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.463213+0000', 'last_change': '2024-09-12T03:37:05.463213+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.463213+0000', 'last_undegraded': '2024-09-12T03:37:05.463213+0000', 'last_fullsized': '2024-09-12T03:37:05.463213+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.469142+0000', 'last_change': '2024-09-12T03:37:05.469142+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.469142+0000', 'last_undegraded': '2024-09-12T03:37:05.469142+0000', 'last_fullsized': '2024-09-12T03:37:05.469142+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3 is not active+clean 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.460703+0000', 'last_change': '2024-09-12T03:37:05.460703+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.460703+0000', 'last_undegraded': '2024-09-12T03:37:05.460703+0000', 'last_fullsized': '2024-09-12T03:37:05.460703+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-12T03:37:11.241 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.468071+0000', 'last_change': '2024-09-12T03:37:05.468071+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.468071+0000', 'last_undegraded': '2024-09-12T03:37:05.468071+0000', 'last_fullsized': '2024-09-12T03:37:05.468071+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.242 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-12T03:37:11.242 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 73, 'state': 'creating+peering', 'last_fresh': '2024-09-12T03:37:05.464786+0000', 'last_change': '2024-09-12T03:37:05.464786+0000', 'last_active': '2024-09-12T03:37:05.445854+0000', 'last_peered': '2024-09-12T03:37:05.445854+0000', 'last_clean': '2024-09-12T03:37:05.445854+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T03:37:05.464786+0000', 'last_undegraded': '2024-09-12T03:37:05.464786+0000', 'last_fullsized': '2024-09-12T03:37:05.464786+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'last_clean_scrub_stamp': '2024-09-12T03:37:05.445854+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T03:37:11.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T03:37:11.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.394+0000 7fed52dd9640 1 Processor -- start 2024-09-12T03:37:11.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.394+0000 7fed52dd9640 1 -- start start 2024-09-12T03:37:11.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.394+0000 7fed52dd9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fed4c070020 0x7fed4c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.394+0000 7fed52dd9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed4c0aede0 con 0x7fed4c15f1d0 2024-09-12T03:37:11.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.394+0000 7fed52dd9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed4c15fa10 con 0x7fed4c1520a0 2024-09-12T03:37:11.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.394+0000 7fed52dd9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fed4c152480 con 0x7fed4c070020 2024-09-12T03:37:11.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fed4c15f1d0 0x7fed4c0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58152/0 (socket says 172.21.15.73:58152) 2024-09-12T03:37:11.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 -- 172.21.15.73:0/2603226261 learned_addr learned my addr 172.21.15.73:0/2603226261 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4bfff640 1 --2- 172.21.15.73:0/2603226261 >> v2:172.21.15.150:3300/0 conn(0x7fed4c070020 0x7fed4c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3939262134 0 0) 0x7fed4c0aede0 con 0x7fed4c15f1d0 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed34003530 con 0x7fed4c15f1d0 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2137019389 0 0) 0x7fed34003530 con 0x7fed4c15f1d0 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 >> v2:172.21.15.150:3300/0 conn(0x7fed4c070020 msgr2=0x7fed4c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 --2- 172.21.15.73:0/2603226261 >> v2:172.21.15.150:3300/0 conn(0x7fed4c070020 0x7fed4c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 >> v1:172.21.15.150:6789/0 conn(0x7fed4c1520a0 legacy=0x7fed4c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c074250 con 0x7fed4c15f1d0 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fed44001a00 con 0x7fed4c15f1d0 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 >> v1:172.21.15.73:6789/0 conn(0x7fed4c15f1d0 legacy=0x7fed4c0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed340039c0 0x7fed34003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed34004810 0x7fed34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fed3400c040 con 0x7fed340051d0 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fed3400c1f0 con 0x7fed340039c0 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fed3400c3f0 con 0x7fed34004810 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed50b75640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed340039c0 0x7fed34003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4bfff640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed34004810 0x7fed34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 -- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed34004810 msgr2=0x7fed34004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed34004810 0x7fed34004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 -- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed340039c0 msgr2=0x7fed34003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:11.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed340039c0 0x7fed34003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 -- 172.21.15.73:0/2603226261 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed34003530 con 0x7fed340051d0 2024-09-12T03:37:11.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4bfff640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed34004810 0x7fed34004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:11.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 -- 172.21.15.73:0/2603226261 reap_dead start 2024-09-12T03:37:11.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed51376640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed3400b9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fed4400a860 tx=0x7fed4401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2590b1c966cde8ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4400a480 con 0x7fed340051d0 2024-09-12T03:37:11.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed440ad630 con 0x7fed340051d0 2024-09-12T03:37:11.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.398+0000 7fed4b7fe640 1 -- 172.21.15.73:0/2603226261 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed440ada00 con 0x7fed340051d0 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- 172.21.15.73:0/2603226261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 msgr2=0x7fed3400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed3400b9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fed4400a860 tx=0x7fed4401d380 comp rx=0 tx=0).stop 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- 172.21.15.73:0/2603226261 shutdown_connections 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2603226261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed3400b9d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- 172.21.15.73:0/2603226261 >> 172.21.15.73:0/2603226261 conn(0x7fed4c0b1f90 msgr2=0x7fed4c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- 172.21.15.73:0/2603226261 shutdown_connections 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- 172.21.15.73:0/2603226261 wait complete. 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 Processor -- start 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- start start 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed4c1f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed4c1f4ec0 0x7fed4c149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed4c0b42e0 0x7fed4c0b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c073a50 con 0x7fed340051d0 2024-09-12T03:37:11.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c073770 con 0x7fed4c1f4ec0 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fed4c073d30 con 0x7fed4c0b42e0 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed4c1f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed4c1f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39704/0 (socket says 172.21.15.73:39704) 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 -- 172.21.15.73:0/2530307012 learned_addr learned my addr 172.21.15.73:0/2530307012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed4bfff640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed4c1f4ec0 0x7fed4c149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed51376640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed4c0b42e0 0x7fed4c0b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 -- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed4c0b42e0 msgr2=0x7fed4c0b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed4c0b42e0 0x7fed4c0b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 -- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed4c1f4ec0 msgr2=0x7fed4c149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed4c1f4ec0 0x7fed4c149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 -- 172.21.15.73:0/2530307012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c1f8780 con 0x7fed340051d0 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed4bfff640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed4c1f4ec0 0x7fed4c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed50b75640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed4c1f8240 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00e4b0 tx=0x7fed3c00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed497fa640 1 -- 172.21.15.73:0/2530307012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0052e0 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed497fa640 1 -- 172.21.15.73:0/2530307012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3c018070 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4c0cba20 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed497fa640 1 -- 172.21.15.73:0/2530307012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3c005480 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.402+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4c0cb740 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.406+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4c068e50 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.406+0000 7fed497fa640 1 -- 172.21.15.73:0/2530307012 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fed3c003840 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.406+0000 7fed497fa640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed380678f0 0x7fed38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.406+0000 7fed497fa640 1 -- 172.21.15.73:0/2530307012 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fed3c085710 con 0x7fed340051d0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.406+0000 7fed4bfff640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed380678f0 0x7fed38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.406+0000 7fed4bfff640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed380678f0 0x7fed38069db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed4c15e7a0 tx=0x7fed40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.410+0000 7fed497fa640 1 -- 172.21.15.73:0/2530307012 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fed4c1f8780 con 0x7fed340051d0 2024-09-12T03:37:11.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.618+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fed4c0aede0 con 0x7fed340051d0 2024-09-12T03:37:11.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.618+0000 7fed497fa640 1 -- 172.21.15.73:0/2530307012 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1560 (secure 0 0 0) 0x7fed3c0560c0 con 0x7fed340051d0 2024-09-12T03:37:11.620 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:11.620 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":176,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1726112066,"num_in_osds":8,"osd_in_since":1726112057,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":75},{"state_name":"creating+peering","count":22}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591166,"bytes_used":255410176,"bytes_avail":772838703104,"bytes_total":773094113280,"inactive_pgs_ratio":0.22680412232875824,"write_bytes_sec":2090,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":41,"btime":"2024-09-12T03:37:09:534051+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5892}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-12T03:36:23.821828+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T03:37:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed380678f0 msgr2=0x7fed38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed380678f0 0x7fed38069db0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed4c15e7a0 tx=0x7fed40008040 comp rx=0 tx=0).stop 2024-09-12T03:37:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 msgr2=0x7fed4c1f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed4c1f8240 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00e4b0 tx=0x7fed3c00e970 comp rx=0 tx=0).stop 2024-09-12T03:37:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 shutdown_connections 2024-09-12T03:37:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fed380678f0 0x7fed38069db0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fed4c0b42e0 0x7fed4c0b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fed4c1f4ec0 0x7fed4c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 --2- 172.21.15.73:0/2530307012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed340051d0 0x7fed4c1f8240 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 >> 172.21.15.73:0/2530307012 conn(0x7fed4c0b1f90 msgr2=0x7fed4c0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 shutdown_connections 2024-09-12T03:37:11.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.622+0000 7fed52dd9640 1 -- 172.21.15.73:0/2530307012 wait complete. 2024-09-12T03:37:11.638 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T03:37:11.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:11.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.754+0000 7f147d971640 1 Processor -- start 2024-09-12T03:37:11.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.754+0000 7f147d971640 1 -- start start 2024-09-12T03:37:11.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f147d971640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 0x7f147806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f147d971640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1478070250 con 0x7f147806fe50 2024-09-12T03:37:11.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f147d971640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14780aede0 con 0x7f147815f3a0 2024-09-12T03:37:11.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f147d971640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1478152480 con 0x7f14781520a0 2024-09-12T03:37:11.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14767fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f147806fe50 0x7f147815ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58160/0 (socket says 172.21.15.73:58160) 2024-09-12T03:37:11.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14767fc640 1 -- 172.21.15.73:0/2636631686 learned_addr learned my addr 172.21.15.73:0/2636631686 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:11.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1476ffd640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 0x7f147806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864914830 0 0) 0x7f1478070250 con 0x7f147806fe50 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1464003530 con 0x7f147806fe50 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1573387153 0 0) 0x7f1464003530 con 0x7f147806fe50 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 msgr2=0x7f147806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 0x7f147806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 >> v1:172.21.15.150:6789/0 conn(0x7f147815f3a0 legacy=0x7f14780adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147815fa10 con 0x7f147806fe50 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f1468001a00 con 0x7f147806fe50 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 >> v1:172.21.15.73:6789/0 conn(0x7f147806fe50 legacy=0x7f147815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14640039f0 0x7f1464003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 0x7f1464004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1464004d50 0x7f14640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f146400ba80 con 0x7f1464004d50 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f146400bc00 con 0x7f14640039f0 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f146400be00 con 0x7f14781520a0 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14777fe640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1464004d50 0x7f14640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14767fc640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 0x7f1464004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f1476ffd640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14640039f0 0x7f1464003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14777fe640 1 -- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 msgr2=0x7f1464004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14777fe640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f14781520a0 0x7f1464004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14777fe640 1 -- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14640039f0 msgr2=0x7f1464003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14777fe640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14640039f0 0x7f1464003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.758+0000 7f14777fe640 1 -- 172.21.15.73:0/2636631686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1464003530 con 0x7f1464004d50 2024-09-12T03:37:11.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1464004d50 0x7f14640051d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1470001750 tx=0x7f147001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783b7b2eb13c6c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14700013a0 con 0x7f1464004d50 2024-09-12T03:37:11.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14700052f0 con 0x7f1464004d50 2024-09-12T03:37:11.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f1475ffb640 1 -- 172.21.15.73:0/2636631686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470003840 con 0x7f1464004d50 2024-09-12T03:37:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- 172.21.15.73:0/2636631686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1464004d50 msgr2=0x7f14640051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 --2- 172.21.15.73:0/2636631686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1464004d50 0x7f14640051d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1470001750 tx=0x7f147001c3e0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 -- 172.21.15.73:0/2636631686 reap_dead start 2024-09-12T03:37:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- 172.21.15.73:0/2636631686 shutdown_connections 2024-09-12T03:37:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- 172.21.15.73:0/2636631686 >> 172.21.15.73:0/2636631686 conn(0x7f14780b1f90 msgr2=0x7f14780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- 172.21.15.73:0/2636631686 shutdown_connections 2024-09-12T03:37:11.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- 172.21.15.73:0/2636631686 wait complete. 2024-09-12T03:37:11.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 Processor -- start 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- start start 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1464004d50 0x7f14781548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f147814c5c0 0x7f147814db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f147815de10 0x7f1478099520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1478073770 con 0x7f147815de10 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1478073490 con 0x7f147814c5c0 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1478073a50 con 0x7f1464004d50 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f147815de10 0x7f1478099520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f147815de10 0x7f1478099520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39730/0 (socket says 172.21.15.73:39730) 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 -- 172.21.15.73:0/3264129038 learned_addr learned my addr 172.21.15.73:0/3264129038 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:11.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14767fc640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f147814c5c0 0x7f147814db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f1476ffd640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1464004d50 0x7f14781548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 -- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1464004d50 msgr2=0x7f14781548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1464004d50 0x7f14781548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 -- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f147814c5c0 msgr2=0x7f147814db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f147814c5c0 0x7f147814db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 -- 172.21.15.73:0/3264129038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147814caa0 con 0x7f147815de10 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f14777fe640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f147815de10 0x7f1478099520 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1470005040 tx=0x7f1464005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f146ffff640 1 -- 172.21.15.73:0/3264129038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14700013a0 con 0x7f147815de10 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f146ffff640 1 -- 172.21.15.73:0/3264129038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14700054a0 con 0x7f147815de10 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147814cd80 con 0x7f147815de10 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f146ffff640 1 -- 172.21.15.73:0/3264129038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470007a40 con 0x7f147815de10 2024-09-12T03:37:11.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.762+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147814d340 con 0x7f147815de10 2024-09-12T03:37:11.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.766+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1478073d30 con 0x7f147815de10 2024-09-12T03:37:11.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.766+0000 7f146ffff640 1 -- 172.21.15.73:0/3264129038 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14700bd020 con 0x7f147815de10 2024-09-12T03:37:11.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.766+0000 7f146ffff640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14580678c0 0x7f1458069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:11.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.766+0000 7f1476ffd640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14580678c0 0x7f1458069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:11.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.766+0000 7f146ffff640 1 -- 172.21.15.73:0/3264129038 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f147011fd20 con 0x7f147815de10 2024-09-12T03:37:11.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.766+0000 7f1476ffd640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14580678c0 0x7f1458069d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1460009970 tx=0x7f1460008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:11.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.770+0000 7f146ffff640 1 -- 172.21.15.73:0/3264129038 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f14700160f0 con 0x7f147815de10 2024-09-12T03:37:11.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.926+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14780b3680 con 0x7f14580678c0 2024-09-12T03:37:11.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.938+0000 7f146ffff640 1 -- 172.21.15.73:0/3264129038 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252062 (secure 0 0 0) 0x7f14780b3680 con 0x7f14580678c0 2024-09-12T03:37:11.940 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:11.942 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.938+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14580678c0 msgr2=0x7f1458069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.938+0000 7f147d971640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14580678c0 0x7f1458069d80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1460009970 tx=0x7f1460008040 comp rx=0 tx=0).stop 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.938+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f147815de10 msgr2=0x7f1478099520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.938+0000 7f147d971640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f147815de10 0x7f1478099520 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1470005040 tx=0x7f1464005840 comp rx=0 tx=0).stop 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 shutdown_connections 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f14580678c0 0x7f1458069d80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f147815de10 0x7f1478099520 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f147814c5c0 0x7f147814db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 --2- 172.21.15.73:0/3264129038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1464004d50 0x7f14781548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:11.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 >> 172.21.15.73:0/3264129038 conn(0x7f14780b1f90 msgr2=0x7f14780b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:11.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 shutdown_connections 2024-09-12T03:37:11.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:11.942+0000 7f147d971640 1 -- 172.21.15.73:0/3264129038 wait complete. 2024-09-12T03:37:11.959 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-12T03:37:11.835132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249496,"kb_used_data":8280,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725224,"statfs":{"total":773094113280,"available":772838629376,"internally_reserved":0,"allocated":8478720,"data_stored":4464244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":246795827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.383641"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490484+0000","last_change":"2024-09-12T03:37:06.514437+0000","last_active":"2024-09-12T03:37:07.490484+0000","last_peered":"2024-09-12T03:37:07.490484+0000","last_clean":"2024-09-12T03:37:07.490484+0000","last_became_active":"2024-09-12T03:37:06.513608+0000","last_became_peered":"2024-09-12T03:37:06.513608+0000","last_unstale":"2024-09-12T03:37:07.490484+0000","last_undegraded":"2024-09-12T03:37:07.490484+0000","last_fullsized":"2024-09-12T03:37:07.490484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:14.954094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486683+0000","last_change":"2024-09-12T03:37:06.526622+0000","last_active":"2024-09-12T03:37:07.486683+0000","last_peered":"2024-09-12T03:37:07.486683+0000","last_clean":"2024-09-12T03:37:07.486683+0000","last_became_active":"2024-09-12T03:37:06.526228+0000","last_became_peered":"2024-09-12T03:37:06.526228+0000","last_unstale":"2024-09-12T03:37:07.486683+0000","last_undegraded":"2024-09-12T03:37:07.486683+0000","last_fullsized":"2024-09-12T03:37:07.486683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.203496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.540703+0000","last_change":"2024-09-12T03:37:06.537800+0000","last_active":"2024-09-12T03:37:06.540703+0000","last_peered":"2024-09-12T03:37:06.540703+0000","last_clean":"2024-09-12T03:37:06.540703+0000","last_became_active":"2024-09-12T03:37:06.537380+0000","last_became_peered":"2024-09-12T03:37:06.537380+0000","last_unstale":"2024-09-12T03:37:06.540703+0000","last_undegraded":"2024-09-12T03:37:06.540703+0000","last_fullsized":"2024-09-12T03:37:06.540703+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:02.077400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736298+0000","last_change":"2024-09-12T03:37:06.502862+0000","last_active":"2024-09-12T03:37:07.736298+0000","last_peered":"2024-09-12T03:37:07.736298+0000","last_clean":"2024-09-12T03:37:07.736298+0000","last_became_active":"2024-09-12T03:37:06.502106+0000","last_became_peered":"2024-09-12T03:37:06.502106+0000","last_unstale":"2024-09-12T03:37:07.736298+0000","last_undegraded":"2024-09-12T03:37:07.736298+0000","last_fullsized":"2024-09-12T03:37:07.736298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525735+0000","last_change":"2024-09-12T03:37:06.510258+0000","last_active":"2024-09-12T03:37:07.525735+0000","last_peered":"2024-09-12T03:37:07.525735+0000","last_clean":"2024-09-12T03:37:07.525735+0000","last_became_active":"2024-09-12T03:37:06.509410+0000","last_became_peered":"2024-09-12T03:37:06.509410+0000","last_unstale":"2024-09-12T03:37:07.525735+0000","last_undegraded":"2024-09-12T03:37:07.525735+0000","last_fullsized":"2024-09-12T03:37:07.525735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:00.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490171+0000","last_change":"2024-09-12T03:37:06.531549+0000","last_active":"2024-09-12T03:37:07.490171+0000","last_peered":"2024-09-12T03:37:07.490171+0000","last_clean":"2024-09-12T03:37:07.490171+0000","last_became_active":"2024-09-12T03:37:06.530951+0000","last_became_peered":"2024-09-12T03:37:06.530951+0000","last_unstale":"2024-09-12T03:37:07.490171+0000","last_undegraded":"2024-09-12T03:37:07.490171+0000","last_fullsized":"2024-09-12T03:37:07.490171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:39.887489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524557+0000","last_change":"2024-09-12T03:37:06.527833+0000","last_active":"2024-09-12T03:37:08.524557+0000","last_peered":"2024-09-12T03:37:08.524557+0000","last_clean":"2024-09-12T03:37:08.524557+0000","last_became_active":"2024-09-12T03:37:06.527142+0000","last_became_peered":"2024-09-12T03:37:06.527142+0000","last_unstale":"2024-09-12T03:37:08.524557+0000","last_undegraded":"2024-09-12T03:37:08.524557+0000","last_fullsized":"2024-09-12T03:37:08.524557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:18.544723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524109+0000","last_change":"2024-09-12T03:37:06.516755+0000","last_active":"2024-09-12T03:37:07.524109+0000","last_peered":"2024-09-12T03:37:07.524109+0000","last_clean":"2024-09-12T03:37:07.524109+0000","last_became_active":"2024-09-12T03:37:06.515980+0000","last_became_peered":"2024-09-12T03:37:06.515980+0000","last_unstale":"2024-09-12T03:37:07.524109+0000","last_undegraded":"2024-09-12T03:37:07.524109+0000","last_fullsized":"2024-09-12T03:37:07.524109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:11.002245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536002+0000","last_change":"2024-09-12T03:37:06.523408+0000","last_active":"2024-09-12T03:37:06.536002+0000","last_peered":"2024-09-12T03:37:06.536002+0000","last_clean":"2024-09-12T03:37:06.536002+0000","last_became_active":"2024-09-12T03:37:06.522698+0000","last_became_peered":"2024-09-12T03:37:06.522698+0000","last_unstale":"2024-09-12T03:37:06.536002+0000","last_undegraded":"2024-09-12T03:37:06.536002+0000","last_fullsized":"2024-09-12T03:37:06.536002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.051078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736249+0000","last_change":"2024-09-12T03:37:06.531047+0000","last_active":"2024-09-12T03:37:07.736249+0000","last_peered":"2024-09-12T03:37:07.736249+0000","last_clean":"2024-09-12T03:37:07.736249+0000","last_became_active":"2024-09-12T03:37:06.530313+0000","last_became_peered":"2024-09-12T03:37:06.530313+0000","last_unstale":"2024-09-12T03:37:07.736249+0000","last_undegraded":"2024-09-12T03:37:07.736249+0000","last_fullsized":"2024-09-12T03:37:07.736249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:50.907872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486504+0000","last_change":"2024-09-12T03:37:06.536308+0000","last_active":"2024-09-12T03:37:07.486504+0000","last_peered":"2024-09-12T03:37:07.486504+0000","last_clean":"2024-09-12T03:37:07.486504+0000","last_became_active":"2024-09-12T03:37:06.529889+0000","last_became_peered":"2024-09-12T03:37:06.529889+0000","last_unstale":"2024-09-12T03:37:07.486504+0000","last_undegraded":"2024-09-12T03:37:07.486504+0000","last_fullsized":"2024-09-12T03:37:07.486504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:10.002268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736293+0000","last_change":"2024-09-12T03:37:06.527826+0000","last_active":"2024-09-12T03:37:07.736293+0000","last_peered":"2024-09-12T03:37:07.736293+0000","last_clean":"2024-09-12T03:37:07.736293+0000","last_became_active":"2024-09-12T03:37:06.527024+0000","last_became_peered":"2024-09-12T03:37:06.527024+0000","last_unstale":"2024-09-12T03:37:07.736293+0000","last_undegraded":"2024-09-12T03:37:07.736293+0000","last_fullsized":"2024-09-12T03:37:07.736293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:37.906427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525835+0000","last_change":"2024-09-12T03:37:06.520117+0000","last_active":"2024-09-12T03:37:07.525835+0000","last_peered":"2024-09-12T03:37:07.525835+0000","last_clean":"2024-09-12T03:37:07.525835+0000","last_became_active":"2024-09-12T03:37:06.519404+0000","last_became_peered":"2024-09-12T03:37:06.519404+0000","last_unstale":"2024-09-12T03:37:07.525835+0000","last_undegraded":"2024-09-12T03:37:07.525835+0000","last_fullsized":"2024-09-12T03:37:07.525835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:13.557412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490257+0000","last_change":"2024-09-12T03:37:06.531349+0000","last_active":"2024-09-12T03:37:07.490257+0000","last_peered":"2024-09-12T03:37:07.490257+0000","last_clean":"2024-09-12T03:37:07.490257+0000","last_became_active":"2024-09-12T03:37:06.530817+0000","last_became_peered":"2024-09-12T03:37:06.530817+0000","last_unstale":"2024-09-12T03:37:07.490257+0000","last_undegraded":"2024-09-12T03:37:07.490257+0000","last_fullsized":"2024-09-12T03:37:07.490257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:35.000985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485307+0000","last_change":"2024-09-12T03:37:06.530660+0000","last_active":"2024-09-12T03:37:07.485307+0000","last_peered":"2024-09-12T03:37:07.485307+0000","last_clean":"2024-09-12T03:37:07.485307+0000","last_became_active":"2024-09-12T03:37:06.530221+0000","last_became_peered":"2024-09-12T03:37:06.530221+0000","last_unstale":"2024-09-12T03:37:07.485307+0000","last_undegraded":"2024-09-12T03:37:07.485307+0000","last_fullsized":"2024-09-12T03:37:07.485307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:48.703179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489610+0000","last_change":"2024-09-12T03:37:06.514904+0000","last_active":"2024-09-12T03:37:07.489610+0000","last_peered":"2024-09-12T03:37:07.489610+0000","last_clean":"2024-09-12T03:37:07.489610+0000","last_became_active":"2024-09-12T03:37:06.514039+0000","last_became_peered":"2024-09-12T03:37:06.514039+0000","last_unstale":"2024-09-12T03:37:07.489610+0000","last_undegraded":"2024-09-12T03:37:07.489610+0000","last_fullsized":"2024-09-12T03:37:07.489610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.632530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526403+0000","last_change":"2024-09-12T03:37:06.532098+0000","last_active":"2024-09-12T03:37:07.526403+0000","last_peered":"2024-09-12T03:37:07.526403+0000","last_clean":"2024-09-12T03:37:07.526403+0000","last_became_active":"2024-09-12T03:37:06.531862+0000","last_became_peered":"2024-09-12T03:37:06.531862+0000","last_unstale":"2024-09-12T03:37:07.526403+0000","last_undegraded":"2024-09-12T03:37:07.526403+0000","last_fullsized":"2024-09-12T03:37:07.526403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.841005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.510047+0000","last_change":"2024-09-12T03:37:06.504175+0000","last_active":"2024-09-12T03:37:06.510047+0000","last_peered":"2024-09-12T03:37:06.510047+0000","last_clean":"2024-09-12T03:37:06.510047+0000","last_became_active":"2024-09-12T03:37:06.503252+0000","last_became_peered":"2024-09-12T03:37:06.503252+0000","last_unstale":"2024-09-12T03:37:06.510047+0000","last_undegraded":"2024-09-12T03:37:06.510047+0000","last_fullsized":"2024-09-12T03:37:06.510047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:07.426916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490185+0000","last_change":"2024-09-12T03:37:06.522629+0000","last_active":"2024-09-12T03:37:07.490185+0000","last_peered":"2024-09-12T03:37:07.490185+0000","last_clean":"2024-09-12T03:37:07.490185+0000","last_became_active":"2024-09-12T03:37:06.522349+0000","last_became_peered":"2024-09-12T03:37:06.522349+0000","last_unstale":"2024-09-12T03:37:07.490185+0000","last_undegraded":"2024-09-12T03:37:07.490185+0000","last_fullsized":"2024-09-12T03:37:07.490185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:18.204607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525939+0000","last_change":"2024-09-12T03:37:06.505805+0000","last_active":"2024-09-12T03:37:07.525939+0000","last_peered":"2024-09-12T03:37:07.525939+0000","last_clean":"2024-09-12T03:37:07.525939+0000","last_became_active":"2024-09-12T03:37:06.504970+0000","last_became_peered":"2024-09-12T03:37:06.504970+0000","last_unstale":"2024-09-12T03:37:07.525939+0000","last_undegraded":"2024-09-12T03:37:07.525939+0000","last_fullsized":"2024-09-12T03:37:07.525939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:33.899192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509640+0000","last_change":"2024-09-12T03:37:06.500401+0000","last_active":"2024-09-12T03:37:06.509640+0000","last_peered":"2024-09-12T03:37:06.509640+0000","last_clean":"2024-09-12T03:37:06.509640+0000","last_became_active":"2024-09-12T03:37:06.499636+0000","last_became_peered":"2024-09-12T03:37:06.499636+0000","last_unstale":"2024-09-12T03:37:06.509640+0000","last_undegraded":"2024-09-12T03:37:06.509640+0000","last_fullsized":"2024-09-12T03:37:06.509640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:28.462827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524890+0000","last_change":"2024-09-12T03:37:06.543601+0000","last_active":"2024-09-12T03:37:07.524890+0000","last_peered":"2024-09-12T03:37:07.524890+0000","last_clean":"2024-09-12T03:37:07.524890+0000","last_became_active":"2024-09-12T03:37:06.542384+0000","last_became_peered":"2024-09-12T03:37:06.542384+0000","last_unstale":"2024-09-12T03:37:07.524890+0000","last_undegraded":"2024-09-12T03:37:07.524890+0000","last_fullsized":"2024-09-12T03:37:07.524890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.149213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.499591+0000","last_change":"2024-09-12T03:37:06.497773+0000","last_active":"2024-09-12T03:37:06.499591+0000","last_peered":"2024-09-12T03:37:06.499591+0000","last_clean":"2024-09-12T03:37:06.499591+0000","last_became_active":"2024-09-12T03:37:06.496867+0000","last_became_peered":"2024-09-12T03:37:06.496867+0000","last_unstale":"2024-09-12T03:37:06.499591+0000","last_undegraded":"2024-09-12T03:37:06.499591+0000","last_fullsized":"2024-09-12T03:37:06.499591+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:52.164141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485330+0000","last_change":"2024-09-12T03:37:06.530211+0000","last_active":"2024-09-12T03:37:07.485330+0000","last_peered":"2024-09-12T03:37:07.485330+0000","last_clean":"2024-09-12T03:37:07.485330+0000","last_became_active":"2024-09-12T03:37:06.527133+0000","last_became_peered":"2024-09-12T03:37:06.527133+0000","last_unstale":"2024-09-12T03:37:07.485330+0000","last_undegraded":"2024-09-12T03:37:07.485330+0000","last_fullsized":"2024-09-12T03:37:07.485330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:19.876518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486989+0000","last_change":"2024-09-12T03:37:06.530602+0000","last_active":"2024-09-12T03:37:07.486989+0000","last_peered":"2024-09-12T03:37:07.486989+0000","last_clean":"2024-09-12T03:37:07.486989+0000","last_became_active":"2024-09-12T03:37:06.526983+0000","last_became_peered":"2024-09-12T03:37:06.526983+0000","last_unstale":"2024-09-12T03:37:07.486989+0000","last_undegraded":"2024-09-12T03:37:07.486989+0000","last_fullsized":"2024-09-12T03:37:07.486989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:26.881150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736116+0000","last_change":"2024-09-12T03:37:06.527918+0000","last_active":"2024-09-12T03:37:07.736116+0000","last_peered":"2024-09-12T03:37:07.736116+0000","last_clean":"2024-09-12T03:37:07.736116+0000","last_became_active":"2024-09-12T03:37:06.527243+0000","last_became_peered":"2024-09-12T03:37:06.527243+0000","last_unstale":"2024-09-12T03:37:07.736116+0000","last_undegraded":"2024-09-12T03:37:07.736116+0000","last_fullsized":"2024-09-12T03:37:07.736116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:32.967011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489935+0000","last_change":"2024-09-12T03:37:06.513491+0000","last_active":"2024-09-12T03:37:07.489935+0000","last_peered":"2024-09-12T03:37:07.489935+0000","last_clean":"2024-09-12T03:37:07.489935+0000","last_became_active":"2024-09-12T03:37:06.508794+0000","last_became_peered":"2024-09-12T03:37:06.508794+0000","last_unstale":"2024-09-12T03:37:07.489935+0000","last_undegraded":"2024-09-12T03:37:07.489935+0000","last_fullsized":"2024-09-12T03:37:07.489935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.834025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526079+0000","last_change":"2024-09-12T03:37:06.493731+0000","last_active":"2024-09-12T03:37:07.526079+0000","last_peered":"2024-09-12T03:37:07.526079+0000","last_clean":"2024-09-12T03:37:07.526079+0000","last_became_active":"2024-09-12T03:37:06.492963+0000","last_became_peered":"2024-09-12T03:37:06.492963+0000","last_unstale":"2024-09-12T03:37:07.526079+0000","last_undegraded":"2024-09-12T03:37:07.526079+0000","last_fullsized":"2024-09-12T03:37:07.526079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:40.752488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485898+0000","last_change":"2024-09-12T03:37:06.537468+0000","last_active":"2024-09-12T03:37:07.485898+0000","last_peered":"2024-09-12T03:37:07.485898+0000","last_clean":"2024-09-12T03:37:07.485898+0000","last_became_active":"2024-09-12T03:37:06.537055+0000","last_became_peered":"2024-09-12T03:37:06.537055+0000","last_unstale":"2024-09-12T03:37:07.485898+0000","last_undegraded":"2024-09-12T03:37:07.485898+0000","last_fullsized":"2024-09-12T03:37:07.485898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:01.802028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489520+0000","last_change":"2024-09-12T03:37:06.538257+0000","last_active":"2024-09-12T03:37:07.489520+0000","last_peered":"2024-09-12T03:37:07.489520+0000","last_clean":"2024-09-12T03:37:07.489520+0000","last_became_active":"2024-09-12T03:37:06.537464+0000","last_became_peered":"2024-09-12T03:37:06.537464+0000","last_unstale":"2024-09-12T03:37:07.489520+0000","last_undegraded":"2024-09-12T03:37:07.489520+0000","last_fullsized":"2024-09-12T03:37:07.489520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:47.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537849+0000","last_change":"2024-09-12T03:37:06.529226+0000","last_active":"2024-09-12T03:37:06.537849+0000","last_peered":"2024-09-12T03:37:06.537849+0000","last_clean":"2024-09-12T03:37:06.537849+0000","last_became_active":"2024-09-12T03:37:06.528961+0000","last_became_peered":"2024-09-12T03:37:06.528961+0000","last_unstale":"2024-09-12T03:37:06.537849+0000","last_undegraded":"2024-09-12T03:37:06.537849+0000","last_fullsized":"2024-09-12T03:37:06.537849+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:29.822067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490040+0000","last_change":"2024-09-12T03:37:06.520303+0000","last_active":"2024-09-12T03:37:07.490040+0000","last_peered":"2024-09-12T03:37:07.490040+0000","last_clean":"2024-09-12T03:37:07.490040+0000","last_became_active":"2024-09-12T03:37:06.514601+0000","last_became_peered":"2024-09-12T03:37:06.514601+0000","last_unstale":"2024-09-12T03:37:07.490040+0000","last_undegraded":"2024-09-12T03:37:07.490040+0000","last_fullsized":"2024-09-12T03:37:07.490040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:02.773931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509950+0000","last_change":"2024-09-12T03:37:06.503918+0000","last_active":"2024-09-12T03:37:06.509950+0000","last_peered":"2024-09-12T03:37:06.509950+0000","last_clean":"2024-09-12T03:37:06.509950+0000","last_became_active":"2024-09-12T03:37:06.503138+0000","last_became_peered":"2024-09-12T03:37:06.503138+0000","last_unstale":"2024-09-12T03:37:06.509950+0000","last_undegraded":"2024-09-12T03:37:06.509950+0000","last_fullsized":"2024-09-12T03:37:06.509950+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:12.810601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526469+0000","last_change":"2024-09-12T03:37:05.472634+0000","last_active":"2024-09-12T03:37:07.526469+0000","last_peered":"2024-09-12T03:37:07.526469+0000","last_clean":"2024-09-12T03:37:07.526469+0000","last_became_active":"2024-09-12T03:37:05.472206+0000","last_became_peered":"2024-09-12T03:37:05.472206+0000","last_unstale":"2024-09-12T03:37:07.526469+0000","last_undegraded":"2024-09-12T03:37:07.526469+0000","last_fullsized":"2024-09-12T03:37:07.526469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:29.832710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485540+0000","last_change":"2024-09-12T03:37:06.530706+0000","last_active":"2024-09-12T03:37:07.485540+0000","last_peered":"2024-09-12T03:37:07.485540+0000","last_clean":"2024-09-12T03:37:07.485540+0000","last_became_active":"2024-09-12T03:37:06.530075+0000","last_became_peered":"2024-09-12T03:37:06.530075+0000","last_unstale":"2024-09-12T03:37:07.485540+0000","last_undegraded":"2024-09-12T03:37:07.485540+0000","last_fullsized":"2024-09-12T03:37:07.485540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.431067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490508+0000","last_change":"2024-09-12T03:37:05.500119+0000","last_active":"2024-09-12T03:37:07.490508+0000","last_peered":"2024-09-12T03:37:07.490508+0000","last_clean":"2024-09-12T03:37:07.490508+0000","last_became_active":"2024-09-12T03:37:05.499397+0000","last_became_peered":"2024-09-12T03:37:05.499397+0000","last_unstale":"2024-09-12T03:37:07.490508+0000","last_undegraded":"2024-09-12T03:37:07.490508+0000","last_fullsized":"2024-09-12T03:37:07.490508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:49.894769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.543034+0000","last_change":"2024-09-12T03:37:06.533084+0000","last_active":"2024-09-12T03:37:06.543034+0000","last_peered":"2024-09-12T03:37:06.543034+0000","last_clean":"2024-09-12T03:37:06.543034+0000","last_became_active":"2024-09-12T03:37:06.532362+0000","last_became_peered":"2024-09-12T03:37:06.532362+0000","last_unstale":"2024-09-12T03:37:06.543034+0000","last_undegraded":"2024-09-12T03:37:06.543034+0000","last_fullsized":"2024-09-12T03:37:06.543034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:51.545805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490159+0000","last_change":"2024-09-12T03:37:05.503226+0000","last_active":"2024-09-12T03:37:07.490159+0000","last_peered":"2024-09-12T03:37:07.490159+0000","last_clean":"2024-09-12T03:37:07.490159+0000","last_became_active":"2024-09-12T03:37:05.499243+0000","last_became_peered":"2024-09-12T03:37:05.499243+0000","last_unstale":"2024-09-12T03:37:07.490159+0000","last_undegraded":"2024-09-12T03:37:07.490159+0000","last_fullsized":"2024-09-12T03:37:07.490159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:31.953907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.509254+0000","last_change":"2024-09-12T03:37:06.500139+0000","last_active":"2024-09-12T03:37:06.509254+0000","last_peered":"2024-09-12T03:37:06.509254+0000","last_clean":"2024-09-12T03:37:06.509254+0000","last_became_active":"2024-09-12T03:37:06.498715+0000","last_became_peered":"2024-09-12T03:37:06.498715+0000","last_unstale":"2024-09-12T03:37:06.509254+0000","last_undegraded":"2024-09-12T03:37:06.509254+0000","last_fullsized":"2024-09-12T03:37:06.509254+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:54.772753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525890+0000","last_change":"2024-09-12T03:37:05.499938+0000","last_active":"2024-09-12T03:37:08.525890+0000","last_peered":"2024-09-12T03:37:08.525890+0000","last_clean":"2024-09-12T03:37:08.525890+0000","last_became_active":"2024-09-12T03:37:05.499502+0000","last_became_peered":"2024-09-12T03:37:05.499502+0000","last_unstale":"2024-09-12T03:37:08.525890+0000","last_undegraded":"2024-09-12T03:37:08.525890+0000","last_fullsized":"2024-09-12T03:37:08.525890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:11.120338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486088+0000","last_change":"2024-09-12T03:37:06.535868+0000","last_active":"2024-09-12T03:37:07.486088+0000","last_peered":"2024-09-12T03:37:07.486088+0000","last_clean":"2024-09-12T03:37:07.486088+0000","last_became_active":"2024-09-12T03:37:06.531151+0000","last_became_peered":"2024-09-12T03:37:06.531151+0000","last_unstale":"2024-09-12T03:37:07.486088+0000","last_undegraded":"2024-09-12T03:37:07.486088+0000","last_fullsized":"2024-09-12T03:37:07.486088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:20.482463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.548588+0000","last_change":"2024-09-12T03:37:05.494187+0000","last_active":"2024-09-12T03:37:06.548588+0000","last_peered":"2024-09-12T03:37:06.548588+0000","last_clean":"2024-09-12T03:37:06.548588+0000","last_became_active":"2024-09-12T03:37:05.493427+0000","last_became_peered":"2024-09-12T03:37:05.493427+0000","last_unstale":"2024-09-12T03:37:06.548588+0000","last_undegraded":"2024-09-12T03:37:06.548588+0000","last_fullsized":"2024-09-12T03:37:06.548588+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.568721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486730+0000","last_change":"2024-09-12T03:37:06.526681+0000","last_active":"2024-09-12T03:37:07.486730+0000","last_peered":"2024-09-12T03:37:07.486730+0000","last_clean":"2024-09-12T03:37:07.486730+0000","last_became_active":"2024-09-12T03:37:06.526403+0000","last_became_peered":"2024-09-12T03:37:06.526403+0000","last_unstale":"2024-09-12T03:37:07.486730+0000","last_undegraded":"2024-09-12T03:37:07.486730+0000","last_fullsized":"2024-09-12T03:37:07.486730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:46.581712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735804+0000","last_change":"2024-09-12T03:37:05.475494+0000","last_active":"2024-09-12T03:37:07.735804+0000","last_peered":"2024-09-12T03:37:07.735804+0000","last_clean":"2024-09-12T03:37:07.735804+0000","last_became_active":"2024-09-12T03:37:05.474778+0000","last_became_peered":"2024-09-12T03:37:05.474778+0000","last_unstale":"2024-09-12T03:37:07.735804+0000","last_undegraded":"2024-09-12T03:37:07.735804+0000","last_fullsized":"2024-09-12T03:37:07.735804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.185281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.536045+0000","last_change":"2024-09-12T03:37:06.523174+0000","last_active":"2024-09-12T03:37:06.536045+0000","last_peered":"2024-09-12T03:37:06.536045+0000","last_clean":"2024-09-12T03:37:06.536045+0000","last_became_active":"2024-09-12T03:37:06.522469+0000","last_became_peered":"2024-09-12T03:37:06.522469+0000","last_unstale":"2024-09-12T03:37:06.536045+0000","last_undegraded":"2024-09-12T03:37:06.536045+0000","last_fullsized":"2024-09-12T03:37:06.536045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:51.550177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485552+0000","last_change":"2024-09-12T03:37:05.493173+0000","last_active":"2024-09-12T03:37:07.485552+0000","last_peered":"2024-09-12T03:37:07.485552+0000","last_clean":"2024-09-12T03:37:07.485552+0000","last_became_active":"2024-09-12T03:37:05.492841+0000","last_became_peered":"2024-09-12T03:37:05.492841+0000","last_unstale":"2024-09-12T03:37:07.485552+0000","last_undegraded":"2024-09-12T03:37:07.485552+0000","last_fullsized":"2024-09-12T03:37:07.485552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:04.958173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525342+0000","last_change":"2024-09-12T03:37:06.529302+0000","last_active":"2024-09-12T03:37:08.525342+0000","last_peered":"2024-09-12T03:37:08.525342+0000","last_clean":"2024-09-12T03:37:08.525342+0000","last_became_active":"2024-09-12T03:37:06.528550+0000","last_became_peered":"2024-09-12T03:37:06.528550+0000","last_unstale":"2024-09-12T03:37:08.525342+0000","last_undegraded":"2024-09-12T03:37:08.525342+0000","last_fullsized":"2024-09-12T03:37:08.525342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:35.222734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524122+0000","last_change":"2024-09-12T03:37:05.481678+0000","last_active":"2024-09-12T03:37:07.524122+0000","last_peered":"2024-09-12T03:37:07.524122+0000","last_clean":"2024-09-12T03:37:07.524122+0000","last_became_active":"2024-09-12T03:37:05.481386+0000","last_became_peered":"2024-09-12T03:37:05.481386+0000","last_unstale":"2024-09-12T03:37:07.524122+0000","last_undegraded":"2024-09-12T03:37:07.524122+0000","last_fullsized":"2024-09-12T03:37:07.524122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.008960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486005+0000","last_change":"2024-09-12T03:37:06.529751+0000","last_active":"2024-09-12T03:37:07.486005+0000","last_peered":"2024-09-12T03:37:07.486005+0000","last_clean":"2024-09-12T03:37:07.486005+0000","last_became_active":"2024-09-12T03:37:06.526175+0000","last_became_peered":"2024-09-12T03:37:06.526175+0000","last_unstale":"2024-09-12T03:37:07.486005+0000","last_undegraded":"2024-09-12T03:37:07.486005+0000","last_fullsized":"2024-09-12T03:37:07.486005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:40.225388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490322+0000","last_change":"2024-09-12T03:37:05.502676+0000","last_active":"2024-09-12T03:37:07.490322+0000","last_peered":"2024-09-12T03:37:07.490322+0000","last_clean":"2024-09-12T03:37:07.490322+0000","last_became_active":"2024-09-12T03:37:05.500422+0000","last_became_peered":"2024-09-12T03:37:05.500422+0000","last_unstale":"2024-09-12T03:37:07.490322+0000","last_undegraded":"2024-09-12T03:37:07.490322+0000","last_fullsized":"2024-09-12T03:37:07.490322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.951815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736193+0000","last_change":"2024-09-12T03:37:06.503404+0000","last_active":"2024-09-12T03:37:07.736193+0000","last_peered":"2024-09-12T03:37:07.736193+0000","last_clean":"2024-09-12T03:37:07.736193+0000","last_became_active":"2024-09-12T03:37:06.501502+0000","last_became_peered":"2024-09-12T03:37:06.501502+0000","last_unstale":"2024-09-12T03:37:07.736193+0000","last_undegraded":"2024-09-12T03:37:07.736193+0000","last_fullsized":"2024-09-12T03:37:07.736193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:44.036902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736206+0000","last_change":"2024-09-12T03:37:05.484198+0000","last_active":"2024-09-12T03:37:07.736206+0000","last_peered":"2024-09-12T03:37:07.736206+0000","last_clean":"2024-09-12T03:37:07.736206+0000","last_became_active":"2024-09-12T03:37:05.483437+0000","last_became_peered":"2024-09-12T03:37:05.483437+0000","last_unstale":"2024-09-12T03:37:07.736206+0000","last_undegraded":"2024-09-12T03:37:07.736206+0000","last_fullsized":"2024-09-12T03:37:07.736206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:57.022689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490642+0000","last_change":"2024-09-12T03:37:06.531132+0000","last_active":"2024-09-12T03:37:07.490642+0000","last_peered":"2024-09-12T03:37:07.490642+0000","last_clean":"2024-09-12T03:37:07.490642+0000","last_became_active":"2024-09-12T03:37:06.530579+0000","last_became_peered":"2024-09-12T03:37:06.530579+0000","last_unstale":"2024-09-12T03:37:07.490642+0000","last_undegraded":"2024-09-12T03:37:07.490642+0000","last_fullsized":"2024-09-12T03:37:07.490642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526095+0000","last_change":"2024-09-12T03:37:05.467252+0000","last_active":"2024-09-12T03:37:07.526095+0000","last_peered":"2024-09-12T03:37:07.526095+0000","last_clean":"2024-09-12T03:37:07.526095+0000","last_became_active":"2024-09-12T03:37:05.466976+0000","last_became_peered":"2024-09-12T03:37:05.466976+0000","last_unstale":"2024-09-12T03:37:07.526095+0000","last_undegraded":"2024-09-12T03:37:07.526095+0000","last_fullsized":"2024-09-12T03:37:07.526095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:52.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.537737+0000","last_change":"2024-09-12T03:37:06.532029+0000","last_active":"2024-09-12T03:37:06.537737+0000","last_peered":"2024-09-12T03:37:06.537737+0000","last_clean":"2024-09-12T03:37:06.537737+0000","last_became_active":"2024-09-12T03:37:06.531754+0000","last_became_peered":"2024-09-12T03:37:06.531754+0000","last_unstale":"2024-09-12T03:37:06.537737+0000","last_undegraded":"2024-09-12T03:37:06.537737+0000","last_fullsized":"2024-09-12T03:37:06.537737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:01:34.296632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.526142+0000","last_change":"2024-09-12T03:37:05.486509+0000","last_active":"2024-09-12T03:37:08.526142+0000","last_peered":"2024-09-12T03:37:08.526142+0000","last_clean":"2024-09-12T03:37:08.526142+0000","last_became_active":"2024-09-12T03:37:05.485863+0000","last_became_peered":"2024-09-12T03:37:05.485863+0000","last_unstale":"2024-09-12T03:37:08.526142+0000","last_undegraded":"2024-09-12T03:37:08.526142+0000","last_fullsized":"2024-09-12T03:37:08.526142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.998560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736503+0000","last_change":"2024-09-12T03:37:06.524797+0000","last_active":"2024-09-12T03:37:07.736503+0000","last_peered":"2024-09-12T03:37:07.736503+0000","last_clean":"2024-09-12T03:37:07.736503+0000","last_became_active":"2024-09-12T03:37:06.524051+0000","last_became_peered":"2024-09-12T03:37:06.524051+0000","last_unstale":"2024-09-12T03:37:07.736503+0000","last_undegraded":"2024-09-12T03:37:07.736503+0000","last_fullsized":"2024-09-12T03:37:07.736503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735820+0000","last_change":"2024-09-12T03:37:05.484324+0000","last_active":"2024-09-12T03:37:07.735820+0000","last_peered":"2024-09-12T03:37:07.735820+0000","last_clean":"2024-09-12T03:37:07.735820+0000","last_became_active":"2024-09-12T03:37:05.483498+0000","last_became_peered":"2024-09-12T03:37:05.483498+0000","last_unstale":"2024-09-12T03:37:07.735820+0000","last_undegraded":"2024-09-12T03:37:07.735820+0000","last_fullsized":"2024-09-12T03:37:07.735820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524638+0000","last_change":"2024-09-12T03:37:06.526596+0000","last_active":"2024-09-12T03:37:08.524638+0000","last_peered":"2024-09-12T03:37:08.524638+0000","last_clean":"2024-09-12T03:37:08.524638+0000","last_became_active":"2024-09-12T03:37:06.525894+0000","last_became_peered":"2024-09-12T03:37:06.525894+0000","last_unstale":"2024-09-12T03:37:08.524638+0000","last_undegraded":"2024-09-12T03:37:08.524638+0000","last_fullsized":"2024-09-12T03:37:08.524638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:36.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489421+0000","last_change":"2024-09-12T03:37:05.500057+0000","last_active":"2024-09-12T03:37:07.489421+0000","last_peered":"2024-09-12T03:37:07.489421+0000","last_clean":"2024-09-12T03:37:07.489421+0000","last_became_active":"2024-09-12T03:37:05.499311+0000","last_became_peered":"2024-09-12T03:37:05.499311+0000","last_unstale":"2024-09-12T03:37:07.489421+0000","last_undegraded":"2024-09-12T03:37:07.489421+0000","last_fullsized":"2024-09-12T03:37:07.489421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:29.673134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524603+0000","last_change":"2024-09-12T03:37:06.532766+0000","last_active":"2024-09-12T03:37:08.524603+0000","last_peered":"2024-09-12T03:37:08.524603+0000","last_clean":"2024-09-12T03:37:08.524603+0000","last_became_active":"2024-09-12T03:37:06.530405+0000","last_became_peered":"2024-09-12T03:37:06.530405+0000","last_unstale":"2024-09-12T03:37:08.524603+0000","last_undegraded":"2024-09-12T03:37:08.524603+0000","last_fullsized":"2024-09-12T03:37:08.524603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.843854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524346+0000","last_change":"2024-09-12T03:37:05.473264+0000","last_active":"2024-09-12T03:37:07.524346+0000","last_peered":"2024-09-12T03:37:07.524346+0000","last_clean":"2024-09-12T03:37:07.524346+0000","last_became_active":"2024-09-12T03:37:05.472961+0000","last_became_peered":"2024-09-12T03:37:05.472961+0000","last_unstale":"2024-09-12T03:37:07.524346+0000","last_undegraded":"2024-09-12T03:37:07.524346+0000","last_fullsized":"2024-09-12T03:37:07.524346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:08.526759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525492+0000","last_change":"2024-09-12T03:37:06.531486+0000","last_active":"2024-09-12T03:37:08.525492+0000","last_peered":"2024-09-12T03:37:08.525492+0000","last_clean":"2024-09-12T03:37:08.525492+0000","last_became_active":"2024-09-12T03:37:06.530802+0000","last_became_peered":"2024-09-12T03:37:06.530802+0000","last_unstale":"2024-09-12T03:37:08.525492+0000","last_undegraded":"2024-09-12T03:37:08.525492+0000","last_fullsized":"2024-09-12T03:37:08.525492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:54.166887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485651+0000","last_change":"2024-09-12T03:37:05.487121+0000","last_active":"2024-09-12T03:37:07.485651+0000","last_peered":"2024-09-12T03:37:07.485651+0000","last_clean":"2024-09-12T03:37:07.485651+0000","last_became_active":"2024-09-12T03:37:05.486606+0000","last_became_peered":"2024-09-12T03:37:05.486606+0000","last_unstale":"2024-09-12T03:37:07.485651+0000","last_undegraded":"2024-09-12T03:37:07.485651+0000","last_fullsized":"2024-09-12T03:37:07.485651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:30.524887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489543+0000","last_change":"2024-09-12T03:37:06.523220+0000","last_active":"2024-09-12T03:37:07.489543+0000","last_peered":"2024-09-12T03:37:07.489543+0000","last_clean":"2024-09-12T03:37:07.489543+0000","last_became_active":"2024-09-12T03:37:06.522654+0000","last_became_peered":"2024-09-12T03:37:06.522654+0000","last_unstale":"2024-09-12T03:37:07.489543+0000","last_undegraded":"2024-09-12T03:37:07.489543+0000","last_fullsized":"2024-09-12T03:37:07.489543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490664+0000","last_change":"2024-09-12T03:37:05.504584+0000","last_active":"2024-09-12T03:37:07.490664+0000","last_peered":"2024-09-12T03:37:07.490664+0000","last_clean":"2024-09-12T03:37:07.490664+0000","last_became_active":"2024-09-12T03:37:05.504027+0000","last_became_peered":"2024-09-12T03:37:05.504027+0000","last_unstale":"2024-09-12T03:37:07.490664+0000","last_undegraded":"2024-09-12T03:37:07.490664+0000","last_fullsized":"2024-09-12T03:37:07.490664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:36.893323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524199+0000","last_change":"2024-09-12T03:37:06.529939+0000","last_active":"2024-09-12T03:37:07.524199+0000","last_peered":"2024-09-12T03:37:07.524199+0000","last_clean":"2024-09-12T03:37:07.524199+0000","last_became_active":"2024-09-12T03:37:06.529695+0000","last_became_peered":"2024-09-12T03:37:06.529695+0000","last_unstale":"2024-09-12T03:37:07.524199+0000","last_undegraded":"2024-09-12T03:37:07.524199+0000","last_fullsized":"2024-09-12T03:37:07.524199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:31.343811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.547797+0000","last_change":"2024-09-12T03:37:05.482266+0000","last_active":"2024-09-12T03:37:06.547797+0000","last_peered":"2024-09-12T03:37:06.547797+0000","last_clean":"2024-09-12T03:37:06.547797+0000","last_became_active":"2024-09-12T03:37:05.481642+0000","last_became_peered":"2024-09-12T03:37:05.481642+0000","last_unstale":"2024-09-12T03:37:06.547797+0000","last_undegraded":"2024-09-12T03:37:06.547797+0000","last_fullsized":"2024-09-12T03:37:06.547797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:45.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525240+0000","last_change":"2024-09-12T03:37:06.513529+0000","last_active":"2024-09-12T03:37:07.525240+0000","last_peered":"2024-09-12T03:37:07.525240+0000","last_clean":"2024-09-12T03:37:07.525240+0000","last_became_active":"2024-09-12T03:37:06.512794+0000","last_became_peered":"2024-09-12T03:37:06.512794+0000","last_unstale":"2024-09-12T03:37:07.525240+0000","last_undegraded":"2024-09-12T03:37:07.525240+0000","last_fullsized":"2024-09-12T03:37:07.525240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:44.645938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526174+0000","last_change":"2024-09-12T03:37:05.482661+0000","last_active":"2024-09-12T03:37:07.526174+0000","last_peered":"2024-09-12T03:37:07.526174+0000","last_clean":"2024-09-12T03:37:07.526174+0000","last_became_active":"2024-09-12T03:37:05.482383+0000","last_became_peered":"2024-09-12T03:37:05.482383+0000","last_unstale":"2024-09-12T03:37:07.526174+0000","last_undegraded":"2024-09-12T03:37:07.526174+0000","last_fullsized":"2024-09-12T03:37:07.526174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:10.781273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489983+0000","last_change":"2024-09-12T03:37:06.524850+0000","last_active":"2024-09-12T03:37:07.489983+0000","last_peered":"2024-09-12T03:37:07.489983+0000","last_clean":"2024-09-12T03:37:07.489983+0000","last_became_active":"2024-09-12T03:37:06.524667+0000","last_became_peered":"2024-09-12T03:37:06.524667+0000","last_unstale":"2024-09-12T03:37:07.489983+0000","last_undegraded":"2024-09-12T03:37:07.489983+0000","last_fullsized":"2024-09-12T03:37:07.489983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:52.329645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.497387+0000","last_change":"2024-09-12T03:37:05.473843+0000","last_active":"2024-09-12T03:37:06.497387+0000","last_peered":"2024-09-12T03:37:06.497387+0000","last_clean":"2024-09-12T03:37:06.497387+0000","last_became_active":"2024-09-12T03:37:05.473434+0000","last_became_peered":"2024-09-12T03:37:05.473434+0000","last_unstale":"2024-09-12T03:37:06.497387+0000","last_undegraded":"2024-09-12T03:37:06.497387+0000","last_fullsized":"2024-09-12T03:37:06.497387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:03.854469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486176+0000","last_change":"2024-09-12T03:37:06.535398+0000","last_active":"2024-09-12T03:37:07.486176+0000","last_peered":"2024-09-12T03:37:07.486176+0000","last_clean":"2024-09-12T03:37:07.486176+0000","last_became_active":"2024-09-12T03:37:06.526524+0000","last_became_peered":"2024-09-12T03:37:06.526524+0000","last_unstale":"2024-09-12T03:37:07.486176+0000","last_undegraded":"2024-09-12T03:37:07.486176+0000","last_fullsized":"2024-09-12T03:37:07.486176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:56.224588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489811+0000","last_change":"2024-09-12T03:37:05.468431+0000","last_active":"2024-09-12T03:37:07.489811+0000","last_peered":"2024-09-12T03:37:07.489811+0000","last_clean":"2024-09-12T03:37:07.489811+0000","last_became_active":"2024-09-12T03:37:05.467975+0000","last_became_peered":"2024-09-12T03:37:05.467975+0000","last_unstale":"2024-09-12T03:37:07.489811+0000","last_undegraded":"2024-09-12T03:37:07.489811+0000","last_fullsized":"2024-09-12T03:37:07.489811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:45.853956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486805+0000","last_change":"2024-09-12T03:37:06.526539+0000","last_active":"2024-09-12T03:37:07.486805+0000","last_peered":"2024-09-12T03:37:07.486805+0000","last_clean":"2024-09-12T03:37:07.486805+0000","last_became_active":"2024-09-12T03:37:06.525853+0000","last_became_peered":"2024-09-12T03:37:06.525853+0000","last_unstale":"2024-09-12T03:37:07.486805+0000","last_undegraded":"2024-09-12T03:37:07.486805+0000","last_fullsized":"2024-09-12T03:37:07.486805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:15.588357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489828+0000","last_change":"2024-09-12T03:37:05.486564+0000","last_active":"2024-09-12T03:37:07.489828+0000","last_peered":"2024-09-12T03:37:07.489828+0000","last_clean":"2024-09-12T03:37:07.489828+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.489828+0000","last_undegraded":"2024-09-12T03:37:07.489828+0000","last_fullsized":"2024-09-12T03:37:07.489828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:15.007890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525764+0000","last_change":"2024-09-12T03:37:06.527609+0000","last_active":"2024-09-12T03:37:08.525764+0000","last_peered":"2024-09-12T03:37:08.525764+0000","last_clean":"2024-09-12T03:37:08.525764+0000","last_became_active":"2024-09-12T03:37:06.526869+0000","last_became_peered":"2024-09-12T03:37:06.526869+0000","last_unstale":"2024-09-12T03:37:08.525764+0000","last_undegraded":"2024-09-12T03:37:08.525764+0000","last_fullsized":"2024-09-12T03:37:08.525764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:55.802978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489733+0000","last_change":"2024-09-12T03:37:05.486727+0000","last_active":"2024-09-12T03:37:07.489733+0000","last_peered":"2024-09-12T03:37:07.489733+0000","last_clean":"2024-09-12T03:37:07.489733+0000","last_became_active":"2024-09-12T03:37:05.486147+0000","last_became_peered":"2024-09-12T03:37:05.486147+0000","last_unstale":"2024-09-12T03:37:07.489733+0000","last_undegraded":"2024-09-12T03:37:07.489733+0000","last_fullsized":"2024-09-12T03:37:07.489733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.039642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542699+0000","last_change":"2024-09-12T03:37:06.529021+0000","last_active":"2024-09-12T03:37:06.542699+0000","last_peered":"2024-09-12T03:37:06.542699+0000","last_clean":"2024-09-12T03:37:06.542699+0000","last_became_active":"2024-09-12T03:37:06.528314+0000","last_became_peered":"2024-09-12T03:37:06.528314+0000","last_unstale":"2024-09-12T03:37:06.542699+0000","last_undegraded":"2024-09-12T03:37:06.542699+0000","last_fullsized":"2024-09-12T03:37:06.542699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:18.263844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735928+0000","last_change":"2024-09-12T03:37:05.468166+0000","last_active":"2024-09-12T03:37:07.735928+0000","last_peered":"2024-09-12T03:37:07.735928+0000","last_clean":"2024-09-12T03:37:07.735928+0000","last_became_active":"2024-09-12T03:37:05.467379+0000","last_became_peered":"2024-09-12T03:37:05.467379+0000","last_unstale":"2024-09-12T03:37:07.735928+0000","last_undegraded":"2024-09-12T03:37:07.735928+0000","last_fullsized":"2024-09-12T03:37:07.735928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:19.886719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524952+0000","last_change":"2024-09-12T03:37:06.526490+0000","last_active":"2024-09-12T03:37:08.524952+0000","last_peered":"2024-09-12T03:37:08.524952+0000","last_clean":"2024-09-12T03:37:08.524952+0000","last_became_active":"2024-09-12T03:37:06.525634+0000","last_became_peered":"2024-09-12T03:37:06.525634+0000","last_unstale":"2024-09-12T03:37:08.524952+0000","last_undegraded":"2024-09-12T03:37:08.524952+0000","last_fullsized":"2024-09-12T03:37:08.524952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:24.126290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.487010+0000","last_change":"2024-09-12T03:37:05.469039+0000","last_active":"2024-09-12T03:37:07.487010+0000","last_peered":"2024-09-12T03:37:07.487010+0000","last_clean":"2024-09-12T03:37:07.487010+0000","last_became_active":"2024-09-12T03:37:05.468116+0000","last_became_peered":"2024-09-12T03:37:05.468116+0000","last_unstale":"2024-09-12T03:37:07.487010+0000","last_undegraded":"2024-09-12T03:37:07.487010+0000","last_fullsized":"2024-09-12T03:37:07.487010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:55.343471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.542992+0000","last_change":"2024-09-12T03:37:06.532084+0000","last_active":"2024-09-12T03:37:06.542992+0000","last_peered":"2024-09-12T03:37:06.542992+0000","last_clean":"2024-09-12T03:37:06.542992+0000","last_became_active":"2024-09-12T03:37:06.531460+0000","last_became_peered":"2024-09-12T03:37:06.531460+0000","last_unstale":"2024-09-12T03:37:06.542992+0000","last_undegraded":"2024-09-12T03:37:06.542992+0000","last_fullsized":"2024-09-12T03:37:06.542992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:20.111098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490457+0000","last_change":"2024-09-12T03:37:05.504695+0000","last_active":"2024-09-12T03:37:07.490457+0000","last_peered":"2024-09-12T03:37:07.490457+0000","last_clean":"2024-09-12T03:37:07.490457+0000","last_became_active":"2024-09-12T03:37:05.503970+0000","last_became_peered":"2024-09-12T03:37:05.503970+0000","last_unstale":"2024-09-12T03:37:07.490457+0000","last_undegraded":"2024-09-12T03:37:07.490457+0000","last_fullsized":"2024-09-12T03:37:07.490457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485992+0000","last_change":"2024-09-12T03:37:06.530334+0000","last_active":"2024-09-12T03:37:07.485992+0000","last_peered":"2024-09-12T03:37:07.485992+0000","last_clean":"2024-09-12T03:37:07.485992+0000","last_became_active":"2024-09-12T03:37:06.529912+0000","last_became_peered":"2024-09-12T03:37:06.529912+0000","last_unstale":"2024-09-12T03:37:07.485992+0000","last_undegraded":"2024-09-12T03:37:07.485992+0000","last_fullsized":"2024-09-12T03:37:07.485992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:22.274517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489771+0000","last_change":"2024-09-12T03:37:05.502764+0000","last_active":"2024-09-12T03:37:07.489771+0000","last_peered":"2024-09-12T03:37:07.489771+0000","last_clean":"2024-09-12T03:37:07.489771+0000","last_became_active":"2024-09-12T03:37:05.499370+0000","last_became_peered":"2024-09-12T03:37:05.499370+0000","last_unstale":"2024-09-12T03:37:07.489771+0000","last_undegraded":"2024-09-12T03:37:07.489771+0000","last_fullsized":"2024-09-12T03:37:07.489771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:32.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525997+0000","last_change":"2024-09-12T03:37:06.530530+0000","last_active":"2024-09-12T03:37:08.525997+0000","last_peered":"2024-09-12T03:37:08.525997+0000","last_clean":"2024-09-12T03:37:08.525997+0000","last_became_active":"2024-09-12T03:37:06.529056+0000","last_became_peered":"2024-09-12T03:37:06.529056+0000","last_unstale":"2024-09-12T03:37:08.525997+0000","last_undegraded":"2024-09-12T03:37:08.525997+0000","last_fullsized":"2024-09-12T03:37:08.525997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.031944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524189+0000","last_change":"2024-09-12T03:37:05.496667+0000","last_active":"2024-09-12T03:37:08.524189+0000","last_peered":"2024-09-12T03:37:08.524189+0000","last_clean":"2024-09-12T03:37:08.524189+0000","last_became_active":"2024-09-12T03:37:05.493460+0000","last_became_peered":"2024-09-12T03:37:05.493460+0000","last_unstale":"2024-09-12T03:37:08.524189+0000","last_undegraded":"2024-09-12T03:37:08.524189+0000","last_fullsized":"2024-09-12T03:37:08.524189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.141800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525041+0000","last_change":"2024-09-12T03:37:06.531933+0000","last_active":"2024-09-12T03:37:08.525041+0000","last_peered":"2024-09-12T03:37:08.525041+0000","last_clean":"2024-09-12T03:37:08.525041+0000","last_became_active":"2024-09-12T03:37:06.531201+0000","last_became_peered":"2024-09-12T03:37:06.531201+0000","last_unstale":"2024-09-12T03:37:08.525041+0000","last_undegraded":"2024-09-12T03:37:08.525041+0000","last_fullsized":"2024-09-12T03:37:08.525041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:39.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525488+0000","last_change":"2024-09-12T03:37:05.473252+0000","last_active":"2024-09-12T03:37:07.525488+0000","last_peered":"2024-09-12T03:37:07.525488+0000","last_clean":"2024-09-12T03:37:07.525488+0000","last_became_active":"2024-09-12T03:37:05.472943+0000","last_became_peered":"2024-09-12T03:37:05.472943+0000","last_unstale":"2024-09-12T03:37:07.525488+0000","last_undegraded":"2024-09-12T03:37:07.525488+0000","last_fullsized":"2024-09-12T03:37:07.525488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.445282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.533602+0000","last_change":"2024-09-12T03:37:06.527704+0000","last_active":"2024-09-12T03:37:06.533602+0000","last_peered":"2024-09-12T03:37:06.533602+0000","last_clean":"2024-09-12T03:37:06.533602+0000","last_became_active":"2024-09-12T03:37:06.527397+0000","last_became_peered":"2024-09-12T03:37:06.527397+0000","last_unstale":"2024-09-12T03:37:06.533602+0000","last_undegraded":"2024-09-12T03:37:06.533602+0000","last_fullsized":"2024-09-12T03:37:06.533602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:39:48.117214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525387+0000","last_change":"2024-09-12T03:37:05.485037+0000","last_active":"2024-09-12T03:37:08.525387+0000","last_peered":"2024-09-12T03:37:08.525387+0000","last_clean":"2024-09-12T03:37:08.525387+0000","last_became_active":"2024-09-12T03:37:05.480275+0000","last_became_peered":"2024-09-12T03:37:05.480275+0000","last_unstale":"2024-09-12T03:37:08.525387+0000","last_undegraded":"2024-09-12T03:37:08.525387+0000","last_fullsized":"2024-09-12T03:37:08.525387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:12.196548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.522903+0000","last_change":"2024-09-12T03:37:06.520045+0000","last_active":"2024-09-12T03:37:06.522903+0000","last_peered":"2024-09-12T03:37:06.522903+0000","last_clean":"2024-09-12T03:37:06.522903+0000","last_became_active":"2024-09-12T03:37:06.519644+0000","last_became_peered":"2024-09-12T03:37:06.519644+0000","last_unstale":"2024-09-12T03:37:06.522903+0000","last_undegraded":"2024-09-12T03:37:06.522903+0000","last_fullsized":"2024-09-12T03:37:06.522903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:33.320891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-12T03:37:06.496993+0000","last_change":"2024-09-12T03:37:05.476302+0000","last_active":"2024-09-12T03:37:06.496993+0000","last_peered":"2024-09-12T03:37:06.496993+0000","last_clean":"2024-09-12T03:37:06.496993+0000","last_became_active":"2024-09-12T03:37:05.476014+0000","last_became_peered":"2024-09-12T03:37:05.476014+0000","last_unstale":"2024-09-12T03:37:06.496993+0000","last_undegraded":"2024-09-12T03:37:06.496993+0000","last_fullsized":"2024-09-12T03:37:06.496993+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.302276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490326+0000","last_change":"2024-09-12T03:37:06.514906+0000","last_active":"2024-09-12T03:37:07.490326+0000","last_peered":"2024-09-12T03:37:07.490326+0000","last_clean":"2024-09-12T03:37:07.490326+0000","last_became_active":"2024-09-12T03:37:06.514221+0000","last_became_peered":"2024-09-12T03:37:06.514221+0000","last_unstale":"2024-09-12T03:37:07.490326+0000","last_undegraded":"2024-09-12T03:37:07.490326+0000","last_fullsized":"2024-09-12T03:37:07.490326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:47.249428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490559+0000","last_change":"2024-09-12T03:37:05.486679+0000","last_active":"2024-09-12T03:37:07.490559+0000","last_peered":"2024-09-12T03:37:07.490559+0000","last_clean":"2024-09-12T03:37:07.490559+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.490559+0000","last_undegraded":"2024-09-12T03:37:07.490559+0000","last_fullsized":"2024-09-12T03:37:07.490559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490179+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:07.490179+0000","last_peered":"2024-09-12T03:37:07.490179+0000","last_clean":"2024-09-12T03:37:07.490179+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:07.490179+0000","last_undegraded":"2024-09-12T03:37:07.490179+0000","last_fullsized":"2024-09-12T03:37:07.490179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1507328,"data_stored":1003572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":913408,"data_stored":413216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":917504,"data_stored":408206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":901120,"data_stored":407072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":909312,"data_stored":407232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":905216,"data_stored":406602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":414794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1503232,"data_stored":1003550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:15.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:15.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdf5990640 1 Processor -- start 2024-09-12T03:37:15.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdf5990640 1 -- start start 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdf5990640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdf00cf800 0x7fcdf00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdf5990640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcdf00b4340 0x7fcdf00d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdf5990640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf00d27a0 con 0x7fcdf01457a0 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdf5990640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf00b4790 con 0x7fcdf00cf800 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdf5990640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf00d2a80 con 0x7fcdf00b4340 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdee7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdf00cf800 0x7fcdf00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdee7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdf00cf800 0x7fcdf00b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53810/0 (socket says 172.21.15.73:53810) 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdee7fc640 1 -- 172.21.15.73:0/3655904375 learned_addr learned my addr 172.21.15.73:0/3655904375 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:15.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdee7fc640 1 -- 172.21.15.73:0/3655904375 >> v2:172.21.15.150:3300/0 conn(0x7fcdf00b4340 msgr2=0x7fcdf00d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdef7fe640 1 --2- 172.21.15.73:0/3655904375 >> v2:172.21.15.150:3300/0 conn(0x7fcdf00b4340 0x7fcdf00d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdee7fc640 1 --2- 172.21.15.73:0/3655904375 >> v2:172.21.15.150:3300/0 conn(0x7fcdf00b4340 0x7fcdf00d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdee7fc640 1 -- 172.21.15.73:0/3655904375 >> v1:172.21.15.150:6789/0 conn(0x7fcdf01457a0 legacy=0x7fcdf00d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:15.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.150+0000 7fcdee7fc640 1 -- 172.21.15.73:0/3655904375 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf00d2d60 con 0x7fcdf00cf800 2024-09-12T03:37:15.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdee7fc640 1 --2- 172.21.15.73:0/3655904375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf00cf800 0x7fcdf00b3e00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00cda00 tx=0x7fcde401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a87190d6cdfd553 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdedffb640 1 -- 172.21.15.73:0/3655904375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde40b0070 con 0x7fcdf00cf800 2024-09-12T03:37:15.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdedffb640 1 -- 172.21.15.73:0/3655904375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde40ab600 con 0x7fcdf00cf800 2024-09-12T03:37:15.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdedffb640 1 -- 172.21.15.73:0/3655904375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde40ab9d0 con 0x7fcdf00cf800 2024-09-12T03:37:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- 172.21.15.73:0/3655904375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf00cf800 msgr2=0x7fcdf00b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 --2- 172.21.15.73:0/3655904375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf00cf800 0x7fcdf00b3e00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fcdf00cda00 tx=0x7fcde401c450 comp rx=0 tx=0).stop 2024-09-12T03:37:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- 172.21.15.73:0/3655904375 shutdown_connections 2024-09-12T03:37:15.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 --2- 172.21.15.73:0/3655904375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf00cf800 0x7fcdf00b3e00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 --2- 172.21.15.73:0/3655904375 >> v2:172.21.15.150:3300/0 conn(0x7fcdf00b4340 0x7fcdf00d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- 172.21.15.73:0/3655904375 >> 172.21.15.73:0/3655904375 conn(0x7fcdf006bcc0 msgr2=0x7fcdf006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- 172.21.15.73:0/3655904375 shutdown_connections 2024-09-12T03:37:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- 172.21.15.73:0/3655904375 wait complete. 2024-09-12T03:37:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 Processor -- start 2024-09-12T03:37:15.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- start start 2024-09-12T03:37:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdf00b4340 0x7fcdf0165f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdf00cf800 0x7fcdf015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf01457a0 0x7fcdf0161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf006ede0 con 0x7fcdf01457a0 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf00d1670 con 0x7fcdf00cf800 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdf5990640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf01670a0 con 0x7fcdf00b4340 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf01457a0 0x7fcdf0161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf01457a0 0x7fcdf0161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53826/0 (socket says 172.21.15.73:53826) 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 -- 172.21.15.73:0/1401178638 learned_addr learned my addr 172.21.15.73:0/1401178638 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 -- 172.21.15.73:0/1401178638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdf00b4340 msgr2=0x7fcdf0165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdf00b4340 0x7fcdf0165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 -- 172.21.15.73:0/1401178638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdf00cf800 msgr2=0x7fcdf015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdf00cf800 0x7fcdf015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.154+0000 7fcdef7fe640 1 -- 172.21.15.73:0/1401178638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf01632b0 con 0x7fcdf01457a0 2024-09-12T03:37:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdef7fe640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf01457a0 0x7fcdf0161050 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcde800cd70 tx=0x7fcde800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdd7fff640 1 -- 172.21.15.73:0/1401178638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8003ba0 con 0x7fcdf01457a0 2024-09-12T03:37:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdd7fff640 1 -- 172.21.15.73:0/1401178638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde8003d40 con 0x7fcdf01457a0 2024-09-12T03:37:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf0163550 con 0x7fcdf01457a0 2024-09-12T03:37:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdd7fff640 1 -- 172.21.15.73:0/1401178638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8004240 con 0x7fcdf01457a0 2024-09-12T03:37:15.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf0163b10 con 0x7fcdf01457a0 2024-09-12T03:37:15.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf00d0710 con 0x7fcdf01457a0 2024-09-12T03:37:15.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdd7fff640 1 -- 172.21.15.73:0/1401178638 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcde80043e0 con 0x7fcdf01457a0 2024-09-12T03:37:15.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdd7fff640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcddc0678c0 0x7fcddc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdeeffd640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcddc0678c0 0x7fcddc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdd7fff640 1 -- 172.21.15.73:0/1401178638 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fcde8086850 con 0x7fcdf01457a0 2024-09-12T03:37:15.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.158+0000 7fcdeeffd640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcddc0678c0 0x7fcddc069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009650 tx=0x7fcde0006bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.162+0000 7fcdd7fff640 1 -- 172.21.15.73:0/1401178638 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcde801d340 con 0x7fcdf01457a0 2024-09-12T03:37:15.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.322+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdf00008e0 con 0x7fcddc0678c0 2024-09-12T03:37:15.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.338+0000 7fcdd7fff640 1 -- 172.21.15.73:0/1401178638 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252033 (secure 0 0 0) 0x7fcdf00008e0 con 0x7fcddc0678c0 2024-09-12T03:37:15.341 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:15.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcddc0678c0 msgr2=0x7fcddc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcddc0678c0 0x7fcddc069d80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009650 tx=0x7fcde0006bb0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf01457a0 msgr2=0x7fcdf0161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf01457a0 0x7fcdf0161050 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fcde800cd70 tx=0x7fcde800a660 comp rx=0 tx=0).stop 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 shutdown_connections 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcddc0678c0 0x7fcddc069d80 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009650 tx=0x7fcde0006bb0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf01457a0 0x7fcdf0161050 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcdf00cf800 0x7fcdf015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 --2- 172.21.15.73:0/1401178638 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcdf00b4340 0x7fcdf0165f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 >> 172.21.15.73:0/1401178638 conn(0x7fcdf006bcc0 msgr2=0x7fcdf00b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 shutdown_connections 2024-09-12T03:37:15.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.342+0000 7fcdf5990640 1 -- 172.21.15.73:0/1401178638 wait complete. 2024-09-12T03:37:15.360 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-12T03:37:13.835643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249544,"kb_used_data":8328,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725176,"statfs":{"total":773094113280,"available":772838580224,"internally_reserved":0,"allocated":8527872,"data_stored":4491012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":246795827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002394"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490484+0000","last_change":"2024-09-12T03:37:06.514437+0000","last_active":"2024-09-12T03:37:07.490484+0000","last_peered":"2024-09-12T03:37:07.490484+0000","last_clean":"2024-09-12T03:37:07.490484+0000","last_became_active":"2024-09-12T03:37:06.513608+0000","last_became_peered":"2024-09-12T03:37:06.513608+0000","last_unstale":"2024-09-12T03:37:07.490484+0000","last_undegraded":"2024-09-12T03:37:07.490484+0000","last_fullsized":"2024-09-12T03:37:07.490484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:14.954094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486683+0000","last_change":"2024-09-12T03:37:06.526622+0000","last_active":"2024-09-12T03:37:07.486683+0000","last_peered":"2024-09-12T03:37:07.486683+0000","last_clean":"2024-09-12T03:37:07.486683+0000","last_became_active":"2024-09-12T03:37:06.526228+0000","last_became_peered":"2024-09-12T03:37:06.526228+0000","last_unstale":"2024-09-12T03:37:07.486683+0000","last_undegraded":"2024-09-12T03:37:07.486683+0000","last_fullsized":"2024-09-12T03:37:07.486683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:09.203496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.523030+0000","last_change":"2024-09-12T03:37:06.537800+0000","last_active":"2024-09-12T03:37:08.523030+0000","last_peered":"2024-09-12T03:37:08.523030+0000","last_clean":"2024-09-12T03:37:08.523030+0000","last_became_active":"2024-09-12T03:37:06.537380+0000","last_became_peered":"2024-09-12T03:37:06.537380+0000","last_unstale":"2024-09-12T03:37:08.523030+0000","last_undegraded":"2024-09-12T03:37:08.523030+0000","last_fullsized":"2024-09-12T03:37:08.523030+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:47.857861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736298+0000","last_change":"2024-09-12T03:37:06.502862+0000","last_active":"2024-09-12T03:37:07.736298+0000","last_peered":"2024-09-12T03:37:07.736298+0000","last_clean":"2024-09-12T03:37:07.736298+0000","last_became_active":"2024-09-12T03:37:06.502106+0000","last_became_peered":"2024-09-12T03:37:06.502106+0000","last_unstale":"2024-09-12T03:37:07.736298+0000","last_undegraded":"2024-09-12T03:37:07.736298+0000","last_fullsized":"2024-09-12T03:37:07.736298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:44.964919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525735+0000","last_change":"2024-09-12T03:37:06.510258+0000","last_active":"2024-09-12T03:37:07.525735+0000","last_peered":"2024-09-12T03:37:07.525735+0000","last_clean":"2024-09-12T03:37:07.525735+0000","last_became_active":"2024-09-12T03:37:06.509410+0000","last_became_peered":"2024-09-12T03:37:06.509410+0000","last_unstale":"2024-09-12T03:37:07.525735+0000","last_undegraded":"2024-09-12T03:37:07.525735+0000","last_fullsized":"2024-09-12T03:37:07.525735+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:00.812673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490171+0000","last_change":"2024-09-12T03:37:06.531549+0000","last_active":"2024-09-12T03:37:07.490171+0000","last_peered":"2024-09-12T03:37:07.490171+0000","last_clean":"2024-09-12T03:37:07.490171+0000","last_became_active":"2024-09-12T03:37:06.530951+0000","last_became_peered":"2024-09-12T03:37:06.530951+0000","last_unstale":"2024-09-12T03:37:07.490171+0000","last_undegraded":"2024-09-12T03:37:07.490171+0000","last_fullsized":"2024-09-12T03:37:07.490171+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:39.887489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524557+0000","last_change":"2024-09-12T03:37:06.527833+0000","last_active":"2024-09-12T03:37:08.524557+0000","last_peered":"2024-09-12T03:37:08.524557+0000","last_clean":"2024-09-12T03:37:08.524557+0000","last_became_active":"2024-09-12T03:37:06.527142+0000","last_became_peered":"2024-09-12T03:37:06.527142+0000","last_unstale":"2024-09-12T03:37:08.524557+0000","last_undegraded":"2024-09-12T03:37:08.524557+0000","last_fullsized":"2024-09-12T03:37:08.524557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:18.544723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524109+0000","last_change":"2024-09-12T03:37:06.516755+0000","last_active":"2024-09-12T03:37:07.524109+0000","last_peered":"2024-09-12T03:37:07.524109+0000","last_clean":"2024-09-12T03:37:07.524109+0000","last_became_active":"2024-09-12T03:37:06.515980+0000","last_became_peered":"2024-09-12T03:37:06.515980+0000","last_unstale":"2024-09-12T03:37:07.524109+0000","last_undegraded":"2024-09-12T03:37:07.524109+0000","last_fullsized":"2024-09-12T03:37:07.524109+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:11.002245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524327+0000","last_change":"2024-09-12T03:37:06.523408+0000","last_active":"2024-09-12T03:37:08.524327+0000","last_peered":"2024-09-12T03:37:08.524327+0000","last_clean":"2024-09-12T03:37:08.524327+0000","last_became_active":"2024-09-12T03:37:06.522698+0000","last_became_peered":"2024-09-12T03:37:06.522698+0000","last_unstale":"2024-09-12T03:37:08.524327+0000","last_undegraded":"2024-09-12T03:37:08.524327+0000","last_fullsized":"2024-09-12T03:37:08.524327+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:17.443762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736249+0000","last_change":"2024-09-12T03:37:06.531047+0000","last_active":"2024-09-12T03:37:07.736249+0000","last_peered":"2024-09-12T03:37:07.736249+0000","last_clean":"2024-09-12T03:37:07.736249+0000","last_became_active":"2024-09-12T03:37:06.530313+0000","last_became_peered":"2024-09-12T03:37:06.530313+0000","last_unstale":"2024-09-12T03:37:07.736249+0000","last_undegraded":"2024-09-12T03:37:07.736249+0000","last_fullsized":"2024-09-12T03:37:07.736249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:50.907872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486504+0000","last_change":"2024-09-12T03:37:06.536308+0000","last_active":"2024-09-12T03:37:07.486504+0000","last_peered":"2024-09-12T03:37:07.486504+0000","last_clean":"2024-09-12T03:37:07.486504+0000","last_became_active":"2024-09-12T03:37:06.529889+0000","last_became_peered":"2024-09-12T03:37:06.529889+0000","last_unstale":"2024-09-12T03:37:07.486504+0000","last_undegraded":"2024-09-12T03:37:07.486504+0000","last_fullsized":"2024-09-12T03:37:07.486504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:10.002268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736293+0000","last_change":"2024-09-12T03:37:06.527826+0000","last_active":"2024-09-12T03:37:07.736293+0000","last_peered":"2024-09-12T03:37:07.736293+0000","last_clean":"2024-09-12T03:37:07.736293+0000","last_became_active":"2024-09-12T03:37:06.527024+0000","last_became_peered":"2024-09-12T03:37:06.527024+0000","last_unstale":"2024-09-12T03:37:07.736293+0000","last_undegraded":"2024-09-12T03:37:07.736293+0000","last_fullsized":"2024-09-12T03:37:07.736293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:37.906427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525835+0000","last_change":"2024-09-12T03:37:06.520117+0000","last_active":"2024-09-12T03:37:07.525835+0000","last_peered":"2024-09-12T03:37:07.525835+0000","last_clean":"2024-09-12T03:37:07.525835+0000","last_became_active":"2024-09-12T03:37:06.519404+0000","last_became_peered":"2024-09-12T03:37:06.519404+0000","last_unstale":"2024-09-12T03:37:07.525835+0000","last_undegraded":"2024-09-12T03:37:07.525835+0000","last_fullsized":"2024-09-12T03:37:07.525835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:59:13.557412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490257+0000","last_change":"2024-09-12T03:37:06.531349+0000","last_active":"2024-09-12T03:37:07.490257+0000","last_peered":"2024-09-12T03:37:07.490257+0000","last_clean":"2024-09-12T03:37:07.490257+0000","last_became_active":"2024-09-12T03:37:06.530817+0000","last_became_peered":"2024-09-12T03:37:06.530817+0000","last_unstale":"2024-09-12T03:37:07.490257+0000","last_undegraded":"2024-09-12T03:37:07.490257+0000","last_fullsized":"2024-09-12T03:37:07.490257+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:35.000985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485307+0000","last_change":"2024-09-12T03:37:06.530660+0000","last_active":"2024-09-12T03:37:07.485307+0000","last_peered":"2024-09-12T03:37:07.485307+0000","last_clean":"2024-09-12T03:37:07.485307+0000","last_became_active":"2024-09-12T03:37:06.530221+0000","last_became_peered":"2024-09-12T03:37:06.530221+0000","last_unstale":"2024-09-12T03:37:07.485307+0000","last_undegraded":"2024-09-12T03:37:07.485307+0000","last_fullsized":"2024-09-12T03:37:07.485307+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:48.703179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489610+0000","last_change":"2024-09-12T03:37:06.514904+0000","last_active":"2024-09-12T03:37:07.489610+0000","last_peered":"2024-09-12T03:37:07.489610+0000","last_clean":"2024-09-12T03:37:07.489610+0000","last_became_active":"2024-09-12T03:37:06.514039+0000","last_became_peered":"2024-09-12T03:37:06.514039+0000","last_unstale":"2024-09-12T03:37:07.489610+0000","last_undegraded":"2024-09-12T03:37:07.489610+0000","last_fullsized":"2024-09-12T03:37:07.489610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.632530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526403+0000","last_change":"2024-09-12T03:37:06.532098+0000","last_active":"2024-09-12T03:37:07.526403+0000","last_peered":"2024-09-12T03:37:07.526403+0000","last_clean":"2024-09-12T03:37:07.526403+0000","last_became_active":"2024-09-12T03:37:06.531862+0000","last_became_peered":"2024-09-12T03:37:06.531862+0000","last_unstale":"2024-09-12T03:37:07.526403+0000","last_undegraded":"2024-09-12T03:37:07.526403+0000","last_fullsized":"2024-09-12T03:37:07.526403+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.841005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.522971+0000","last_change":"2024-09-12T03:37:06.504175+0000","last_active":"2024-09-12T03:37:08.522971+0000","last_peered":"2024-09-12T03:37:08.522971+0000","last_clean":"2024-09-12T03:37:08.522971+0000","last_became_active":"2024-09-12T03:37:06.503252+0000","last_became_peered":"2024-09-12T03:37:06.503252+0000","last_unstale":"2024-09-12T03:37:08.522971+0000","last_undegraded":"2024-09-12T03:37:08.522971+0000","last_fullsized":"2024-09-12T03:37:08.522971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:54.565923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490185+0000","last_change":"2024-09-12T03:37:06.522629+0000","last_active":"2024-09-12T03:37:07.490185+0000","last_peered":"2024-09-12T03:37:07.490185+0000","last_clean":"2024-09-12T03:37:07.490185+0000","last_became_active":"2024-09-12T03:37:06.522349+0000","last_became_peered":"2024-09-12T03:37:06.522349+0000","last_unstale":"2024-09-12T03:37:07.490185+0000","last_undegraded":"2024-09-12T03:37:07.490185+0000","last_fullsized":"2024-09-12T03:37:07.490185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:18.204607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525939+0000","last_change":"2024-09-12T03:37:06.505805+0000","last_active":"2024-09-12T03:37:07.525939+0000","last_peered":"2024-09-12T03:37:07.525939+0000","last_clean":"2024-09-12T03:37:07.525939+0000","last_became_active":"2024-09-12T03:37:06.504970+0000","last_became_peered":"2024-09-12T03:37:06.504970+0000","last_unstale":"2024-09-12T03:37:07.525939+0000","last_undegraded":"2024-09-12T03:37:07.525939+0000","last_fullsized":"2024-09-12T03:37:07.525939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:33.899192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524382+0000","last_change":"2024-09-12T03:37:06.500401+0000","last_active":"2024-09-12T03:37:08.524382+0000","last_peered":"2024-09-12T03:37:08.524382+0000","last_clean":"2024-09-12T03:37:08.524382+0000","last_became_active":"2024-09-12T03:37:06.499636+0000","last_became_peered":"2024-09-12T03:37:06.499636+0000","last_unstale":"2024-09-12T03:37:08.524382+0000","last_undegraded":"2024-09-12T03:37:08.524382+0000","last_fullsized":"2024-09-12T03:37:08.524382+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:04.867573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524890+0000","last_change":"2024-09-12T03:37:06.543601+0000","last_active":"2024-09-12T03:37:07.524890+0000","last_peered":"2024-09-12T03:37:07.524890+0000","last_clean":"2024-09-12T03:37:07.524890+0000","last_became_active":"2024-09-12T03:37:06.542384+0000","last_became_peered":"2024-09-12T03:37:06.542384+0000","last_unstale":"2024-09-12T03:37:07.524890+0000","last_undegraded":"2024-09-12T03:37:07.524890+0000","last_fullsized":"2024-09-12T03:37:07.524890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:49.149213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524293+0000","last_change":"2024-09-12T03:37:06.497773+0000","last_active":"2024-09-12T03:37:08.524293+0000","last_peered":"2024-09-12T03:37:08.524293+0000","last_clean":"2024-09-12T03:37:08.524293+0000","last_became_active":"2024-09-12T03:37:06.496867+0000","last_became_peered":"2024-09-12T03:37:06.496867+0000","last_unstale":"2024-09-12T03:37:08.524293+0000","last_undegraded":"2024-09-12T03:37:08.524293+0000","last_fullsized":"2024-09-12T03:37:08.524293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:25.667489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485330+0000","last_change":"2024-09-12T03:37:06.530211+0000","last_active":"2024-09-12T03:37:07.485330+0000","last_peered":"2024-09-12T03:37:07.485330+0000","last_clean":"2024-09-12T03:37:07.485330+0000","last_became_active":"2024-09-12T03:37:06.527133+0000","last_became_peered":"2024-09-12T03:37:06.527133+0000","last_unstale":"2024-09-12T03:37:07.485330+0000","last_undegraded":"2024-09-12T03:37:07.485330+0000","last_fullsized":"2024-09-12T03:37:07.485330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:19.876518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486989+0000","last_change":"2024-09-12T03:37:06.530602+0000","last_active":"2024-09-12T03:37:07.486989+0000","last_peered":"2024-09-12T03:37:07.486989+0000","last_clean":"2024-09-12T03:37:07.486989+0000","last_became_active":"2024-09-12T03:37:06.526983+0000","last_became_peered":"2024-09-12T03:37:06.526983+0000","last_unstale":"2024-09-12T03:37:07.486989+0000","last_undegraded":"2024-09-12T03:37:07.486989+0000","last_fullsized":"2024-09-12T03:37:07.486989+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:26.881150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736116+0000","last_change":"2024-09-12T03:37:06.527918+0000","last_active":"2024-09-12T03:37:07.736116+0000","last_peered":"2024-09-12T03:37:07.736116+0000","last_clean":"2024-09-12T03:37:07.736116+0000","last_became_active":"2024-09-12T03:37:06.527243+0000","last_became_peered":"2024-09-12T03:37:06.527243+0000","last_unstale":"2024-09-12T03:37:07.736116+0000","last_undegraded":"2024-09-12T03:37:07.736116+0000","last_fullsized":"2024-09-12T03:37:07.736116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:32.967011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489935+0000","last_change":"2024-09-12T03:37:06.513491+0000","last_active":"2024-09-12T03:37:07.489935+0000","last_peered":"2024-09-12T03:37:07.489935+0000","last_clean":"2024-09-12T03:37:07.489935+0000","last_became_active":"2024-09-12T03:37:06.508794+0000","last_became_peered":"2024-09-12T03:37:06.508794+0000","last_unstale":"2024-09-12T03:37:07.489935+0000","last_undegraded":"2024-09-12T03:37:07.489935+0000","last_fullsized":"2024-09-12T03:37:07.489935+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.834025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526079+0000","last_change":"2024-09-12T03:37:06.493731+0000","last_active":"2024-09-12T03:37:07.526079+0000","last_peered":"2024-09-12T03:37:07.526079+0000","last_clean":"2024-09-12T03:37:07.526079+0000","last_became_active":"2024-09-12T03:37:06.492963+0000","last_became_peered":"2024-09-12T03:37:06.492963+0000","last_unstale":"2024-09-12T03:37:07.526079+0000","last_undegraded":"2024-09-12T03:37:07.526079+0000","last_fullsized":"2024-09-12T03:37:07.526079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:40.752488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485898+0000","last_change":"2024-09-12T03:37:06.537468+0000","last_active":"2024-09-12T03:37:07.485898+0000","last_peered":"2024-09-12T03:37:07.485898+0000","last_clean":"2024-09-12T03:37:07.485898+0000","last_became_active":"2024-09-12T03:37:06.537055+0000","last_became_peered":"2024-09-12T03:37:06.537055+0000","last_unstale":"2024-09-12T03:37:07.485898+0000","last_undegraded":"2024-09-12T03:37:07.485898+0000","last_fullsized":"2024-09-12T03:37:07.485898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:01.802028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489520+0000","last_change":"2024-09-12T03:37:06.538257+0000","last_active":"2024-09-12T03:37:07.489520+0000","last_peered":"2024-09-12T03:37:07.489520+0000","last_clean":"2024-09-12T03:37:07.489520+0000","last_became_active":"2024-09-12T03:37:06.537464+0000","last_became_peered":"2024-09-12T03:37:06.537464+0000","last_unstale":"2024-09-12T03:37:07.489520+0000","last_undegraded":"2024-09-12T03:37:07.489520+0000","last_fullsized":"2024-09-12T03:37:07.489520+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:47.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.522310+0000","last_change":"2024-09-12T03:37:06.529226+0000","last_active":"2024-09-12T03:37:08.522310+0000","last_peered":"2024-09-12T03:37:08.522310+0000","last_clean":"2024-09-12T03:37:08.522310+0000","last_became_active":"2024-09-12T03:37:06.528961+0000","last_became_peered":"2024-09-12T03:37:06.528961+0000","last_unstale":"2024-09-12T03:37:08.522310+0000","last_undegraded":"2024-09-12T03:37:08.522310+0000","last_fullsized":"2024-09-12T03:37:08.522310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:21.164401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490040+0000","last_change":"2024-09-12T03:37:06.520303+0000","last_active":"2024-09-12T03:37:07.490040+0000","last_peered":"2024-09-12T03:37:07.490040+0000","last_clean":"2024-09-12T03:37:07.490040+0000","last_became_active":"2024-09-12T03:37:06.514601+0000","last_became_peered":"2024-09-12T03:37:06.514601+0000","last_unstale":"2024-09-12T03:37:07.490040+0000","last_undegraded":"2024-09-12T03:37:07.490040+0000","last_fullsized":"2024-09-12T03:37:07.490040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:02.773931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.522217+0000","last_change":"2024-09-12T03:37:06.503918+0000","last_active":"2024-09-12T03:37:08.522217+0000","last_peered":"2024-09-12T03:37:08.522217+0000","last_clean":"2024-09-12T03:37:08.522217+0000","last_became_active":"2024-09-12T03:37:06.503138+0000","last_became_peered":"2024-09-12T03:37:06.503138+0000","last_unstale":"2024-09-12T03:37:08.522217+0000","last_undegraded":"2024-09-12T03:37:08.522217+0000","last_fullsized":"2024-09-12T03:37:08.522217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:27.016199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526469+0000","last_change":"2024-09-12T03:37:05.472634+0000","last_active":"2024-09-12T03:37:07.526469+0000","last_peered":"2024-09-12T03:37:07.526469+0000","last_clean":"2024-09-12T03:37:07.526469+0000","last_became_active":"2024-09-12T03:37:05.472206+0000","last_became_peered":"2024-09-12T03:37:05.472206+0000","last_unstale":"2024-09-12T03:37:07.526469+0000","last_undegraded":"2024-09-12T03:37:07.526469+0000","last_fullsized":"2024-09-12T03:37:07.526469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:29.832710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485540+0000","last_change":"2024-09-12T03:37:06.530706+0000","last_active":"2024-09-12T03:37:07.485540+0000","last_peered":"2024-09-12T03:37:07.485540+0000","last_clean":"2024-09-12T03:37:07.485540+0000","last_became_active":"2024-09-12T03:37:06.530075+0000","last_became_peered":"2024-09-12T03:37:06.530075+0000","last_unstale":"2024-09-12T03:37:07.485540+0000","last_undegraded":"2024-09-12T03:37:07.485540+0000","last_fullsized":"2024-09-12T03:37:07.485540+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:09.431067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490508+0000","last_change":"2024-09-12T03:37:05.500119+0000","last_active":"2024-09-12T03:37:07.490508+0000","last_peered":"2024-09-12T03:37:07.490508+0000","last_clean":"2024-09-12T03:37:07.490508+0000","last_became_active":"2024-09-12T03:37:05.499397+0000","last_became_peered":"2024-09-12T03:37:05.499397+0000","last_unstale":"2024-09-12T03:37:07.490508+0000","last_undegraded":"2024-09-12T03:37:07.490508+0000","last_fullsized":"2024-09-12T03:37:07.490508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:49.894769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524369+0000","last_change":"2024-09-12T03:37:06.533084+0000","last_active":"2024-09-12T03:37:08.524369+0000","last_peered":"2024-09-12T03:37:08.524369+0000","last_clean":"2024-09-12T03:37:08.524369+0000","last_became_active":"2024-09-12T03:37:06.532362+0000","last_became_peered":"2024-09-12T03:37:06.532362+0000","last_unstale":"2024-09-12T03:37:08.524369+0000","last_undegraded":"2024-09-12T03:37:08.524369+0000","last_fullsized":"2024-09-12T03:37:08.524369+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:59.315379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490159+0000","last_change":"2024-09-12T03:37:05.503226+0000","last_active":"2024-09-12T03:37:07.490159+0000","last_peered":"2024-09-12T03:37:07.490159+0000","last_clean":"2024-09-12T03:37:07.490159+0000","last_became_active":"2024-09-12T03:37:05.499243+0000","last_became_peered":"2024-09-12T03:37:05.499243+0000","last_unstale":"2024-09-12T03:37:07.490159+0000","last_undegraded":"2024-09-12T03:37:07.490159+0000","last_fullsized":"2024-09-12T03:37:07.490159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:31.953907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524899+0000","last_change":"2024-09-12T03:37:06.500139+0000","last_active":"2024-09-12T03:37:08.524899+0000","last_peered":"2024-09-12T03:37:08.524899+0000","last_clean":"2024-09-12T03:37:08.524899+0000","last_became_active":"2024-09-12T03:37:06.498715+0000","last_became_peered":"2024-09-12T03:37:06.498715+0000","last_unstale":"2024-09-12T03:37:08.524899+0000","last_undegraded":"2024-09-12T03:37:08.524899+0000","last_fullsized":"2024-09-12T03:37:08.524899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:07.426916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525890+0000","last_change":"2024-09-12T03:37:05.499938+0000","last_active":"2024-09-12T03:37:08.525890+0000","last_peered":"2024-09-12T03:37:08.525890+0000","last_clean":"2024-09-12T03:37:08.525890+0000","last_became_active":"2024-09-12T03:37:05.499502+0000","last_became_peered":"2024-09-12T03:37:05.499502+0000","last_unstale":"2024-09-12T03:37:08.525890+0000","last_undegraded":"2024-09-12T03:37:08.525890+0000","last_fullsized":"2024-09-12T03:37:08.525890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:11.120338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486088+0000","last_change":"2024-09-12T03:37:06.535868+0000","last_active":"2024-09-12T03:37:07.486088+0000","last_peered":"2024-09-12T03:37:07.486088+0000","last_clean":"2024-09-12T03:37:07.486088+0000","last_became_active":"2024-09-12T03:37:06.531151+0000","last_became_peered":"2024-09-12T03:37:06.531151+0000","last_unstale":"2024-09-12T03:37:07.486088+0000","last_undegraded":"2024-09-12T03:37:07.486088+0000","last_fullsized":"2024-09-12T03:37:07.486088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:20.482463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525105+0000","last_change":"2024-09-12T03:37:05.494187+0000","last_active":"2024-09-12T03:37:08.525105+0000","last_peered":"2024-09-12T03:37:08.525105+0000","last_clean":"2024-09-12T03:37:08.525105+0000","last_became_active":"2024-09-12T03:37:05.493427+0000","last_became_peered":"2024-09-12T03:37:05.493427+0000","last_unstale":"2024-09-12T03:37:08.525105+0000","last_undegraded":"2024-09-12T03:37:08.525105+0000","last_fullsized":"2024-09-12T03:37:08.525105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:41.568721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486730+0000","last_change":"2024-09-12T03:37:06.526681+0000","last_active":"2024-09-12T03:37:07.486730+0000","last_peered":"2024-09-12T03:37:07.486730+0000","last_clean":"2024-09-12T03:37:07.486730+0000","last_became_active":"2024-09-12T03:37:06.526403+0000","last_became_peered":"2024-09-12T03:37:06.526403+0000","last_unstale":"2024-09-12T03:37:07.486730+0000","last_undegraded":"2024-09-12T03:37:07.486730+0000","last_fullsized":"2024-09-12T03:37:07.486730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:46.581712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735804+0000","last_change":"2024-09-12T03:37:05.475494+0000","last_active":"2024-09-12T03:37:07.735804+0000","last_peered":"2024-09-12T03:37:07.735804+0000","last_clean":"2024-09-12T03:37:07.735804+0000","last_became_active":"2024-09-12T03:37:05.474778+0000","last_became_peered":"2024-09-12T03:37:05.474778+0000","last_unstale":"2024-09-12T03:37:07.735804+0000","last_undegraded":"2024-09-12T03:37:07.735804+0000","last_fullsized":"2024-09-12T03:37:07.735804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:42.185281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.526070+0000","last_change":"2024-09-12T03:37:06.523174+0000","last_active":"2024-09-12T03:37:08.526070+0000","last_peered":"2024-09-12T03:37:08.526070+0000","last_clean":"2024-09-12T03:37:08.526070+0000","last_became_active":"2024-09-12T03:37:06.522469+0000","last_became_peered":"2024-09-12T03:37:06.522469+0000","last_unstale":"2024-09-12T03:37:08.526070+0000","last_undegraded":"2024-09-12T03:37:08.526070+0000","last_fullsized":"2024-09-12T03:37:08.526070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:33.320891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485552+0000","last_change":"2024-09-12T03:37:05.493173+0000","last_active":"2024-09-12T03:37:07.485552+0000","last_peered":"2024-09-12T03:37:07.485552+0000","last_clean":"2024-09-12T03:37:07.485552+0000","last_became_active":"2024-09-12T03:37:05.492841+0000","last_became_peered":"2024-09-12T03:37:05.492841+0000","last_unstale":"2024-09-12T03:37:07.485552+0000","last_undegraded":"2024-09-12T03:37:07.485552+0000","last_fullsized":"2024-09-12T03:37:07.485552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:04.958173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525342+0000","last_change":"2024-09-12T03:37:06.529302+0000","last_active":"2024-09-12T03:37:08.525342+0000","last_peered":"2024-09-12T03:37:08.525342+0000","last_clean":"2024-09-12T03:37:08.525342+0000","last_became_active":"2024-09-12T03:37:06.528550+0000","last_became_peered":"2024-09-12T03:37:06.528550+0000","last_unstale":"2024-09-12T03:37:08.525342+0000","last_undegraded":"2024-09-12T03:37:08.525342+0000","last_fullsized":"2024-09-12T03:37:08.525342+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:35.222734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524122+0000","last_change":"2024-09-12T03:37:05.481678+0000","last_active":"2024-09-12T03:37:07.524122+0000","last_peered":"2024-09-12T03:37:07.524122+0000","last_clean":"2024-09-12T03:37:07.524122+0000","last_became_active":"2024-09-12T03:37:05.481386+0000","last_became_peered":"2024-09-12T03:37:05.481386+0000","last_unstale":"2024-09-12T03:37:07.524122+0000","last_undegraded":"2024-09-12T03:37:07.524122+0000","last_fullsized":"2024-09-12T03:37:07.524122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.008960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486005+0000","last_change":"2024-09-12T03:37:06.529751+0000","last_active":"2024-09-12T03:37:07.486005+0000","last_peered":"2024-09-12T03:37:07.486005+0000","last_clean":"2024-09-12T03:37:07.486005+0000","last_became_active":"2024-09-12T03:37:06.526175+0000","last_became_peered":"2024-09-12T03:37:06.526175+0000","last_unstale":"2024-09-12T03:37:07.486005+0000","last_undegraded":"2024-09-12T03:37:07.486005+0000","last_fullsized":"2024-09-12T03:37:07.486005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:40.225388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490322+0000","last_change":"2024-09-12T03:37:05.502676+0000","last_active":"2024-09-12T03:37:07.490322+0000","last_peered":"2024-09-12T03:37:07.490322+0000","last_clean":"2024-09-12T03:37:07.490322+0000","last_became_active":"2024-09-12T03:37:05.500422+0000","last_became_peered":"2024-09-12T03:37:05.500422+0000","last_unstale":"2024-09-12T03:37:07.490322+0000","last_undegraded":"2024-09-12T03:37:07.490322+0000","last_fullsized":"2024-09-12T03:37:07.490322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.951815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736193+0000","last_change":"2024-09-12T03:37:06.503404+0000","last_active":"2024-09-12T03:37:07.736193+0000","last_peered":"2024-09-12T03:37:07.736193+0000","last_clean":"2024-09-12T03:37:07.736193+0000","last_became_active":"2024-09-12T03:37:06.501502+0000","last_became_peered":"2024-09-12T03:37:06.501502+0000","last_unstale":"2024-09-12T03:37:07.736193+0000","last_undegraded":"2024-09-12T03:37:07.736193+0000","last_fullsized":"2024-09-12T03:37:07.736193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:44.036902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736206+0000","last_change":"2024-09-12T03:37:05.484198+0000","last_active":"2024-09-12T03:37:07.736206+0000","last_peered":"2024-09-12T03:37:07.736206+0000","last_clean":"2024-09-12T03:37:07.736206+0000","last_became_active":"2024-09-12T03:37:05.483437+0000","last_became_peered":"2024-09-12T03:37:05.483437+0000","last_unstale":"2024-09-12T03:37:07.736206+0000","last_undegraded":"2024-09-12T03:37:07.736206+0000","last_fullsized":"2024-09-12T03:37:07.736206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:57.022689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490642+0000","last_change":"2024-09-12T03:37:06.531132+0000","last_active":"2024-09-12T03:37:07.490642+0000","last_peered":"2024-09-12T03:37:07.490642+0000","last_clean":"2024-09-12T03:37:07.490642+0000","last_became_active":"2024-09-12T03:37:06.530579+0000","last_became_peered":"2024-09-12T03:37:06.530579+0000","last_unstale":"2024-09-12T03:37:07.490642+0000","last_undegraded":"2024-09-12T03:37:07.490642+0000","last_fullsized":"2024-09-12T03:37:07.490642+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:04.263681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526095+0000","last_change":"2024-09-12T03:37:05.467252+0000","last_active":"2024-09-12T03:37:07.526095+0000","last_peered":"2024-09-12T03:37:07.526095+0000","last_clean":"2024-09-12T03:37:07.526095+0000","last_became_active":"2024-09-12T03:37:05.466976+0000","last_became_peered":"2024-09-12T03:37:05.466976+0000","last_unstale":"2024-09-12T03:37:07.526095+0000","last_undegraded":"2024-09-12T03:37:07.526095+0000","last_fullsized":"2024-09-12T03:37:07.526095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:52.867554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.522534+0000","last_change":"2024-09-12T03:37:06.532029+0000","last_active":"2024-09-12T03:37:08.522534+0000","last_peered":"2024-09-12T03:37:08.522534+0000","last_clean":"2024-09-12T03:37:08.522534+0000","last_became_active":"2024-09-12T03:37:06.531754+0000","last_became_peered":"2024-09-12T03:37:06.531754+0000","last_unstale":"2024-09-12T03:37:08.522534+0000","last_undegraded":"2024-09-12T03:37:08.522534+0000","last_fullsized":"2024-09-12T03:37:08.522534+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:21.062752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.526142+0000","last_change":"2024-09-12T03:37:05.486509+0000","last_active":"2024-09-12T03:37:08.526142+0000","last_peered":"2024-09-12T03:37:08.526142+0000","last_clean":"2024-09-12T03:37:08.526142+0000","last_became_active":"2024-09-12T03:37:05.485863+0000","last_became_peered":"2024-09-12T03:37:05.485863+0000","last_unstale":"2024-09-12T03:37:08.526142+0000","last_undegraded":"2024-09-12T03:37:08.526142+0000","last_fullsized":"2024-09-12T03:37:08.526142+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.998560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.736503+0000","last_change":"2024-09-12T03:37:06.524797+0000","last_active":"2024-09-12T03:37:07.736503+0000","last_peered":"2024-09-12T03:37:07.736503+0000","last_clean":"2024-09-12T03:37:07.736503+0000","last_became_active":"2024-09-12T03:37:06.524051+0000","last_became_peered":"2024-09-12T03:37:06.524051+0000","last_unstale":"2024-09-12T03:37:07.736503+0000","last_undegraded":"2024-09-12T03:37:07.736503+0000","last_fullsized":"2024-09-12T03:37:07.736503+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735820+0000","last_change":"2024-09-12T03:37:05.484324+0000","last_active":"2024-09-12T03:37:07.735820+0000","last_peered":"2024-09-12T03:37:07.735820+0000","last_clean":"2024-09-12T03:37:07.735820+0000","last_became_active":"2024-09-12T03:37:05.483498+0000","last_became_peered":"2024-09-12T03:37:05.483498+0000","last_unstale":"2024-09-12T03:37:07.735820+0000","last_undegraded":"2024-09-12T03:37:07.735820+0000","last_fullsized":"2024-09-12T03:37:07.735820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:50.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524638+0000","last_change":"2024-09-12T03:37:06.526596+0000","last_active":"2024-09-12T03:37:08.524638+0000","last_peered":"2024-09-12T03:37:08.524638+0000","last_clean":"2024-09-12T03:37:08.524638+0000","last_became_active":"2024-09-12T03:37:06.525894+0000","last_became_peered":"2024-09-12T03:37:06.525894+0000","last_unstale":"2024-09-12T03:37:08.524638+0000","last_undegraded":"2024-09-12T03:37:08.524638+0000","last_fullsized":"2024-09-12T03:37:08.524638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:36.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489421+0000","last_change":"2024-09-12T03:37:05.500057+0000","last_active":"2024-09-12T03:37:07.489421+0000","last_peered":"2024-09-12T03:37:07.489421+0000","last_clean":"2024-09-12T03:37:07.489421+0000","last_became_active":"2024-09-12T03:37:05.499311+0000","last_became_peered":"2024-09-12T03:37:05.499311+0000","last_unstale":"2024-09-12T03:37:07.489421+0000","last_undegraded":"2024-09-12T03:37:07.489421+0000","last_fullsized":"2024-09-12T03:37:07.489421+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:29.673134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524603+0000","last_change":"2024-09-12T03:37:06.532766+0000","last_active":"2024-09-12T03:37:08.524603+0000","last_peered":"2024-09-12T03:37:08.524603+0000","last_clean":"2024-09-12T03:37:08.524603+0000","last_became_active":"2024-09-12T03:37:06.530405+0000","last_became_peered":"2024-09-12T03:37:06.530405+0000","last_unstale":"2024-09-12T03:37:08.524603+0000","last_undegraded":"2024-09-12T03:37:08.524603+0000","last_fullsized":"2024-09-12T03:37:08.524603+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.843854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524346+0000","last_change":"2024-09-12T03:37:05.473264+0000","last_active":"2024-09-12T03:37:07.524346+0000","last_peered":"2024-09-12T03:37:07.524346+0000","last_clean":"2024-09-12T03:37:07.524346+0000","last_became_active":"2024-09-12T03:37:05.472961+0000","last_became_peered":"2024-09-12T03:37:05.472961+0000","last_unstale":"2024-09-12T03:37:07.524346+0000","last_undegraded":"2024-09-12T03:37:07.524346+0000","last_fullsized":"2024-09-12T03:37:07.524346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:08.526759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525492+0000","last_change":"2024-09-12T03:37:06.531486+0000","last_active":"2024-09-12T03:37:08.525492+0000","last_peered":"2024-09-12T03:37:08.525492+0000","last_clean":"2024-09-12T03:37:08.525492+0000","last_became_active":"2024-09-12T03:37:06.530802+0000","last_became_peered":"2024-09-12T03:37:06.530802+0000","last_unstale":"2024-09-12T03:37:08.525492+0000","last_undegraded":"2024-09-12T03:37:08.525492+0000","last_fullsized":"2024-09-12T03:37:08.525492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:54.166887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485651+0000","last_change":"2024-09-12T03:37:05.487121+0000","last_active":"2024-09-12T03:37:07.485651+0000","last_peered":"2024-09-12T03:37:07.485651+0000","last_clean":"2024-09-12T03:37:07.485651+0000","last_became_active":"2024-09-12T03:37:05.486606+0000","last_became_peered":"2024-09-12T03:37:05.486606+0000","last_unstale":"2024-09-12T03:37:07.485651+0000","last_undegraded":"2024-09-12T03:37:07.485651+0000","last_fullsized":"2024-09-12T03:37:07.485651+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:30.524887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489543+0000","last_change":"2024-09-12T03:37:06.523220+0000","last_active":"2024-09-12T03:37:07.489543+0000","last_peered":"2024-09-12T03:37:07.489543+0000","last_clean":"2024-09-12T03:37:07.489543+0000","last_became_active":"2024-09-12T03:37:06.522654+0000","last_became_peered":"2024-09-12T03:37:06.522654+0000","last_unstale":"2024-09-12T03:37:07.489543+0000","last_undegraded":"2024-09-12T03:37:07.489543+0000","last_fullsized":"2024-09-12T03:37:07.489543+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:50.329591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490664+0000","last_change":"2024-09-12T03:37:05.504584+0000","last_active":"2024-09-12T03:37:07.490664+0000","last_peered":"2024-09-12T03:37:07.490664+0000","last_clean":"2024-09-12T03:37:07.490664+0000","last_became_active":"2024-09-12T03:37:05.504027+0000","last_became_peered":"2024-09-12T03:37:05.504027+0000","last_unstale":"2024-09-12T03:37:07.490664+0000","last_undegraded":"2024-09-12T03:37:07.490664+0000","last_fullsized":"2024-09-12T03:37:07.490664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:36.893323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.524199+0000","last_change":"2024-09-12T03:37:06.529939+0000","last_active":"2024-09-12T03:37:07.524199+0000","last_peered":"2024-09-12T03:37:07.524199+0000","last_clean":"2024-09-12T03:37:07.524199+0000","last_became_active":"2024-09-12T03:37:06.529695+0000","last_became_peered":"2024-09-12T03:37:06.529695+0000","last_unstale":"2024-09-12T03:37:07.524199+0000","last_undegraded":"2024-09-12T03:37:07.524199+0000","last_fullsized":"2024-09-12T03:37:07.524199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:31.343811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525694+0000","last_change":"2024-09-12T03:37:05.482266+0000","last_active":"2024-09-12T03:37:08.525694+0000","last_peered":"2024-09-12T03:37:08.525694+0000","last_clean":"2024-09-12T03:37:08.525694+0000","last_became_active":"2024-09-12T03:37:05.481642+0000","last_became_peered":"2024-09-12T03:37:05.481642+0000","last_unstale":"2024-09-12T03:37:08.525694+0000","last_undegraded":"2024-09-12T03:37:08.525694+0000","last_fullsized":"2024-09-12T03:37:08.525694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:45.817237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525240+0000","last_change":"2024-09-12T03:37:06.513529+0000","last_active":"2024-09-12T03:37:07.525240+0000","last_peered":"2024-09-12T03:37:07.525240+0000","last_clean":"2024-09-12T03:37:07.525240+0000","last_became_active":"2024-09-12T03:37:06.512794+0000","last_became_peered":"2024-09-12T03:37:06.512794+0000","last_unstale":"2024-09-12T03:37:07.525240+0000","last_undegraded":"2024-09-12T03:37:07.525240+0000","last_fullsized":"2024-09-12T03:37:07.525240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:44.645938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.526174+0000","last_change":"2024-09-12T03:37:05.482661+0000","last_active":"2024-09-12T03:37:07.526174+0000","last_peered":"2024-09-12T03:37:07.526174+0000","last_clean":"2024-09-12T03:37:07.526174+0000","last_became_active":"2024-09-12T03:37:05.482383+0000","last_became_peered":"2024-09-12T03:37:05.482383+0000","last_unstale":"2024-09-12T03:37:07.526174+0000","last_undegraded":"2024-09-12T03:37:07.526174+0000","last_fullsized":"2024-09-12T03:37:07.526174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:10.781273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489983+0000","last_change":"2024-09-12T03:37:06.524850+0000","last_active":"2024-09-12T03:37:07.489983+0000","last_peered":"2024-09-12T03:37:07.489983+0000","last_clean":"2024-09-12T03:37:07.489983+0000","last_became_active":"2024-09-12T03:37:06.524667+0000","last_became_peered":"2024-09-12T03:37:06.524667+0000","last_unstale":"2024-09-12T03:37:07.489983+0000","last_undegraded":"2024-09-12T03:37:07.489983+0000","last_fullsized":"2024-09-12T03:37:07.489983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:52.329645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.522544+0000","last_change":"2024-09-12T03:37:05.473843+0000","last_active":"2024-09-12T03:37:08.522544+0000","last_peered":"2024-09-12T03:37:08.522544+0000","last_clean":"2024-09-12T03:37:08.522544+0000","last_became_active":"2024-09-12T03:37:05.473434+0000","last_became_peered":"2024-09-12T03:37:05.473434+0000","last_unstale":"2024-09-12T03:37:08.522544+0000","last_undegraded":"2024-09-12T03:37:08.522544+0000","last_fullsized":"2024-09-12T03:37:08.522544+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:06:03.854469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486176+0000","last_change":"2024-09-12T03:37:06.535398+0000","last_active":"2024-09-12T03:37:07.486176+0000","last_peered":"2024-09-12T03:37:07.486176+0000","last_clean":"2024-09-12T03:37:07.486176+0000","last_became_active":"2024-09-12T03:37:06.526524+0000","last_became_peered":"2024-09-12T03:37:06.526524+0000","last_unstale":"2024-09-12T03:37:07.486176+0000","last_undegraded":"2024-09-12T03:37:07.486176+0000","last_fullsized":"2024-09-12T03:37:07.486176+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:56.224588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489811+0000","last_change":"2024-09-12T03:37:05.468431+0000","last_active":"2024-09-12T03:37:07.489811+0000","last_peered":"2024-09-12T03:37:07.489811+0000","last_clean":"2024-09-12T03:37:07.489811+0000","last_became_active":"2024-09-12T03:37:05.467975+0000","last_became_peered":"2024-09-12T03:37:05.467975+0000","last_unstale":"2024-09-12T03:37:07.489811+0000","last_undegraded":"2024-09-12T03:37:07.489811+0000","last_fullsized":"2024-09-12T03:37:07.489811+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:33:45.853956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.486805+0000","last_change":"2024-09-12T03:37:06.526539+0000","last_active":"2024-09-12T03:37:07.486805+0000","last_peered":"2024-09-12T03:37:07.486805+0000","last_clean":"2024-09-12T03:37:07.486805+0000","last_became_active":"2024-09-12T03:37:06.525853+0000","last_became_peered":"2024-09-12T03:37:06.525853+0000","last_unstale":"2024-09-12T03:37:07.486805+0000","last_undegraded":"2024-09-12T03:37:07.486805+0000","last_fullsized":"2024-09-12T03:37:07.486805+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:15.588357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489828+0000","last_change":"2024-09-12T03:37:05.486564+0000","last_active":"2024-09-12T03:37:07.489828+0000","last_peered":"2024-09-12T03:37:07.489828+0000","last_clean":"2024-09-12T03:37:07.489828+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.489828+0000","last_undegraded":"2024-09-12T03:37:07.489828+0000","last_fullsized":"2024-09-12T03:37:07.489828+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:15.007890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525764+0000","last_change":"2024-09-12T03:37:06.527609+0000","last_active":"2024-09-12T03:37:08.525764+0000","last_peered":"2024-09-12T03:37:08.525764+0000","last_clean":"2024-09-12T03:37:08.525764+0000","last_became_active":"2024-09-12T03:37:06.526869+0000","last_became_peered":"2024-09-12T03:37:06.526869+0000","last_unstale":"2024-09-12T03:37:08.525764+0000","last_undegraded":"2024-09-12T03:37:08.525764+0000","last_fullsized":"2024-09-12T03:37:08.525764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:55.802978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489733+0000","last_change":"2024-09-12T03:37:05.486727+0000","last_active":"2024-09-12T03:37:07.489733+0000","last_peered":"2024-09-12T03:37:07.489733+0000","last_clean":"2024-09-12T03:37:07.489733+0000","last_became_active":"2024-09-12T03:37:05.486147+0000","last_became_peered":"2024-09-12T03:37:05.486147+0000","last_unstale":"2024-09-12T03:37:07.489733+0000","last_undegraded":"2024-09-12T03:37:07.489733+0000","last_fullsized":"2024-09-12T03:37:07.489733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:20.039642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.523913+0000","last_change":"2024-09-12T03:37:06.529021+0000","last_active":"2024-09-12T03:37:08.523913+0000","last_peered":"2024-09-12T03:37:08.523913+0000","last_clean":"2024-09-12T03:37:08.523913+0000","last_became_active":"2024-09-12T03:37:06.528314+0000","last_became_peered":"2024-09-12T03:37:06.528314+0000","last_unstale":"2024-09-12T03:37:08.523913+0000","last_undegraded":"2024-09-12T03:37:08.523913+0000","last_fullsized":"2024-09-12T03:37:08.523913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:15.612040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.735928+0000","last_change":"2024-09-12T03:37:05.468166+0000","last_active":"2024-09-12T03:37:07.735928+0000","last_peered":"2024-09-12T03:37:07.735928+0000","last_clean":"2024-09-12T03:37:07.735928+0000","last_became_active":"2024-09-12T03:37:05.467379+0000","last_became_peered":"2024-09-12T03:37:05.467379+0000","last_unstale":"2024-09-12T03:37:07.735928+0000","last_undegraded":"2024-09-12T03:37:07.735928+0000","last_fullsized":"2024-09-12T03:37:07.735928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:19.886719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524952+0000","last_change":"2024-09-12T03:37:06.526490+0000","last_active":"2024-09-12T03:37:08.524952+0000","last_peered":"2024-09-12T03:37:08.524952+0000","last_clean":"2024-09-12T03:37:08.524952+0000","last_became_active":"2024-09-12T03:37:06.525634+0000","last_became_peered":"2024-09-12T03:37:06.525634+0000","last_unstale":"2024-09-12T03:37:08.524952+0000","last_undegraded":"2024-09-12T03:37:08.524952+0000","last_fullsized":"2024-09-12T03:37:08.524952+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:24.126290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.487010+0000","last_change":"2024-09-12T03:37:05.469039+0000","last_active":"2024-09-12T03:37:07.487010+0000","last_peered":"2024-09-12T03:37:07.487010+0000","last_clean":"2024-09-12T03:37:07.487010+0000","last_became_active":"2024-09-12T03:37:05.468116+0000","last_became_peered":"2024-09-12T03:37:05.468116+0000","last_unstale":"2024-09-12T03:37:07.487010+0000","last_undegraded":"2024-09-12T03:37:07.487010+0000","last_fullsized":"2024-09-12T03:37:07.487010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:55.343471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524785+0000","last_change":"2024-09-12T03:37:06.532084+0000","last_active":"2024-09-12T03:37:08.524785+0000","last_peered":"2024-09-12T03:37:08.524785+0000","last_clean":"2024-09-12T03:37:08.524785+0000","last_became_active":"2024-09-12T03:37:06.531460+0000","last_became_peered":"2024-09-12T03:37:06.531460+0000","last_unstale":"2024-09-12T03:37:08.524785+0000","last_undegraded":"2024-09-12T03:37:08.524785+0000","last_fullsized":"2024-09-12T03:37:08.524785+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:17:12.810601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490457+0000","last_change":"2024-09-12T03:37:05.504695+0000","last_active":"2024-09-12T03:37:07.490457+0000","last_peered":"2024-09-12T03:37:07.490457+0000","last_clean":"2024-09-12T03:37:07.490457+0000","last_became_active":"2024-09-12T03:37:05.503970+0000","last_became_peered":"2024-09-12T03:37:05.503970+0000","last_unstale":"2024-09-12T03:37:07.490457+0000","last_undegraded":"2024-09-12T03:37:07.490457+0000","last_fullsized":"2024-09-12T03:37:07.490457+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.485992+0000","last_change":"2024-09-12T03:37:06.530334+0000","last_active":"2024-09-12T03:37:07.485992+0000","last_peered":"2024-09-12T03:37:07.485992+0000","last_clean":"2024-09-12T03:37:07.485992+0000","last_became_active":"2024-09-12T03:37:06.529912+0000","last_became_peered":"2024-09-12T03:37:06.529912+0000","last_unstale":"2024-09-12T03:37:07.485992+0000","last_undegraded":"2024-09-12T03:37:07.485992+0000","last_fullsized":"2024-09-12T03:37:07.485992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:22.274517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.489771+0000","last_change":"2024-09-12T03:37:05.502764+0000","last_active":"2024-09-12T03:37:07.489771+0000","last_peered":"2024-09-12T03:37:07.489771+0000","last_clean":"2024-09-12T03:37:07.489771+0000","last_became_active":"2024-09-12T03:37:05.499370+0000","last_became_peered":"2024-09-12T03:37:05.499370+0000","last_unstale":"2024-09-12T03:37:07.489771+0000","last_undegraded":"2024-09-12T03:37:07.489771+0000","last_fullsized":"2024-09-12T03:37:07.489771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:32.857632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525997+0000","last_change":"2024-09-12T03:37:06.530530+0000","last_active":"2024-09-12T03:37:08.525997+0000","last_peered":"2024-09-12T03:37:08.525997+0000","last_clean":"2024-09-12T03:37:08.525997+0000","last_became_active":"2024-09-12T03:37:06.529056+0000","last_became_peered":"2024-09-12T03:37:06.529056+0000","last_unstale":"2024-09-12T03:37:08.525997+0000","last_undegraded":"2024-09-12T03:37:08.525997+0000","last_fullsized":"2024-09-12T03:37:08.525997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:11.031944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.524189+0000","last_change":"2024-09-12T03:37:05.496667+0000","last_active":"2024-09-12T03:37:08.524189+0000","last_peered":"2024-09-12T03:37:08.524189+0000","last_clean":"2024-09-12T03:37:08.524189+0000","last_became_active":"2024-09-12T03:37:05.493460+0000","last_became_peered":"2024-09-12T03:37:05.493460+0000","last_unstale":"2024-09-12T03:37:08.524189+0000","last_undegraded":"2024-09-12T03:37:08.524189+0000","last_fullsized":"2024-09-12T03:37:08.524189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.141800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525041+0000","last_change":"2024-09-12T03:37:06.531933+0000","last_active":"2024-09-12T03:37:08.525041+0000","last_peered":"2024-09-12T03:37:08.525041+0000","last_clean":"2024-09-12T03:37:08.525041+0000","last_became_active":"2024-09-12T03:37:06.531201+0000","last_became_peered":"2024-09-12T03:37:06.531201+0000","last_unstale":"2024-09-12T03:37:08.525041+0000","last_undegraded":"2024-09-12T03:37:08.525041+0000","last_fullsized":"2024-09-12T03:37:08.525041+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:39.395925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.525488+0000","last_change":"2024-09-12T03:37:05.473252+0000","last_active":"2024-09-12T03:37:07.525488+0000","last_peered":"2024-09-12T03:37:07.525488+0000","last_clean":"2024-09-12T03:37:07.525488+0000","last_became_active":"2024-09-12T03:37:05.472943+0000","last_became_peered":"2024-09-12T03:37:05.472943+0000","last_unstale":"2024-09-12T03:37:07.525488+0000","last_undegraded":"2024-09-12T03:37:07.525488+0000","last_fullsized":"2024-09-12T03:37:07.525488+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:53.445282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.523100+0000","last_change":"2024-09-12T03:37:06.527704+0000","last_active":"2024-09-12T03:37:08.523100+0000","last_peered":"2024-09-12T03:37:08.523100+0000","last_clean":"2024-09-12T03:37:08.523100+0000","last_became_active":"2024-09-12T03:37:06.527397+0000","last_became_peered":"2024-09-12T03:37:06.527397+0000","last_unstale":"2024-09-12T03:37:08.523100+0000","last_undegraded":"2024-09-12T03:37:08.523100+0000","last_fullsized":"2024-09-12T03:37:08.523100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:37.624292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.525387+0000","last_change":"2024-09-12T03:37:05.485037+0000","last_active":"2024-09-12T03:37:08.525387+0000","last_peered":"2024-09-12T03:37:08.525387+0000","last_clean":"2024-09-12T03:37:08.525387+0000","last_became_active":"2024-09-12T03:37:05.480275+0000","last_became_peered":"2024-09-12T03:37:05.480275+0000","last_unstale":"2024-09-12T03:37:08.525387+0000","last_undegraded":"2024-09-12T03:37:08.525387+0000","last_fullsized":"2024-09-12T03:37:08.525387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:12.196548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.523138+0000","last_change":"2024-09-12T03:37:06.520045+0000","last_active":"2024-09-12T03:37:08.523138+0000","last_peered":"2024-09-12T03:37:08.523138+0000","last_clean":"2024-09-12T03:37:08.523138+0000","last_became_active":"2024-09-12T03:37:06.519644+0000","last_became_peered":"2024-09-12T03:37:06.519644+0000","last_unstale":"2024-09-12T03:37:08.523138+0000","last_undegraded":"2024-09-12T03:37:08.523138+0000","last_fullsized":"2024-09-12T03:37:08.523138+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:10.550451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:08.522059+0000","last_change":"2024-09-12T03:37:05.476302+0000","last_active":"2024-09-12T03:37:08.522059+0000","last_peered":"2024-09-12T03:37:08.522059+0000","last_clean":"2024-09-12T03:37:08.522059+0000","last_became_active":"2024-09-12T03:37:05.476014+0000","last_became_peered":"2024-09-12T03:37:05.476014+0000","last_unstale":"2024-09-12T03:37:08.522059+0000","last_undegraded":"2024-09-12T03:37:08.522059+0000","last_fullsized":"2024-09-12T03:37:08.522059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:58.302276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490326+0000","last_change":"2024-09-12T03:37:06.514906+0000","last_active":"2024-09-12T03:37:07.490326+0000","last_peered":"2024-09-12T03:37:07.490326+0000","last_clean":"2024-09-12T03:37:07.490326+0000","last_became_active":"2024-09-12T03:37:06.514221+0000","last_became_peered":"2024-09-12T03:37:06.514221+0000","last_unstale":"2024-09-12T03:37:07.490326+0000","last_undegraded":"2024-09-12T03:37:07.490326+0000","last_fullsized":"2024-09-12T03:37:07.490326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:05.445854+0000","last_clean_scrub_stamp":"2024-09-12T03:37:05.445854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:47.249428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490559+0000","last_change":"2024-09-12T03:37:05.486679+0000","last_active":"2024-09-12T03:37:07.490559+0000","last_peered":"2024-09-12T03:37:07.490559+0000","last_clean":"2024-09-12T03:37:07.490559+0000","last_became_active":"2024-09-12T03:37:05.486217+0000","last_became_peered":"2024-09-12T03:37:05.486217+0000","last_unstale":"2024-09-12T03:37:07.490559+0000","last_undegraded":"2024-09-12T03:37:07.490559+0000","last_fullsized":"2024-09-12T03:37:07.490559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:04.432751+0000","last_clean_scrub_stamp":"2024-09-12T03:37:04.432751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:43.023798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":265,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-12T03:37:07.490179+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:07.490179+0000","last_peered":"2024-09-12T03:37:07.490179+0000","last_clean":"2024-09-12T03:37:07.490179+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:07.490179+0000","last_undegraded":"2024-09-12T03:37:07.490179+0000","last_fullsized":"2024-09-12T03:37:07.490179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1507328,"data_stored":1003572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":913408,"data_stored":413216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":414898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":913408,"data_stored":413764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":921600,"data_stored":413924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":413294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":921600,"data_stored":414794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1503232,"data_stored":1003550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:15.364 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:37:15.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T03:37:15.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f7125681640 1 Processor -- start 2024-09-12T03:37:15.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f7125681640 1 -- start start 2024-09-12T03:37:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f7125681640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f712015aa50 0x7f71200b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f7125681640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71200cdfd0 0x7f71200ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f7125681640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71200b3720 con 0x7f71200cebe0 2024-09-12T03:37:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f7125681640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f71200ce940 con 0x7f71200cdfd0 2024-09-12T03:37:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f7125681640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f71200cc470 con 0x7f712015aa50 2024-09-12T03:37:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71200cdfd0 0x7f71200ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71200cdfd0 0x7f71200ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53832/0 (socket says 172.21.15.73:53832) 2024-09-12T03:37:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711f7fe640 1 -- 172.21.15.73:0/1822964273 learned_addr learned my addr 172.21.15.73:0/1822964273 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711effd640 1 --2- 172.21.15.73:0/1822964273 >> v2:172.21.15.150:3300/0 conn(0x7f712015aa50 0x7f71200b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711f7fe640 1 -- 172.21.15.73:0/1822964273 >> v2:172.21.15.150:3300/0 conn(0x7f712015aa50 msgr2=0x7f71200b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711f7fe640 1 --2- 172.21.15.73:0/1822964273 >> v2:172.21.15.150:3300/0 conn(0x7f712015aa50 0x7f71200b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711f7fe640 1 -- 172.21.15.73:0/1822964273 >> v1:172.21.15.73:6789/0 conn(0x7f71200cebe0 legacy=0x7f71200b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711dffb640 1 -- 172.21.15.73:0/1822964273 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471050546 0 0) 0x7f71200b3720 con 0x7f71200cebe0 2024-09-12T03:37:15.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.534+0000 7f711f7fe640 1 -- 172.21.15.73:0/1822964273 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71200cc750 con 0x7f71200cdfd0 2024-09-12T03:37:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f711f7fe640 1 --2- 172.21.15.73:0/1822964273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200ce400 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7120068970 tx=0x7f711801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4784bd3199599e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f711dffb640 1 -- 172.21.15.73:0/1822964273 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71200cd240 con 0x7f71200cdfd0 2024-09-12T03:37:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f711dffb640 1 -- 172.21.15.73:0/1822964273 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71180a56a0 con 0x7f71200cdfd0 2024-09-12T03:37:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f711dffb640 1 -- 172.21.15.73:0/1822964273 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71180a5a70 con 0x7f71200cdfd0 2024-09-12T03:37:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 -- 172.21.15.73:0/1822964273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 msgr2=0x7f71200ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 --2- 172.21.15.73:0/1822964273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200ce400 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7120068970 tx=0x7f711801c8d0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 -- 172.21.15.73:0/1822964273 shutdown_connections 2024-09-12T03:37:15.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 --2- 172.21.15.73:0/1822964273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200ce400 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 --2- 172.21.15.73:0/1822964273 >> v2:172.21.15.150:3300/0 conn(0x7f712015aa50 0x7f71200b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 -- 172.21.15.73:0/1822964273 >> 172.21.15.73:0/1822964273 conn(0x7f71200b1c80 msgr2=0x7f71200b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:15.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 -- 172.21.15.73:0/1822964273 shutdown_connections 2024-09-12T03:37:15.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 -- 172.21.15.73:0/1822964273 wait complete. 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 Processor -- start 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.538+0000 7f7125681640 1 -- start start 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71200cebe0 0x7f71200ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712015aa50 0x7f71200c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f712006eb70 con 0x7f71200cdfd0 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f712006e9f0 con 0x7f712015aa50 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f712006ecf0 con 0x7f71200cebe0 2024-09-12T03:37:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200c4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53834/0 (socket says 172.21.15.73:53834) 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 -- 172.21.15.73:0/583525005 learned_addr learned my addr 172.21.15.73:0/583525005 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 -- 172.21.15.73:0/583525005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71200cebe0 msgr2=0x7f71200ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71200cebe0 0x7f71200ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711f7fe640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712015aa50 0x7f71200c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 -- 172.21.15.73:0/583525005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712015aa50 msgr2=0x7f71200c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712015aa50 0x7f71200c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 -- 172.21.15.73:0/583525005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7120068ed0 con 0x7f71200cdfd0 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711effd640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200c4ef0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f711000d5f0 tx=0x7f711000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f71077fe640 1 -- 172.21.15.73:0/583525005 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71100125f0 con 0x7f71200cdfd0 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f71077fe640 1 -- 172.21.15.73:0/583525005 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7110019070 con 0x7f71200cdfd0 2024-09-12T03:37:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71200c5e00 con 0x7f71200cdfd0 2024-09-12T03:37:15.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f71077fe640 1 -- 172.21.15.73:0/583525005 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71100129b0 con 0x7f71200cdfd0 2024-09-12T03:37:15.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71200c6820 con 0x7f71200cdfd0 2024-09-12T03:37:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f712006eff0 con 0x7f71200cdfd0 2024-09-12T03:37:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f71077fe640 1 -- 172.21.15.73:0/583525005 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7110012b50 con 0x7f71200cdfd0 2024-09-12T03:37:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f71077fe640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f710c0678c0 0x7f710c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f71077fe640 1 -- 172.21.15.73:0/583525005 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f7110086250 con 0x7f71200cdfd0 2024-09-12T03:37:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711e7fc640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f710c0678c0 0x7f710c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.542+0000 7f711e7fc640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f710c0678c0 0x7f710c069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7114007fd0 tx=0x7f7114007940 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.546+0000 7f71077fe640 1 -- 172.21.15.73:0/583525005 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7110056c00 con 0x7f71200cdfd0 2024-09-12T03:37:15.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.770+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f71200b36d0 con 0x7f71200cdfd0 2024-09-12T03:37:15.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f71077fe640 1 -- 172.21.15.73:0/583525005 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f7110056500 con 0x7f71200cdfd0 2024-09-12T03:37:15.775 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T03:37:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:37:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-09-12T03:37:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-09-12T03:37:15.775 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T03:37:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-09-12T03:37:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f710c0678c0 msgr2=0x7f710c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f710c0678c0 0x7f710c069d80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7114007fd0 tx=0x7f7114007940 comp rx=0 tx=0).stop 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 msgr2=0x7f71200c4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200c4ef0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f711000d5f0 tx=0x7f711000dab0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 shutdown_connections 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f710c0678c0 0x7f710c069d80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f712015aa50 0x7f71200c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f71200cebe0 0x7f71200ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 --2- 172.21.15.73:0/583525005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71200cdfd0 0x7f71200c4ef0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 >> 172.21.15.73:0/583525005 conn(0x7f71200b1c80 msgr2=0x7f71200722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 shutdown_connections 2024-09-12T03:37:15.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.774+0000 7f7125681640 1 -- 172.21.15.73:0/583525005 wait complete. 2024-09-12T03:37:15.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:15.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d821c9640 1 Processor -- start 2024-09-12T03:37:15.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d821c9640 1 -- start start 2024-09-12T03:37:15.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d821c9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0d7c1587a0 0x7f0d7c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d821c9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c06ec60 con 0x7f0d7c06e680 2024-09-12T03:37:15.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d821c9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c06ef40 con 0x7f0d7c0b37d0 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d821c9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0d7c0b3c40 con 0x7f0d7c1587a0 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d7bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0d7c06e680 0x7f0d7c072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43864/0 (socket says 172.21.15.73:43864) 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d7bfff640 1 -- 172.21.15.73:0/1358504367 learned_addr learned my addr 172.21.15.73:0/1358504367 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.906+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/1358504367 >> v2:172.21.15.150:3300/0 conn(0x7f0d7c1587a0 0x7f0d7c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922051906 0 0) 0x7f0d7c06ec60 con 0x7f0d7c06e680 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d64003530 con 0x7f0d7c06e680 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 445682179 0 0) 0x7f0d64003530 con 0x7f0d7c06e680 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 >> v2:172.21.15.150:3300/0 conn(0x7f0d7c1587a0 msgr2=0x7f0d7c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:15.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 --2- 172.21.15.73:0/1358504367 >> v2:172.21.15.150:3300/0 conn(0x7f0d7c1587a0 0x7f0d7c0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 >> v1:172.21.15.150:6789/0 conn(0x7f0d7c0b37d0 legacy=0x7f0d7c06df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c06f220 con 0x7f0d7c06e680 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f0d74001a00 con 0x7f0d7c06e680 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 >> v1:172.21.15.73:6789/0 conn(0x7f0d7c06e680 legacy=0x7f0d7c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d64004810 0x7f0d64004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d640051d0 0x7f0d6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c0b3c40 con 0x7f0d640039c0 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6400c070 con 0x7f0d640051d0 2024-09-12T03:37:15.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6400c270 con 0x7f0d64004810 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7affd640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d64004810 0x7f0d64004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7b7fe640 1 -- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d64004810 msgr2=0x7f0d64004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7bfff640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d640051d0 0x7f0d6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d64004810 0x7f0d64004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7b7fe640 1 -- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d640051d0 msgr2=0x7f0d6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d640051d0 0x7f0d6400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7b7fe640 1 -- 172.21.15.73:0/1358504367 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d64003530 con 0x7f0d640039c0 2024-09-12T03:37:15.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7bfff640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d640051d0 0x7f0d6400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:15.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7bfff640 1 -- 172.21.15.73:0/1358504367 reap_dead start 2024-09-12T03:37:15.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009ac0 tx=0x7f0d7001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c87e934cbacfb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70009690 con 0x7f0d640039c0 2024-09-12T03:37:15.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d700a6430 con 0x7f0d640039c0 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d7a7fc640 1 -- 172.21.15.73:0/1358504367 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d700a6800 con 0x7f0d640039c0 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d821c9640 1 -- 172.21.15.73:0/1358504367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d640039c0 msgr2=0x7f0d64003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d821c9640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009ac0 tx=0x7f0d7001ca50 comp rx=0 tx=0).stop 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d821c9640 1 -- 172.21.15.73:0/1358504367 shutdown_connections 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d821c9640 1 --2- 172.21.15.73:0/1358504367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d640039c0 0x7f0d64003de0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d821c9640 1 -- 172.21.15.73:0/1358504367 >> 172.21.15.73:0/1358504367 conn(0x7f0d7c0b1f90 msgr2=0x7f0d7c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d821c9640 1 -- 172.21.15.73:0/1358504367 shutdown_connections 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.910+0000 7f0d821c9640 1 -- 172.21.15.73:0/1358504367 wait complete. 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 Processor -- start 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 -- start start 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d640039c0 0x7f0d7c155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c158d90 0x7f0d7c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d7c146fd0 0x7f0d7c147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1627e0 con 0x7f0d7c146fd0 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c162660 con 0x7f0d7c158d90 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7c162960 con 0x7f0d640039c0 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d7c146fd0 0x7f0d7c147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d7c146fd0 0x7f0d7c147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53852/0 (socket says 172.21.15.73:53852) 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 -- 172.21.15.73:0/2951375784 learned_addr learned my addr 172.21.15.73:0/2951375784 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d640039c0 0x7f0d7c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7affd640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c158d90 0x7f0d7c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 -- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d640039c0 msgr2=0x7f0d7c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d640039c0 0x7f0d7c155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 -- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c158d90 msgr2=0x7f0d7c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c158d90 0x7f0d7c0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 -- 172.21.15.73:0/2951375784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c155c50 con 0x7f0d7c146fd0 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7affd640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c158d90 0x7f0d7c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d640039c0 0x7f0d7c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d7bfff640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d7c146fd0 0x7f0d7c147480 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0b44f0 tx=0x7f0d7400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d63fff640 1 -- 172.21.15.73:0/2951375784 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74004d70 con 0x7f0d7c146fd0 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d63fff640 1 -- 172.21.15.73:0/2951375784 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7400bb20 con 0x7f0d7c146fd0 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c155f30 con 0x7f0d7c146fd0 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d63fff640 1 -- 172.21.15.73:0/2951375784 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74007110 con 0x7f0d7c146fd0 2024-09-12T03:37:15.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1564f0 con 0x7f0d7c146fd0 2024-09-12T03:37:15.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.914+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c1568d0 con 0x7f0d7c146fd0 2024-09-12T03:37:15.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.918+0000 7f0d63fff640 1 -- 172.21.15.73:0/2951375784 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d7401b020 con 0x7f0d7c146fd0 2024-09-12T03:37:15.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.918+0000 7f0d63fff640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0d680678c0 0x7f0d68069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:15.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.918+0000 7f0d63fff640 1 -- 172.21.15.73:0/2951375784 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f0d74085ed0 con 0x7f0d7c146fd0 2024-09-12T03:37:15.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.918+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0d680678c0 0x7f0d68069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:15.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.918+0000 7f0d7b7fe640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0d680678c0 0x7f0d68069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0d700ad000 tx=0x7f0d700046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:15.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:15.922+0000 7f0d63fff640 1 -- 172.21.15.73:0/2951375784 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d7c1568d0 con 0x7f0d7c146fd0 2024-09-12T03:37:16.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d7c09b680 con 0x7f0d7c146fd0 2024-09-12T03:37:16.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d63fff640 1 -- 172.21.15.73:0/2951375784 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5222 (secure 0 0 0) 0x7f0d7c09b680 con 0x7f0d7c146fd0 2024-09-12T03:37:16.107 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:16.107 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-12T03:37:09:534051+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/703389966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":703389966},{"type":"v1","addr":"172.21.15.150:6833","nonce":703389966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/624796455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":624796455},{"type":"v1","addr":"172.21.15.150:6835","nonce":624796455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3527064235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3527064235},{"type":"v1","addr":"172.21.15.73:6835","nonce":3527064235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:05.827803+0000","modified":"2024-09-12T03:37:08.894254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/585196866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":585196866},{"type":"v1","addr":"172.21.15.73:6837","nonce":585196866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5892,"qdb_cluster":[5892]},"id":5}]} 2024-09-12T03:37:16.108 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0d680678c0 msgr2=0x7f0d68069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0d680678c0 0x7f0d68069d80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0d700ad000 tx=0x7f0d700046d0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d7c146fd0 msgr2=0x7f0d7c147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d7c146fd0 0x7f0d7c147480 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0b44f0 tx=0x7f0d7400b4a0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 shutdown_connections 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0d680678c0 0x7f0d68069d80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d7c146fd0 0x7f0d7c147480 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0d7c158d90 0x7f0d7c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 --2- 172.21.15.73:0/2951375784 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0d640039c0 0x7f0d7c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 >> 172.21.15.73:0/2951375784 conn(0x7f0d7c0b1f90 msgr2=0x7f0d7c1577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 shutdown_connections 2024-09-12T03:37:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.106+0000 7f0d821c9640 1 -- 172.21.15.73:0/2951375784 wait complete. 2024-09-12T03:37:16.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:37:05.827803+0000', 'modified': '2024-09-12T03:37:08.894254+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5892}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5892': {'gid': 5892, 'name': 'c', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/585196866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 585196866}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 585196866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5892, 'qdb_cluster': [5892]} 2024-09-12T03:37:16.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:37:16.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T03:37:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb25b3640 1 Processor -- start 2024-09-12T03:37:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb25b3640 1 -- start start 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb25b3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8bac1587a0 0x7f8bac0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb25b3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8bac0b37d0 0x7f8bac06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb25b3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bac06ec60 con 0x7f8bac06e4b0 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb25b3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8bac0b3c40 con 0x7f8bac0b37d0 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb25b3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8bac06f870 con 0x7f8bac1587a0 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bab7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8bac0b37d0 0x7f8bac06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb0b50640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8bac06e4b0 0x7f8bac161e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43880/0 (socket says 172.21.15.73:43880) 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8bb0b50640 1 -- 172.21.15.73:0/3806995882 learned_addr learned my addr 172.21.15.73:0/3806995882 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.654+0000 7f8babfff640 1 --2- 172.21.15.73:0/3806995882 >> v2:172.21.15.150:3300/0 conn(0x7f8bac1587a0 0x7f8bac0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bab7fe640 1 -- 172.21.15.73:0/3806995882 >> v2:172.21.15.150:3300/0 conn(0x7f8bac1587a0 msgr2=0x7f8bac0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/3806995882 >> v2:172.21.15.150:3300/0 conn(0x7f8bac1587a0 0x7f8bac0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bab7fe640 1 -- 172.21.15.73:0/3806995882 >> v1:172.21.15.73:6789/0 conn(0x7f8bac06e4b0 legacy=0x7f8bac161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bab7fe640 1 -- 172.21.15.73:0/3806995882 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac06ef40 con 0x7f8bac0b37d0 2024-09-12T03:37:16.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/3806995882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac0b37d0 0x7f8bac06df70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8bac071710 tx=0x7f8b9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5f9b54d622d715 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8baaffd640 1 -- 172.21.15.73:0/3806995882 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b940b0070 con 0x7f8bac0b37d0 2024-09-12T03:37:16.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8baaffd640 1 -- 172.21.15.73:0/3806995882 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b940ab600 con 0x7f8bac0b37d0 2024-09-12T03:37:16.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8baaffd640 1 -- 172.21.15.73:0/3806995882 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b940ab9d0 con 0x7f8bac0b37d0 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 -- 172.21.15.73:0/3806995882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac0b37d0 msgr2=0x7f8bac06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/3806995882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac0b37d0 0x7f8bac06df70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8bac071710 tx=0x7f8b9401c450 comp rx=0 tx=0).stop 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 -- 172.21.15.73:0/3806995882 shutdown_connections 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/3806995882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac0b37d0 0x7f8bac06df70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/3806995882 >> v2:172.21.15.150:3300/0 conn(0x7f8bac1587a0 0x7f8bac0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 -- 172.21.15.73:0/3806995882 >> 172.21.15.73:0/3806995882 conn(0x7f8bac0b1f90 msgr2=0x7f8bac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 -- 172.21.15.73:0/3806995882 shutdown_connections 2024-09-12T03:37:16.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.658+0000 7f8bb25b3640 1 -- 172.21.15.73:0/3806995882 wait complete. 2024-09-12T03:37:16.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 Processor -- start 2024-09-12T03:37:16.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 -- start start 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bac06e4b0 0x7f8bac151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bac0b37d0 0x7f8bac146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac1587a0 0x7f8bac150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac158b80 con 0x7f8bac1587a0 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac073170 con 0x7f8bac0b37d0 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac1603d0 con 0x7f8bac06e4b0 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac1587a0 0x7f8bac150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac1587a0 0x7f8bac150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53882/0 (socket says 172.21.15.73:53882) 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1507782966 learned_addr learned my addr 172.21.15.73:0/1507782966 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:16.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8babfff640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bac06e4b0 0x7f8bac151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bac0b37d0 0x7f8bac146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bac06e4b0 msgr2=0x7f8bac151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bac06e4b0 0x7f8bac151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bac0b37d0 msgr2=0x7f8bac146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bac0b37d0 0x7f8bac146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1507782966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac1600f0 con 0x7f8bac1587a0 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8babfff640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bac06e4b0 0x7f8bac151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac1587a0 0x7f8bac150740 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c430 tx=0x7f8b9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8ba8ff9640 1 -- 172.21.15.73:0/1507782966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c017070 con 0x7f8bac1587a0 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8ba8ff9640 1 -- 172.21.15.73:0/1507782966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c005cf0 con 0x7f8bac1587a0 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8ba8ff9640 1 -- 172.21.15.73:0/1507782966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0072d0 con 0x7f8bac1587a0 2024-09-12T03:37:16.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac145f30 con 0x7f8bac1587a0 2024-09-12T03:37:16.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac1464f0 con 0x7f8bac1587a0 2024-09-12T03:37:16.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.662+0000 7f8ba8ff9640 1 -- 172.21.15.73:0/1507782966 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b9c01a070 con 0x7f8bac1587a0 2024-09-12T03:37:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8ba8ff9640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b8c0678c0 0x7f8b8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8ba8ff9640 1 -- 172.21.15.73:0/1507782966 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8b9c085150 con 0x7f8bac1587a0 2024-09-12T03:37:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8babfff640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b8c0678c0 0x7f8b8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8babfff640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b8c0678c0 0x7f8b8c069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009f50 tx=0x7f8ba400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 Processor -- start 2024-09-12T03:37:16.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- start start 2024-09-12T03:37:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc82f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefc38d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc39290 0x559fefc39670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559fefb20b60 con 0x559fefc39290 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559fefa87c70 con 0x559fefc82b20 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x559fefa2ded0 con 0x559fefc83440 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc39290 0x559fefc39670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc39290 0x559fefc39670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53890/0 (socket says 172.21.15.73:53890) 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 -- 172.21.15.73:0/769303362 learned_addr learned my addr 172.21.15.73:0/769303362 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 -- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 msgr2=0x559fefc38d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefc38d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefc38d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 -- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 msgr2=0x559fefc82f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8babfff640 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc82f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc82f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 -- 172.21.15.73:0/769303362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fefa3fe50 con 0x559fefc39290 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc39290 0x559fefc39670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0070a0 tx=0x7f8b9c054f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77848fa161fcfa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8ba1ffb640 1 -- 172.21.15.73:0/769303362 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c0537b0 con 0x559fefc39290 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8ba1ffb640 1 -- 172.21.15.73:0/769303362 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c051b20 con 0x559fefc39290 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8ba1ffb640 1 -- 172.21.15.73:0/769303362 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c06d400 con 0x559fefc39290 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- 172.21.15.73:0/769303362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc39290 msgr2=0x559fefc39670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc39290 0x559fefc39670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0070a0 tx=0x7f8b9c054f10 comp rx=0 tx=0).stop 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- 172.21.15.73:0/769303362 shutdown_connections 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc39290 0x559fefc39670 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefc38d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 --2- 172.21.15.73:0/769303362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc82f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- 172.21.15.73:0/769303362 >> 172.21.15.73:0/769303362 conn(0x559fefc3f600 msgr2=0x559fefc37630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- 172.21.15.73:0/769303362 shutdown_connections 2024-09-12T03:37:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- 172.21.15.73:0/769303362 wait complete. 2024-09-12T03:37:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 -- start start 2024-09-12T03:37:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.666+0000 7f8bb566f000 1 Processor -- start 2024-09-12T03:37:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 0x559fefc3ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 0x559fefc43cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc44230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559fefae9b00 con 0x559fefc3e330 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559fefa62360 con 0x559fefc83440 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x559fefa5f2d0 con 0x559fefc82b20 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 10 client.0 _ll_register_callbacks cb 0x559fefc24820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc44230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc44230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53904/0 (socket says 172.21.15.73:53904) 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1960921870 learned_addr learned my addr 172.21.15.73:0/1960921870 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 0x559fefc43cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8babfff640 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 0x559fefc3ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 msgr2=0x559fefc3ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 0x559fefc3ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 msgr2=0x559fefc43cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 0x559fefc43cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 -- 172.21.15.73:0/1960921870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fefa2e120 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc44230 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0518c0 tx=0x7f8b9c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125fdcf9ddca22c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 1 -- 172.21.15.73:0/1960921870 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c007680 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 1 -- 172.21.15.73:0/1960921870 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8b9c054900 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b9c051b20 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 1 -- 172.21.15.73:0/1960921870 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8b9c054b00 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 10 client.6054 fetch_fsmap learned FSMap version 41 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x559fefa27450 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 1 -- 172.21.15.73:0/1960921870 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c051b20 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 1 -- 172.21.15.73:0/1960921870 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f8b9c051200 con 0x559fefc3e330 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 10 client.6054 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T03:37:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 10 client.6054 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 20 client.6054 populate_metadata read hostname 'smithi073' 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefc91280 0x559fefc93670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 4 client.6054 mds_command: new command op to 5892 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 --> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fefa21c00 con 0x559fefc91280 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8babfff640 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefc91280 0x559fefc93670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 10 client.6054 ms_handle_connect on v2:172.21.15.73:6836/585196866 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8babfff640 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefc91280 0x559fefc93670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16147ae75cd055b8 server_cookie=a4ddd6e7ad1b4bb8 in_seq=0 out_seq=0 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 1 -- 172.21.15.73:0/1960921870 <== mds.0 v2:172.21.15.73:6836/585196866 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fefa21c00 con 0x559fefc91280 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 10 client.6054 handle_command_reply: tid=0 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 client.6054 shutdown 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 msgr2=0x559fefc44230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc44230 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0518c0 tx=0x7f8b9c000ee0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 shutdown_connections 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefc91280 0x559fefc93670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc44230 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 0x559fefc43cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8b8affd640 0 client.6054 ms_handle_reset on v2:172.21.15.73:6836/585196866 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1960921870 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 0x559fefc3ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 >> 172.21.15.73:0/1960921870 conn(0x559fefc39290 msgr2=0x559fefc37d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 shutdown_connections 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 1 -- 172.21.15.73:0/1960921870 wait complete. 2024-09-12T03:37:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.670+0000 7f8bb566f000 20 client.6054 trim_cache size 0 max 16384 2024-09-12T03:37:16.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 Processor -- start 2024-09-12T03:37:16.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 -- start start 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 0x559fefc82230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 0x559fefc93670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac202d40 con 0x559fefc3e330 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac154980 con 0x559fefc83440 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac2026f0 con 0x559fefc82b20 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc81cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc81cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53916/0 (socket says 172.21.15.73:53916) 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 -- 172.21.15.73:0/1818929671 learned_addr learned my addr 172.21.15.73:0/1818929671 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:16.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 -- 172.21.15.73:0/1818929671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 msgr2=0x559fefc82230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 --2- 172.21.15.73:0/1818929671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 0x559fefc82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 -- 172.21.15.73:0/1818929671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 msgr2=0x559fefc93670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 --2- 172.21.15.73:0/1818929671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 0x559fefc93670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 -- 172.21.15.73:0/1818929671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fefa0efd0 con 0x559fefc3e330 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8babfff640 1 --2- 172.21.15.73:0/1818929671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc81cf0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x559fefa1f060 tx=0x7f8ba4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ef3ed44e4fa293 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8ba17fa640 1 -- 172.21.15.73:0/1818929671 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4032070 con 0x559fefc3e330 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8ba17fa640 1 -- 172.21.15.73:0/1818929671 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba4003d50 con 0x559fefc3e330 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.690+0000 7f8ba17fa640 1 -- 172.21.15.73:0/1818929671 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4027430 con 0x559fefc3e330 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/1818929671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 msgr2=0x559fefc81cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1818929671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc81cf0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x559fefa1f060 tx=0x7f8ba4015000 comp rx=0 tx=0).stop 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/1818929671 shutdown_connections 2024-09-12T03:37:16.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1818929671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc83440 0x559fefc93670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1818929671 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc82b20 0x559fefc82230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/1818929671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc81cf0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/1818929671 >> 172.21.15.73:0/1818929671 conn(0x559fefc39290 msgr2=0x559fefc3d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/1818929671 shutdown_connections 2024-09-12T03:37:16.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/1818929671 wait complete. 2024-09-12T03:37:16.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- start start 2024-09-12T03:37:16.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 Processor -- start 2024-09-12T03:37:16.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc968c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc96e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefcba170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559fefa86f80 con 0x559fefc3e330 2024-09-12T03:37:16.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x559fefa3fca0 con 0x559fefc82b20 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x559fefa8c2a0 con 0x559fefc83440 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 10 client.0 _ll_register_callbacks cb 0x7f8b9c0554b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53922/0 (socket says 172.21.15.73:53922) 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 -- 172.21.15.73:0/2158771352 learned_addr learned my addr 172.21.15.73:0/2158771352 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefcba170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc96e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 -- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 msgr2=0x559fefcba170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefcba170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 -- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 msgr2=0x559fefc96e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc96e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 -- 172.21.15.73:0/2158771352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fefb0a750 con 0x559fefc3e330 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb0b50640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefcba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc96e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8babfff640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc968c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4030040 tx=0x7f8ba4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5732ca6832462df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 1 -- 172.21.15.73:0/2158771352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba403e060 con 0x559fefc3e330 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba4003d50 con 0x559fefc3e330 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 1 -- 172.21.15.73:0/2158771352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8ba4020040 con 0x559fefc3e330 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 1 -- 172.21.15.73:0/2158771352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8ba4044050 con 0x559fefc3e330 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 10 client.6060 fetch_fsmap learned FSMap version 41 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x559fefa15a30 con 0x559fefc3e330 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 1 -- 172.21.15.73:0/2158771352 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba4003d50 con 0x559fefc3e330 2024-09-12T03:37:16.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 1 -- 172.21.15.73:0/2158771352 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 41) ==== 3502+0+0 (secure 0 0 0) 0x7f8ba4047020 con 0x559fefc3e330 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 10 client.6060 fetch_fsmap finished waiting for FSMap version 41 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 10 client.6060 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 20 client.6060 populate_metadata read hostname 'smithi073' 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefcbab30 0x559fefcfe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 4 client.6060 mds_command: new command op to 5892 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 --> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] -- command(tid 0: {"prefix": "status"}) -- 0x559fefa953a0 con 0x559fefcbab30 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefcbab30 0x559fefcfe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bab7fe640 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefcbab30 0x559fefcfe200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2383a6ba2260077e server_cookie=fb5cdc942dbb9466 in_seq=0 out_seq=0 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 10 client.6060 ms_handle_connect on v2:172.21.15.73:6836/585196866 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 1 -- 172.21.15.73:0/2158771352 <== mds.0 v2:172.21.15.73:6836/585196866 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x559fefa953a0 con 0x559fefcbab30 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 10 client.6060 handle_command_reply: tid=0 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 client.6060 shutdown 2024-09-12T03:37:16.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 msgr2=0x559fefc968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc968c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4030040 tx=0x7f8ba4004ac0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 shutdown_connections 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:6836/585196866,v1:172.21.15.73:6837/585196866] conn(0x559fefcbab30 0x559fefcfe200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x559fefc83440 0x559fefcba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8b8affd640 0 client.6060 ms_handle_reset on v2:172.21.15.73:6836/585196866 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559fefc82b20 0x559fefc96e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 --2- 172.21.15.73:0/2158771352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559fefc3e330 0x559fefc968c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 >> 172.21.15.73:0/2158771352 conn(0x559fefc39290 msgr2=0x559fefc80ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 shutdown_connections 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 1 -- 172.21.15.73:0/2158771352 wait complete. 2024-09-12T03:37:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.694+0000 7f8bb566f000 20 client.6060 trim_cache size 0 max 16384 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5892, 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.180731749, 2024-09-12T03:37:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 41, 2024-09-12T03:37:16.706 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 75, 2024-09-12T03:37:16.706 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 75, 2024-09-12T03:37:16.706 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 15.270991822999999 2024-09-12T03:37:16.706 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b8c0678c0 msgr2=0x7f8b8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b8c0678c0 0x7f8b8c069d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009f50 tx=0x7f8ba400b040 comp rx=0 tx=0).stop 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac1587a0 msgr2=0x7f8bac150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac1587a0 0x7f8bac150740 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00c430 tx=0x7f8b9c00c8f0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 shutdown_connections 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b8c0678c0 0x7f8b8c069d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bac1587a0 0x7f8bac150740 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8bac0b37d0 0x7f8bac146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 --2- 172.21.15.73:0/1507782966 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8bac06e4b0 0x7f8bac151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 >> 172.21.15.73:0/1507782966 conn(0x7f8bac0b1f90 msgr2=0x7f8bac0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 shutdown_connections 2024-09-12T03:37:16.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.698+0000 7f8bb25b3640 1 -- 172.21.15.73:0/1507782966 wait complete. 2024-09-12T03:37:16.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:37:16.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0f9e9640 1 Processor -- start 2024-09-12T03:37:16.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0f9e9640 1 -- start start 2024-09-12T03:37:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0f9e9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4b0815bec0 0x7f4b080ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0f9e9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080b3290 con 0x7f4b080af470 2024-09-12T03:37:16.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0f9e9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080b3570 con 0x7f4b0815c2a0 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0f9e9640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f4b080b3850 con 0x7f4b0815bec0 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4b080af470 0x7f4b0806e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43894/0 (socket says 172.21.15.73:43894) 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 -- 172.21.15.73:0/170002913 learned_addr learned my addr 172.21.15.73:0/170002913 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0d785640 1 --2- 172.21.15.73:0/170002913 >> v2:172.21.15.150:3300/0 conn(0x7f4b0815bec0 0x7f4b080ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786960839 0 0) 0x7f4b080b3290 con 0x7f4b080af470 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4af4003530 con 0x7f4b080af470 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1463995318 0 0) 0x7f4af4003530 con 0x7f4b080af470 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 >> v2:172.21.15.150:3300/0 conn(0x7f4b0815bec0 msgr2=0x7f4b080ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 --2- 172.21.15.73:0/170002913 >> v2:172.21.15.150:3300/0 conn(0x7f4b0815bec0 0x7f4b080ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 >> v1:172.21.15.150:6789/0 conn(0x7f4b0815c2a0 legacy=0x7f4b080aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b080b3b30 con 0x7f4b080af470 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f4b00001a00 con 0x7f4b080af470 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 >> v1:172.21.15.73:6789/0 conn(0x7f4b080af470 legacy=0x7f4b0806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40039c0 0x7f4af4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4004810 0x7f4af4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4af40051d0 0x7f4af400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080b3850 con 0x7f4af40051d0 2024-09-12T03:37:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4af400c070 con 0x7f4af4004810 2024-09-12T03:37:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4af400c270 con 0x7f4af40039c0 2024-09-12T03:37:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4af40051d0 0x7f4af400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0cf84640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4004810 0x7f4af4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0d785640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40039c0 0x7f4af4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 -- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40039c0 msgr2=0x7f4af4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4af40039c0 0x7f4af4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 -- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4004810 msgr2=0x7f4af4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af4004810 0x7f4af4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.826+0000 7f4b0df86640 1 -- 172.21.15.73:0/170002913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af4003530 con 0x7f4af40051d0 2024-09-12T03:37:16.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0df86640 1 -- 172.21.15.73:0/170002913 reap_dead start 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0df86640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4af40051d0 0x7f4af400b9d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a840 tx=0x7f4b0001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813596cf45abd4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000a460 con 0x7f4af40051d0 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b000ac640 con 0x7f4af40051d0 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4afffff640 1 -- 172.21.15.73:0/170002913 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000aca30 con 0x7f4af40051d0 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/170002913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4af40051d0 msgr2=0x7f4af400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4af40051d0 0x7f4af400b9d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a840 tx=0x7f4b0001d360 comp rx=0 tx=0).stop 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/170002913 shutdown_connections 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/170002913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4af40051d0 0x7f4af400b9d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/170002913 >> 172.21.15.73:0/170002913 conn(0x7f4b080b1f90 msgr2=0x7f4b080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:16.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/170002913 shutdown_connections 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/170002913 wait complete. 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 Processor -- start 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 -- start start 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.830+0000 7f4b0f9e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af40051d0 0x7f4b081f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b0814f9f0 0x7f4b081f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b081f5010 0x7f4b081558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080afc90 con 0x7f4b081f5010 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4b080b40f0 con 0x7f4af40051d0 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4b080aed60 con 0x7f4b0814f9f0 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b081f5010 0x7f4b081558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b081f5010 0x7f4b081558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53944/0 (socket says 172.21.15.73:53944) 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 -- 172.21.15.73:0/730678228 learned_addr learned my addr 172.21.15.73:0/730678228 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0cf84640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b0814f9f0 0x7f4b081f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0d785640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af40051d0 0x7f4b081f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 -- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b0814f9f0 msgr2=0x7f4b081f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b0814f9f0 0x7f4b081f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 -- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af40051d0 msgr2=0x7f4b081f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af40051d0 0x7f4b081f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 -- 172.21.15.73:0/730678228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b081f6700 con 0x7f4b081f5010 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0d785640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af40051d0 0x7f4b081f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0df86640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b081f5010 0x7f4b081558d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4b0001dc00 tx=0x7f4af4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4afdffb640 1 -- 172.21.15.73:0/730678228 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000019c0 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4afdffb640 1 -- 172.21.15.73:0/730678228 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00001c00 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b08153e90 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4afdffb640 1 -- 172.21.15.73:0/730678228 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00004d70 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b08154410 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b080af0f0 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4afdffb640 1 -- 172.21.15.73:0/730678228 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b000070e0 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4afdffb640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4aec0678c0 0x7f4aec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4afdffb640 1 -- 172.21.15.73:0/730678228 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f4b0011efd0 con 0x7f4b081f5010 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0d785640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4aec0678c0 0x7f4aec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:16.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.834+0000 7f4b0d785640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4aec0678c0 0x7f4aec069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4b0815f770 tx=0x7f4b04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:16.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:16.838+0000 7f4afdffb640 1 -- 172.21.15.73:0/730678228 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b081f6700 con 0x7f4b081f5010 2024-09-12T03:37:17.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.022+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4b0806fcd0 con 0x7f4b081f5010 2024-09-12T03:37:17.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4afdffb640 1 -- 172.21.15.73:0/730678228 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f4b00017070 con 0x7f4b081f5010 2024-09-12T03:37:17.026 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4aec0678c0 msgr2=0x7f4aec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4aec0678c0 0x7f4aec069d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4b0815f770 tx=0x7f4b04008040 comp rx=0 tx=0).stop 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b081f5010 msgr2=0x7f4b081558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b081f5010 0x7f4b081558d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4b0001dc00 tx=0x7f4af4005840 comp rx=0 tx=0).stop 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 shutdown_connections 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4aec0678c0 0x7f4aec069d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b081f5010 0x7f4b081558d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4b0814f9f0 0x7f4b081f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 --2- 172.21.15.73:0/730678228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4af40051d0 0x7f4b081f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 >> 172.21.15.73:0/730678228 conn(0x7f4b080b1f90 msgr2=0x7f4b0815a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 shutdown_connections 2024-09-12T03:37:17.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17.026+0000 7f4b0f9e9640 1 -- 172.21.15.73:0/730678228 wait complete. 2024-09-12T03:37:17.043 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:37:17.043 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:37:17.043 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:37:17.043 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T03:37:17.043 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:17.043 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:37:17.044 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:37:17.044 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:37:17.044 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:37:17.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:17.044 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:37:17.052 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:17.053 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42331sec preferred_lft 42331sec 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.054 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.055 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:37:17.056 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:17.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:17.057 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:37:17.102 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:37:17.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:17.103 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:17.157 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:37:17.158 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:37:17.158 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:37:17.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:37:17.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:37:17.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:37:17.158 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:37:17.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:37:17.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:17.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:17.278 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:37:17.326 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T03:37:17.326 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:37:17.327 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:37:17.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:17.327 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:37:17.382 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T03:37:17.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:17.382 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:17.430 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:37:17.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:17.431 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:17.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:37:17.540 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:17.587 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:37:17.588 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:17.589 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:17.590 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:17.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:17.592 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:37:17.639 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:37:17.639 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T03:37:17.688 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:37:17.703 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:17.750 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:37:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:37:17.752 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:17.753 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:17.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:17.754 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:37:17.765 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-09-12T03:37:17.762+0000 7f7bc44fd580 -1 init, newargv = 0x559b3cabddd0 newargc=15 2024-09-12T03:37:17.765 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[41820]: starting ceph client 2024-09-12T03:37:17.771 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[41820]: starting fuse 2024-09-12T03:37:18.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:37:18.887 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:18.941 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:37:18.941 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:37:18.941 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:37:18.941 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:37:18.941 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:37:18.941 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:37:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:37:18.943 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:37:18.944 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:37:18.944 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:18.944 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:18.944 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:18.944 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:18.944 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:18.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:18.945 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:37:18.995 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:37:18.995 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:37:18.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:37:18.996 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:37:18.997 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:37:18.998 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:18.998 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-09-12T03:37:18.998 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:37:19.121 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.41820.asok 2024-09-12T03:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:19.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41820.asok 2024-09-12T03:37:19.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:19.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41820.asok status 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "41820", 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:37:19.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6072, 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6072 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3442709129 2024-09-12T03:37:19.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3442709129 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.6072 192.168.0.1:0/3442709129", 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/3442709129", 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 41, 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 75, 2024-09-12T03:37:19.297 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:37:19.298 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:37:19.298 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:37:19.298 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:37:19.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:19.309 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:37:19.309 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:19.315 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:37:19.316 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:19.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:19.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:19.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:37:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.542+0000 7f850cbac640 1 Processor -- start 2024-09-12T03:37:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850cbac640 1 -- start start 2024-09-12T03:37:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850cbac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 0x7f85080b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850cbac640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85080b3c50 con 0x7f85080b51b0 2024-09-12T03:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850cbac640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85080d0b80 con 0x7f850815bc80 2024-09-12T03:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850cbac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f85080d0e60 con 0x7f85080b3330 2024-09-12T03:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f84fdd9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f85080b51b0 0x7f850815b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43904/0 (socket says 172.21.15.73:43904) 2024-09-12T03:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f84fdd9b640 1 -- 172.21.15.73:0/1218307808 learned_addr learned my addr 172.21.15.73:0/1218307808 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190814591 0 0) 0x7f85080b3c50 con 0x7f85080b51b0 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84f4003530 con 0x7f85080b51b0 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850659c640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 0x7f85080b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 639666115 0 0) 0x7f84f4003530 con 0x7f85080b51b0 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 msgr2=0x7f85080b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 0x7f85080b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 >> v1:172.21.15.150:6789/0 conn(0x7f850815bc80 legacy=0x7f85080cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85080b46d0 con 0x7f85080b51b0 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f84f0001680 con 0x7f85080b51b0 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 >> v1:172.21.15.73:6789/0 conn(0x7f85080b51b0 legacy=0x7f850815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 0x7f84f40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004070 0x7f84f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f4004d50 0x7f84f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f85080d0e60 con 0x7f84f4004d50 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f84f400de20 con 0x7f84f4004070 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f84f400e020 con 0x7f85080b3330 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8506d9d640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f4004d50 0x7f84f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f84fdd9b640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004070 0x7f84f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850659c640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 0x7f84f40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8506d9d640 1 -- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 msgr2=0x7f84f40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8506d9d640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 0x7f84f40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8506d9d640 1 -- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004070 msgr2=0x7f84f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8506d9d640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004070 0x7f84f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f8506d9d640 1 -- 172.21.15.73:0/1218307808 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f4003530 con 0x7f84f4004d50 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f850659c640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85080b3330 0x7f84f40039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.546+0000 7f84fdd9b640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004070 0x7f84f4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f8506d9d640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f4004d50 0x7f84f40051d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f850815c080 tx=0x7f850001c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b384295e857c7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500001a90 con 0x7f84f4004d50 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8500003b80 con 0x7f84f4004d50 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f8505d9b640 1 -- 172.21.15.73:0/1218307808 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500005080 con 0x7f84f4004d50 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- 172.21.15.73:0/1218307808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f4004d50 msgr2=0x7f84f40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 --2- 172.21.15.73:0/1218307808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84f4004d50 0x7f84f40051d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f850815c080 tx=0x7f850001c720 comp rx=0 tx=0).stop 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f8506d9d640 1 -- 172.21.15.73:0/1218307808 reap_dead start 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- 172.21.15.73:0/1218307808 shutdown_connections 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- 172.21.15.73:0/1218307808 >> 172.21.15.73:0/1218307808 conn(0x7f85080b6870 msgr2=0x7f85080b6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- 172.21.15.73:0/1218307808 shutdown_connections 2024-09-12T03:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- 172.21.15.73:0/1218307808 wait complete. 2024-09-12T03:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 Processor -- start 2024-09-12T03:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- start start 2024-09-12T03:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004d50 0x7f850815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85081ef970 0x7f850815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85081f2f30 0x7f8508142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8508144d00 con 0x7f85081f2f30 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f85080b4c90 con 0x7f84f4004d50 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f850cbac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8508144e80 con 0x7f85081ef970 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.550+0000 7f8506d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85081f2f30 0x7f8508142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85081f2f30 0x7f8508142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53966/0 (socket says 172.21.15.73:53966) 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 -- 172.21.15.73:0/1089477352 learned_addr learned my addr 172.21.15.73:0/1089477352 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84fdd9b640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85081ef970 0x7f850815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f850659c640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004d50 0x7f850815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 -- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85081ef970 msgr2=0x7f850815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85081ef970 0x7f850815d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 -- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004d50 msgr2=0x7f850815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004d50 0x7f850815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 -- 172.21.15.73:0/1089477352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850815b010 con 0x7f85081f2f30 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84fdd9b640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85081ef970 0x7f850815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f8506d9d640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85081f2f30 0x7f8508142de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8500098130 tx=0x7f84f4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84ff7fe640 1 -- 172.21.15.73:0/1089477352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000ba070 con 0x7f85081f2f30 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84ff7fe640 1 -- 172.21.15.73:0/1089477352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8500006b60 con 0x7f85081f2f30 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850815def0 con 0x7f85081f2f30 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84ff7fe640 1 -- 172.21.15.73:0/1089477352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500001a90 con 0x7f85081f2f30 2024-09-12T03:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85081f37d0 con 0x7f85081f2f30 2024-09-12T03:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85080b55d0 con 0x7f85081f2f30 2024-09-12T03:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84ff7fe640 1 -- 172.21.15.73:0/1089477352 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85000bd070 con 0x7f85081f2f30 2024-09-12T03:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84ff7fe640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f84e80678c0 0x7f84e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f84ff7fe640 1 -- 172.21.15.73:0/1089477352 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f850011f600 con 0x7f85081f2f30 2024-09-12T03:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f850659c640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f84e80678c0 0x7f84e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.554+0000 7f850659c640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f84e80678c0 0x7f84e8069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f85080b02f0 tx=0x7f84f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.558+0000 7f84ff7fe640 1 -- 172.21.15.73:0/1089477352 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f85000ac020 con 0x7f85081f2f30 2024-09-12T03:37:19.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.758+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f85080b6e90 con 0x7f85081f2f30 2024-09-12T03:37:19.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.758+0000 7f84ff7fe640 1 -- 172.21.15.73:0/1089477352 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f8500016430 con 0x7f85081f2f30 2024-09-12T03:37:19.760 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f84e80678c0 msgr2=0x7f84e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f84e80678c0 0x7f84e8069d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f85080b02f0 tx=0x7f84f8008040 comp rx=0 tx=0).stop 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85081f2f30 msgr2=0x7f8508142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85081f2f30 0x7f8508142de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f8500098130 tx=0x7f84f4005840 comp rx=0 tx=0).stop 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 shutdown_connections 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f84e80678c0 0x7f84e8069d80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85081f2f30 0x7f8508142de0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f85081ef970 0x7f850815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 --2- 172.21.15.73:0/1089477352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84f4004d50 0x7f850815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 >> 172.21.15.73:0/1089477352 conn(0x7f85080b6870 msgr2=0x7f85080b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 shutdown_connections 2024-09-12T03:37:19.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:19.762+0000 7f850cbac640 1 -- 172.21.15.73:0/1089477352 wait complete. 2024-09-12T03:37:19.779 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:37:19.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:37:19.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:37:19.779 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:37:19.779 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:19.779 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:37:19.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:37:19.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:37:19.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:19.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:19.780 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:37:19.787 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:37:19.787 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:37:19.788 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42340sec preferred_lft 42340sec 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.789 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:37:19.790 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:19.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:19.791 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:37:19.843 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:37:19.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:19.845 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:37:19.897 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:37:19.897 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:37:19.897 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:37:19.897 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:37:19.898 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:37:19.898 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:37:19.898 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:37:19.898 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:19.898 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:19.898 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:19.898 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:37:19.898 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:37:19.898 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:37:19.899 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:37:19.899 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:37:19.899 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:37:19.899 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:37:19.987 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:37:20.020 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:20.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:20.027 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:37:20.033 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:37:20.033 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:37:20.033 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:20.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:20.033 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:37:20.087 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:37:20.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:20.087 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:20.132 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:20.133 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:20.133 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:20.180 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:20.238 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:20.285 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:20.285 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:20.285 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:20.285 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:20.285 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:20.286 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:20.287 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:20.288 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:20.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:20.289 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:20.337 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:37:20.337 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T03:37:20.381 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:20.396 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:20.445 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:20.446 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:20.447 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:20.448 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:20.448 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:20.448 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:20.448 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:20.448 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:20.448 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:20.448 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:20.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:20.449 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:20.457 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:37:20.455+0000 7f460d253580 -1 init, newargv = 0x55b8d72e6010 newargc=15 2024-09-12T03:37:20.458 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35207]: starting ceph client 2024-09-12T03:37:20.464 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35207]: starting fuse 2024-09-12T03:37:21.562 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:21.578 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:21.629 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:21.629 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:21.630 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:21.631 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:21.632 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:21.632 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:21.632 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:21.632 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:21.632 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:21.632 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:21.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:21.634 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:21.685 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:37:21.685 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:37:21.685 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:37:21.685 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:37:21.685 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:37:21.685 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:37:21.685 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:37:21.685 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:21.685 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:37:21.686 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:37:21.686 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:37:21.686 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:37:21.686 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:21.686 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:37:21.686 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:37:21.687 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:37:21.688 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:37:21.688 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:37:21.688 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:21.688 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:37:21.688 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:37:21.809 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.35207.asok 2024-09-12T03:37:21.813 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:21.820 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35207.asok 2024-09-12T03:37:21.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:21.821 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35207.asok status 2024-09-12T03:37:21.974 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:37:21.974 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:37:21.974 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "35207", 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5278, 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:37:21.975 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5278 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3371830780 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:37:21.976 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3371830780 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.5278 192.168.0.1:0/3371830780", 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/3371830780", 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 41, 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 75, 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:37:21.977 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:37:21.978 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:37:21.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:21.988 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:37:21.988 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:21.994 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:37:21.994 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:21.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:21.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:22.046 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:22.046 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:22.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:37:22.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f8880131640 1 Processor -- start 2024-09-12T03:37:22.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f8880131640 1 -- start start 2024-09-12T03:37:22.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f8880131640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f887815bec0 0x7f88780ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f8880131640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f88780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f8880131640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88780b3290 con 0x7f88780af2a0 2024-09-12T03:37:22.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f8880131640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f88780b3570 con 0x7f887815bec0 2024-09-12T03:37:22.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f8880131640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f88780b3850 con 0x7f887815c2a0 2024-09-12T03:37:22.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887decd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f887815bec0 0x7f88780ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887d6cc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f88780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887e6ce640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f88780af2a0 0x7f887815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:40090/0 (socket says 172.21.15.73:40090) 2024-09-12T03:37:22.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887e6ce640 1 -- 172.21.15.73:0/3201283108 learned_addr learned my addr 172.21.15.73:0/3201283108 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:22.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887decd640 1 -- 172.21.15.73:0/3201283108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 msgr2=0x7f88780aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:22.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887decd640 1 --2- 172.21.15.73:0/3201283108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f88780aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887decd640 1 -- 172.21.15.73:0/3201283108 >> v1:172.21.15.150:6789/0 conn(0x7f88780af2a0 legacy=0x7f887815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.226+0000 7f887decd640 1 -- 172.21.15.73:0/3201283108 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88780b3b30 con 0x7f887815bec0 2024-09-12T03:37:22.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f887decd640 1 --2- 172.21.15.73:0/3201283108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815bec0 0x7f88780ad200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8868009d90 tx=0x7f886801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab8e2bddd78e0556 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:22.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f887cecb640 1 -- 172.21.15.73:0/3201283108 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680b2070 con 0x7f887815bec0 2024-09-12T03:37:22.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f887cecb640 1 -- 172.21.15.73:0/3201283108 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88680a5a00 con 0x7f887815bec0 2024-09-12T03:37:22.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f887cecb640 1 -- 172.21.15.73:0/3201283108 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680a5dd0 con 0x7f887815bec0 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 -- 172.21.15.73:0/3201283108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815bec0 msgr2=0x7f88780ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 --2- 172.21.15.73:0/3201283108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815bec0 0x7f88780ad200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8868009d90 tx=0x7f886801c940 comp rx=0 tx=0).stop 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 -- 172.21.15.73:0/3201283108 shutdown_connections 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 --2- 172.21.15.73:0/3201283108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f88780aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 --2- 172.21.15.73:0/3201283108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815bec0 0x7f88780ad200 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 -- 172.21.15.73:0/3201283108 >> 172.21.15.73:0/3201283108 conn(0x7f88780b1f90 msgr2=0x7f88780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 -- 172.21.15.73:0/3201283108 shutdown_connections 2024-09-12T03:37:22.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.230+0000 7f8880131640 1 -- 172.21.15.73:0/3201283108 wait complete. 2024-09-12T03:37:22.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 Processor -- start 2024-09-12T03:37:22.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 -- start start 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88780af2a0 0x7f8878152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f887815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815f660 0x7f88780b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88780af6b0 con 0x7f88780af2a0 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f88780ad740 con 0x7f887815f660 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8878169000 con 0x7f887815c2a0 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88780af2a0 0x7f8878152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88780af2a0 0x7f8878152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53970/0 (socket says 172.21.15.73:53970) 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 -- 172.21.15.73:0/1555262248 learned_addr learned my addr 172.21.15.73:0/1555262248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887e6ce640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815f660 0x7f88780b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887d6cc640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f887815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 -- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 msgr2=0x7f887815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f887815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 -- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815f660 msgr2=0x7f88780b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815f660 0x7f88780b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 -- 172.21.15.73:0/1555262248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8878153150 con 0x7f88780af2a0 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f887decd640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88780af2a0 0x7f8878152c10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f88680b0040 tx=0x7f88680196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f88767fc640 1 -- 172.21.15.73:0/1555262248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680b2050 con 0x7f88780af2a0 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f88767fc640 1 -- 172.21.15.73:0/1555262248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88680be070 con 0x7f88780af2a0 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887815d5f0 con 0x7f88780af2a0 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f88767fc640 1 -- 172.21.15.73:0/1555262248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88680adb90 con 0x7f88780af2a0 2024-09-12T03:37:22.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887815ccb0 con 0x7f88780af2a0 2024-09-12T03:37:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88780ad200 con 0x7f88780af2a0 2024-09-12T03:37:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.234+0000 7f88767fc640 1 -- 172.21.15.73:0/1555262248 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88680c3460 con 0x7f88780af2a0 2024-09-12T03:37:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.238+0000 7f88767fc640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88640678c0 0x7f8864069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.238+0000 7f88767fc640 1 -- 172.21.15.73:0/1555262248 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8868121200 con 0x7f88780af2a0 2024-09-12T03:37:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.238+0000 7f887d6cc640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88640678c0 0x7f8864069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.238+0000 7f887d6cc640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88640678c0 0x7f8864069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8878073340 tx=0x7f886c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:22.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.242+0000 7f88767fc640 1 -- 172.21.15.73:0/1555262248 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8868016560 con 0x7f88780af2a0 2024-09-12T03:37:22.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.414+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f887815ef20 con 0x7f88780af2a0 2024-09-12T03:37:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.414+0000 7f88767fc640 1 -- 172.21.15.73:0/1555262248 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f88680f1c40 con 0x7f88780af2a0 2024-09-12T03:37:22.417 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:37:22.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88640678c0 msgr2=0x7f8864069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88640678c0 0x7f8864069d80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8878073340 tx=0x7f886c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88780af2a0 msgr2=0x7f8878152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88780af2a0 0x7f8878152c10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f88680b0040 tx=0x7f88680196e0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 shutdown_connections 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f88640678c0 0x7f8864069d80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f887815f660 0x7f88780b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f887815c2a0 0x7f887815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 --2- 172.21.15.73:0/1555262248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88780af2a0 0x7f8878152c10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 >> 172.21.15.73:0/1555262248 conn(0x7f88780b1f90 msgr2=0x7f8878158310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 shutdown_connections 2024-09-12T03:37:22.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.418+0000 7f8880131640 1 -- 172.21.15.73:0/1555262248 wait complete. 2024-09-12T03:37:22.434 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:22.435 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:22.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:37:22.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd264575640 1 Processor -- start 2024-09-12T03:37:22.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd264575640 1 -- start start 2024-09-12T03:37:22.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd264575640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd25c0b39a0 0x7fd25c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd264575640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c06e4b0 0x7fd25c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd264575640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25c06ec60 con 0x7fd25c1587a0 2024-09-12T03:37:22.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd264575640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd25c06f870 con 0x7fd25c0b39a0 2024-09-12T03:37:22.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd264575640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd25c06ef40 con 0x7fd25c06e4b0 2024-09-12T03:37:22.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd262b12640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c06e4b0 0x7fd25c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd261b10640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd25c0b39a0 0x7fd25c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd262311640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd25c1587a0 0x7fd25c0b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:40094/0 (socket says 172.21.15.73:40094) 2024-09-12T03:37:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd262b12640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c06e4b0 0x7fd25c072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:35078/0 (socket says 172.21.15.73:35078) 2024-09-12T03:37:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd262311640 1 -- 172.21.15.73:0/606186623 learned_addr learned my addr 172.21.15.73:0/606186623 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd261b10640 1 -- 172.21.15.73:0/606186623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c06e4b0 msgr2=0x7fd25c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd261b10640 1 --2- 172.21.15.73:0/606186623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c06e4b0 0x7fd25c072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd261b10640 1 -- 172.21.15.73:0/606186623 >> v1:172.21.15.150:6789/0 conn(0x7fd25c1587a0 legacy=0x7fd25c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.562+0000 7fd261b10640 1 -- 172.21.15.73:0/606186623 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25c06f220 con 0x7fd25c0b39a0 2024-09-12T03:37:22.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd261b10640 1 --2- 172.21.15.73:0/606186623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c0b39a0 0x7fd25c06df70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097c0 tx=0x7fd25801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b631161dc88ec8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:22.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd26130f640 1 -- 172.21.15.73:0/606186623 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580b2070 con 0x7fd25c0b39a0 2024-09-12T03:37:22.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd26130f640 1 -- 172.21.15.73:0/606186623 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2580ad640 con 0x7fd25c0b39a0 2024-09-12T03:37:22.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd26130f640 1 -- 172.21.15.73:0/606186623 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580ada10 con 0x7fd25c0b39a0 2024-09-12T03:37:22.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 -- 172.21.15.73:0/606186623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c0b39a0 msgr2=0x7fd25c06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 --2- 172.21.15.73:0/606186623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c0b39a0 0x7fd25c06df70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097c0 tx=0x7fd25801c470 comp rx=0 tx=0).stop 2024-09-12T03:37:22.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 -- 172.21.15.73:0/606186623 shutdown_connections 2024-09-12T03:37:22.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 --2- 172.21.15.73:0/606186623 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c06e4b0 0x7fd25c072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 --2- 172.21.15.73:0/606186623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c0b39a0 0x7fd25c06df70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 -- 172.21.15.73:0/606186623 >> 172.21.15.73:0/606186623 conn(0x7fd25c0b1f90 msgr2=0x7fd25c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:22.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 -- 172.21.15.73:0/606186623 shutdown_connections 2024-09-12T03:37:22.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.566+0000 7fd264575640 1 -- 172.21.15.73:0/606186623 wait complete. 2024-09-12T03:37:22.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 Processor -- start 2024-09-12T03:37:22.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 -- start start 2024-09-12T03:37:22.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e4b0 0x7fd25c14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0b39a0 0x7fd25c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c1587a0 0x7fd25c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c073030 con 0x7fd25c0b39a0 2024-09-12T03:37:22.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c072eb0 con 0x7fd25c06e4b0 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd25c0731b0 con 0x7fd25c1587a0 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0b39a0 0x7fd25c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0b39a0 0x7fd25c150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53986/0 (socket says 172.21.15.73:53986) 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 -- 172.21.15.73:0/2251856102 learned_addr learned my addr 172.21.15.73:0/2251856102 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd262b12640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c1587a0 0x7fd25c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd262311640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e4b0 0x7fd25c14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 -- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c1587a0 msgr2=0x7fd25c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c1587a0 0x7fd25c155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 -- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e4b0 msgr2=0x7fd25c14e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e4b0 0x7fd25c14e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 -- 172.21.15.73:0/2251856102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25c14f0c0 con 0x7fd25c0b39a0 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd261b10640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0b39a0 0x7fd25c150020 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097c0 tx=0x7fd258019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:22.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd252ffd640 1 -- 172.21.15.73:0/2251856102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580b2040 con 0x7fd25c0b39a0 2024-09-12T03:37:22.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd252ffd640 1 -- 172.21.15.73:0/2251856102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2580bc070 con 0x7fd25c0b39a0 2024-09-12T03:37:22.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25c150560 con 0x7fd25c0b39a0 2024-09-12T03:37:22.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd252ffd640 1 -- 172.21.15.73:0/2251856102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2580b6630 con 0x7fd25c0b39a0 2024-09-12T03:37:22.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25c14e820 con 0x7fd25c0b39a0 2024-09-12T03:37:22.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.570+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25c072160 con 0x7fd25c0b39a0 2024-09-12T03:37:22.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.574+0000 7fd252ffd640 1 -- 172.21.15.73:0/2251856102 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2580b67d0 con 0x7fd25c0b39a0 2024-09-12T03:37:22.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.574+0000 7fd252ffd640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2400678c0 0x7fd240069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:22.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.574+0000 7fd252ffd640 1 -- 172.21.15.73:0/2251856102 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd25811fdb0 con 0x7fd25c0b39a0 2024-09-12T03:37:22.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.574+0000 7fd262311640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2400678c0 0x7fd240069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:22.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.574+0000 7fd262311640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2400678c0 0x7fd240069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd25c152b10 tx=0x7fd24c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:22.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.578+0000 7fd252ffd640 1 -- 172.21.15.73:0/2251856102 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd258016090 con 0x7fd25c0b39a0 2024-09-12T03:37:22.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd25c070080 con 0x7fd25c0b39a0 2024-09-12T03:37:22.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd252ffd640 1 -- 172.21.15.73:0/2251856102 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7fd2580f0880 con 0x7fd25c0b39a0 2024-09-12T03:37:22.739 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:37:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2400678c0 msgr2=0x7fd240069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2400678c0 0x7fd240069d80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd25c152b10 tx=0x7fd24c009040 comp rx=0 tx=0).stop 2024-09-12T03:37:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0b39a0 msgr2=0x7fd25c150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:22.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0b39a0 0x7fd25c150020 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd2580097c0 tx=0x7fd258019210 comp rx=0 tx=0).stop 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 shutdown_connections 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd2400678c0 0x7fd240069d80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0b39a0 0x7fd25c150020 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd25c1587a0 0x7fd25c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 --2- 172.21.15.73:0/2251856102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd25c06e4b0 0x7fd25c14e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 >> 172.21.15.73:0/2251856102 conn(0x7fd25c0b1f90 msgr2=0x7fd25c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 shutdown_connections 2024-09-12T03:37:22.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:22.738+0000 7fd264575640 1 -- 172.21.15.73:0/2251856102 wait complete. 2024-09-12T03:37:22.756 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:37:22.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:22.757 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:22.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35207]: fuse finished with error 0 and tester_r 0 2024-09-12T03:37:22.772 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:22.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:37:22.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:22.848 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:37:22.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:22.854 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T03:37:22.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:22.868 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 134217728 ./subdir) 2024-09-12T03:37:22.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:37:23.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.082+0000 7fd0cbfce640 1 Processor -- start 2024-09-12T03:37:23.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.082+0000 7fd0cbfce640 1 -- start start 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0cbfce640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd0c41520a0 0x7fd0c406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0cbfce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0c406fe50 0x7fd0c415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0cbfce640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0c4070250 con 0x7fd0c415f1d0 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0cbfce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c4152480 con 0x7fd0c406fe50 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0cbfce640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd0c40aede0 con 0x7fd0c41520a0 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0c406fe50 0x7fd0c415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0c406fe50 0x7fd0c415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53990/0 (socket says 172.21.15.73:53990) 2024-09-12T03:37:23.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 -- 172.21.15.73:0/1606564703 learned_addr learned my addr 172.21.15.73:0/1606564703 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9d6a640 1 --2- 172.21.15.73:0/1606564703 >> v2:172.21.15.150:3300/0 conn(0x7fd0c41520a0 0x7fd0c406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 -- 172.21.15.73:0/1606564703 >> v2:172.21.15.150:3300/0 conn(0x7fd0c41520a0 msgr2=0x7fd0c406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 --2- 172.21.15.73:0/1606564703 >> v2:172.21.15.150:3300/0 conn(0x7fd0c41520a0 0x7fd0c406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 -- 172.21.15.73:0/1606564703 >> v1:172.21.15.150:6789/0 conn(0x7fd0c415f1d0 legacy=0x7fd0c4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:23.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 -- 172.21.15.73:0/1606564703 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c415fa10 con 0x7fd0c406fe50 2024-09-12T03:37:23.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c9569640 1 --2- 172.21.15.73:0/1606564703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c406fe50 0x7fd0c415ec90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4071710 tx=0x7fd0c001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d593bf2885ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:23.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c8d68640 1 -- 172.21.15.73:0/1606564703 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00b1070 con 0x7fd0c406fe50 2024-09-12T03:37:23.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c8d68640 1 -- 172.21.15.73:0/1606564703 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c00a8050 con 0x7fd0c406fe50 2024-09-12T03:37:23.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.086+0000 7fd0c8d68640 1 -- 172.21.15.73:0/1606564703 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00ac860 con 0x7fd0c406fe50 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- 172.21.15.73:0/1606564703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c406fe50 msgr2=0x7fd0c415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/1606564703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c406fe50 0x7fd0c415ec90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4071710 tx=0x7fd0c001c4c0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- 172.21.15.73:0/1606564703 shutdown_connections 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/1606564703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c406fe50 0x7fd0c415ec90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/1606564703 >> v2:172.21.15.150:3300/0 conn(0x7fd0c41520a0 0x7fd0c406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- 172.21.15.73:0/1606564703 >> 172.21.15.73:0/1606564703 conn(0x7fd0c40b1f90 msgr2=0x7fd0c40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- 172.21.15.73:0/1606564703 shutdown_connections 2024-09-12T03:37:23.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- 172.21.15.73:0/1606564703 wait complete. 2024-09-12T03:37:23.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 Processor -- start 2024-09-12T03:37:23.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- start start 2024-09-12T03:37:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0c406fe50 0x7fd0c4149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c41520a0 0x7fd0c4159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0c415f1d0 0x7fd0c415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4073d30 con 0x7fd0c41520a0 2024-09-12T03:37:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c4073a50 con 0x7fd0c415f1d0 2024-09-12T03:37:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c415f660 con 0x7fd0c406fe50 2024-09-12T03:37:23.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c41520a0 0x7fd0c4159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c41520a0 0x7fd0c4159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53992/0 (socket says 172.21.15.73:53992) 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 -- 172.21.15.73:0/3609431518 learned_addr learned my addr 172.21.15.73:0/3609431518 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9d6a640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0c406fe50 0x7fd0c4149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0ca56b640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0c415f1d0 0x7fd0c415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 -- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0c406fe50 msgr2=0x7fd0c4149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0c406fe50 0x7fd0c4149610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 -- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0c415f1d0 msgr2=0x7fd0c415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0c415f1d0 0x7fd0c415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 -- 172.21.15.73:0/3609431518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c4155580 con 0x7fd0c41520a0 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0ca56b640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0c415f1d0 0x7fd0c415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0c9569640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c41520a0 0x7fd0c4159f80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd0c001a0f0 tx=0x7fd0c001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:23.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0ba7fc640 1 -- 172.21.15.73:0/3609431518 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00b1040 con 0x7fd0c41520a0 2024-09-12T03:37:23.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0ba7fc640 1 -- 172.21.15.73:0/3609431518 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c00bc070 con 0x7fd0c41520a0 2024-09-12T03:37:23.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c4155860 con 0x7fd0c41520a0 2024-09-12T03:37:23.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0ba7fc640 1 -- 172.21.15.73:0/3609431518 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c00b7670 con 0x7fd0c41520a0 2024-09-12T03:37:23.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.090+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c4167290 con 0x7fd0c41520a0 2024-09-12T03:37:23.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.094+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c4153450 con 0x7fd0c41520a0 2024-09-12T03:37:23.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.094+0000 7fd0ba7fc640 1 -- 172.21.15.73:0/3609431518 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0c00b7810 con 0x7fd0c41520a0 2024-09-12T03:37:23.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.094+0000 7fd0ba7fc640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0a80678c0 0x7fd0a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:23.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.094+0000 7fd0ba7fc640 1 -- 172.21.15.73:0/3609431518 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd0c0120110 con 0x7fd0c41520a0 2024-09-12T03:37:23.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.094+0000 7fd0c9d6a640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0a80678c0 0x7fd0a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:23.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.094+0000 7fd0c9d6a640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0a80678c0 0x7fd0a8069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40723d0 tx=0x7fd0b4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:23.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.098+0000 7fd0ba7fc640 1 -- 172.21.15.73:0/3609431518 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0c00160b0 con 0x7fd0c41520a0 2024-09-12T03:37:23.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd0c40cc630 con 0x7fd0c41520a0 2024-09-12T03:37:23.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0ba7fc640 1 -- 172.21.15.73:0/3609431518 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7fd0c00f0b50 con 0x7fd0c41520a0 2024-09-12T03:37:23.282 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:37:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0a80678c0 msgr2=0x7fd0a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0a80678c0 0x7fd0a8069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40723d0 tx=0x7fd0b4008040 comp rx=0 tx=0).stop 2024-09-12T03:37:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c41520a0 msgr2=0x7fd0c4159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c41520a0 0x7fd0c4159f80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd0c001a0f0 tx=0x7fd0c001ad00 comp rx=0 tx=0).stop 2024-09-12T03:37:23.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 shutdown_connections 2024-09-12T03:37:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd0a80678c0 0x7fd0a8069d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0c41520a0 0x7fd0c4159f80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd0c415f1d0 0x7fd0c415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 --2- 172.21.15.73:0/3609431518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd0c406fe50 0x7fd0c4149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 >> 172.21.15.73:0/3609431518 conn(0x7fd0c40b1f90 msgr2=0x7fd0c40b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 shutdown_connections 2024-09-12T03:37:23.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:23.282+0000 7fd0cbfce640 1 -- 172.21.15.73:0/3609431518 wait complete. 2024-09-12T03:37:23.299 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:self.cephfs_mntpt = /subdir 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:37:23.300 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:23.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:23.300 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:37:23.307 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:37:23.307 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:23.308 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42336sec preferred_lft 42336sec 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:37:23.309 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:37:23.310 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:23.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:23.311 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:37:23.364 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:37:23.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:23.366 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:37:23.416 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:37:23.416 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:23.417 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:37:23.418 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:37:23.418 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:37:23.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:37:23.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:37:23.418 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:37:23.418 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:37:23.508 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:37:23.535 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:23.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:23.542 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:37:23.547 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:37:23.548 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:37:23.548 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:23.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:23.548 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:37:23.602 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:37:23.602 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:23.603 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:23.648 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:23.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:23.649 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:23.696 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:23.754 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:23.801 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:23.801 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:23.802 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:23.803 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:23.804 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:23.804 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:23.804 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:23.804 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:23.804 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:23.804 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:23.804 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:23.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:23.806 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:23.852 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:37:23.852 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_mountpoint=/subdir) 2024-09-12T03:37:23.897 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:23.911 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:23.961 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:23.961 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:23.961 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:23.961 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:23.962 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:23.963 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:23.964 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:23.964 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:23.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:23.964 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:23.978 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:37:23.975+0000 7f3bdf46c580 -1 init, newargv = 0x5606f7b38f70 newargc=15 2024-09-12T03:37:23.978 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35297]: starting ceph client 2024-09-12T03:37:23.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35297]: starting fuse 2024-09-12T03:37:25.083 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:25.099 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:25.145 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:25.146 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:25.147 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:25.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:25.148 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:25.196 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:37:25.197 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:37:25.197 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:37:25.198 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:37:25.199 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:25.199 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:37:25.199 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:37:25.318 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.35297.asok 2024-09-12T03:37:25.322 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:25.330 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35297.asok 2024-09-12T03:37:25.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:25.330 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35297.asok status 2024-09-12T03:37:25.485 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:37:25.485 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "35297", 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/subdir" 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:37:25.486 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4961, 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4961 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3796995341 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:37:25.487 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 3796995341 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4961 192.168.0.1:0/3796995341", 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/3796995341", 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 2, 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 41, 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 75, 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:37:25.488 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:37:25.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:25.499 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:37:25.499 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:25.506 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:37:25.506 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:25.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:25.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:25.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:25.563 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2024-09-12T03:37:25.631 INFO:teuthology.orchestra.run.smithi150.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2024-09-12T03:37:25.648 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-fuse 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:25.648 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', 'ceph-fuse 134217728 0 134217728 0% /home/ubuntu/cephtest/mnt.1'] 2024-09-12T03:37:25.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:25.649 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 268435456 ./subdir) 2024-09-12T03:37:25.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:25.667 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec df -B1 .) 2024-09-12T03:37:25.686 INFO:teuthology.orchestra.run.smithi150.stdout:Filesystem 1B-blocks Used Available Use% Mounted on 2024-09-12T03:37:25.686 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-fuse 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:25.687 WARNING:tasks.cephfs.mount:['Filesystem 1B-blocks Used Available Use% Mounted on', 'ceph-fuse 268435456 0 268435456 0% /home/ubuntu/cephtest/mnt.1'] 2024-09-12T03:37:25.688 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:37:25.688 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:25.764 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:25.814 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:37:25.814 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:25.814 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:25.814 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:25.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:37:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.990+0000 7fe1a8004640 1 Processor -- start 2024-09-12T03:37:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.990+0000 7fe1a8004640 1 -- start start 2024-09-12T03:37:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a8004640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe1a0161a60 0x7fe1a00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a8004640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1a00cf620 0x7fe1a006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a8004640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1a00d32b0 con 0x7fe1a00d2e90 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a8004640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe1a00d0300 con 0x7fe1a0161a60 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a8004640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe1a00cfa90 con 0x7fe1a00cf620 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a5da0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe1a0161a60 0x7fe1a00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a5da0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe1a0161a60 0x7fe1a00d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53268/0 (socket says 172.21.15.73:53268) 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a5da0640 1 -- 172.21.15.73:0/2706644588 learned_addr learned my addr 172.21.15.73:0/2706644588 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a65a1640 1 --2- 172.21.15.73:0/2706644588 >> v2:172.21.15.150:3300/0 conn(0x7fe1a00cf620 0x7fe1a006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a5da0640 1 -- 172.21.15.73:0/2706644588 >> v2:172.21.15.150:3300/0 conn(0x7fe1a00cf620 msgr2=0x7fe1a006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a5da0640 1 --2- 172.21.15.73:0/2706644588 >> v2:172.21.15.150:3300/0 conn(0x7fe1a00cf620 0x7fe1a006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:25.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a5da0640 1 -- 172.21.15.73:0/2706644588 >> v1:172.21.15.150:6789/0 conn(0x7fe1a00d2e90 legacy=0x7fe1a00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:25.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.994+0000 7fe1a5da0640 1 -- 172.21.15.73:0/2706644588 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a00b0f60 con 0x7fe1a0161a60 2024-09-12T03:37:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 --2- 172.21.15.73:0/2706644588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a0161a60 0x7fe1a00d2950 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00ce950 tx=0x7fe19001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be31be466edb476 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a4d9e640 1 -- 172.21.15.73:0/2706644588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1900ab620 con 0x7fe1a0161a60 2024-09-12T03:37:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a4d9e640 1 -- 172.21.15.73:0/2706644588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1900b0070 con 0x7fe1a0161a60 2024-09-12T03:37:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a4d9e640 1 -- 172.21.15.73:0/2706644588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1900ab9e0 con 0x7fe1a0161a60 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- 172.21.15.73:0/2706644588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a0161a60 msgr2=0x7fe1a00d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 --2- 172.21.15.73:0/2706644588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a0161a60 0x7fe1a00d2950 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00ce950 tx=0x7fe19001c420 comp rx=0 tx=0).stop 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- 172.21.15.73:0/2706644588 shutdown_connections 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 --2- 172.21.15.73:0/2706644588 >> v2:172.21.15.150:3300/0 conn(0x7fe1a00cf620 0x7fe1a006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 --2- 172.21.15.73:0/2706644588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a0161a60 0x7fe1a00d2950 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- 172.21.15.73:0/2706644588 >> 172.21.15.73:0/2706644588 conn(0x7fe1a008bf90 msgr2=0x7fe1a009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- 172.21.15.73:0/2706644588 shutdown_connections 2024-09-12T03:37:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- 172.21.15.73:0/2706644588 wait complete. 2024-09-12T03:37:26.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 Processor -- start 2024-09-12T03:37:26.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- start start 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a00cf620 0x7fe1a00b9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a00d2e90 0x7fe1a00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a0161a60 0x7fe1a0159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a006e400 con 0x7fe1a00cf620 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a006d190 con 0x7fe1a0161a60 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a8004640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a006e580 con 0x7fe1a00d2e90 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a00cf620 0x7fe1a00b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a00cf620 0x7fe1a00b9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53274/0 (socket says 172.21.15.73:53274) 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 -- 172.21.15.73:0/1588760969 learned_addr learned my addr 172.21.15.73:0/1588760969 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a559f640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a00d2e90 0x7fe1a00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a65a1640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a0161a60 0x7fe1a0159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 -- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a00d2e90 msgr2=0x7fe1a00b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a00d2e90 0x7fe1a00b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 -- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a0161a60 msgr2=0x7fe1a0159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a0161a60 0x7fe1a0159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:25.998+0000 7fe1a5da0640 1 -- 172.21.15.73:0/1588760969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a0158a80 con 0x7fe1a00cf620 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1a5da0640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a00cf620 0x7fe1a00b9420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe1900ad040 tx=0x7fe19001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1967fc640 1 -- 172.21.15.73:0/1588760969 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1900abd90 con 0x7fe1a00cf620 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1967fc640 1 -- 172.21.15.73:0/1588760969 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1900be3f0 con 0x7fe1a00cf620 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a0158d60 con 0x7fe1a00cf620 2024-09-12T03:37:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1967fc640 1 -- 172.21.15.73:0/1588760969 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1900be7e0 con 0x7fe1a00cf620 2024-09-12T03:37:26.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a0159320 con 0x7fe1a00cf620 2024-09-12T03:37:26.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a006d6b0 con 0x7fe1a00cf620 2024-09-12T03:37:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1967fc640 1 -- 172.21.15.73:0/1588760969 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1900b43f0 con 0x7fe1a00cf620 2024-09-12T03:37:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1967fc640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1840678c0 0x7fe184069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1967fc640 1 -- 172.21.15.73:0/1588760969 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fe190120270 con 0x7fe1a00cf620 2024-09-12T03:37:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1a559f640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1840678c0 0x7fe184069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.002+0000 7fe1a559f640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1840678c0 0x7fe184069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe1a01fa740 tx=0x7fe19c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:26.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.006+0000 7fe1967fc640 1 -- 172.21.15.73:0/1588760969 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1900c4060 con 0x7fe1a00cf620 2024-09-12T03:37:26.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe1a006bcc0 con 0x7fe1a00cf620 2024-09-12T03:37:26.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1967fc640 1 -- 172.21.15.73:0/1588760969 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7fe1900160d0 con 0x7fe1a00cf620 2024-09-12T03:37:26.183 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:37:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1840678c0 msgr2=0x7fe184069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1840678c0 0x7fe184069d80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe1a01fa740 tx=0x7fe19c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a00cf620 msgr2=0x7fe1a00b9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a00cf620 0x7fe1a00b9420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe1900ad040 tx=0x7fe19001ac60 comp rx=0 tx=0).stop 2024-09-12T03:37:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 shutdown_connections 2024-09-12T03:37:26.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1840678c0 0x7fe184069d80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1a0161a60 0x7fe1a0159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1a00d2e90 0x7fe1a00b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 --2- 172.21.15.73:0/1588760969 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1a00cf620 0x7fe1a00b9420 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 >> 172.21.15.73:0/1588760969 conn(0x7fe1a008bf90 msgr2=0x7fe1a00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 shutdown_connections 2024-09-12T03:37:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.182+0000 7fe1a8004640 1 -- 172.21.15.73:0/1588760969 wait complete. 2024-09-12T03:37:26.202 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:37:26.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:26.202 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:26.213 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[41820]: fuse finished with error 0 and tester_r 0 2024-09-12T03:37:26.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:37:26.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:26.215 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:37:26.363 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:26.363 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:26.364 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:26.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:37:26.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f734abb8640 1 Processor -- start 2024-09-12T03:37:26.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f734abb8640 1 -- start start 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f734abb8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f734415e430 0x7f73440b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f734abb8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7344070d40 0x7f73440ae000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f734abb8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73440b5c90 con 0x7f73440b03a0 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f734abb8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f73440b4560 con 0x7f734415e430 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f734abb8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f73440b5f90 con 0x7f7344070d40 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7343fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f73440b03a0 0x7f7344070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39888/0 (socket says 172.21.15.73:39888) 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7348954640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f734415e430 0x7f73440b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7343fff640 1 -- 172.21.15.73:0/2099324627 learned_addr learned my addr 172.21.15.73:0/2099324627 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7349155640 1 --2- 172.21.15.73:0/2099324627 >> v2:172.21.15.150:3300/0 conn(0x7f7344070d40 0x7f73440ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f73437fe640 1 -- 172.21.15.73:0/2099324627 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419051324 0 0) 0x7f73440b5c90 con 0x7f73440b03a0 2024-09-12T03:37:26.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f73437fe640 1 -- 172.21.15.73:0/2099324627 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7330003530 con 0x7f73440b03a0 2024-09-12T03:37:26.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7348954640 1 -- 172.21.15.73:0/2099324627 >> v2:172.21.15.150:3300/0 conn(0x7f7344070d40 msgr2=0x7f73440ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:26.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7348954640 1 --2- 172.21.15.73:0/2099324627 >> v2:172.21.15.150:3300/0 conn(0x7f7344070d40 0x7f73440ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7348954640 1 -- 172.21.15.73:0/2099324627 >> v1:172.21.15.73:6789/0 conn(0x7f73440b03a0 legacy=0x7f7344070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.494+0000 7f7348954640 1 -- 172.21.15.73:0/2099324627 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734406f940 con 0x7f734415e430 2024-09-12T03:37:26.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f7348954640 1 --2- 172.21.15.73:0/2099324627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734415e430 0x7f73440b4020 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7344072e20 tx=0x7f733c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1114bed8918392 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f73437fe640 1 -- 172.21.15.73:0/2099324627 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0b2070 con 0x7f734415e430 2024-09-12T03:37:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f73437fe640 1 -- 172.21.15.73:0/2099324627 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c0a58c0 con 0x7f734415e430 2024-09-12T03:37:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f73437fe640 1 -- 172.21.15.73:0/2099324627 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0a5c70 con 0x7f734415e430 2024-09-12T03:37:26.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- 172.21.15.73:0/2099324627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734415e430 msgr2=0x7f73440b4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 --2- 172.21.15.73:0/2099324627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734415e430 0x7f73440b4020 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7344072e20 tx=0x7f733c01c8f0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- 172.21.15.73:0/2099324627 shutdown_connections 2024-09-12T03:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 --2- 172.21.15.73:0/2099324627 >> v2:172.21.15.150:3300/0 conn(0x7f7344070d40 0x7f73440ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 --2- 172.21.15.73:0/2099324627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f734415e430 0x7f73440b4020 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- 172.21.15.73:0/2099324627 >> 172.21.15.73:0/2099324627 conn(0x7f734409aa00 msgr2=0x7f73440b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- 172.21.15.73:0/2099324627 shutdown_connections 2024-09-12T03:37:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- 172.21.15.73:0/2099324627 wait complete. 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 Processor -- start 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- start start 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7344070d40 0x7f7344159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73440b03a0 0x7f73440cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734415e430 0x7f73440cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f73440af0e0 con 0x7f7344070d40 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f73440aef60 con 0x7f734415e430 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f734abb8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f73440af260 con 0x7f73440b03a0 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.498+0000 7f7348954640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7344070d40 0x7f7344159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7344070d40 0x7f7344159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53306/0 (socket says 172.21.15.73:53306) 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 -- 172.21.15.73:0/3782833622 learned_addr learned my addr 172.21.15.73:0/3782833622 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7349155640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734415e430 0x7f73440cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7343fff640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73440b03a0 0x7f73440cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 -- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73440b03a0 msgr2=0x7f73440cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73440b03a0 0x7f73440cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 -- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734415e430 msgr2=0x7f73440cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734415e430 0x7f73440cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 -- 172.21.15.73:0/3782833622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7344156200 con 0x7f7344070d40 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7349155640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734415e430 0x7f73440cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7348954640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7344070d40 0x7f7344159530 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f733c000f90 tx=0x7f733c019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:26.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f73417fa640 1 -- 172.21.15.73:0/3782833622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0b2050 con 0x7f7344070d40 2024-09-12T03:37:26.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f73417fa640 1 -- 172.21.15.73:0/3782833622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c0b3040 con 0x7f7344070d40 2024-09-12T03:37:26.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73441564e0 con 0x7f7344070d40 2024-09-12T03:37:26.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f73417fa640 1 -- 172.21.15.73:0/3782833622 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c003db0 con 0x7f7344070d40 2024-09-12T03:37:26.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7344156aa0 con 0x7f7344070d40 2024-09-12T03:37:26.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73440ae000 con 0x7f7344070d40 2024-09-12T03:37:26.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f73417fa640 1 -- 172.21.15.73:0/3782833622 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f733c0c0020 con 0x7f7344070d40 2024-09-12T03:37:26.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f73417fa640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73240678c0 0x7f7324069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:26.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f73417fa640 1 -- 172.21.15.73:0/3782833622 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f733c120800 con 0x7f7344070d40 2024-09-12T03:37:26.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7343fff640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73240678c0 0x7f7324069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:26.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.502+0000 7f7343fff640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73240678c0 0x7f7324069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f73440cce90 tx=0x7f732c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:26.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.506+0000 7f73417fa640 1 -- 172.21.15.73:0/3782833622 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f733c0164e0 con 0x7f7344070d40 2024-09-12T03:37:26.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.682+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f734415c850 con 0x7f7344070d40 2024-09-12T03:37:26.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f73417fa640 1 -- 172.21.15.73:0/3782833622 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7f733c0f11a0 con 0x7f7344070d40 2024-09-12T03:37:26.686 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:37:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73240678c0 msgr2=0x7f7324069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73240678c0 0x7f7324069d80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f73440cce90 tx=0x7f732c009040 comp rx=0 tx=0).stop 2024-09-12T03:37:26.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7344070d40 msgr2=0x7f7344159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7344070d40 0x7f7344159530 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f733c000f90 tx=0x7f733c019690 comp rx=0 tx=0).stop 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 shutdown_connections 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f73240678c0 0x7f7324069d80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f734415e430 0x7f73440cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f73440b03a0 0x7f73440cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 --2- 172.21.15.73:0/3782833622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7344070d40 0x7f7344159530 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 >> 172.21.15.73:0/3782833622 conn(0x7f734409aa00 msgr2=0x7f73440af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 shutdown_connections 2024-09-12T03:37:26.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:26.686+0000 7f734abb8640 1 -- 172.21.15.73:0/3782833622 wait complete. 2024-09-12T03:37:26.705 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:37:26.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:26.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:26.718 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35297]: fuse finished with error 0 and tester_r 0 2024-09-12T03:37:26.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:37:26.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:26.720 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:37:26.889 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:26.889 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:26.889 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:26.895 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:37:26.895 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:37:26.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:26.896 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T03:37:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T03:37:26.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:37:26.947 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:26.947 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:26.947 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:26.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:37:26.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:37:26.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:26.954 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T03:37:27.000 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T03:37:27.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:37:27.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8df208d640 1 Processor -- start 2024-09-12T03:37:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8df208d640 1 -- start start 2024-09-12T03:37:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8df208d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8dec0b3e00 0x7f8dec0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8df208d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0d19e0 0x7f8dec0d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8df208d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dec06e7a0 con 0x7f8dec15e650 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8df208d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8dec0d1550 con 0x7f8dec0b3e00 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8df208d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec0b4780 con 0x7f8dec0d19e0 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8deaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8dec0b3e00 0x7f8dec0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8deaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8dec0b3e00 0x7f8dec0b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53318/0 (socket says 172.21.15.73:53318) 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8deaffd640 1 -- 172.21.15.73:0/2776042390 learned_addr learned my addr 172.21.15.73:0/2776042390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8debfff640 1 --2- 172.21.15.73:0/2776042390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0d19e0 0x7f8dec0d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8deaffd640 1 -- 172.21.15.73:0/2776042390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0d19e0 msgr2=0x7f8dec0d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8deaffd640 1 --2- 172.21.15.73:0/2776042390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0d19e0 0x7f8dec0d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8deaffd640 1 -- 172.21.15.73:0/2776042390 >> v1:172.21.15.150:6789/0 conn(0x7f8dec15e650 legacy=0x7f8dec06dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.134+0000 7f8deaffd640 1 -- 172.21.15.73:0/2776042390 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec0d0f00 con 0x7f8dec0b3e00 2024-09-12T03:37:27.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 --2- 172.21.15.73:0/2776042390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0b3e00 0x7f8dec0b4240 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beb288467b7ef47 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8dea7fc640 1 -- 172.21.15.73:0/2776042390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0ab430 con 0x7f8dec0b3e00 2024-09-12T03:37:27.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8dea7fc640 1 -- 172.21.15.73:0/2776042390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ddc0b0070 con 0x7f8dec0b3e00 2024-09-12T03:37:27.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8dea7fc640 1 -- 172.21.15.73:0/2776042390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0ab7f0 con 0x7f8dec0b3e00 2024-09-12T03:37:27.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- 172.21.15.73:0/2776042390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0b3e00 msgr2=0x7f8dec0b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 --2- 172.21.15.73:0/2776042390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0b3e00 0x7f8dec0b4240 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc01c560 comp rx=0 tx=0).stop 2024-09-12T03:37:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- 172.21.15.73:0/2776042390 shutdown_connections 2024-09-12T03:37:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 --2- 172.21.15.73:0/2776042390 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0d19e0 0x7f8dec0d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 --2- 172.21.15.73:0/2776042390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0b3e00 0x7f8dec0b4240 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- 172.21.15.73:0/2776042390 >> 172.21.15.73:0/2776042390 conn(0x7f8dec06bcc0 msgr2=0x7f8dec06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- 172.21.15.73:0/2776042390 shutdown_connections 2024-09-12T03:37:27.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- 172.21.15.73:0/2776042390 wait complete. 2024-09-12T03:37:27.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 Processor -- start 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- start start 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0b3e00 0x7f8dec14cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0d19e0 0x7f8dec1fa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec15e650 0x7f8dec161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec06e4c0 con 0x7f8dec0d19e0 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec06e340 con 0x7f8dec15e650 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8df208d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec16b280 con 0x7f8dec0b3e00 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0d19e0 0x7f8dec1fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0d19e0 0x7f8dec1fa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53332/0 (socket says 172.21.15.73:53332) 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 -- 172.21.15.73:0/2601379105 learned_addr learned my addr 172.21.15.73:0/2601379105 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deb7fe640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0b3e00 0x7f8dec14cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8debfff640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec15e650 0x7f8dec161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 -- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0b3e00 msgr2=0x7f8dec14cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0b3e00 0x7f8dec14cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 -- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec15e650 msgr2=0x7f8dec161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec15e650 0x7f8dec161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8deaffd640 1 -- 172.21.15.73:0/2601379105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec161ad0 con 0x7f8dec0d19e0 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.138+0000 7f8debfff640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec15e650 0x7f8dec161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8deaffd640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0d19e0 0x7f8dec1fa870 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0ad040 tx=0x7f8ddc019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8dd3fff640 1 -- 172.21.15.73:0/2601379105 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0b4420 con 0x7f8dec0d19e0 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8dd3fff640 1 -- 172.21.15.73:0/2601379105 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ddc0b45c0 con 0x7f8dec0d19e0 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec155680 con 0x7f8dec0d19e0 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8dd3fff640 1 -- 172.21.15.73:0/2601379105 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0b47b0 con 0x7f8dec0d19e0 2024-09-12T03:37:27.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec161d50 con 0x7f8dec0d19e0 2024-09-12T03:37:27.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec0b4240 con 0x7f8dec0d19e0 2024-09-12T03:37:27.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8dd3fff640 1 -- 172.21.15.73:0/2601379105 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ddc0bd020 con 0x7f8dec0d19e0 2024-09-12T03:37:27.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8dd3fff640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8dd80678c0 0x7f8dd8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8deb7fe640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8dd80678c0 0x7f8dd8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8dd3fff640 1 -- 172.21.15.73:0/2601379105 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f8ddc11f4e0 con 0x7f8dec0d19e0 2024-09-12T03:37:27.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.142+0000 7f8deb7fe640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8dd80678c0 0x7f8dd8069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8dec158460 tx=0x7f8de0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.146+0000 7f8dd3fff640 1 -- 172.21.15.73:0/2601379105 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8ddc0c4020 con 0x7f8dec0d19e0 2024-09-12T03:37:27.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.342+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dec0ce070 con 0x7f8dec0d19e0 2024-09-12T03:37:27.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8dd3fff640 1 -- 172.21.15.73:0/2601379105 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5222 (secure 0 0 0) 0x7f8dec161ad0 con 0x7f8dec0d19e0 2024-09-12T03:37:27.347 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:27.347 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-12T03:37:09:534051+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/703389966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":703389966},{"type":"v1","addr":"172.21.15.150:6833","nonce":703389966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/624796455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":624796455},{"type":"v1","addr":"172.21.15.150:6835","nonce":624796455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3527064235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3527064235},{"type":"v1","addr":"172.21.15.73:6835","nonce":3527064235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:05.827803+0000","modified":"2024-09-12T03:37:08.894254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/585196866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":585196866},{"type":"v1","addr":"172.21.15.73:6837","nonce":585196866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5892,"qdb_cluster":[5892]},"id":5}]} 2024-09-12T03:37:27.347 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-12T03:37:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8dd80678c0 msgr2=0x7f8dd8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8dd80678c0 0x7f8dd8069d80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8dec158460 tx=0x7f8de0009040 comp rx=0 tx=0).stop 2024-09-12T03:37:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0d19e0 msgr2=0x7f8dec1fa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0d19e0 0x7f8dec1fa870 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0ad040 tx=0x7f8ddc019300 comp rx=0 tx=0).stop 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 shutdown_connections 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8dd80678c0 0x7f8dd8069d80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8dec0d19e0 0x7f8dec1fa870 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec15e650 0x7f8dec161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 --2- 172.21.15.73:0/2601379105 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8dec0b3e00 0x7f8dec14cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 >> 172.21.15.73:0/2601379105 conn(0x7f8dec06bcc0 msgr2=0x7f8dec0ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 shutdown_connections 2024-09-12T03:37:27.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.346+0000 7f8df208d640 1 -- 172.21.15.73:0/2601379105 wait complete. 2024-09-12T03:37:27.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:27.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45f0734640 1 Processor -- start 2024-09-12T03:37:27.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45f0734640 1 -- start start 2024-09-12T03:37:27.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45f0734640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f45e815c2a0 0x7f45e80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45f0734640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 0x7f45e806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45f0734640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e80b3290 con 0x7f45e815bec0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45f0734640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f45e80b3570 con 0x7f45e815c2a0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45f0734640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f45e80b3850 con 0x7f45e80af2a0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f45e815bec0 0x7f45e80ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39902/0 (socket says 172.21.15.73:39902) 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 -- 172.21.15.73:0/1325985328 learned_addr learned my addr 172.21.15.73:0/1325985328 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45eecd1640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 0x7f45e806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45edccf640 1 --2- 172.21.15.73:0/1325985328 >> v2:172.21.15.150:3300/0 conn(0x7f45e815c2a0 0x7f45e80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671896319 0 0) 0x7f45e80b3290 con 0x7f45e815bec0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45d4003530 con 0x7f45e815bec0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2247712308 0 0) 0x7f45d4003530 con 0x7f45e815bec0 2024-09-12T03:37:27.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 msgr2=0x7f45e806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 0x7f45e806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 >> v2:172.21.15.150:3300/0 conn(0x7f45e815c2a0 msgr2=0x7f45e80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 --2- 172.21.15.73:0/1325985328 >> v2:172.21.15.150:3300/0 conn(0x7f45e815c2a0 0x7f45e80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e80b3b30 con 0x7f45e815bec0 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f45e4001680 con 0x7f45e815bec0 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 >> v1:172.21.15.73:6789/0 conn(0x7f45e815bec0 legacy=0x7f45e80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45d40039c0 0x7f45d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 0x7f45d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45d4004d50 0x7f45d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80b3570 con 0x7f45d40039c0 2024-09-12T03:37:27.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80b3850 con 0x7f45d4004d50 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f45d400b9d0 con 0x7f45e80af2a0 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45d40039c0 0x7f45d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45eecd1640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45d4004d50 0x7f45d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45edccf640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 0x7f45d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 -- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 msgr2=0x7f45d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 0x7f45d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 -- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45d4004d50 msgr2=0x7f45d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45d4004d50 0x7f45d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45ee4d0640 1 -- 172.21.15.73:0/1325985328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d4003530 con 0x7f45d40039c0 2024-09-12T03:37:27.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.482+0000 7f45edccf640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80af2a0 0x7f45d4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45ee4d0640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45d40039c0 0x7f45d4003de0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c240 tx=0x7f45e401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c99d0597a16728c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4007d40 con 0x7f45d40039c0 2024-09-12T03:37:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e40a9020 con 0x7f45d40039c0 2024-09-12T03:37:27.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45ed4ce640 1 -- 172.21.15.73:0/1325985328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e40a5b70 con 0x7f45d40039c0 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 -- 172.21.15.73:0/1325985328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45d40039c0 msgr2=0x7f45d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 --2- 172.21.15.73:0/1325985328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45d40039c0 0x7f45d4003de0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c240 tx=0x7f45e401cc70 comp rx=0 tx=0).stop 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45eecd1640 1 -- 172.21.15.73:0/1325985328 reap_dead start 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 -- 172.21.15.73:0/1325985328 shutdown_connections 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 -- 172.21.15.73:0/1325985328 >> 172.21.15.73:0/1325985328 conn(0x7f45e80b1f90 msgr2=0x7f45e80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 -- 172.21.15.73:0/1325985328 shutdown_connections 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 -- 172.21.15.73:0/1325985328 wait complete. 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 Processor -- start 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.486+0000 7f45f0734640 1 -- start start 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e80b0d00 0x7f45e8150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80b10e0 0x7f45e8152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e8145180 0x7f45e8145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f45e806e810 con 0x7f45e8145180 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80af6b0 con 0x7f45e80b0d00 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f45e806e990 con 0x7f45e80b10e0 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e8145180 0x7f45e8145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e8145180 0x7f45e8145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53360/0 (socket says 172.21.15.73:53360) 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 -- 172.21.15.73:0/930447959 learned_addr learned my addr 172.21.15.73:0/930447959 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45edccf640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80b10e0 0x7f45e8152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45ee4d0640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e80b0d00 0x7f45e8150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 -- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80b10e0 msgr2=0x7f45e8152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80b10e0 0x7f45e8152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 -- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e80b0d00 msgr2=0x7f45e8150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e80b0d00 0x7f45e8150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 -- 172.21.15.73:0/930447959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e8153380 con 0x7f45e8145180 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45edccf640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80b10e0 0x7f45e8152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45eecd1640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e8145180 0x7f45e8145600 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f45e80b5950 tx=0x7f45e00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45deffd640 1 -- 172.21.15.73:0/930447959 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0011e40 con 0x7f45e8145180 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45deffd640 1 -- 172.21.15.73:0/930447959 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e001b070 con 0x7f45e8145180 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e8072040 con 0x7f45e8145180 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45deffd640 1 -- 172.21.15.73:0/930447959 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00039a0 con 0x7f45e8145180 2024-09-12T03:37:27.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e8152dc0 con 0x7f45e8145180 2024-09-12T03:37:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e80aed60 con 0x7f45e8145180 2024-09-12T03:37:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45deffd640 1 -- 172.21.15.73:0/930447959 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f45e0003b40 con 0x7f45e8145180 2024-09-12T03:37:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45deffd640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f45cc0678f0 0x7f45cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45deffd640 1 -- 172.21.15.73:0/930447959 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f45e0086440 con 0x7f45e8145180 2024-09-12T03:37:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45ee4d0640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f45cc0678f0 0x7f45cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.490+0000 7f45ee4d0640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f45cc0678f0 0x7f45cc069db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f45e40aa000 tx=0x7f45e80b3460 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.494+0000 7f45deffd640 1 -- 172.21.15.73:0/930447959 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f45e0056e80 con 0x7f45e8145180 2024-09-12T03:37:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45e8072210 con 0x7f45e8145180 2024-09-12T03:37:27.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45deffd640 1 -- 172.21.15.73:0/930447959 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5222 (secure 0 0 0) 0x7f45e0056780 con 0x7f45e8145180 2024-09-12T03:37:27.694 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:27.695 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-12T03:37:09:534051+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/703389966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":703389966},{"type":"v1","addr":"172.21.15.150:6833","nonce":703389966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/624796455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":624796455},{"type":"v1","addr":"172.21.15.150:6835","nonce":624796455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3527064235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3527064235},{"type":"v1","addr":"172.21.15.73:6835","nonce":3527064235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:05.827803+0000","modified":"2024-09-12T03:37:08.894254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/585196866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":585196866},{"type":"v1","addr":"172.21.15.73:6837","nonce":585196866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5892,"qdb_cluster":[5892]},"id":5}]} 2024-09-12T03:37:27.695 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-12T03:37:27.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f45cc0678f0 msgr2=0x7f45cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f45cc0678f0 0x7f45cc069db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f45e40aa000 tx=0x7f45e80b3460 comp rx=0 tx=0).stop 2024-09-12T03:37:27.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e8145180 msgr2=0x7f45e8145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e8145180 0x7f45e8145600 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f45e80b5950 tx=0x7f45e00115a0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 shutdown_connections 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f45cc0678f0 0x7f45cc069db0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e8145180 0x7f45e8145600 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f45e80b10e0 0x7f45e8152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 --2- 172.21.15.73:0/930447959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45e80b0d00 0x7f45e8150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 >> 172.21.15.73:0/930447959 conn(0x7f45e80b1f90 msgr2=0x7f45e80b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 shutdown_connections 2024-09-12T03:37:27.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.694+0000 7f45f0734640 1 -- 172.21.15.73:0/930447959 wait complete. 2024-09-12T03:37:27.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa7914ab640 1 Processor -- start 2024-09-12T03:37:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa7914ab640 1 -- start start 2024-09-12T03:37:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa7914ab640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15bec0 0x7fa78c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa7914ab640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa78c15c2a0 0x7fa78c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa7914ab640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c0b3290 con 0x7fa78c0af2a0 2024-09-12T03:37:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa7914ab640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c0b3570 con 0x7fa78c15c2a0 2024-09-12T03:37:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa7914ab640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa78c0b3850 con 0x7fa78c15bec0 2024-09-12T03:37:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78a7fc640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa78c15c2a0 0x7fa78c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78affd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15bec0 0x7fa78c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78b7fe640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fa78c0af2a0 0x7fa78c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:38026/0 (socket says 172.21.15.73:38026) 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78b7fe640 1 -- 172.21.15.73:0/2102649265 learned_addr learned my addr 172.21.15.73:0/2102649265 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa789ffb640 1 -- 172.21.15.73:0/2102649265 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907514361 0 0) 0x7fa78c0b3290 con 0x7fa78c0af2a0 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa789ffb640 1 -- 172.21.15.73:0/2102649265 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa774003530 con 0x7fa78c0af2a0 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78a7fc640 1 -- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15bec0 msgr2=0x7fa78c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78a7fc640 1 --2- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15bec0 0x7fa78c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78a7fc640 1 -- 172.21.15.73:0/2102649265 >> v1:172.21.15.150:6789/0 conn(0x7fa78c0af2a0 legacy=0x7fa78c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78a7fc640 1 -- 172.21.15.73:0/2102649265 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0b3b30 con 0x7fa78c15c2a0 2024-09-12T03:37:27.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.834+0000 7fa78affd640 1 --2- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15bec0 0x7fa78c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:37:27.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa78a7fc640 1 --2- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c15c2a0 0x7fa78c0aed60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7800097c0 tx=0x7fa78001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9908b2222fad8dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa789ffb640 1 -- 172.21.15.73:0/2102649265 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800a7070 con 0x7fa78c15c2a0 2024-09-12T03:37:27.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa789ffb640 1 -- 172.21.15.73:0/2102649265 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7800b0070 con 0x7fa78c15c2a0 2024-09-12T03:37:27.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa789ffb640 1 -- 172.21.15.73:0/2102649265 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800ab890 con 0x7fa78c15c2a0 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 -- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c15c2a0 msgr2=0x7fa78c0aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 --2- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c15c2a0 0x7fa78c0aed60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7800097c0 tx=0x7fa78001c470 comp rx=0 tx=0).stop 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 -- 172.21.15.73:0/2102649265 shutdown_connections 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 --2- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c15c2a0 0x7fa78c0aed60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 --2- 172.21.15.73:0/2102649265 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15bec0 0x7fa78c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 -- 172.21.15.73:0/2102649265 >> 172.21.15.73:0/2102649265 conn(0x7fa78c0b1f90 msgr2=0x7fa78c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 -- 172.21.15.73:0/2102649265 shutdown_connections 2024-09-12T03:37:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 -- 172.21.15.73:0/2102649265 wait complete. 2024-09-12T03:37:27.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 Processor -- start 2024-09-12T03:37:27.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.838+0000 7fa7914ab640 1 -- start start 2024-09-12T03:37:27.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c0af2a0 0x7fa78c09d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa78c15bec0 0x7fa78c15e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15c2a0 0x7fa78c152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0af6b0 con 0x7fa78c15bec0 2024-09-12T03:37:27.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0ad740 con 0x7fa78c0af2a0 2024-09-12T03:37:27.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa78c169000 con 0x7fa78c15c2a0 2024-09-12T03:37:27.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa78c15bec0 0x7fa78c15e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa78c15bec0 0x7fa78c15e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53372/0 (socket says 172.21.15.73:53372) 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 -- 172.21.15.73:0/68324902 learned_addr learned my addr 172.21.15.73:0/68324902 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78affd640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c0af2a0 0x7fa78c09d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78b7fe640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15c2a0 0x7fa78c152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 -- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15c2a0 msgr2=0x7fa78c152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15c2a0 0x7fa78c152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 -- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c0af2a0 msgr2=0x7fa78c09d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c0af2a0 0x7fa78c09d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 -- 172.21.15.73:0/68324902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c152960 con 0x7fa78c15bec0 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78a7fc640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa78c15bec0 0x7fa78c15e160 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa78001ab20 tx=0x7fa780019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7737fe640 1 -- 172.21.15.73:0/68324902 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800abc30 con 0x7fa78c15bec0 2024-09-12T03:37:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7737fe640 1 -- 172.21.15.73:0/68324902 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7800abdd0 con 0x7fa78c15bec0 2024-09-12T03:37:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c15e8d0 con 0x7fa78c15bec0 2024-09-12T03:37:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7737fe640 1 -- 172.21.15.73:0/68324902 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800bf690 con 0x7fa78c15bec0 2024-09-12T03:37:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c15ee90 con 0x7fa78c15bec0 2024-09-12T03:37:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c0ad200 con 0x7fa78c15bec0 2024-09-12T03:37:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7737fe640 1 -- 172.21.15.73:0/68324902 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7800bf830 con 0x7fa78c15bec0 2024-09-12T03:37:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7737fe640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7780678c0 0x7fa778069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78affd640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7780678c0 0x7fa778069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa7737fe640 1 -- 172.21.15.73:0/68324902 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fa780120a10 con 0x7fa78c15bec0 2024-09-12T03:37:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.842+0000 7fa78affd640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7780678c0 0x7fa778069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa78c166410 tx=0x7fa77c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:27.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:27.850+0000 7fa7737fe640 1 -- 172.21.15.73:0/68324902 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa7800c4060 con 0x7fa78c15bec0 2024-09-12T03:37:28.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.006+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa78c074a10 con 0x7fa78c15bec0 2024-09-12T03:37:28.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.010+0000 7fa7737fe640 1 -- 172.21.15.73:0/68324902 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17017 (secure 0 0 0) 0x7fa780016090 con 0x7fa78c15bec0 2024-09-12T03:37:28.011 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:28.011 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":75,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:07.479673+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:03.529153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:04.805186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.010+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7780678c0 msgr2=0x7fa778069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.010+0000 7fa7914ab640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7780678c0 0x7fa778069d80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa78c166410 tx=0x7fa77c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.010+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa78c15bec0 msgr2=0x7fa78c15e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.010+0000 7fa7914ab640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa78c15bec0 0x7fa78c15e160 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa78001ab20 tx=0x7fa780019210 comp rx=0 tx=0).stop 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 shutdown_connections 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa7780678c0 0x7fa778069d80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa78c15bec0 0x7fa78c15e160 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa78c15c2a0 0x7fa78c152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 --2- 172.21.15.73:0/68324902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa78c0af2a0 0x7fa78c09d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 >> 172.21.15.73:0/68324902 conn(0x7fa78c0b1f90 msgr2=0x7fa78c074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:28.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 shutdown_connections 2024-09-12T03:37:28.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.014+0000 7fa7914ab640 1 -- 172.21.15.73:0/68324902 wait complete. 2024-09-12T03:37:28.029 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:37:28.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.146+0000 7ffbcd795640 1 Processor -- start 2024-09-12T03:37:28.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.146+0000 7ffbcd795640 1 -- start start 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbcd795640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbc80d3060 0x7ffbc80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbcd795640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ffbc80cf450 0x7ffbc806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbcd795640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc80d0300 con 0x7ffbc8161a60 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbcd795640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc80b0f60 con 0x7ffbc80d3060 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbcd795640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc80cfd40 con 0x7ffbc80cf450 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbc80d3060 0x7ffbc80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbc80d3060 0x7ffbc80cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53380/0 (socket says 172.21.15.73:53380) 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 -- 172.21.15.73:0/2019811561 learned_addr learned my addr 172.21.15.73:0/2019811561 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc77fe640 1 --2- 172.21.15.73:0/2019811561 >> v2:172.21.15.150:3300/0 conn(0x7ffbc80cf450 0x7ffbc806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 -- 172.21.15.73:0/2019811561 >> v2:172.21.15.150:3300/0 conn(0x7ffbc80cf450 msgr2=0x7ffbc806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:28.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 --2- 172.21.15.73:0/2019811561 >> v2:172.21.15.150:3300/0 conn(0x7ffbc80cf450 0x7ffbc806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 -- 172.21.15.73:0/2019811561 >> v1:172.21.15.150:6789/0 conn(0x7ffbc8161a60 legacy=0x7ffbc80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:28.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 -- 172.21.15.73:0/2019811561 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc80d0020 con 0x7ffbc80d3060 2024-09-12T03:37:28.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc77fe640 1 --2- 172.21.15.73:0/2019811561 >> v2:172.21.15.150:3300/0 conn(0x7ffbc80cf450 0x7ffbc806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:28.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc67fc640 1 --2- 172.21.15.73:0/2019811561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80d3060 0x7ffbc80cef10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80ce950 tx=0x7ffbb801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64fe283b400f81e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc5ffb640 1 -- 172.21.15.73:0/2019811561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80b0070 con 0x7ffbc80d3060 2024-09-12T03:37:28.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc5ffb640 1 -- 172.21.15.73:0/2019811561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb80ab600 con 0x7ffbc80d3060 2024-09-12T03:37:28.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.150+0000 7ffbc5ffb640 1 -- 172.21.15.73:0/2019811561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80ab9d0 con 0x7ffbc80d3060 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- 172.21.15.73:0/2019811561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80d3060 msgr2=0x7ffbc80cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 --2- 172.21.15.73:0/2019811561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80d3060 0x7ffbc80cef10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80ce950 tx=0x7ffbb801c240 comp rx=0 tx=0).stop 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- 172.21.15.73:0/2019811561 shutdown_connections 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 --2- 172.21.15.73:0/2019811561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80d3060 0x7ffbc80cef10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 --2- 172.21.15.73:0/2019811561 >> v2:172.21.15.150:3300/0 conn(0x7ffbc80cf450 0x7ffbc806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- 172.21.15.73:0/2019811561 >> 172.21.15.73:0/2019811561 conn(0x7ffbc808bf90 msgr2=0x7ffbc809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- 172.21.15.73:0/2019811561 shutdown_connections 2024-09-12T03:37:28.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- 172.21.15.73:0/2019811561 wait complete. 2024-09-12T03:37:28.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 Processor -- start 2024-09-12T03:37:28.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- start start 2024-09-12T03:37:28.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80cf450 0x7ffbc8153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc80d3060 0x7ffbc80c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc8161a60 0x7ffbc80c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc816af20 con 0x7ffbc80cf450 2024-09-12T03:37:28.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc806e650 con 0x7ffbc80d3060 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc816b0a0 con 0x7ffbc8161a60 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80cf450 0x7ffbc8153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80cf450 0x7ffbc8153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53392/0 (socket says 172.21.15.73:53392) 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 -- 172.21.15.73:0/23621177 learned_addr learned my addr 172.21.15.73:0/23621177 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc67fc640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc80d3060 0x7ffbc80c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc77fe640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc8161a60 0x7ffbc80c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 -- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc8161a60 msgr2=0x7ffbc80c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc8161a60 0x7ffbc80c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 -- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc80d3060 msgr2=0x7ffbc80c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc80d3060 0x7ffbc80c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 -- 172.21.15.73:0/23621177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc80c89d0 con 0x7ffbc80cf450 2024-09-12T03:37:28.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbc6ffd640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80cf450 0x7ffbc8153860 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c480 tx=0x7ffbb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbbf7fe640 1 -- 172.21.15.73:0/23621177 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0012830 con 0x7ffbc80cf450 2024-09-12T03:37:28.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbbf7fe640 1 -- 172.21.15.73:0/23621177 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb0017070 con 0x7ffbc80cf450 2024-09-12T03:37:28.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbbf7fe640 1 -- 172.21.15.73:0/23621177 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0012c30 con 0x7ffbc80cf450 2024-09-12T03:37:28.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc80b1690 con 0x7ffbc80cf450 2024-09-12T03:37:28.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.154+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc80b1c50 con 0x7ffbc80cf450 2024-09-12T03:37:28.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.158+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc806d6b0 con 0x7ffbc80cf450 2024-09-12T03:37:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.158+0000 7ffbbf7fe640 1 -- 172.21.15.73:0/23621177 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffbb001c460 con 0x7ffbc80cf450 2024-09-12T03:37:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.158+0000 7ffbbf7fe640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffba80678f0 0x7ffba8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.158+0000 7ffbbf7fe640 1 -- 172.21.15.73:0/23621177 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7ffbb0085b90 con 0x7ffbc80cf450 2024-09-12T03:37:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.158+0000 7ffbc67fc640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffba80678f0 0x7ffba8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.158+0000 7ffbc67fc640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffba80678f0 0x7ffba8069db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80ad000 tx=0x7ffbb80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.162+0000 7ffbbf7fe640 1 -- 172.21.15.73:0/23621177 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffbc80c89d0 con 0x7ffbc80cf450 2024-09-12T03:37:28.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.342+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbc80cacf0 con 0x7ffbc80cf450 2024-09-12T03:37:28.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbbf7fe640 1 -- 172.21.15.73:0/23621177 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5222 (secure 0 0 0) 0x7ffbb00565d0 con 0x7ffbc80cf450 2024-09-12T03:37:28.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:28.346 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-12T03:37:09:534051+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/703389966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":703389966},{"type":"v1","addr":"172.21.15.150:6833","nonce":703389966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/624796455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":624796455},{"type":"v1","addr":"172.21.15.150:6835","nonce":624796455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3527064235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3527064235},{"type":"v1","addr":"172.21.15.73:6835","nonce":3527064235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:05.827803+0000","modified":"2024-09-12T03:37:08.894254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/585196866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":585196866},{"type":"v1","addr":"172.21.15.73:6837","nonce":585196866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5892,"qdb_cluster":[5892]},"id":5}]} 2024-09-12T03:37:28.347 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-12T03:37:28.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffba80678f0 msgr2=0x7ffba8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffba80678f0 0x7ffba8069db0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80ad000 tx=0x7ffbb80a6000 comp rx=0 tx=0).stop 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80cf450 msgr2=0x7ffbc8153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80cf450 0x7ffbc8153860 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c480 tx=0x7ffbb000c940 comp rx=0 tx=0).stop 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 shutdown_connections 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ffba80678f0 0x7ffba8069db0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ffbc8161a60 0x7ffbc80c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbc80d3060 0x7ffbc80c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 --2- 172.21.15.73:0/23621177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc80cf450 0x7ffbc8153860 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 >> 172.21.15.73:0/23621177 conn(0x7ffbc808bf90 msgr2=0x7ffbc80d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:28.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 shutdown_connections 2024-09-12T03:37:28.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.346+0000 7ffbcd795640 1 -- 172.21.15.73:0/23621177 wait complete. 2024-09-12T03:37:28.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:28.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.470+0000 7f902f47e640 1 Processor -- start 2024-09-12T03:37:28.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.470+0000 7f902f47e640 1 -- start start 2024-09-12T03:37:28.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f902815bec0 0x7f90280ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f902815c2a0 0x7f90280aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90280b3290 con 0x7f90280af2a0 2024-09-12T03:37:28.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f90280b3570 con 0x7f902815c2a0 2024-09-12T03:37:28.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f90280b3850 con 0x7f902815bec0 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902ca19640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f902815c2a0 0x7f90280aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902da1b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f90280af2a0 0x7f902815fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39914/0 (socket says 172.21.15.73:39914) 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902da1b640 1 -- 172.21.15.73:0/3805108827 learned_addr learned my addr 172.21.15.73:0/3805108827 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902ca19640 1 -- 172.21.15.73:0/3805108827 >> v2:172.21.15.150:3300/0 conn(0x7f902815bec0 msgr2=0x7f90280ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902ca19640 1 --2- 172.21.15.73:0/3805108827 >> v2:172.21.15.150:3300/0 conn(0x7f902815bec0 0x7f90280ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902ca19640 1 -- 172.21.15.73:0/3805108827 >> v1:172.21.15.73:6789/0 conn(0x7f90280af2a0 legacy=0x7f902815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902ca19640 1 -- 172.21.15.73:0/3805108827 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90280b3b30 con 0x7f902815c2a0 2024-09-12T03:37:28.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f901ffff640 1 -- 172.21.15.73:0/3805108827 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475222404 0 0) 0x7f90280b3290 con 0x7f90280af2a0 2024-09-12T03:37:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902ca19640 1 --2- 172.21.15.73:0/3805108827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f90280aed60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9028071710 tx=0x7f902401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8350b2fec0ee4b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f901ffff640 1 -- 172.21.15.73:0/3805108827 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240ab650 con 0x7f902815c2a0 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f901ffff640 1 -- 172.21.15.73:0/3805108827 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90240b0070 con 0x7f902815c2a0 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f901ffff640 1 -- 172.21.15.73:0/3805108827 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240aba10 con 0x7f902815c2a0 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- 172.21.15.73:0/3805108827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 msgr2=0x7f90280aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 --2- 172.21.15.73:0/3805108827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f90280aed60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9028071710 tx=0x7f902401c450 comp rx=0 tx=0).stop 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- 172.21.15.73:0/3805108827 shutdown_connections 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 --2- 172.21.15.73:0/3805108827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f90280aed60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 --2- 172.21.15.73:0/3805108827 >> v2:172.21.15.150:3300/0 conn(0x7f902815bec0 0x7f90280ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- 172.21.15.73:0/3805108827 >> 172.21.15.73:0/3805108827 conn(0x7f90280b1f90 msgr2=0x7f90280b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- 172.21.15.73:0/3805108827 shutdown_connections 2024-09-12T03:37:28.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.474+0000 7f902f47e640 1 -- 172.21.15.73:0/3805108827 wait complete. 2024-09-12T03:37:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 Processor -- start 2024-09-12T03:37:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 -- start start 2024-09-12T03:37:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280af2a0 0x7f90281502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902815bec0 0x7f902815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f902814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f90280af6d0 con 0x7f902815c2a0 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f90280ad740 con 0x7f90280af2a0 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9028169000 con 0x7f902815bec0 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f902814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f902814a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53410/0 (socket says 172.21.15.73:53410) 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 -- 172.21.15.73:0/3049948395 learned_addr learned my addr 172.21.15.73:0/3049948395 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 -- 172.21.15.73:0/3049948395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902815bec0 msgr2=0x7f902815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902815bec0 0x7f902815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 -- 172.21.15.73:0/3049948395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280af2a0 msgr2=0x7f90281502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280af2a0 0x7f90281502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 -- 172.21.15.73:0/3049948395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902815ec30 con 0x7f902815c2a0 2024-09-12T03:37:28.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902da1b640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f902814a280 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f902000c7a0 tx=0x7f902000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f901dffb640 1 -- 172.21.15.73:0/3049948395 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020018070 con 0x7f902815c2a0 2024-09-12T03:37:28.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f901dffb640 1 -- 172.21.15.73:0/3049948395 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902000a640 con 0x7f902815c2a0 2024-09-12T03:37:28.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90281566e0 con 0x7f902815c2a0 2024-09-12T03:37:28.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f901dffb640 1 -- 172.21.15.73:0/3049948395 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902000aab0 con 0x7f902815c2a0 2024-09-12T03:37:28.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902814a7c0 con 0x7f902815c2a0 2024-09-12T03:37:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.478+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90280ad200 con 0x7f902815c2a0 2024-09-12T03:37:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.482+0000 7f901dffb640 1 -- 172.21.15.73:0/3049948395 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f902001b070 con 0x7f902815c2a0 2024-09-12T03:37:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.482+0000 7f901dffb640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f900c0678c0 0x7f900c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.482+0000 7f901dffb640 1 -- 172.21.15.73:0/3049948395 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f9020085360 con 0x7f902815c2a0 2024-09-12T03:37:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.482+0000 7f902d21a640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f900c0678c0 0x7f900c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.482+0000 7f902d21a640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f900c0678c0 0x7f900c069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9018009730 tx=0x7f9018006ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.486+0000 7f901dffb640 1 -- 172.21.15.73:0/3049948395 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9020055da0 con 0x7f902815c2a0 2024-09-12T03:37:28.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.682+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f902806fcd0 con 0x7f902815c2a0 2024-09-12T03:37:28.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.682+0000 7f901dffb640 1 -- 172.21.15.73:0/3049948395 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5222 (secure 0 0 0) 0x7f90200556a0 con 0x7f902815c2a0 2024-09-12T03:37:28.684 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:28.684 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":41,"btime":"2024-09-12T03:37:09:534051+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/703389966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":703389966},{"type":"v1","addr":"172.21.15.150:6833","nonce":703389966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/624796455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":624796455},{"type":"v1","addr":"172.21.15.150:6835","nonce":624796455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3527064235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3527064235},{"type":"v1","addr":"172.21.15.73:6835","nonce":3527064235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:05.827803+0000","modified":"2024-09-12T03:37:08.894254+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5892},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5892":{"gid":5892,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/585196866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":585196866},{"type":"v1","addr":"172.21.15.73:6837","nonce":585196866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5892,"qdb_cluster":[5892]},"id":5}]} 2024-09-12T03:37:28.685 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 41 2024-09-12T03:37:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f900c0678c0 msgr2=0x7f900c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f900c0678c0 0x7f900c069d80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9018009730 tx=0x7f9018006ca0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 msgr2=0x7f902814a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f902814a280 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f902000c7a0 tx=0x7f902000cc60 comp rx=0 tx=0).stop 2024-09-12T03:37:28.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 shutdown_connections 2024-09-12T03:37:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f900c0678c0 0x7f900c069d80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902815c2a0 0x7f902814a280 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f902815bec0 0x7f902815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 --2- 172.21.15.73:0/3049948395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90280af2a0 0x7f90281502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 >> 172.21.15.73:0/3049948395 conn(0x7f90280b1f90 msgr2=0x7f90280b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 shutdown_connections 2024-09-12T03:37:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.686+0000 7f902f47e640 1 -- 172.21.15.73:0/3049948395 wait complete. 2024-09-12T03:37:28.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:28.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d5b676640 1 Processor -- start 2024-09-12T03:37:28.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d5b676640 1 -- start start 2024-09-12T03:37:28.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d5b676640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d540b4b20 0x7f5d54141030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d5b676640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d5413fb30 con 0x7f5d54156720 2024-09-12T03:37:28.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d5b676640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d5413fe10 con 0x7f5d54140bd0 2024-09-12T03:37:28.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d5b676640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5d54141570 con 0x7f5d540b4b20 2024-09-12T03:37:28.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d59c13640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d540b4b20 0x7f5d54141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d59412640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5d54156720 0x7f5d540b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39916/0 (socket says 172.21.15.73:39916) 2024-09-12T03:37:28.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.806+0000 7f5d59412640 1 -- 172.21.15.73:0/3374771039 learned_addr learned my addr 172.21.15.73:0/3374771039 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:28.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d59c13640 1 -- 172.21.15.73:0/3374771039 >> v1:172.21.15.150:6789/0 conn(0x7f5d54140bd0 legacy=0x7f5d540b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d59c13640 1 -- 172.21.15.73:0/3374771039 >> v1:172.21.15.73:6789/0 conn(0x7f5d54156720 legacy=0x7f5d540b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d59c13640 1 -- 172.21.15.73:0/3374771039 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d541400f0 con 0x7f5d540b4b20 2024-09-12T03:37:28.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d4bfff640 1 -- 172.21.15.73:0/3374771039 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727589399 0 0) 0x7f5d5413fb30 con 0x7f5d54156720 2024-09-12T03:37:28.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d59c13640 1 --2- 172.21.15.73:0/3374771039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d540b4b20 0x7f5d54141030 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009d90 tx=0x7f5d4c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67db8ee65f98b342 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d4bfff640 1 -- 172.21.15.73:0/3374771039 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0b2070 con 0x7f5d540b4b20 2024-09-12T03:37:28.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d4bfff640 1 -- 172.21.15.73:0/3374771039 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d4c0a5940 con 0x7f5d540b4b20 2024-09-12T03:37:28.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d4bfff640 1 -- 172.21.15.73:0/3374771039 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0a5d10 con 0x7f5d540b4b20 2024-09-12T03:37:28.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d5b676640 1 -- 172.21.15.73:0/3374771039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d540b4b20 msgr2=0x7f5d54141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d5b676640 1 --2- 172.21.15.73:0/3374771039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d540b4b20 0x7f5d54141030 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009d90 tx=0x7f5d4c01c970 comp rx=0 tx=0).stop 2024-09-12T03:37:28.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d5b676640 1 -- 172.21.15.73:0/3374771039 shutdown_connections 2024-09-12T03:37:28.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d5b676640 1 --2- 172.21.15.73:0/3374771039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d540b4b20 0x7f5d54141030 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d5b676640 1 -- 172.21.15.73:0/3374771039 >> 172.21.15.73:0/3374771039 conn(0x7f5d5406c0c0 msgr2=0x7f5d5406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:28.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.810+0000 7f5d5b676640 1 -- 172.21.15.73:0/3374771039 shutdown_connections 2024-09-12T03:37:28.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 -- 172.21.15.73:0/3374771039 wait complete. 2024-09-12T03:37:28.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 Processor -- start 2024-09-12T03:37:28.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 -- start start 2024-09-12T03:37:28.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d540b4b20 0x7f5d54151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d54140bd0 0x7f5d540c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d54156720 0x7f5d541590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5413f6e0 con 0x7f5d54140bd0 2024-09-12T03:37:28.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54140740 con 0x7f5d540b4b20 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d5413f860 con 0x7f5d54156720 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d54140bd0 0x7f5d540c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d54140bd0 0x7f5d540c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53434/0 (socket says 172.21.15.73:53434) 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 -- 172.21.15.73:0/2653518331 learned_addr learned my addr 172.21.15.73:0/2653518331 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d59c13640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d54156720 0x7f5d541590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d59412640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d540b4b20 0x7f5d54151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 -- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d54156720 msgr2=0x7f5d541590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d54156720 0x7f5d541590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 -- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d540b4b20 msgr2=0x7f5d54151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d540b4b20 0x7f5d54151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 -- 172.21.15.73:0/2653518331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d540c8180 con 0x7f5d54140bd0 2024-09-12T03:37:28.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d59412640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d540b4b20 0x7f5d54151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d58c11640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d54140bd0 0x7f5d540c7c40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c500 tx=0x7f5d4400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d49ffb640 1 -- 172.21.15.73:0/2653518331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44016020 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d49ffb640 1 -- 172.21.15.73:0/2653518331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d44005220 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5413eb10 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d49ffb640 1 -- 172.21.15.73:0/2653518331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44007030 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.814+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d5413df50 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.818+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5413e150 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.818+0000 7f5d49ffb640 1 -- 172.21.15.73:0/2653518331 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d440071f0 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.818+0000 7f5d49ffb640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d380678c0 0x7f5d38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.818+0000 7f5d49ffb640 1 -- 172.21.15.73:0/2653518331 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f5d440852a0 con 0x7f5d54140bd0 2024-09-12T03:37:28.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.818+0000 7f5d59412640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d380678c0 0x7f5d38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:28.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.818+0000 7f5d59412640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d380678c0 0x7f5d38069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d50000f70 tx=0x7f5d50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:28.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.822+0000 7f5d49ffb640 1 -- 172.21.15.73:0/2653518331 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5d5413e150 con 0x7f5d54140bd0 2024-09-12T03:37:28.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.982+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d54141030 con 0x7f5d54140bd0 2024-09-12T03:37:28.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d49ffb640 1 -- 172.21.15.73:0/2653518331 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17017 (secure 0 0 0) 0x7f5d540c8180 con 0x7f5d54140bd0 2024-09-12T03:37:28.986 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:28.987 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":75,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:07.479673+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:03.529153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:04.805186+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d380678c0 msgr2=0x7f5d38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d380678c0 0x7f5d38069d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5d50000f70 tx=0x7f5d50009040 comp rx=0 tx=0).stop 2024-09-12T03:37:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d54140bd0 msgr2=0x7f5d540c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d54140bd0 0x7f5d540c7c40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400c500 tx=0x7f5d4400c9c0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 shutdown_connections 2024-09-12T03:37:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d380678c0 0x7f5d38069d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d54140bd0 0x7f5d540c7c40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d54156720 0x7f5d541590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 --2- 172.21.15.73:0/2653518331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d540b4b20 0x7f5d54151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 >> 172.21.15.73:0/2653518331 conn(0x7f5d5406c0c0 msgr2=0x7f5d5406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 shutdown_connections 2024-09-12T03:37:28.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:28.986+0000 7f5d5b676640 1 -- 172.21.15.73:0/2653518331 wait complete. 2024-09-12T03:37:29.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:37:29.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.110+0000 7f4eb5a5b640 1 Processor -- start 2024-09-12T03:37:29.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.110+0000 7f4eb5a5b640 1 -- start start 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.110+0000 7f4eb5a5b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4eb006fef0 0x7f4eb006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.110+0000 7f4eb5a5b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb006ee50 con 0x7f4eb0073e60 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.110+0000 7f4eb5a5b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb006f130 con 0x7f4eb00b3d50 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.110+0000 7f4eb5a5b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb006f410 con 0x7f4eb006fef0 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.110+0000 7f4eaeffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4eb0073e60 0x7f4eb015b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39926/0 (socket says 172.21.15.73:39926) 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eaeffd640 1 -- 172.21.15.73:0/1177213474 learned_addr learned my addr 172.21.15.73:0/1177213474 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4ea67fc640 1 --2- 172.21.15.73:0/1177213474 >> v2:172.21.15.73:3300/0 conn(0x7f4eb006fef0 0x7f4eb006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4ea67fc640 1 -- 172.21.15.73:0/1177213474 >> v1:172.21.15.150:6789/0 conn(0x7f4eb00b3d50 legacy=0x7f4eb0072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4ea67fc640 1 -- 172.21.15.73:0/1177213474 >> v1:172.21.15.73:6789/0 conn(0x7f4eb0073e60 legacy=0x7f4eb015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eae7fc640 1 -- 172.21.15.73:0/1177213474 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068227833 0 0) 0x7f4eb006ee50 con 0x7f4eb0073e60 2024-09-12T03:37:29.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4ea67fc640 1 -- 172.21.15.73:0/1177213474 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb006f6f0 con 0x7f4eb006fef0 2024-09-12T03:37:29.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4ea67fc640 1 --2- 172.21.15.73:0/1177213474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb006e800 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800a960 tx=0x7f4e9801d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5d79624826116 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:29.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eae7fc640 1 -- 172.21.15.73:0/1177213474 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9800b040 con 0x7f4eb006fef0 2024-09-12T03:37:29.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eae7fc640 1 -- 172.21.15.73:0/1177213474 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980a7710 con 0x7f4eb006fef0 2024-09-12T03:37:29.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eae7fc640 1 -- 172.21.15.73:0/1177213474 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980a7ae0 con 0x7f4eb006fef0 2024-09-12T03:37:29.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/1177213474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 msgr2=0x7f4eb006e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/1177213474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb006e800 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800a960 tx=0x7f4e9801d7a0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/1177213474 shutdown_connections 2024-09-12T03:37:29.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/1177213474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb006e800 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/1177213474 >> 172.21.15.73:0/1177213474 conn(0x7f4eb00b1f90 msgr2=0x7f4eb00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/1177213474 shutdown_connections 2024-09-12T03:37:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.114+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/1177213474 wait complete. 2024-09-12T03:37:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 Processor -- start 2024-09-12T03:37:29.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 -- start start 2024-09-12T03:37:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0073e60 0x7f4eb014f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb00b3d50 0x7f4eb0150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00730f0 con 0x7f4eb006fef0 2024-09-12T03:37:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0072f70 con 0x7f4eb0073e60 2024-09-12T03:37:29.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb0073270 con 0x7f4eb00b3d50 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb014a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53444/0 (socket says 172.21.15.73:53444) 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 -- 172.21.15.73:0/3871684803 learned_addr learned my addr 172.21.15.73:0/3871684803 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4ea67fc640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0073e60 0x7f4eb014f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaf7fe640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb00b3d50 0x7f4eb0150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 -- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb00b3d50 msgr2=0x7f4eb0150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb00b3d50 0x7f4eb0150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 -- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0073e60 msgr2=0x7f4eb014f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0073e60 0x7f4eb014f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 -- 172.21.15.73:0/3871684803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb01539b0 con 0x7f4eb006fef0 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4ea67fc640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0073e60 0x7f4eb014f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eaeffd640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb014a5a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00011f0 tx=0x7f4ea000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eacff9640 1 -- 172.21.15.73:0/3871684803 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0018070 con 0x7f4eb006fef0 2024-09-12T03:37:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eacff9640 1 -- 172.21.15.73:0/3871684803 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00074e0 con 0x7f4eb006fef0 2024-09-12T03:37:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eacff9640 1 -- 172.21.15.73:0/3871684803 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0004a10 con 0x7f4eb006fef0 2024-09-12T03:37:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb0153c90 con 0x7f4eb006fef0 2024-09-12T03:37:29.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb0154250 con 0x7f4eb006fef0 2024-09-12T03:37:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb006e800 con 0x7f4eb006fef0 2024-09-12T03:37:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.118+0000 7f4eacff9640 1 -- 172.21.15.73:0/3871684803 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ea0004bb0 con 0x7f4eb006fef0 2024-09-12T03:37:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.122+0000 7f4eacff9640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4e900678c0 0x7f4e90069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.122+0000 7f4eacff9640 1 -- 172.21.15.73:0/3871684803 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f4ea0085200 con 0x7f4eb006fef0 2024-09-12T03:37:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.122+0000 7f4ea67fc640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4e900678c0 0x7f4e90069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.122+0000 7f4ea67fc640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4e900678c0 0x7f4e90069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b0000 tx=0x7f4e9800c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:29.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.126+0000 7f4eacff9640 1 -- 172.21.15.73:0/3871684803 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4ea0055bb0 con 0x7f4eb006fef0 2024-09-12T03:37:29.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.322+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4eb00723f0 con 0x7f4eb006fef0 2024-09-12T03:37:29.322 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T03:37:29.322+0000 7fe1c1027640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:37:29.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.322+0000 7f4eacff9640 1 -- 172.21.15.73:0/3871684803 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7f4ea00554b0 con 0x7f4eb006fef0 2024-09-12T03:37:29.325 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4e900678c0 msgr2=0x7f4e90069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4e900678c0 0x7f4e90069d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4e980b0000 tx=0x7f4e9800c040 comp rx=0 tx=0).stop 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 msgr2=0x7f4eb014a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb014a5a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00011f0 tx=0x7f4ea000c9b0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 shutdown_connections 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4e900678c0 0x7f4e90069d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4eb00b3d50 0x7f4eb0150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4eb0073e60 0x7f4eb014f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 --2- 172.21.15.73:0/3871684803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eb006fef0 0x7f4eb014a5a0 secure :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00011f0 tx=0x7f4ea000c9b0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.326+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 >> 172.21.15.73:0/3871684803 conn(0x7f4eb00b1f90 msgr2=0x7f4eb0074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:29.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.330+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 shutdown_connections 2024-09-12T03:37:29.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.330+0000 7f4eb5a5b640 1 -- 172.21.15.73:0/3871684803 wait complete. 2024-09-12T03:37:29.333 INFO:tasks.ceph.mds.c.smithi073.stderr: -3062> 2024-09-12T03:37:08.438+0000 7f89dd82d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:37:29.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:37:29.373 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:37:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa380719640 1 Processor -- start 2024-09-12T03:37:29.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa380719640 1 -- start start 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa380719640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 0x7fa3780aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa380719640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3780b3290 con 0x7fa37815bec0 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa380719640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3780b3570 con 0x7fa3780af2a0 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa380719640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780b3850 con 0x7fa37815c2a0 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa37e4b5640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa37815bec0 0x7fa3780ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39954/0 (socket says 172.21.15.73:39954) 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.458+0000 7fa37e4b5640 1 -- 172.21.15.73:0/635428453 learned_addr learned my addr 172.21.15.73:0/635428453 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37dcb4640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 0x7fa3780aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654565860 0 0) 0x7fa3780b3290 con 0x7fa37815bec0 2024-09-12T03:37:29.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa364003530 con 0x7fa37815bec0 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 38986968 0 0) 0x7fa364003530 con 0x7fa37815bec0 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 msgr2=0x7fa3780aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 0x7fa3780aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 >> v1:172.21.15.150:6789/0 conn(0x7fa3780af2a0 legacy=0x7fa37806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3780b3b30 con 0x7fa37815bec0 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fa374001680 con 0x7fa37815bec0 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 >> v1:172.21.15.73:6789/0 conn(0x7fa37815bec0 legacy=0x7fa3780ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 0x7fa3640039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004020 0x7fa364004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa364004d50 0x7fa3640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780b3850 con 0x7fa364004d50 2024-09-12T03:37:29.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa36400bb90 con 0x7fa364004020 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa36400bd90 con 0x7fa37815c2a0 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa364004d50 0x7fa3640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37dcb4640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004020 0x7fa364004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37e4b5640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 0x7fa3640039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 -- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 msgr2=0x7fa3640039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa37815c2a0 0x7fa3640039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 -- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004020 msgr2=0x7fa364004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004020 0x7fa364004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 -- 172.21.15.73:0/635428453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa364003530 con 0x7fa364004d50 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa364004d50 0x7fa3640051d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa370001e70 tx=0x7fa37001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494c5358beb7b2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370001a90 con 0x7fa364004d50 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370003b80 con 0x7fa364004d50 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37d4b3640 1 -- 172.21.15.73:0/635428453 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370005080 con 0x7fa364004d50 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa380719640 1 -- 172.21.15.73:0/635428453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa364004d50 msgr2=0x7fa3640051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa380719640 1 --2- 172.21.15.73:0/635428453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa364004d50 0x7fa3640051d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa370001e70 tx=0x7fa37001c780 comp rx=0 tx=0).stop 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa37ecb6640 1 -- 172.21.15.73:0/635428453 reap_dead start 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa380719640 1 -- 172.21.15.73:0/635428453 shutdown_connections 2024-09-12T03:37:29.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa380719640 1 -- 172.21.15.73:0/635428453 >> 172.21.15.73:0/635428453 conn(0x7fa3780b1f90 msgr2=0x7fa3780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa380719640 1 -- 172.21.15.73:0/635428453 shutdown_connections 2024-09-12T03:37:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.462+0000 7fa380719640 1 -- 172.21.15.73:0/635428453 wait complete. 2024-09-12T03:37:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 Processor -- start 2024-09-12T03:37:29.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 -- start start 2024-09-12T03:37:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004d50 0x7fa3781f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa378141e70 0x7fa3780733d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa378073910 0x7fa37806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780af730 con 0x7fa378073910 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780b40f0 con 0x7fa364004d50 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fa3780afc90 con 0x7fa378141e70 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa378073910 0x7fa37806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa378073910 0x7fa37806e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53464/0 (socket says 172.21.15.73:53464) 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 -- 172.21.15.73:0/392839010 learned_addr learned my addr 172.21.15.73:0/392839010 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37dcb4640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa378141e70 0x7fa3780733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37e4b5640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004d50 0x7fa3781f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 -- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa378141e70 msgr2=0x7fa3780733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa378141e70 0x7fa3780733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 -- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004d50 msgr2=0x7fa3781f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004d50 0x7fa3781f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:29.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 -- 172.21.15.73:0/392839010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37814fcf0 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37e4b5640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004d50 0x7fa3781f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa37ecb6640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa378073910 0x7fa37806e8c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa370098190 tx=0x7fa364005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa36effd640 1 -- 172.21.15.73:0/392839010 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b9070 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa36effd640 1 -- 172.21.15.73:0/392839010 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370005820 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37815c810 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa36effd640 1 -- 172.21.15.73:0/392839010 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370001a90 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37815cdd0 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.466+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3780aed60 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.470+0000 7fa36effd640 1 -- 172.21.15.73:0/392839010 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3700bc070 con 0x7fa378073910 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.470+0000 7fa36effd640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa35c0678f0 0x7fa35c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:29.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.470+0000 7fa36effd640 1 -- 172.21.15.73:0/392839010 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7fa37011f650 con 0x7fa378073910 2024-09-12T03:37:29.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.470+0000 7fa37e4b5640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa35c0678f0 0x7fa35c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:29.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.470+0000 7fa37e4b5640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa35c0678f0 0x7fa35c069db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa374000f70 tx=0x7fa374000f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:29.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.474+0000 7fa36effd640 1 -- 172.21.15.73:0/392839010 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa3700ac020 con 0x7fa378073910 2024-09-12T03:37:29.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:29.670+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa3780b51d0 con 0x7fa378073910 2024-09-12T03:37:30.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.326+0000 7fa36effd640 1 -- 172.21.15.73:0/392839010 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7fa370016490 con 0x7fa378073910 2024-09-12T03:37:30.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa35c0678f0 msgr2=0x7fa35c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:30.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa35c0678f0 0x7fa35c069db0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa374000f70 tx=0x7fa374000f00 comp rx=0 tx=0).stop 2024-09-12T03:37:30.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa378073910 msgr2=0x7fa37806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:30.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa378073910 0x7fa37806e8c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa370098190 tx=0x7fa364005840 comp rx=0 tx=0).stop 2024-09-12T03:37:30.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 shutdown_connections 2024-09-12T03:37:30.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fa35c0678f0 0x7fa35c069db0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa378073910 0x7fa37806e8c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fa378141e70 0x7fa3780733d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 --2- 172.21.15.73:0/392839010 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364004d50 0x7fa3781f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 >> 172.21.15.73:0/392839010 conn(0x7fa3780b1f90 msgr2=0x7fa3780b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:30.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 shutdown_connections 2024-09-12T03:37:30.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.330+0000 7fa380719640 1 -- 172.21.15.73:0/392839010 wait complete. 2024-09-12T03:37:30.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:37:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.526+0000 7f42fcb48640 1 Processor -- start 2024-09-12T03:37:30.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.526+0000 7f42fcb48640 1 -- start start 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.526+0000 7f42fcb48640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f42f8156720 0x7f42f80b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.526+0000 7f42fcb48640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.526+0000 7f42fcb48640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42f8141110 0x7f42f80b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f42f8141560 con 0x7f42f8141110 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f42f8140740 con 0x7f42f8156720 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f42f813fb30 con 0x7f42f80b5b50 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42f8141110 0x7f42f80b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42f8141110 0x7f42f80b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53470/0 (socket says 172.21.15.73:53470) 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 -- 172.21.15.73:0/1398255434 learned_addr learned my addr 172.21.15.73:0/1398255434 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:30.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42effff640 1 --2- 172.21.15.73:0/1398255434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f659c640 1 --2- 172.21.15.73:0/1398255434 >> v2:172.21.15.150:3300/0 conn(0x7f42f8156720 0x7f42f80b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 -- 172.21.15.73:0/1398255434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 msgr2=0x7f42f8140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 --2- 172.21.15.73:0/1398255434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 -- 172.21.15.73:0/1398255434 >> v2:172.21.15.150:3300/0 conn(0x7f42f8156720 msgr2=0x7f42f80b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 --2- 172.21.15.73:0/1398255434 >> v2:172.21.15.150:3300/0 conn(0x7f42f8156720 0x7f42f80b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 -- 172.21.15.73:0/1398255434 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f813fe10 con 0x7f42f8141110 2024-09-12T03:37:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f6d9d640 1 --2- 172.21.15.73:0/1398255434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8141110 0x7f42f80b4410 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f42f8072390 tx=0x7f42f001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9157109590e08d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f5d9b640 1 -- 172.21.15.73:0/1398255434 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00a5670 con 0x7f42f8141110 2024-09-12T03:37:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f5d9b640 1 -- 172.21.15.73:0/1398255434 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00a5810 con 0x7f42f8141110 2024-09-12T03:37:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42f5d9b640 1 -- 172.21.15.73:0/1398255434 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00a5be0 con 0x7f42f8141110 2024-09-12T03:37:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- 172.21.15.73:0/1398255434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8141110 msgr2=0x7f42f80b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:30.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 --2- 172.21.15.73:0/1398255434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8141110 0x7f42f80b4410 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f42f8072390 tx=0x7f42f001c9f0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- 172.21.15.73:0/1398255434 shutdown_connections 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 --2- 172.21.15.73:0/1398255434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8141110 0x7f42f80b4410 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 --2- 172.21.15.73:0/1398255434 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 --2- 172.21.15.73:0/1398255434 >> v2:172.21.15.150:3300/0 conn(0x7f42f8156720 0x7f42f80b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- 172.21.15.73:0/1398255434 >> 172.21.15.73:0/1398255434 conn(0x7f42f806c0c0 msgr2=0x7f42f806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- 172.21.15.73:0/1398255434 shutdown_connections 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.530+0000 7f42fcb48640 1 -- 172.21.15.73:0/1398255434 wait complete. 2024-09-12T03:37:30.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 Processor -- start 2024-09-12T03:37:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 -- start start 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42f8141110 0x7f42f8139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8156720 0x7f42f81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42f813f860 con 0x7f42f8156720 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f42f813f6e0 con 0x7f42f8141110 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f42f8141f80 con 0x7f42f80b5b50 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8156720 0x7f42f81589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8156720 0x7f42f81589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53486/0 (socket says 172.21.15.73:53486) 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 -- 172.21.15.73:0/397057032 learned_addr learned my addr 172.21.15.73:0/397057032 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42effff640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42f8141110 0x7f42f8139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f659c640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 -- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 msgr2=0x7f42f8138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 -- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42f8141110 msgr2=0x7f42f8139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42f8141110 0x7f42f8139840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 -- 172.21.15.73:0/397057032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f813a240 con 0x7f42f8156720 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42effff640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42f8141110 0x7f42f8139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f659c640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42f6d9d640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8156720 0x7f42f81589f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f42f00af040 tx=0x7f42f0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42eeffd640 1 -- 172.21.15.73:0/397057032 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0009510 con 0x7f42f8156720 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42eeffd640 1 -- 172.21.15.73:0/397057032 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00be070 con 0x7f42f8156720 2024-09-12T03:37:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f813a520 con 0x7f42f8156720 2024-09-12T03:37:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42eeffd640 1 -- 172.21.15.73:0/397057032 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00b88b0 con 0x7f42f8156720 2024-09-12T03:37:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f813aae0 con 0x7f42f8156720 2024-09-12T03:37:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.534+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f8142390 con 0x7f42f8156720 2024-09-12T03:37:30.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.538+0000 7f42eeffd640 1 -- 172.21.15.73:0/397057032 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42f00b8a50 con 0x7f42f8156720 2024-09-12T03:37:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.538+0000 7f42eeffd640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f42d80678c0 0x7f42d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.538+0000 7f42eeffd640 1 -- 172.21.15.73:0/397057032 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f42f0120f80 con 0x7f42f8156720 2024-09-12T03:37:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.538+0000 7f42f659c640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f42d80678c0 0x7f42d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:30.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.538+0000 7f42f659c640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f42d80678c0 0x7f42d8069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:30.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.542+0000 7f42eeffd640 1 -- 172.21.15.73:0/397057032 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42f00165e0 con 0x7f42f8156720 2024-09-12T03:37:30.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:30.706+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42f80d2340 con 0x7f42f8156720 2024-09-12T03:37:31.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.334+0000 7f42eeffd640 1 -- 172.21.15.73:0/397057032 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f42f00f1ac0 con 0x7f42f8156720 2024-09-12T03:37:31.337 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:37:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f42d80678c0 msgr2=0x7f42d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f42d80678c0 0x7f42d8069d80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8008040 comp rx=0 tx=0).stop 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8156720 msgr2=0x7f42f81589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8156720 0x7f42f81589f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f42f00af040 tx=0x7f42f0019790 comp rx=0 tx=0).stop 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 shutdown_connections 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f42d80678c0 0x7f42d8069d80 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8008040 comp rx=0 tx=0).stop 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42f8156720 0x7f42f81589f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42f8141110 0x7f42f8139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 --2- 172.21.15.73:0/397057032 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42f80b5b50 0x7f42f8138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 >> 172.21.15.73:0/397057032 conn(0x7f42f806c0c0 msgr2=0x7f42f8156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 shutdown_connections 2024-09-12T03:37:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.342+0000 7f42fcb48640 1 -- 172.21.15.73:0/397057032 wait complete. 2024-09-12T03:37:31.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:37:31.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ec590640 1 Processor -- start 2024-09-12T03:37:31.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ec590640 1 -- start start 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ec590640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63e415bec0 0x7f63e40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ec590640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e40af470 0x7f63e406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ec590640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e40b3290 con 0x7f63e415c2a0 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ec590640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f63e40b3570 con 0x7f63e415bec0 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ec590640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f63e40b3850 con 0x7f63e40af470 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ea32c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63e415bec0 0x7f63e40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ea32c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63e415bec0 0x7f63e40ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53500/0 (socket says 172.21.15.73:53500) 2024-09-12T03:37:31.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ea32c640 1 -- 172.21.15.73:0/3430743256 learned_addr learned my addr 172.21.15.73:0/3430743256 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:31.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63eab2d640 1 --2- 172.21.15.73:0/3430743256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e40af470 0x7f63e406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:31.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ea32c640 1 -- 172.21.15.73:0/3430743256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e40af470 msgr2=0x7f63e406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:31.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ea32c640 1 --2- 172.21.15.73:0/3430743256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e40af470 0x7f63e406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ea32c640 1 -- 172.21.15.73:0/3430743256 >> v1:172.21.15.150:6789/0 conn(0x7f63e415c2a0 legacy=0x7f63e40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:31.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.490+0000 7f63ea32c640 1 -- 172.21.15.73:0/3430743256 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40b3b30 con 0x7f63e415bec0 2024-09-12T03:37:31.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ea32c640 1 --2- 172.21.15.73:0/3430743256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e415bec0 0x7f63e40ad200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009870 tx=0x7f63e001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68689ba635e4a353 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:31.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63e932a640 1 -- 172.21.15.73:0/3430743256 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e00ab620 con 0x7f63e415bec0 2024-09-12T03:37:31.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63e932a640 1 -- 172.21.15.73:0/3430743256 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e00b0070 con 0x7f63e415bec0 2024-09-12T03:37:31.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63e932a640 1 -- 172.21.15.73:0/3430743256 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e00ab9e0 con 0x7f63e415bec0 2024-09-12T03:37:31.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 -- 172.21.15.73:0/3430743256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e415bec0 msgr2=0x7f63e40ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:31.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 --2- 172.21.15.73:0/3430743256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e415bec0 0x7f63e40ad200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f63e0009870 tx=0x7f63e001c460 comp rx=0 tx=0).stop 2024-09-12T03:37:31.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 -- 172.21.15.73:0/3430743256 shutdown_connections 2024-09-12T03:37:31.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 --2- 172.21.15.73:0/3430743256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e40af470 0x7f63e406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 --2- 172.21.15.73:0/3430743256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e415bec0 0x7f63e40ad200 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 -- 172.21.15.73:0/3430743256 >> 172.21.15.73:0/3430743256 conn(0x7f63e40b1f90 msgr2=0x7f63e40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:31.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 -- 172.21.15.73:0/3430743256 shutdown_connections 2024-09-12T03:37:31.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.494+0000 7f63ec590640 1 -- 172.21.15.73:0/3430743256 wait complete. 2024-09-12T03:37:31.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 Processor -- start 2024-09-12T03:37:31.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 -- start start 2024-09-12T03:37:31.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e40af470 0x7f63e4072d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:31.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e415bec0 0x7f63e41498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:31.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e415c2a0 0x7f63e4150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f63e406ed50 con 0x7f63e40af470 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f63e40ad740 con 0x7f63e415c2a0 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f63e406eed0 con 0x7f63e415bec0 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e40af470 0x7f63e4072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e40af470 0x7f63e4072d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53514/0 (socket says 172.21.15.73:53514) 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 -- 172.21.15.73:0/490983937 learned_addr learned my addr 172.21.15.73:0/490983937 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63e9b2b640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e415bec0 0x7f63e41498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63eab2d640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e415c2a0 0x7f63e4150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 -- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e415bec0 msgr2=0x7f63e41498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e415bec0 0x7f63e41498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 -- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e415c2a0 msgr2=0x7f63e4150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e415c2a0 0x7f63e4150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 -- 172.21.15.73:0/490983937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e4149e20 con 0x7f63e40af470 2024-09-12T03:37:31.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63e9b2b640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e415bec0 0x7f63e41498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:31.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ea32c640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e40af470 0x7f63e4072d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f63e00ad040 tx=0x7f63e001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:31.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63daffd640 1 -- 172.21.15.73:0/490983937 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e00abd90 con 0x7f63e40af470 2024-09-12T03:37:31.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63daffd640 1 -- 172.21.15.73:0/490983937 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63e00be3f0 con 0x7f63e40af470 2024-09-12T03:37:31.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e4150e80 con 0x7f63e40af470 2024-09-12T03:37:31.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63daffd640 1 -- 172.21.15.73:0/490983937 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e00be7e0 con 0x7f63e40af470 2024-09-12T03:37:31.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e4151440 con 0x7f63e40af470 2024-09-12T03:37:31.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e406f280 con 0x7f63e40af470 2024-09-12T03:37:31.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63daffd640 1 -- 172.21.15.73:0/490983937 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63e00b43f0 con 0x7f63e40af470 2024-09-12T03:37:31.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63daffd640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63c80678c0 0x7f63c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:31.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63daffd640 1 -- 172.21.15.73:0/490983937 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5749+0+0 (secure 0 0 0) 0x7f63e0120160 con 0x7f63e40af470 2024-09-12T03:37:31.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.498+0000 7f63e9b2b640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63c80678c0 0x7f63c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:31.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.502+0000 7f63e9b2b640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63c80678c0 0x7f63c8069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f63e40b1090 tx=0x7f63d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.506+0000 7f63daffd640 1 -- 172.21.15.73:0/490983937 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63e00c4060 con 0x7f63e40af470 2024-09-12T03:37:31.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:31.666+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f63e406fcd0 con 0x7f63e40af470 2024-09-12T03:37:32.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.342+0000 7f63daffd640 1 -- 172.21.15.73:0/490983937 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7f63e0016110 con 0x7f63e40af470 2024-09-12T03:37:32.345 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T03:37:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.350+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63c80678c0 msgr2=0x7f63c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.350+0000 7f63ec590640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63c80678c0 0x7f63c8069d80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f63e40b1090 tx=0x7f63d4008040 comp rx=0 tx=0).stop 2024-09-12T03:37:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.350+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e40af470 msgr2=0x7f63e4072d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.350+0000 7f63ec590640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e40af470 0x7f63e4072d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f63e00ad040 tx=0x7f63e001aca0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.354+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 shutdown_connections 2024-09-12T03:37:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.354+0000 7f63ec590640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63c80678c0 0x7f63c8069d80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.354+0000 7f63ec590640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e415c2a0 0x7f63e4150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.354+0000 7f63ec590640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63e415bec0 0x7f63e41498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.354+0000 7f63ec590640 1 --2- 172.21.15.73:0/490983937 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63e40af470 0x7f63e4072d40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.354+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 >> 172.21.15.73:0/490983937 conn(0x7f63e40b1f90 msgr2=0x7f63e4075230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:32.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.358+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 shutdown_connections 2024-09-12T03:37:32.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.358+0000 7f63ec590640 1 -- 172.21.15.73:0/490983937 wait complete. 2024-09-12T03:37:32.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T03:37:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756f751640 1 Processor -- start 2024-09-12T03:37:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756f751640 1 -- start start 2024-09-12T03:37:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756f751640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f756815e5f0 0x7f756806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756f751640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756806d9c0 con 0x7f75680cfaf0 2024-09-12T03:37:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756f751640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756806dca0 con 0x7f75680ce9d0 2024-09-12T03:37:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756f751640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f756806df80 con 0x7f756815e5f0 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f75680cfaf0 0x7f75680d2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39960/0 (socket says 172.21.15.73:39960) 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 -- 172.21.15.73:0/3719826863 learned_addr learned my addr 172.21.15.73:0/3719826863 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756d4ed640 1 --2- 172.21.15.73:0/3719826863 >> v2:172.21.15.150:3300/0 conn(0x7f756815e5f0 0x7f756806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532822649 0 0) 0x7f756806d9c0 con 0x7f75680cfaf0 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7554003530 con 0x7f75680cfaf0 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1580133575 0 0) 0x7f7554003530 con 0x7f75680cfaf0 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 >> v2:172.21.15.150:3300/0 conn(0x7f756815e5f0 msgr2=0x7f756806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 --2- 172.21.15.73:0/3719826863 >> v2:172.21.15.150:3300/0 conn(0x7f756815e5f0 0x7f756806d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 >> v1:172.21.15.150:6789/0 conn(0x7f75680ce9d0 legacy=0x7f75680cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756806e260 con 0x7f75680cfaf0 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f7560001a00 con 0x7f75680cfaf0 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 >> v1:172.21.15.73:6789/0 conn(0x7f75680cfaf0 legacy=0x7f75680d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75540039c0 0x7f7554003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554004810 0x7f7554004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75540051d0 0x7f755400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f756806df80 con 0x7f75540051d0 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f755400c070 con 0x7f7554004810 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f755400c270 con 0x7f75540039c0 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75540051d0 0x7f755400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756ccec640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554004810 0x7f7554004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756d4ed640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75540039c0 0x7f7554003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 -- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75540039c0 msgr2=0x7f7554003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75540039c0 0x7f7554003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 -- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554004810 msgr2=0x7f7554004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7554004810 0x7f7554004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756dcee640 1 -- 172.21.15.73:0/3719826863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7554003530 con 0x7f75540051d0 2024-09-12T03:37:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.510+0000 7f756d4ed640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75540039c0 0x7f7554003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756dcee640 1 -- 172.21.15.73:0/3719826863 reap_dead start 2024-09-12T03:37:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756dcee640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75540051d0 0x7f755400b9d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f756808d880 tx=0x7f756001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad9bd2d8ec04b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756000a460 con 0x7f75540051d0 2024-09-12T03:37:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75600ac620 con 0x7f75540051d0 2024-09-12T03:37:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f755ffff640 1 -- 172.21.15.73:0/3719826863 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75600aca10 con 0x7f75540051d0 2024-09-12T03:37:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 -- 172.21.15.73:0/3719826863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75540051d0 msgr2=0x7f755400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75540051d0 0x7f755400b9d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f756808d880 tx=0x7f756001d300 comp rx=0 tx=0).stop 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 -- 172.21.15.73:0/3719826863 shutdown_connections 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 --2- 172.21.15.73:0/3719826863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75540051d0 0x7f755400b9d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 -- 172.21.15.73:0/3719826863 >> 172.21.15.73:0/3719826863 conn(0x7f7568074030 msgr2=0x7f756809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 -- 172.21.15.73:0/3719826863 shutdown_connections 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 -- 172.21.15.73:0/3719826863 wait complete. 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 Processor -- start 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.514+0000 7f756f751640 1 -- start start 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75681f7330 0x7f75681f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75681f3d70 0x7f756809f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756809f600 0x7f75680cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f75680cf770 con 0x7f756809f600 2024-09-12T03:37:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f75680cf5f0 con 0x7f75681f7330 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f75680cf8f0 con 0x7f75681f3d70 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756809f600 0x7f75680cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756809f600 0x7f75680cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53522/0 (socket says 172.21.15.73:53522) 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 -- 172.21.15.73:0/4279451498 learned_addr learned my addr 172.21.15.73:0/4279451498 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756d4ed640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75681f7330 0x7f75681f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756ccec640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75681f3d70 0x7f756809f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 -- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75681f3d70 msgr2=0x7f756809f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75681f3d70 0x7f756809f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 -- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75681f7330 msgr2=0x7f75681f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75681f7330 0x7f75681f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 -- 172.21.15.73:0/4279451498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75681f7c50 con 0x7f756809f600 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756dcee640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756809f600 0x7f75680cd540 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f756001cd70 tx=0x7f7554005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f755dffb640 1 -- 172.21.15.73:0/4279451498 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560001950 con 0x7f756809f600 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f755dffb640 1 -- 172.21.15.73:0/4279451498 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7560001af0 con 0x7f756809f600 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75680cc4a0 con 0x7f756809f600 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f755dffb640 1 -- 172.21.15.73:0/4279451498 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75600ac9d0 con 0x7f756809f600 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75680cca60 con 0x7f756809f600 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756806d090 con 0x7f756809f600 2024-09-12T03:37:32.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f755dffb640 1 -- 172.21.15.73:0/4279451498 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f75600acb70 con 0x7f756809f600 2024-09-12T03:37:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f755dffb640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f754c0678c0 0x7f754c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f755dffb640 1 -- 172.21.15.73:0/4279451498 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f756011f910 con 0x7f756809f600 2024-09-12T03:37:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.518+0000 7f756d4ed640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f754c0678c0 0x7f754c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.522+0000 7f756d4ed640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f754c0678c0 0x7f754c069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f75580099e0 tx=0x7f7558008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:32.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.522+0000 7f755dffb640 1 -- 172.21.15.73:0/4279451498 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7560017010 con 0x7f756809f600 2024-09-12T03:37:32.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.690+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f75680d3730 con 0x7f756809f600 2024-09-12T03:37:32.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.694+0000 7f755dffb640 1 -- 172.21.15.73:0/4279451498 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f75600eff70 con 0x7f756809f600 2024-09-12T03:37:32.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f754c0678c0 msgr2=0x7f754c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f754c0678c0 0x7f754c069d80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f75580099e0 tx=0x7f7558008040 comp rx=0 tx=0).stop 2024-09-12T03:37:32.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756809f600 msgr2=0x7f75680cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756809f600 0x7f75680cd540 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f756001cd70 tx=0x7f7554005840 comp rx=0 tx=0).stop 2024-09-12T03:37:32.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 shutdown_connections 2024-09-12T03:37:32.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f754c0678c0 0x7f754c069d80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f756809f600 0x7f75680cd540 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f75681f3d70 0x7f756809f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 --2- 172.21.15.73:0/4279451498 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f75681f7330 0x7f75681f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 >> 172.21.15.73:0/4279451498 conn(0x7f75540051d0 msgr2=0x7f75680d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:32.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 shutdown_connections 2024-09-12T03:37:32.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.698+0000 7f756f751640 1 -- 172.21.15.73:0/4279451498 wait complete. 2024-09-12T03:37:32.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df' 2024-09-12T03:37:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab62626640 1 Processor -- start 2024-09-12T03:37:32.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab62626640 1 -- start start 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab62626640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab5c1567e0 0x7fab5c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab62626640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c0b3c40 0x7fab5c15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab62626640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5c0b4620 con 0x7fab5c0b40d0 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab62626640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fab5c0b4900 con 0x7fab5c1567e0 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab62626640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fab5c0b4be0 con 0x7fab5c0b3c40 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab5c1567e0 0x7fab5c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab5c1567e0 0x7fab5c0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53532/0 (socket says 172.21.15.73:53532) 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5bfff640 1 -- 172.21.15.73:0/3733628827 learned_addr learned my addr 172.21.15.73:0/3733628827 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5b7fe640 1 --2- 172.21.15.73:0/3733628827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c0b3c40 0x7fab5c15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5bfff640 1 -- 172.21.15.73:0/3733628827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c0b3c40 msgr2=0x7fab5c15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:32.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5bfff640 1 --2- 172.21.15.73:0/3733628827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c0b3c40 0x7fab5c15fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5bfff640 1 -- 172.21.15.73:0/3733628827 >> v1:172.21.15.150:6789/0 conn(0x7fab5c0b40d0 legacy=0x7fab5c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.846+0000 7fab5bfff640 1 -- 172.21.15.73:0/3733628827 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c0b4ec0 con 0x7fab5c1567e0 2024-09-12T03:37:32.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 --2- 172.21.15.73:0/3733628827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c1567e0 0x7fab5c0b56c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181991cb0cff600d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5affd640 1 -- 172.21.15.73:0/3733628827 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0b0070 con 0x7fab5c1567e0 2024-09-12T03:37:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5affd640 1 -- 172.21.15.73:0/3733628827 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c0ab600 con 0x7fab5c1567e0 2024-09-12T03:37:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5affd640 1 -- 172.21.15.73:0/3733628827 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0ab9d0 con 0x7fab5c1567e0 2024-09-12T03:37:32.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- 172.21.15.73:0/3733628827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c1567e0 msgr2=0x7fab5c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 --2- 172.21.15.73:0/3733628827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c1567e0 0x7fab5c0b56c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fab4c009870 tx=0x7fab4c01c460 comp rx=0 tx=0).stop 2024-09-12T03:37:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- 172.21.15.73:0/3733628827 shutdown_connections 2024-09-12T03:37:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 --2- 172.21.15.73:0/3733628827 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c0b3c40 0x7fab5c15fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 --2- 172.21.15.73:0/3733628827 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c1567e0 0x7fab5c0b56c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- 172.21.15.73:0/3733628827 >> 172.21.15.73:0/3733628827 conn(0x7fab5c073580 msgr2=0x7fab5c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- 172.21.15.73:0/3733628827 shutdown_connections 2024-09-12T03:37:32.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- 172.21.15.73:0/3733628827 wait complete. 2024-09-12T03:37:32.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 Processor -- start 2024-09-12T03:37:32.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- start start 2024-09-12T03:37:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c0b3c40 0x7fab5c1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab5c0b40d0 0x7fab5c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c1567e0 0x7fab5c147e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c1609d0 con 0x7fab5c0b3c40 2024-09-12T03:37:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c0b5c00 con 0x7fab5c0b40d0 2024-09-12T03:37:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fab5c160b50 con 0x7fab5c1567e0 2024-09-12T03:37:32.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c0b3c40 0x7fab5c1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c0b3c40 0x7fab5c1467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53548/0 (socket says 172.21.15.73:53548) 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 -- 172.21.15.73:0/241426912 learned_addr learned my addr 172.21.15.73:0/241426912 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5b7fe640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab5c0b40d0 0x7fab5c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 -- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c1567e0 msgr2=0x7fab5c147e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab60bc3640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c1567e0 0x7fab5c147e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c1567e0 0x7fab5c147e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 -- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab5c0b40d0 msgr2=0x7fab5c153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab5c0b40d0 0x7fab5c153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 -- 172.21.15.73:0/241426912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c154370 con 0x7fab5c0b3c40 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5b7fe640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab5c0b40d0 0x7fab5c153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab5bfff640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c0b3c40 0x7fab5c1467e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0ae040 tx=0x7fab4c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab58ff9640 1 -- 172.21.15.73:0/241426912 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0ba020 con 0x7fab5c0b3c40 2024-09-12T03:37:32.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab58ff9640 1 -- 172.21.15.73:0/241426912 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c0b6640 con 0x7fab5c0b3c40 2024-09-12T03:37:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c14acf0 con 0x7fab5c0b3c40 2024-09-12T03:37:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab58ff9640 1 -- 172.21.15.73:0/241426912 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c0b0040 con 0x7fab5c0b3c40 2024-09-12T03:37:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.850+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c14aa10 con 0x7fab5c0b3c40 2024-09-12T03:37:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.854+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5c15fd50 con 0x7fab5c0b3c40 2024-09-12T03:37:32.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.854+0000 7fab58ff9640 1 -- 172.21.15.73:0/241426912 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab4c0bd020 con 0x7fab5c0b3c40 2024-09-12T03:37:32.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.854+0000 7fab58ff9640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fab480678c0 0x7fab48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:32.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.854+0000 7fab58ff9640 1 -- 172.21.15.73:0/241426912 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fab4c11fde0 con 0x7fab5c0b3c40 2024-09-12T03:37:32.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.854+0000 7fab5b7fe640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fab480678c0 0x7fab48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:32.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.854+0000 7fab5b7fe640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fab480678c0 0x7fab48069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fab50006fd0 tx=0x7fab50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:32.858+0000 7fab58ff9640 1 -- 172.21.15.73:0/241426912 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fab4c0c4030 con 0x7fab5c0b3c40 2024-09-12T03:37:33.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.082+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]} v 0) -- 0x7fab5c06cec0 con 0x7fab5c0b3c40 2024-09-12T03:37:33.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.346+0000 7fab58ff9640 1 -- 172.21.15.73:0/241426912 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_df"]}]=0 v177) ==== 134+0+0 (secure 0 0 0) 0x7fab5c14acf0 con 0x7fab5c0b3c40 2024-09-12T03:37:33.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fab480678c0 msgr2=0x7fab48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fab480678c0 0x7fab48069d80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fab50006fd0 tx=0x7fab50008040 comp rx=0 tx=0).stop 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c0b3c40 msgr2=0x7fab5c1467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c0b3c40 0x7fab5c1467e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0ae040 tx=0x7fab4c01aca0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 shutdown_connections 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fab480678c0 0x7fab48069d80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fab5c1567e0 0x7fab5c147e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fab5c0b40d0 0x7fab5c153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 --2- 172.21.15.73:0/241426912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab5c0b3c40 0x7fab5c1467e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 >> 172.21.15.73:0/241426912 conn(0x7fab5c073580 msgr2=0x7fab5c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 shutdown_connections 2024-09-12T03:37:33.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.350+0000 7fab62626640 1 -- 172.21.15.73:0/241426912 wait complete. 2024-09-12T03:37:33.373 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2024-09-12T03:37:33.373 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) That quota changes made from one client are visible to another 2024-09-12T03:37:33.373 INFO:tasks.cephfs_test_runner:test_remote_update_getfattr (tasks.cephfs.test_quota.TestQuota) 2024-09-12T03:37:33.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51d1fa3640 1 Processor -- start 2024-09-12T03:37:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51d1fa3640 1 -- start start 2024-09-12T03:37:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51d1fa3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f51cc070020 0x7f51cc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51d1fa3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc0aede0 con 0x7f51cc15f1d0 2024-09-12T03:37:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51d1fa3640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51cc15fa10 con 0x7f51cc1520a0 2024-09-12T03:37:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51d1fa3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f51cc152480 con 0x7f51cc070020 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51cbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f51cc15f1d0 0x7f51cc0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39976/0 (socket says 172.21.15.73:39976) 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51cbfff640 1 -- 172.21.15.73:0/554609057 learned_addr learned my addr 172.21.15.73:0/554609057 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51caffd640 1 --2- 172.21.15.73:0/554609057 >> v2:172.21.15.150:3300/0 conn(0x7f51cc070020 0x7f51cc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072992720 0 0) 0x7f51cc0aede0 con 0x7f51cc15f1d0 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b4003530 con 0x7f51cc15f1d0 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 641094058 0 0) 0x7f51b4003530 con 0x7f51cc15f1d0 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 >> v2:172.21.15.150:3300/0 conn(0x7f51cc070020 msgr2=0x7f51cc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 --2- 172.21.15.73:0/554609057 >> v2:172.21.15.150:3300/0 conn(0x7f51cc070020 0x7f51cc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 >> v1:172.21.15.150:6789/0 conn(0x7f51cc1520a0 legacy=0x7f51cc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc074250 con 0x7f51cc15f1d0 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f51c4001a00 con 0x7f51cc15f1d0 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 >> v1:172.21.15.73:6789/0 conn(0x7f51cc15f1d0 legacy=0x7f51cc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b40039c0 0x7f51b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b40051d0 0x7f51b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f51b400c040 con 0x7f51b4004810 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f51b400c1f0 con 0x7f51b40051d0 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f51b400c3f0 con 0x7f51b40039c0 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51caffd640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51cbfff640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b40051d0 0x7f51b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51caffd640 1 -- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b40039c0 msgr2=0x7f51b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51caffd640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51b40039c0 0x7f51b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51caffd640 1 -- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b40051d0 msgr2=0x7f51b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51caffd640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b40051d0 0x7f51b400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51caffd640 1 -- 172.21.15.73:0/554609057 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b4003530 con 0x7f51b4004810 2024-09-12T03:37:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51cbfff640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51b40051d0 0x7f51b400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:33.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.498+0000 7f51cbfff640 1 -- 172.21.15.73:0/554609057 reap_dead start 2024-09-12T03:37:33.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51caffd640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51b4004c90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009ab0 tx=0x7f51c001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18be6fb91a385182 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c00b2070 con 0x7f51b4004810 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c00a5640 con 0x7f51b4004810 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51ca7fc640 1 -- 172.21.15.73:0/554609057 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c00096b0 con 0x7f51b4004810 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- 172.21.15.73:0/554609057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 msgr2=0x7f51b4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51b4004c90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009ab0 tx=0x7f51c001ca50 comp rx=0 tx=0).stop 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- 172.21.15.73:0/554609057 shutdown_connections 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/554609057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51b4004c90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- 172.21.15.73:0/554609057 >> 172.21.15.73:0/554609057 conn(0x7f51cc0b1f90 msgr2=0x7f51cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- 172.21.15.73:0/554609057 shutdown_connections 2024-09-12T03:37:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- 172.21.15.73:0/554609057 wait complete. 2024-09-12T03:37:33.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 Processor -- start 2024-09-12T03:37:33.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- start start 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51cc15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc1f0270 0x7f51cc1f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0b06f0 0x7f51cc0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc073a50 con 0x7f51b4004810 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc073770 con 0x7f51cc0b06f0 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.502+0000 7f51d1fa3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f51cc073d30 con 0x7f51cc1f0270 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51cc15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51cc15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53568/0 (socket says 172.21.15.73:53568) 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 -- 172.21.15.73:0/824417608 learned_addr learned my addr 172.21.15.73:0/824417608 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 -- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc1f0270 msgr2=0x7f51cc1f06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc1f0270 0x7f51cc1f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 -- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0b06f0 msgr2=0x7f51cc0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cbfff640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0b06f0 0x7f51cc0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0b06f0 0x7f51cc0b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 -- 172.21.15.73:0/824417608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51cc15d5d0 con 0x7f51b4004810 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cbfff640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0b06f0 0x7f51cc0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51cb7fe640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51cc15d090 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00c500 tx=0x7f51bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51b3fff640 1 -- 172.21.15.73:0/824417608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0052d0 con 0x7f51b4004810 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51b3fff640 1 -- 172.21.15.73:0/824417608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc005470 con 0x7f51b4004810 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51cc1f0e00 con 0x7f51b4004810 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51b3fff640 1 -- 172.21.15.73:0/824417608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc012870 con 0x7f51b4004810 2024-09-12T03:37:33.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51cc15c890 con 0x7f51b4004810 2024-09-12T03:37:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51cc0b10b0 con 0x7f51b4004810 2024-09-12T03:37:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51b3fff640 1 -- 172.21.15.73:0/824417608 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f51bc012a10 con 0x7f51b4004810 2024-09-12T03:37:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51b3fff640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f51b80678f0 0x7f51b8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51caffd640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f51b80678f0 0x7f51b8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51b3fff640 1 -- 172.21.15.73:0/824417608 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f51bc085740 con 0x7f51b4004810 2024-09-12T03:37:33.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.506+0000 7f51caffd640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f51b80678f0 0x7f51b8069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f51c00af000 tx=0x7f51c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:33.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.510+0000 7f51b3fff640 1 -- 172.21.15.73:0/824417608 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f51bc0182b0 con 0x7f51b4004810 2024-09-12T03:37:33.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.674+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51cc068e50 con 0x7f51b4004810 2024-09-12T03:37:33.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.674+0000 7f51b3fff640 1 -- 172.21.15.73:0/824417608 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13316 (secure 0 0 0) 0x7f51bc056480 con 0x7f51b4004810 2024-09-12T03:37:33.676 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:33.676 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":78,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:32.338737+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/585196866":"2024-09-13T03:37:29.323931+0000","172.21.15.73:6836/585196866":"2024-09-13T03:37:29.323931+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f51b80678f0 msgr2=0x7f51b8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f51b80678f0 0x7f51b8069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f51c00af000 tx=0x7f51c0008040 comp rx=0 tx=0).stop 2024-09-12T03:37:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 msgr2=0x7f51cc15d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51cc15d090 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00c500 tx=0x7f51bc00c9c0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 shutdown_connections 2024-09-12T03:37:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f51b80678f0 0x7f51b8069db0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51cc0b06f0 0x7f51cc0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f51cc1f0270 0x7f51cc1f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 --2- 172.21.15.73:0/824417608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51b4004810 0x7f51cc15d090 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 >> 172.21.15.73:0/824417608 conn(0x7f51cc0b1f90 msgr2=0x7f51cc0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:33.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 shutdown_connections 2024-09-12T03:37:33.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.678+0000 7f51d1fa3640 1 -- 172.21.15.73:0/824417608 wait complete. 2024-09-12T03:37:33.695 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T03:34:25.956292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T03:37:33.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T03:37:33.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 Processor -- start 2024-09-12T03:37:33.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 -- start start 2024-09-12T03:37:33.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3ef81520a0 0x7f3ef806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ef806fe50 0x7f3ef815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef815f1d0 0x7f3ef8071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef8152480 con 0x7f3ef806fe50 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef8070250 con 0x7f3ef81520a0 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3eff98d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef80aede0 con 0x7f3ef815f1d0 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ef806fe50 0x7f3ef815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ef806fe50 0x7f3ef815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53576/0 (socket says 172.21.15.73:53576) 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 -- 172.21.15.73:0/1287937454 learned_addr learned my addr 172.21.15.73:0/1287937454 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 -- 172.21.15.73:0/1287937454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef815f1d0 msgr2=0x7f3ef8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 --2- 172.21.15.73:0/1287937454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef815f1d0 0x7f3ef8071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 -- 172.21.15.73:0/1287937454 >> v2:172.21.15.150:3300/0 conn(0x7f3ef81520a0 msgr2=0x7f3ef806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efd729640 1 --2- 172.21.15.73:0/1287937454 >> v2:172.21.15.150:3300/0 conn(0x7f3ef81520a0 0x7f3ef806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 --2- 172.21.15.73:0/1287937454 >> v2:172.21.15.150:3300/0 conn(0x7f3ef81520a0 0x7f3ef806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efcf28640 1 -- 172.21.15.73:0/1287937454 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef815fa10 con 0x7f3ef806fe50 2024-09-12T03:37:33.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.822+0000 7f3efd729640 1 --2- 172.21.15.73:0/1287937454 >> v2:172.21.15.150:3300/0 conn(0x7f3ef81520a0 0x7f3ef806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:33.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efcf28640 1 --2- 172.21.15.73:0/1287937454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef815ec90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8071710 tx=0x7f3ef401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106d99b1d554d5f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:33.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eeffff640 1 -- 172.21.15.73:0/1287937454 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40b0070 con 0x7f3ef806fe50 2024-09-12T03:37:33.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eeffff640 1 -- 172.21.15.73:0/1287937454 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef40ab600 con 0x7f3ef806fe50 2024-09-12T03:37:33.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eeffff640 1 -- 172.21.15.73:0/1287937454 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40ab9d0 con 0x7f3ef806fe50 2024-09-12T03:37:33.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- 172.21.15.73:0/1287937454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 msgr2=0x7f3ef815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1287937454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef815ec90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8071710 tx=0x7f3ef401c240 comp rx=0 tx=0).stop 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- 172.21.15.73:0/1287937454 shutdown_connections 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1287937454 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef815f1d0 0x7f3ef8071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1287937454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef815ec90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1287937454 >> v2:172.21.15.150:3300/0 conn(0x7f3ef81520a0 0x7f3ef806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- 172.21.15.73:0/1287937454 >> 172.21.15.73:0/1287937454 conn(0x7f3ef80b1f90 msgr2=0x7f3ef80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- 172.21.15.73:0/1287937454 shutdown_connections 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- 172.21.15.73:0/1287937454 wait complete. 2024-09-12T03:37:33.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 Processor -- start 2024-09-12T03:37:33.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- start start 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef814cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef81520a0 0x7f3ef809ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ef815f1d0 0x7f3ef814ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8073d30 con 0x7f3ef806fe50 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef8073a50 con 0x7f3ef815f1d0 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3eff98d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef815f640 con 0x7f3ef81520a0 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef814cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef814cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53588/0 (socket says 172.21.15.73:53588) 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 -- 172.21.15.73:0/1208262247 learned_addr learned my addr 172.21.15.73:0/1208262247 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efdf2a640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ef815f1d0 0x7f3ef814ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efcf28640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef81520a0 0x7f3ef809ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 -- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef81520a0 msgr2=0x7f3ef809ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef81520a0 0x7f3ef809ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 -- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ef815f1d0 msgr2=0x7f3ef814ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ef815f1d0 0x7f3ef814ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efd729640 1 -- 172.21.15.73:0/1208262247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef809d720 con 0x7f3ef806fe50 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efdf2a640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ef815f1d0 0x7f3ef814ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.826+0000 7f3efcf28640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef81520a0 0x7f3ef809ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3efd729640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef814cb80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c7c0 tx=0x7f3ee800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eedffb640 1 -- 172.21.15.73:0/1208262247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8007a30 con 0x7f3ef806fe50 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eedffb640 1 -- 172.21.15.73:0/1208262247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee8007bd0 con 0x7f3ef806fe50 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eedffb640 1 -- 172.21.15.73:0/1208262247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80113f0 con 0x7f3ef806fe50 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef814f8f0 con 0x7f3ef806fe50 2024-09-12T03:37:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef814feb0 con 0x7f3ef806fe50 2024-09-12T03:37:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef806f910 con 0x7f3ef806fe50 2024-09-12T03:37:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eedffb640 1 -- 172.21.15.73:0/1208262247 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3ee8011590 con 0x7f3ef806fe50 2024-09-12T03:37:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eedffb640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3edc0678c0 0x7f3edc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3eedffb640 1 -- 172.21.15.73:0/1208262247 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f3ee8085d30 con 0x7f3ef806fe50 2024-09-12T03:37:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3efcf28640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3edc0678c0 0x7f3edc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.830+0000 7f3efcf28640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3edc0678c0 0x7f3edc069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40ad000 tx=0x7f3ef4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:33.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.834+0000 7f3eedffb640 1 -- 172.21.15.73:0/1208262247 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ee8015020 con 0x7f3ef806fe50 2024-09-12T03:37:33.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.990+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3ef806e540 con 0x7f3ef806fe50 2024-09-12T03:37:33.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.990+0000 7f3eedffb640 1 -- 172.21.15.73:0/1208262247 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f3ee80569e0 con 0x7f3ef806fe50 2024-09-12T03:37:33.992 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3edc0678c0 msgr2=0x7f3edc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3edc0678c0 0x7f3edc069d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40ad000 tx=0x7f3ef4008040 comp rx=0 tx=0).stop 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 msgr2=0x7f3ef814cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef814cb80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c7c0 tx=0x7f3ee800cc80 comp rx=0 tx=0).stop 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 shutdown_connections 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3edc0678c0 0x7f3edc069d80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ef815f1d0 0x7f3ef814ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3ef81520a0 0x7f3ef809ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 --2- 172.21.15.73:0/1208262247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ef806fe50 0x7f3ef814cb80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 >> 172.21.15.73:0/1208262247 conn(0x7f3ef80b1f90 msgr2=0x7f3ef80b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 shutdown_connections 2024-09-12T03:37:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:33.994+0000 7f3eff98d640 1 -- 172.21.15.73:0/1208262247 wait complete. 2024-09-12T03:37:34.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2024-09-12T03:37:34.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bc6c7640 1 Processor -- start 2024-09-12T03:37:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bc6c7640 1 -- start start 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bc6c7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd9b415bec0 0x7fd9b40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bc6c7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 0x7fd9b406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bc6c7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b40b3290 con 0x7fd9b415c2a0 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bc6c7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b40b3570 con 0x7fd9b415bec0 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bc6c7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b40b3850 con 0x7fd9b40af470 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9c62640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd9b415c2a0 0x7fd9b40aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:39986/0 (socket says 172.21.15.73:39986) 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9c62640 1 -- 172.21.15.73:0/1668741944 learned_addr learned my addr 172.21.15.73:0/1668741944 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:34.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9ba463640 1 --2- 172.21.15.73:0/1668741944 >> v2:172.21.15.150:3300/0 conn(0x7fd9b415bec0 0x7fd9b40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305569199 0 0) 0x7fd9b40b3290 con 0x7fd9b415c2a0 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bac64640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 0x7fd9b406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9a0003530 con 0x7fd9b415c2a0 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 742059392 0 0) 0x7fd9a0003530 con 0x7fd9b415c2a0 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 msgr2=0x7fd9b406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 0x7fd9b406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 >> v2:172.21.15.150:3300/0 conn(0x7fd9b415bec0 msgr2=0x7fd9b40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 --2- 172.21.15.73:0/1668741944 >> v2:172.21.15.150:3300/0 conn(0x7fd9b415bec0 0x7fd9b40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b40b3b30 con 0x7fd9b415c2a0 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fd9b0001680 con 0x7fd9b415c2a0 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bac64640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 0x7fd9b406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 >> v1:172.21.15.73:6789/0 conn(0x7fd9b415c2a0 legacy=0x7fd9b40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9a00039c0 0x7fd9a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9a0004810 0x7fd9a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 0x7fd9a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40b3570 con 0x7fd9a00039c0 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40b3850 con 0x7fd9a0004810 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a000ba50 con 0x7fd9b40af470 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9ba463640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9a00039c0 0x7fd9a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9c62640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9a0004810 0x7fd9a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9ba463640 1 -- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 msgr2=0x7fd9a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9bac64640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 0x7fd9a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9ba463640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9b40af470 0x7fd9a00051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9ba463640 1 -- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9a0004810 msgr2=0x7fd9a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9ba463640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9a0004810 0x7fd9a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9ba463640 1 -- 172.21.15.73:0/1668741944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a0003530 con 0x7fd9a00039c0 2024-09-12T03:37:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.122+0000 7fd9b9c62640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9a0004810 0x7fd9a0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9ba463640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9a00039c0 0x7fd9a0003de0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009ae0 tx=0x7fd9a401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a34ca0b96b47f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40b2070 con 0x7fd9a00039c0 2024-09-12T03:37:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9a40a5570 con 0x7fd9a00039c0 2024-09-12T03:37:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9b9461640 1 -- 172.21.15.73:0/1668741944 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9a40096b0 con 0x7fd9a00039c0 2024-09-12T03:37:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/1668741944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9a00039c0 msgr2=0x7fd9a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9bc6c7640 1 --2- 172.21.15.73:0/1668741944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9a00039c0 0x7fd9a0003de0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4009ae0 tx=0x7fd9a401ca80 comp rx=0 tx=0).stop 2024-09-12T03:37:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9bac64640 1 -- 172.21.15.73:0/1668741944 reap_dead start 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/1668741944 shutdown_connections 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/1668741944 >> 172.21.15.73:0/1668741944 conn(0x7fd9b40b1f90 msgr2=0x7fd9b40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/1668741944 shutdown_connections 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.126+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/1668741944 wait complete. 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 Processor -- start 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 -- start start 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9a00039c0 0x7fd9b4158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9b415cf60 0x7fd9b40999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9b415ebe0 0x7fd9b415f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b406e810 con 0x7fd9b415cf60 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b40ad740 con 0x7fd9b415ebe0 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b406e990 con 0x7fd9a00039c0 2024-09-12T03:37:34.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9b415cf60 0x7fd9b40999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9b415cf60 0x7fd9b40999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53602/0 (socket says 172.21.15.73:53602) 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 -- 172.21.15.73:0/2077151076 learned_addr learned my addr 172.21.15.73:0/2077151076 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9ba463640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9a00039c0 0x7fd9b4158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bac64640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9b415ebe0 0x7fd9b415f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 -- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9a00039c0 msgr2=0x7fd9b4158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9a00039c0 0x7fd9b4158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 -- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9b415ebe0 msgr2=0x7fd9b415f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9b415ebe0 0x7fd9b415f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 -- 172.21.15.73:0/2077151076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b415d4b0 con 0x7fd9b415cf60 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9b9c62640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9b415cf60 0x7fd9b40999d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000d800 tx=0x7fd9b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9aaffd640 1 -- 172.21.15.73:0/2077151076 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0019070 con 0x7fd9b415cf60 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9aaffd640 1 -- 172.21.15.73:0/2077151076 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b00074e0 con 0x7fd9b415cf60 2024-09-12T03:37:34.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9aaffd640 1 -- 172.21.15.73:0/2077151076 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0004a10 con 0x7fd9b415cf60 2024-09-12T03:37:34.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b4156db0 con 0x7fd9b415cf60 2024-09-12T03:37:34.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b415f5a0 con 0x7fd9b415cf60 2024-09-12T03:37:34.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b40ad200 con 0x7fd9b415cf60 2024-09-12T03:37:34.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9aaffd640 1 -- 172.21.15.73:0/2077151076 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd9b0004bb0 con 0x7fd9b415cf60 2024-09-12T03:37:34.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9aaffd640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9980678c0 0x7fd998069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9aaffd640 1 -- 172.21.15.73:0/2077151076 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fd9b0085610 con 0x7fd9b415cf60 2024-09-12T03:37:34.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.130+0000 7fd9ba463640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9980678c0 0x7fd998069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.134+0000 7fd9ba463640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9980678c0 0x7fd998069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40af000 tx=0x7fd9a40046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.138+0000 7fd9aaffd640 1 -- 172.21.15.73:0/2077151076 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd9b0056230 con 0x7fd9b415cf60 2024-09-12T03:37:34.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.342+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) -- 0x7fd9b40cf660 con 0x7fd9b415cf60 2024-09-12T03:37:34.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9aaffd640 1 -- 172.21.15.73:0/2077151076 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v178) ==== 143+0+0 (secure 0 0 0) 0x7fd9b0055b30 con 0x7fd9b415cf60 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9980678c0 msgr2=0x7fd998069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9980678c0 0x7fd998069d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd9a40af000 tx=0x7fd9a40046d0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9b415cf60 msgr2=0x7fd9b40999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9b415cf60 0x7fd9b40999d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000d800 tx=0x7fd9b000dcc0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 shutdown_connections 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd9980678c0 0x7fd998069d80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9b415cf60 0x7fd9b40999d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd9b415ebe0 0x7fd9b415f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 --2- 172.21.15.73:0/2077151076 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd9a00039c0 0x7fd9b4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 >> 172.21.15.73:0/2077151076 conn(0x7fd9b40b1f90 msgr2=0x7fd9b40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:34.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 shutdown_connections 2024-09-12T03:37:34.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.354+0000 7fd9bc6c7640 1 -- 172.21.15.73:0/2077151076 wait complete. 2024-09-12T03:37:34.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T03:37:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef6672e640 1 Processor -- start 2024-09-12T03:37:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef6672e640 1 -- start start 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef6672e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fef60071ef0 0x7fef60141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef6672e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef60142300 con 0x7fef60141230 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef6672e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef601425e0 con 0x7fef60141b50 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef6672e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fef600d1160 con 0x7fef60071ef0 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fef60141230 0x7fef600717e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40000/0 (socket says 172.21.15.73:40000) 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5ffff640 1 -- 172.21.15.73:0/2736630302 learned_addr learned my addr 172.21.15.73:0/2736630302 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628359029 0 0) 0x7fef60142300 con 0x7fef60141230 2024-09-12T03:37:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/2736630302 >> v2:172.21.15.150:3300/0 conn(0x7fef60071ef0 0x7fef60141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef48003530 con 0x7fef60141230 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 519509419 0 0) 0x7fef48003530 con 0x7fef60141230 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 >> v2:172.21.15.150:3300/0 conn(0x7fef60071ef0 msgr2=0x7fef60141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 --2- 172.21.15.73:0/2736630302 >> v2:172.21.15.150:3300/0 conn(0x7fef60071ef0 0x7fef60141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 >> v1:172.21.15.150:6789/0 conn(0x7fef60141b50 legacy=0x7fef600d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef600d1440 con 0x7fef60141230 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fef50001680 con 0x7fef60141230 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 >> v1:172.21.15.73:6789/0 conn(0x7fef60141230 legacy=0x7fef600717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef480039c0 0x7fef48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef48004810 0x7fef48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef480051d0 0x7fef4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fef600d1160 con 0x7fef48004810 2024-09-12T03:37:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fef4800c120 con 0x7fef480051d0 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fef4800c320 con 0x7fef480039c0 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef48004810 0x7fef48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef64ccb640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef480051d0 0x7fef4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5f7fe640 1 -- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef480039c0 msgr2=0x7fef48003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5ffff640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef480039c0 0x7fef48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef480039c0 0x7fef48003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5f7fe640 1 -- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef480051d0 msgr2=0x7fef4800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef480051d0 0x7fef4800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef5f7fe640 1 -- 172.21.15.73:0/2736630302 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef48003530 con 0x7fef48004810 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef64ccb640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef480051d0 0x7fef4800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.482+0000 7fef64ccb640 1 -- 172.21.15.73:0/2736630302 reap_dead start 2024-09-12T03:37:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef48004810 0x7fef48004c90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fef5400ba30 tx=0x7fef5401c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a652225e1b7bae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540ae070 con 0x7fef48004810 2024-09-12T03:37:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef540a9680 con 0x7fef48004810 2024-09-12T03:37:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef5effd640 1 -- 172.21.15.73:0/2736630302 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5400b600 con 0x7fef48004810 2024-09-12T03:37:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 -- 172.21.15.73:0/2736630302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef48004810 msgr2=0x7fef48004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef48004810 0x7fef48004c90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fef5400ba30 tx=0x7fef5401c6a0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 -- 172.21.15.73:0/2736630302 shutdown_connections 2024-09-12T03:37:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 --2- 172.21.15.73:0/2736630302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef48004810 0x7fef48004c90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 -- 172.21.15.73:0/2736630302 >> 172.21.15.73:0/2736630302 conn(0x7fef6006c0c0 msgr2=0x7fef6006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 -- 172.21.15.73:0/2736630302 shutdown_connections 2024-09-12T03:37:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 -- 172.21.15.73:0/2736630302 wait complete. 2024-09-12T03:37:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 Processor -- start 2024-09-12T03:37:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 -- start start 2024-09-12T03:37:34.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.486+0000 7fef6672e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef48004810 0x7fef6015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef6006eb90 0x7fef6015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef601f44a0 0x7fef601f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fef601420e0 con 0x7fef6006eb90 2024-09-12T03:37:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fef60141f60 con 0x7fef601f44a0 2024-09-12T03:37:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fef600d0da0 con 0x7fef48004810 2024-09-12T03:37:34.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef6006eb90 0x7fef6015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef6006eb90 0x7fef6015b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53614/0 (socket says 172.21.15.73:53614) 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 -- 172.21.15.73:0/1609401294 learned_addr learned my addr 172.21.15.73:0/1609401294 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef64ccb640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef601f44a0 0x7fef601f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5ffff640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef48004810 0x7fef6015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 -- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef48004810 msgr2=0x7fef6015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef48004810 0x7fef6015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 -- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef601f44a0 msgr2=0x7fef601f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef601f44a0 0x7fef601f4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 -- 172.21.15.73:0/1609401294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6006cdd0 con 0x7fef6006eb90 2024-09-12T03:37:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5ffff640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef48004810 0x7fef6015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5f7fe640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef6006eb90 0x7fef6015b560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fef5401c6e0 tx=0x7fef48005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5cff9640 1 -- 172.21.15.73:0/1609401294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540ae040 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5cff9640 1 -- 172.21.15.73:0/1609401294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef540a9d00 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6006d090 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5cff9640 1 -- 172.21.15.73:0/1609401294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540a9eb0 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef6006d650 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef60141610 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5cff9640 1 -- 172.21.15.73:0/1609401294 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fef540b1070 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5cff9640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fef4c0678c0 0x7fef4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5cff9640 1 -- 172.21.15.73:0/1609401294 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fef541201a0 con 0x7fef6006eb90 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5ffff640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fef4c0678c0 0x7fef4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.490+0000 7fef5ffff640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fef4c0678c0 0x7fef4c069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef600b37b0 tx=0x7fef500014c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:34.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.494+0000 7fef5cff9640 1 -- 172.21.15.73:0/1609401294 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef540c1060 con 0x7fef6006eb90 2024-09-12T03:37:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.646+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fef6015f510 con 0x7fef6006eb90 2024-09-12T03:37:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef5cff9640 1 -- 172.21.15.73:0/1609401294 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fef540163b0 con 0x7fef6006eb90 2024-09-12T03:37:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fef4c0678c0 msgr2=0x7fef4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fef4c0678c0 0x7fef4c069d80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef600b37b0 tx=0x7fef500014c0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef6006eb90 msgr2=0x7fef6015b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef6006eb90 0x7fef6015b560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fef5401c6e0 tx=0x7fef48005840 comp rx=0 tx=0).stop 2024-09-12T03:37:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 shutdown_connections 2024-09-12T03:37:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fef4c0678c0 0x7fef4c069d80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef6006eb90 0x7fef6015b560 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef601f44a0 0x7fef601f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 --2- 172.21.15.73:0/1609401294 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fef48004810 0x7fef6015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 >> 172.21.15.73:0/1609401294 conn(0x7fef6006c0c0 msgr2=0x7fef600d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:34.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 shutdown_connections 2024-09-12T03:37:34.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.650+0000 7fef6672e640 1 -- 172.21.15.73:0/1609401294 wait complete. 2024-09-12T03:37:34.669 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:37:34.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:34.723 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:34.774 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:37:34.774 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:34.774 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:34.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:37:34.781 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:34.781 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:34.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:37:34.787 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:34.787 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:34.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:37:34.829 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:34.829 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:34.836 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:37:34.836 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T03:37:34.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.990+0000 7f81a819f640 1 Processor -- start 2024-09-12T03:37:34.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.990+0000 7f81a819f640 1 -- start start 2024-09-12T03:37:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a819f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f81a0161a60 0x7f81a00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a819f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a819f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81a00cf450 0x7f81a00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:34.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a819f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f81a00d32b0 con 0x7f81a00cf450 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a819f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f81a00d0300 con 0x7f81a0161a60 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a819f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f81a00b0f60 con 0x7f81a00d2e90 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81a00cf450 0x7f81a00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81a00cf450 0x7f81a00d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57478/0 (socket says 172.21.15.73:57478) 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 -- 172.21.15.73:0/655900506 learned_addr learned my addr 172.21.15.73:0/655900506 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a573a640 1 --2- 172.21.15.73:0/655900506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 -- 172.21.15.73:0/655900506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 msgr2=0x7f81a00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 --2- 172.21.15.73:0/655900506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 -- 172.21.15.73:0/655900506 >> v2:172.21.15.150:3300/0 conn(0x7f81a0161a60 msgr2=0x7f81a00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 --2- 172.21.15.73:0/655900506 >> v2:172.21.15.150:3300/0 conn(0x7f81a0161a60 0x7f81a00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 -- 172.21.15.73:0/655900506 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a00cfd40 con 0x7f81a00cf450 2024-09-12T03:37:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a673c640 1 --2- 172.21.15.73:0/655900506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a00cf450 0x7f81a00d0a10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f81a008e010 tx=0x7f819801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c79e93b1d973c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a4f39640 1 -- 172.21.15.73:0/655900506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980a57b0 con 0x7f81a00cf450 2024-09-12T03:37:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a4f39640 1 -- 172.21.15.73:0/655900506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980a5950 con 0x7f81a00cf450 2024-09-12T03:37:34.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.994+0000 7f81a4f39640 1 -- 172.21.15.73:0/655900506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980a5d20 con 0x7f81a00cf450 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/655900506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a00cf450 msgr2=0x7f81a00d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 --2- 172.21.15.73:0/655900506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a00cf450 0x7f81a00d0a10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f81a008e010 tx=0x7f819801c930 comp rx=0 tx=0).stop 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/655900506 shutdown_connections 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 --2- 172.21.15.73:0/655900506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a00cf450 0x7f81a00d0a10 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 --2- 172.21.15.73:0/655900506 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 --2- 172.21.15.73:0/655900506 >> v2:172.21.15.150:3300/0 conn(0x7f81a0161a60 0x7f81a00d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/655900506 >> 172.21.15.73:0/655900506 conn(0x7f81a008bf90 msgr2=0x7f81a009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/655900506 shutdown_connections 2024-09-12T03:37:34.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/655900506 wait complete. 2024-09-12T03:37:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 Processor -- start 2024-09-12T03:37:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- start start 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00cf450 0x7f81a00cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a0161a60 0x7f81a00b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f81a00cfa60 con 0x7f81a0161a60 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f81a00cf8e0 con 0x7f81a00cf450 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f81a006d6b0 con 0x7f81a00d2e90 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a0161a60 0x7f81a00b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a0161a60 0x7f81a00b97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57494/0 (socket says 172.21.15.73:57494) 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 -- 172.21.15.73:0/1257439324 learned_addr learned my addr 172.21.15.73:0/1257439324 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a573a640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 -- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 msgr2=0x7f81a00c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a5f3b640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00cf450 0x7f81a00cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 -- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00cf450 msgr2=0x7f81a00cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00cf450 0x7f81a00cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 -- 172.21.15.73:0/1257439324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a00b71a0 con 0x7f81a0161a60 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a673c640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a0161a60 0x7f81a00b97b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f819801afe0 tx=0x7f81980196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81967fc640 1 -- 172.21.15.73:0/1257439324 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980b8670 con 0x7f81a0161a60 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81967fc640 1 -- 172.21.15.73:0/1257439324 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81980be070 con 0x7f81a0161a60 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a00b7460 con 0x7f81a0161a60 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81967fc640 1 -- 172.21.15.73:0/1257439324 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980b8ab0 con 0x7f81a0161a60 2024-09-12T03:37:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a01581e0 con 0x7f81a0161a60 2024-09-12T03:37:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:34.998+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a00cef10 con 0x7f81a0161a60 2024-09-12T03:37:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.002+0000 7f81967fc640 1 -- 172.21.15.73:0/1257439324 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81980b8c50 con 0x7f81a0161a60 2024-09-12T03:37:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.002+0000 7f81967fc640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f81840678f0 0x7f8184069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.002+0000 7f81967fc640 1 -- 172.21.15.73:0/1257439324 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f8198120ab0 con 0x7f81a0161a60 2024-09-12T03:37:35.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.002+0000 7f81a5f3b640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f81840678f0 0x7f8184069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.002+0000 7f81a5f3b640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f81840678f0 0x7f8184069db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f819c00a790 tx=0x7f819c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:35.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.006+0000 7f81967fc640 1 -- 172.21.15.73:0/1257439324 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81980165e0 con 0x7f81a0161a60 2024-09-12T03:37:35.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.198+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81a015d660 con 0x7f81a0161a60 2024-09-12T03:37:35.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81967fc640 1 -- 172.21.15.73:0/1257439324 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+3911 (secure 0 0 0) 0x7f81980f16e0 con 0x7f81a0161a60 2024-09-12T03:37:35.202 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:35.202 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":43,"btime":"2024-09-12T03:37:30:326217+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/703389966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":703389966},{"type":"v1","addr":"172.21.15.150:6833","nonce":703389966}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/624796455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":624796455},{"type":"v1","addr":"172.21.15.150:6835","nonce":624796455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5886,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3527064235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3527064235},{"type":"v1","addr":"172.21.15.73:6835","nonce":3527064235}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":6168,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1911976280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1911976280},{"type":"v1","addr":"172.21.15.73:6837","nonce":1911976280}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[]} 2024-09-12T03:37:35.202 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 43 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f81840678f0 msgr2=0x7f8184069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f81840678f0 0x7f8184069db0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f819c00a790 tx=0x7f819c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a0161a60 msgr2=0x7f81a00b97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a0161a60 0x7f81a00b97b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f819801afe0 tx=0x7f81980196d0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 shutdown_connections 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f81840678f0 0x7f8184069db0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a0161a60 0x7f81a00b97b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f81a00d2e90 0x7f81a00c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 --2- 172.21.15.73:0/1257439324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81a00cf450 0x7f81a00cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 >> 172.21.15.73:0/1257439324 conn(0x7f81a008bf90 msgr2=0x7f81a00d0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:35.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 shutdown_connections 2024-09-12T03:37:35.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.202+0000 7f81a819f640 1 -- 172.21.15.73:0/1257439324 wait complete. 2024-09-12T03:37:35.219 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T03:37:35.220 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T03:37:35.220 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:37:35.220 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:35.220 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T03:37:35.220 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T03:37:35.220 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:37:35.221 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:35.221 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T03:37:35.221 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T03:37:35.221 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:37:35.221 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:35.221 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T03:37:35.221 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T03:37:35.222 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:37:35.222 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:37:35.229 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:37:35.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T03:37:35.231 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:37:35.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T03:37:35.234 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:37:35.234 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T03:37:35.240 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:37:35.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T03:37:35.274 INFO:tasks.ceph.mds.a:Started 2024-09-12T03:37:35.274 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:35.275 INFO:tasks.ceph.mds.c:Started 2024-09-12T03:37:35.275 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:35.284 INFO:tasks.ceph.mds.b:Started 2024-09-12T03:37:35.285 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:35.285 INFO:tasks.ceph.mds.d:Started 2024-09-12T03:37:35.286 DEBUG:teuthology.parallel:result is None 2024-09-12T03:37:35.286 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T03:37:35.334 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:37:35.338 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:37:35.356 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:37:35.360 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-12T03:37:35.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a55217640 1 Processor -- start 2024-09-12T03:37:35.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a55217640 1 -- start start 2024-09-12T03:37:35.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a55217640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5015d290 0x7f7a5015e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a55217640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5015fc10 con 0x7f7a5006c3d0 2024-09-12T03:37:35.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a55217640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5015d800 con 0x7f7a5015f830 2024-09-12T03:37:35.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a55217640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5015da40 con 0x7f7a5015d290 2024-09-12T03:37:35.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4e59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7a5006c3d0 0x7f7a5015ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37432/0 (socket says 172.21.15.73:37432) 2024-09-12T03:37:35.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4e59c640 1 -- 172.21.15.73:0/569581486 learned_addr learned my addr 172.21.15.73:0/569581486 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4f59e640 1 --2- 172.21.15.73:0/569581486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5015d290 0x7f7a5015e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4dd9b640 1 -- 172.21.15.73:0/569581486 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4899858 0 0) 0x7f7a5015fc10 con 0x7f7a5006c3d0 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4dd9b640 1 -- 172.21.15.73:0/569581486 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a38003530 con 0x7f7a5006c3d0 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4dd9b640 1 -- 172.21.15.73:0/569581486 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281146846 0 0) 0x7f7a5015d800 con 0x7f7a5015f830 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4dd9b640 1 -- 172.21.15.73:0/569581486 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a5015fc10 con 0x7f7a5015f830 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4f59e640 1 -- 172.21.15.73:0/569581486 >> v1:172.21.15.150:6789/0 conn(0x7f7a5015f830 legacy=0x7f7a5006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4f59e640 1 -- 172.21.15.73:0/569581486 >> v1:172.21.15.73:6789/0 conn(0x7f7a5006c3d0 legacy=0x7f7a5015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.394+0000 7f7a4f59e640 1 -- 172.21.15.73:0/569581486 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a500b3570 con 0x7f7a5015d290 2024-09-12T03:37:35.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 --2- 172.21.15.73:0/569581486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5015d290 0x7f7a5015e5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009dc0 tx=0x7f7a5015f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d4058b3c1ffdad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:35.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4dd9b640 1 -- 172.21.15.73:0/569581486 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480b2070 con 0x7f7a5015d290 2024-09-12T03:37:35.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4dd9b640 1 -- 172.21.15.73:0/569581486 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a480a5a20 con 0x7f7a5015d290 2024-09-12T03:37:35.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4dd9b640 1 -- 172.21.15.73:0/569581486 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480a5dd0 con 0x7f7a5015d290 2024-09-12T03:37:35.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- 172.21.15.73:0/569581486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5015d290 msgr2=0x7f7a5015e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 --2- 172.21.15.73:0/569581486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5015d290 0x7f7a5015e5e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009dc0 tx=0x7f7a5015f330 comp rx=0 tx=0).stop 2024-09-12T03:37:35.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- 172.21.15.73:0/569581486 shutdown_connections 2024-09-12T03:37:35.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 --2- 172.21.15.73:0/569581486 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5015d290 0x7f7a5015e5e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- 172.21.15.73:0/569581486 >> 172.21.15.73:0/569581486 conn(0x7f7a500b6800 msgr2=0x7f7a500b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:35.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- 172.21.15.73:0/569581486 shutdown_connections 2024-09-12T03:37:35.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- 172.21.15.73:0/569581486 wait complete. 2024-09-12T03:37:35.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 Processor -- start 2024-09-12T03:37:35.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- start start 2024-09-12T03:37:35.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5006c3d0 0x7f7a50144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a5015d290 0x7f7a5009b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5015f830 0x7f7a5009bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5016a3a0 con 0x7f7a5015f830 2024-09-12T03:37:35.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5016a220 con 0x7f7a5015d290 2024-09-12T03:37:35.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a55217640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5016a520 con 0x7f7a5006c3d0 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5015f830 0x7f7a5009bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5015f830 0x7f7a5009bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57542/0 (socket says 172.21.15.73:57542) 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 -- 172.21.15.73:0/965649891 learned_addr learned my addr 172.21.15.73:0/965649891 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4ed9d640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5006c3d0 0x7f7a50144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4e59c640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a5015d290 0x7f7a5009b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 -- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5006c3d0 msgr2=0x7f7a50144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5006c3d0 0x7f7a50144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 -- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a5015d290 msgr2=0x7f7a5009b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a5015d290 0x7f7a5009b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.398+0000 7f7a4f59e640 1 -- 172.21.15.73:0/965649891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a500b4d50 con 0x7f7a5015f830 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a4f59e640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5015f830 0x7f7a5009bec0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7a480b0040 tx=0x7f7a48019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:35.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a377fe640 1 -- 172.21.15.73:0/965649891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480bc030 con 0x7f7a5015f830 2024-09-12T03:37:35.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a377fe640 1 -- 172.21.15.73:0/965649891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a480ad440 con 0x7f7a5015f830 2024-09-12T03:37:35.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a500b5010 con 0x7f7a5015f830 2024-09-12T03:37:35.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a377fe640 1 -- 172.21.15.73:0/965649891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480b2040 con 0x7f7a5015f830 2024-09-12T03:37:35.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a500b55d0 con 0x7f7a5015f830 2024-09-12T03:37:35.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a5006bcc0 con 0x7f7a5015f830 2024-09-12T03:37:35.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a377fe640 1 -- 172.21.15.73:0/965649891 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a480bf070 con 0x7f7a5015f830 2024-09-12T03:37:35.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a377fe640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a3c0678f0 0x7f7a3c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:35.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a4ed9d640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a3c0678f0 0x7f7a3c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:35.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a377fe640 1 -- 172.21.15.73:0/965649891 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5335+0+0 (secure 0 0 0) 0x7f7a4811fb70 con 0x7f7a5015f830 2024-09-12T03:37:35.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.402+0000 7f7a4ed9d640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a3c0678f0 0x7f7a3c069db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7a50168150 tx=0x7f7a40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:35.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.406+0000 7f7a377fe640 1 -- 172.21.15.73:0/965649891 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a48016580 con 0x7f7a5015f830 2024-09-12T03:37:35.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:35.578+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7a5006e7c0 con 0x7f7a5015f830 2024-09-12T03:37:36.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.366+0000 7f7a377fe640 1 -- 172.21.15.73:0/965649891 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) ==== 97+0+0 (secure 0 0 0) 0x7f7a480f0260 con 0x7f7a5015f830 2024-09-12T03:37:36.368 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a3c0678f0 msgr2=0x7f7a3c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a3c0678f0 0x7f7a3c069db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7a50168150 tx=0x7f7a40009040 comp rx=0 tx=0).stop 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5015f830 msgr2=0x7f7a5009bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5015f830 0x7f7a5009bec0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7a480b0040 tx=0x7f7a48019700 comp rx=0 tx=0).stop 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 shutdown_connections 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7a3c0678f0 0x7f7a3c069db0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5015f830 0x7f7a5009bec0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a5015d290 0x7f7a5009b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 --2- 172.21.15.73:0/965649891 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7a5006c3d0 0x7f7a50144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 >> 172.21.15.73:0/965649891 conn(0x7f7a500b6800 msgr2=0x7f7a5006ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 shutdown_connections 2024-09-12T03:37:36.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.370+0000 7f7a55217640 1 -- 172.21.15.73:0/965649891 wait complete. 2024-09-12T03:37:36.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T03:37:36.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf9a1b8640 1 Processor -- start 2024-09-12T03:37:36.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf9a1b8640 1 -- start start 2024-09-12T03:37:36.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf9a1b8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcf94070020 0x7fcf9415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf9a1b8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcf9415f1d0 0x7fcf940adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf9a1b8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf940aede0 con 0x7fcf941520a0 2024-09-12T03:37:36.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf9a1b8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcf94152480 con 0x7fcf9415f1d0 2024-09-12T03:37:36.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf9a1b8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9415fa10 con 0x7fcf94070020 2024-09-12T03:37:36.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf937fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcf941520a0 0x7fcf9406f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37446/0 (socket says 172.21.15.73:37446) 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf937fe640 1 -- 172.21.15.73:0/605752927 learned_addr learned my addr 172.21.15.73:0/605752927 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf93fff640 1 --2- 172.21.15.73:0/605752927 >> v2:172.21.15.73:3300/0 conn(0x7fcf9415f1d0 0x7fcf940adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf92ffd640 1 -- 172.21.15.73:0/605752927 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230678662 0 0) 0x7fcf940aede0 con 0x7fcf941520a0 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf8bfff640 1 --2- 172.21.15.73:0/605752927 >> v2:172.21.15.150:3300/0 conn(0x7fcf94070020 0x7fcf9415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf92ffd640 1 -- 172.21.15.73:0/605752927 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf80003530 con 0x7fcf941520a0 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf93fff640 1 -- 172.21.15.73:0/605752927 >> v2:172.21.15.150:3300/0 conn(0x7fcf94070020 msgr2=0x7fcf9415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf93fff640 1 --2- 172.21.15.73:0/605752927 >> v2:172.21.15.150:3300/0 conn(0x7fcf94070020 0x7fcf9415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf93fff640 1 -- 172.21.15.73:0/605752927 >> v1:172.21.15.73:6789/0 conn(0x7fcf941520a0 legacy=0x7fcf9406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.514+0000 7fcf93fff640 1 -- 172.21.15.73:0/605752927 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf94074250 con 0x7fcf9415f1d0 2024-09-12T03:37:36.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf93fff640 1 --2- 172.21.15.73:0/605752927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf9415f1d0 0x7fcf940adc80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcf9406e510 tx=0x7fcf8c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554bc5f9ee37865b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:36.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf92ffd640 1 -- 172.21.15.73:0/605752927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0b2070 con 0x7fcf9415f1d0 2024-09-12T03:37:36.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf92ffd640 1 -- 172.21.15.73:0/605752927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf8c0a59c0 con 0x7fcf9415f1d0 2024-09-12T03:37:36.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf92ffd640 1 -- 172.21.15.73:0/605752927 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0a5d90 con 0x7fcf9415f1d0 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/605752927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf9415f1d0 msgr2=0x7fcf940adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/605752927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf9415f1d0 0x7fcf940adc80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fcf9406e510 tx=0x7fcf8c01c900 comp rx=0 tx=0).stop 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/605752927 shutdown_connections 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/605752927 >> v2:172.21.15.150:3300/0 conn(0x7fcf94070020 0x7fcf9415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/605752927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf9415f1d0 0x7fcf940adc80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/605752927 >> 172.21.15.73:0/605752927 conn(0x7fcf940b1f90 msgr2=0x7fcf940b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/605752927 shutdown_connections 2024-09-12T03:37:36.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/605752927 wait complete. 2024-09-12T03:37:36.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 Processor -- start 2024-09-12T03:37:36.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- start start 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf94070020 0x7fcf9414d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf941520a0 0x7fcf94147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf9415f1d0 0x7fcf941464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9415f680 con 0x7fcf94070020 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94073d30 con 0x7fcf9415f1d0 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf9a1b8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcf94167f10 con 0x7fcf941520a0 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf94070020 0x7fcf9414d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf94070020 0x7fcf9414d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57556/0 (socket says 172.21.15.73:57556) 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.518+0000 7fcf937fe640 1 -- 172.21.15.73:0/2739162610 learned_addr learned my addr 172.21.15.73:0/2739162610 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:36.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf93fff640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf9415f1d0 0x7fcf941464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf8bfff640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf941520a0 0x7fcf94147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf937fe640 1 -- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf941520a0 msgr2=0x7fcf94147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf937fe640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf941520a0 0x7fcf94147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf937fe640 1 -- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf9415f1d0 msgr2=0x7fcf941464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf937fe640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf9415f1d0 0x7fcf941464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf937fe640 1 -- 172.21.15.73:0/2739162610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9406f580 con 0x7fcf94070020 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf93fff640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf9415f1d0 0x7fcf941464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf8bfff640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf941520a0 0x7fcf94147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf937fe640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf94070020 0x7fcf9414d810 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c450 tx=0x7fcf8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf90ff9640 1 -- 172.21.15.73:0/2739162610 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84017070 con 0x7fcf94070020 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf90ff9640 1 -- 172.21.15.73:0/2739162610 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf84005cf0 con 0x7fcf94070020 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf90ff9640 1 -- 172.21.15.73:0/2739162610 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84007290 con 0x7fcf94070020 2024-09-12T03:37:36.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf94153230 con 0x7fcf94070020 2024-09-12T03:37:36.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf941537f0 con 0x7fcf94070020 2024-09-12T03:37:36.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf94153020 con 0x7fcf94070020 2024-09-12T03:37:36.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf90ff9640 1 -- 172.21.15.73:0/2739162610 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf8401a070 con 0x7fcf94070020 2024-09-12T03:37:36.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf90ff9640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcf740678c0 0x7fcf74069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf8bfff640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcf740678c0 0x7fcf74069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf90ff9640 1 -- 172.21.15.73:0/2739162610 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7fcf84084f20 con 0x7fcf94070020 2024-09-12T03:37:36.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.522+0000 7fcf8bfff640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcf740678c0 0x7fcf74069d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcf940ae090 tx=0x7fcf7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:36.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.526+0000 7fcf90ff9640 1 -- 172.21.15.73:0/2739162610 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf84055c20 con 0x7fcf94070020 2024-09-12T03:37:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.746+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcf9415ec90 con 0x7fcf94070020 2024-09-12T03:37:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf90ff9640 1 -- 172.21.15.73:0/2739162610 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fcf84055520 con 0x7fcf94070020 2024-09-12T03:37:36.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:36.750 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:37:36.750 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-09-12T03:37:36.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.750 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ==", 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw==", 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA==", 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:36.752 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ==", 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:36.753 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg==", 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.754 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw==", 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig==", 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ==", 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.756 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A==", 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.757 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg==", 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-09-12T03:37:36.758 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ==", 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g==", 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.759 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg==", 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-09-12T03:37:36.760 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA==", 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw==", 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.761 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ==", 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:37:36.762 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQASYeJmw4+ENRAAkTAy3UFY3keAJJFJvyQaAA==", 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-09-12T03:37:36.763 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw==", 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA==", 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:37:36.764 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:37:36.765 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.765 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:36.765 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T03:37:36.765 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcf740678c0 msgr2=0x7fcf74069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcf740678c0 0x7fcf74069d80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcf940ae090 tx=0x7fcf7c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf94070020 msgr2=0x7fcf9414d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf94070020 0x7fcf9414d810 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400c450 tx=0x7fcf8400c910 comp rx=0 tx=0).stop 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 shutdown_connections 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcf740678c0 0x7fcf74069d80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcf9415f1d0 0x7fcf941464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcf941520a0 0x7fcf94147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 --2- 172.21.15.73:0/2739162610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf94070020 0x7fcf9414d810 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 >> 172.21.15.73:0/2739162610 conn(0x7fcf940b1f90 msgr2=0x7fcf94151300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:36.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 shutdown_connections 2024-09-12T03:37:36.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.750+0000 7fcf9a1b8640 1 -- 172.21.15.73:0/2739162610 wait complete. 2024-09-12T03:37:36.768 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T03:37:36.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.874+0000 7f2c16312640 1 Processor -- start 2024-09-12T03:37:36.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.874+0000 7f2c16312640 1 -- start start 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c16312640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c10161a60 0x7f2c100d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c16312640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 0x7f2c100cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c16312640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c100d32b0 con 0x7f2c100cf450 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c16312640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2c100d0300 con 0x7f2c10161a60 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c16312640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1006e6c0 con 0x7f2c100d2e90 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c10161a60 0x7f2c100d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c148af640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2c100cf450 0x7f2c100d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37452/0 (socket says 172.21.15.73:37452) 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c148af640 1 -- 172.21.15.73:0/743344847 learned_addr learned my addr 172.21.15.73:0/743344847 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0ffff640 1 -- 172.21.15.73:0/743344847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 msgr2=0x7f2c100cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0ffff640 1 --2- 172.21.15.73:0/743344847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 0x7f2c100cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0ffff640 1 -- 172.21.15.73:0/743344847 >> v1:172.21.15.73:6789/0 conn(0x7f2c100cf450 legacy=0x7f2c100d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0ffff640 1 -- 172.21.15.73:0/743344847 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c100b0f60 con 0x7f2c10161a60 2024-09-12T03:37:36.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0f7fe640 1 -- 172.21.15.73:0/743344847 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885787164 0 0) 0x7f2c100d32b0 con 0x7f2c100cf450 2024-09-12T03:37:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0ffff640 1 --2- 172.21.15.73:0/743344847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c100d2950 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2c000097c0 tx=0x7f2c0001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66bb3c1d8210463 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0f7fe640 1 -- 172.21.15.73:0/743344847 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000b1070 con 0x7f2c10161a60 2024-09-12T03:37:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0f7fe640 1 -- 172.21.15.73:0/743344847 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c000a8050 con 0x7f2c10161a60 2024-09-12T03:37:36.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.878+0000 7f2c0f7fe640 1 -- 172.21.15.73:0/743344847 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c100d1930 con 0x7f2c10161a60 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- 172.21.15.73:0/743344847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 msgr2=0x7f2c100d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 --2- 172.21.15.73:0/743344847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c100d2950 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2c000097c0 tx=0x7f2c0001c3e0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- 172.21.15.73:0/743344847 shutdown_connections 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 --2- 172.21.15.73:0/743344847 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 0x7f2c100cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 --2- 172.21.15.73:0/743344847 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c100d2950 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- 172.21.15.73:0/743344847 >> 172.21.15.73:0/743344847 conn(0x7f2c1008bf90 msgr2=0x7f2c1009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- 172.21.15.73:0/743344847 shutdown_connections 2024-09-12T03:37:36.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- 172.21.15.73:0/743344847 wait complete. 2024-09-12T03:37:36.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 Processor -- start 2024-09-12T03:37:36.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- start start 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c100cf450 0x7f2c100b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 0x7f2c100b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c1015c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2c100cf8a0 con 0x7f2c10161a60 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1006d190 con 0x7f2c100cf450 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2c100cfa20 con 0x7f2c100d2e90 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c1015c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c1015c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57568/0 (socket says 172.21.15.73:57568) 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 -- 172.21.15.73:0/1806948735 learned_addr learned my addr 172.21.15.73:0/1806948735 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c077fe640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 0x7f2c100b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c0ffff640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c100cf450 0x7f2c100b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 -- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 msgr2=0x7f2c100b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 0x7f2c100b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 -- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c100cf450 msgr2=0x7f2c100b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c100cf450 0x7f2c100b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 -- 172.21.15.73:0/1806948735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c100b8240 con 0x7f2c10161a60 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c0ffff640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c100cf450 0x7f2c100b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c148af640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c1015c480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c7a0 tx=0x7f2c0800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c0d7fa640 1 -- 172.21.15.73:0/1806948735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08018070 con 0x7f2c10161a60 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c0d7fa640 1 -- 172.21.15.73:0/1806948735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0800a640 con 0x7f2c10161a60 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c100b8520 con 0x7f2c10161a60 2024-09-12T03:37:36.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c0d7fa640 1 -- 172.21.15.73:0/1806948735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800aab0 con 0x7f2c10161a60 2024-09-12T03:37:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.882+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c100b8ae0 con 0x7f2c10161a60 2024-09-12T03:37:36.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.886+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c100cef10 con 0x7f2c10161a60 2024-09-12T03:37:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.886+0000 7f2c0d7fa640 1 -- 172.21.15.73:0/1806948735 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c0801b070 con 0x7f2c10161a60 2024-09-12T03:37:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.886+0000 7f2c0d7fa640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2bf00678c0 0x7f2bf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.886+0000 7f2c0d7fa640 1 -- 172.21.15.73:0/1806948735 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f2c08085150 con 0x7f2c10161a60 2024-09-12T03:37:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.886+0000 7f2c0ffff640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2bf00678c0 0x7f2bf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:36.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.886+0000 7f2c0ffff640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2bf00678c0 0x7f2bf0069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2c000ae000 tx=0x7f2c00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:36.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:36.890+0000 7f2c0d7fa640 1 -- 172.21.15.73:0/1806948735 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c08055e50 con 0x7f2c10161a60 2024-09-12T03:37:37.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.050+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2c100d1be0 con 0x7f2c10161a60 2024-09-12T03:37:37.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.050+0000 7f2c0d7fa640 1 -- 172.21.15.73:0/1806948735 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f2c08055750 con 0x7f2c10161a60 2024-09-12T03:37:37.053 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:37.053 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T03:37:37.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:37:37.053 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T03:37:37.053 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T03:37:37.053 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:37.053 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2bf00678c0 msgr2=0x7f2bf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2bf00678c0 0x7f2bf0069d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2c000ae000 tx=0x7f2c00008040 comp rx=0 tx=0).stop 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 msgr2=0x7f2c1015c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c1015c480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c7a0 tx=0x7f2c0800cc60 comp rx=0 tx=0).stop 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 shutdown_connections 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2bf00678c0 0x7f2bf0069d80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c10161a60 0x7f2c1015c480 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2c100d2e90 0x7f2c100b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 --2- 172.21.15.73:0/1806948735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c100cf450 0x7f2c100b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 >> 172.21.15.73:0/1806948735 conn(0x7f2c1008bf90 msgr2=0x7f2c100b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:37.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 shutdown_connections 2024-09-12T03:37:37.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.054+0000 7f2c16312640 1 -- 172.21.15.73:0/1806948735 wait complete. 2024-09-12T03:37:37.071 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T03:37:37.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T03:37:37.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f2114e9d640 1 Processor -- start 2024-09-12T03:37:37.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f2114e9d640 1 -- start start 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f2114e9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211015e5f0 0x7f211006d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f2114e9d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f21100ce9d0 0x7f21100cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f2114e9d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211006d9c0 con 0x7f21100cf920 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f2114e9d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f211006dca0 con 0x7f21100ce9d0 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f2114e9d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f211006df80 con 0x7f211015e5f0 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f21100cf920 0x7f21100d0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37456/0 (socket says 172.21.15.73:37456) 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 -- 172.21.15.73:0/3709015929 learned_addr learned my addr 172.21.15.73:0/3709015929 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210e59c640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211015e5f0 0x7f211006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2249949874 0 0) 0x7f211006d9c0 con 0x7f21100cf920 2024-09-12T03:37:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210dd9b640 1 --2- 172.21.15.73:0/3709015929 >> v2:172.21.15.150:3300/0 conn(0x7f21100ce9d0 0x7f21100cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20fc003530 con 0x7f21100cf920 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2402082977 0 0) 0x7f20fc003530 con 0x7f21100cf920 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211015e5f0 msgr2=0x7f211006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211015e5f0 0x7f211006d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 >> v2:172.21.15.150:3300/0 conn(0x7f21100ce9d0 msgr2=0x7f21100cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 --2- 172.21.15.73:0/3709015929 >> v2:172.21.15.150:3300/0 conn(0x7f21100ce9d0 0x7f21100cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211006e260 con 0x7f21100cf920 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f2108001a00 con 0x7f21100cf920 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 >> v1:172.21.15.73:6789/0 conn(0x7f21100cf920 legacy=0x7f21100d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0039c0 0x7f20fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20fc004810 0x7f20fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc005190 0x7f20fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f211006dca0 con 0x7f20fc005190 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f211006df80 con 0x7f20fc0039c0 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f20fc004610 con 0x7f20fc004810 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc005190 0x7f20fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210e59c640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0039c0 0x7f20fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 -- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20fc004810 msgr2=0x7f20fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f20fc004810 0x7f20fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 -- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0039c0 msgr2=0x7f20fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20fc0039c0 0x7f20fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.194+0000 7f210ed9d640 1 -- 172.21.15.73:0/3709015929 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc003530 con 0x7f20fc005190 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f210ed9d640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc005190 0x7f20fc00b9d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f210800a870 tx=0x7f210801d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631029b1e8038faa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210800a4c0 con 0x7f20fc005190 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21080072d0 con 0x7f20fc005190 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f210d59a640 1 -- 172.21.15.73:0/3709015929 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21080076c0 con 0x7f20fc005190 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f2114e9d640 1 -- 172.21.15.73:0/3709015929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc005190 msgr2=0x7f20fc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f2114e9d640 1 --2- 172.21.15.73:0/3709015929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20fc005190 0x7f20fc00b9d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f210800a870 tx=0x7f210801d3a0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f210ed9d640 1 -- 172.21.15.73:0/3709015929 reap_dead start 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f2114e9d640 1 -- 172.21.15.73:0/3709015929 shutdown_connections 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f2114e9d640 1 -- 172.21.15.73:0/3709015929 >> 172.21.15.73:0/3709015929 conn(0x7f2110074030 msgr2=0x7f211009d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f2114e9d640 1 -- 172.21.15.73:0/3709015929 shutdown_connections 2024-09-12T03:37:37.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.198+0000 7f2114e9d640 1 -- 172.21.15.73:0/3709015929 wait complete. 2024-09-12T03:37:37.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 Processor -- start 2024-09-12T03:37:37.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 -- start start 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21101f3220 0x7f21100b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21100b8d10 0x7f2110161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211014d410 0x7f211014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f211006d210 con 0x7f21100b8d10 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f211006d090 con 0x7f21101f3220 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f211006d390 con 0x7f211014d410 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21100b8d10 0x7f2110161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21100b8d10 0x7f2110161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57580/0 (socket says 172.21.15.73:57580) 2024-09-12T03:37:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 -- 172.21.15.73:0/1652098331 learned_addr learned my addr 172.21.15.73:0/1652098331 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210e59c640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21101f3220 0x7f21100b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210ed9d640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211014d410 0x7f211014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 -- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211014d410 msgr2=0x7f211014d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211014d410 0x7f211014d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 -- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21101f3220 msgr2=0x7f21100b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21101f3220 0x7f21100b7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 -- 172.21.15.73:0/1652098331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2110161a50 con 0x7f21100b8d10 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f210dd9b640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21100b8d10 0x7f2110161510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f20f800e890 tx=0x7f20f800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2106ffd640 1 -- 172.21.15.73:0/1652098331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8017070 con 0x7f21100b8d10 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21100b7c70 con 0x7f21100b8d10 2024-09-12T03:37:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2106ffd640 1 -- 172.21.15.73:0/1652098331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f800c860 con 0x7f21100b8d10 2024-09-12T03:37:37.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2106ffd640 1 -- 172.21.15.73:0/1652098331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f800cc50 con 0x7f21100b8d10 2024-09-12T03:37:37.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21100b8230 con 0x7f21100b8d10 2024-09-12T03:37:37.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.202+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211014b0a0 con 0x7f21100b8d10 2024-09-12T03:37:37.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.206+0000 7f2106ffd640 1 -- 172.21.15.73:0/1652098331 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20f801a070 con 0x7f21100b8d10 2024-09-12T03:37:37.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.206+0000 7f2106ffd640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20f00678c0 0x7f20f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:37.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.206+0000 7f2106ffd640 1 -- 172.21.15.73:0/1652098331 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5249+0+0 (secure 0 0 0) 0x7f20f8085d70 con 0x7f21100b8d10 2024-09-12T03:37:37.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.206+0000 7f210e59c640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20f00678c0 0x7f20f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:37.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.206+0000 7f210e59c640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20f00678c0 0x7f20f0069d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2100009a30 tx=0x7f2100008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.210+0000 7f2106ffd640 1 -- 172.21.15.73:0/1652098331 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f211014b0a0 con 0x7f21100b8d10 2024-09-12T03:37:37.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:37.374+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f211015e5f0 con 0x7f21100b8d10 2024-09-12T03:37:37.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:37:37.683 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:37:38.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.374+0000 7f2106ffd640 1 -- 172.21.15.73:0/1652098331 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f20f80569f0 con 0x7f21100b8d10 2024-09-12T03:37:38.376 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T03:37:38.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.378+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20f00678c0 msgr2=0x7f20f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:38.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.378+0000 7f2114e9d640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20f00678c0 0x7f20f0069d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2100009a30 tx=0x7f2100008040 comp rx=0 tx=0).stop 2024-09-12T03:37:38.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.378+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21100b8d10 msgr2=0x7f2110161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:38.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.378+0000 7f2114e9d640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21100b8d10 0x7f2110161510 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f20f800e890 tx=0x7f20f800ed50 comp rx=0 tx=0).stop 2024-09-12T03:37:38.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.378+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 shutdown_connections 2024-09-12T03:37:38.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.378+0000 7f2114e9d640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f20f00678c0 0x7f20f0069d80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.382+0000 7f2114e9d640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21100b8d10 0x7f2110161510 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.382+0000 7f2114e9d640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f211014d410 0x7f211014d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.382+0000 7f2114e9d640 1 --2- 172.21.15.73:0/1652098331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21101f3220 0x7f21100b7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.382+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 >> 172.21.15.73:0/1652098331 conn(0x7f20fc005190 msgr2=0x7f2110074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.382+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 shutdown_connections 2024-09-12T03:37:38.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.382+0000 7f2114e9d640 1 -- 172.21.15.73:0/1652098331 wait complete. 2024-09-12T03:37:38.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T03:37:38.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.538+0000 7fb0c29d7640 1 Processor -- start 2024-09-12T03:37:38.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.538+0000 7fb0c29d7640 1 -- start start 2024-09-12T03:37:38.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb0bc06ccd0 0x7fb0bc06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:38.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb0bc0cf7f0 0x7fb0bc0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:38.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0bc06d5f0 con 0x7fb0bc0b4bd0 2024-09-12T03:37:38.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb0bc06f7e0 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fb0bc0d0560 con 0x7fb0bc0cf7f0 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c0f74640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb0bc0b4bd0 0x7fb0bc0b4fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37472/0 (socket says 172.21.15.73:37472) 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c0f74640 1 -- 172.21.15.73:0/239812658 learned_addr learned my addr 172.21.15.73:0/239812658 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bbfff640 1 --2- 172.21.15.73:0/239812658 >> v2:172.21.15.73:3300/0 conn(0x7fb0bc06ccd0 0x7fb0bc06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0b3fff640 1 --2- 172.21.15.73:0/239812658 >> v2:172.21.15.150:3300/0 conn(0x7fb0bc0cf7f0 0x7fb0bc0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bb7fe640 1 -- 172.21.15.73:0/239812658 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321081182 0 0) 0x7fb0bc06d5f0 con 0x7fb0bc0b4bd0 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bb7fe640 1 -- 172.21.15.73:0/239812658 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a8003530 con 0x7fb0bc0b4bd0 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bbfff640 1 -- 172.21.15.73:0/239812658 >> v2:172.21.15.150:3300/0 conn(0x7fb0bc0cf7f0 msgr2=0x7fb0bc0cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bbfff640 1 --2- 172.21.15.73:0/239812658 >> v2:172.21.15.150:3300/0 conn(0x7fb0bc0cf7f0 0x7fb0bc0cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bbfff640 1 -- 172.21.15.73:0/239812658 >> v1:172.21.15.73:6789/0 conn(0x7fb0bc0b4bd0 legacy=0x7fb0bc0b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:38.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bbfff640 1 -- 172.21.15.73:0/239812658 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc06f190 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bbfff640 1 --2- 172.21.15.73:0/239812658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc06d0b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0b6090 tx=0x7fb0ac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885c4134200acc72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:38.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bb7fe640 1 -- 172.21.15.73:0/239812658 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0b0070 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bb7fe640 1 -- 172.21.15.73:0/239812658 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac0ab600 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0bb7fe640 1 -- 172.21.15.73:0/239812658 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0ab9d0 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- 172.21.15.73:0/239812658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 msgr2=0x7fb0bc06d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:38.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/239812658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc06d0b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0b6090 tx=0x7fb0ac01c480 comp rx=0 tx=0).stop 2024-09-12T03:37:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- 172.21.15.73:0/239812658 shutdown_connections 2024-09-12T03:37:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/239812658 >> v2:172.21.15.150:3300/0 conn(0x7fb0bc0cf7f0 0x7fb0bc0cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/239812658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc06d0b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- 172.21.15.73:0/239812658 >> 172.21.15.73:0/239812658 conn(0x7fb0bc072840 msgr2=0x7fb0bc072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- 172.21.15.73:0/239812658 shutdown_connections 2024-09-12T03:37:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.542+0000 7fb0c29d7640 1 -- 172.21.15.73:0/239812658 wait complete. 2024-09-12T03:37:38.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 Processor -- start 2024-09-12T03:37:38.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 -- start start 2024-09-12T03:37:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0bc0b4bd0 0x7fb0bc13e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0bc0cf7f0 0x7fb0bc13ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc168510 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb0bc168390 con 0x7fb0bc0cf7f0 2024-09-12T03:37:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb0bc168690 con 0x7fb0bc0b4bd0 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57608/0 (socket says 172.21.15.73:57608) 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 -- 172.21.15.73:0/783609448 learned_addr learned my addr 172.21.15.73:0/783609448 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 -- 172.21.15.73:0/783609448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0bc0b4bd0 msgr2=0x7fb0bc13e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0bc0b4bd0 0x7fb0bc13e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 -- 172.21.15.73:0/783609448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0bc0cf7f0 msgr2=0x7fb0bc13ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0bc0cf7f0 0x7fb0bc13ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 -- 172.21.15.73:0/783609448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0bc13da90 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0bbfff640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc155180 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0ae040 tx=0x7fb0ac019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0b97fa640 1 -- 172.21.15.73:0/783609448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0b8020 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0b97fa640 1 -- 172.21.15.73:0/783609448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac0b4410 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0bc13dff0 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0b97fa640 1 -- 172.21.15.73:0/783609448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0b0040 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0bc13b1b0 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.546+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0bc0cfc60 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.550+0000 7fb0b97fa640 1 -- 172.21.15.73:0/783609448 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0ac0bb020 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.550+0000 7fb0b97fa640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb09c0678c0 0x7fb09c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.550+0000 7fb0b97fa640 1 -- 172.21.15.73:0/783609448 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5619+0+0 (secure 0 0 0) 0x7fb0ac11f6c0 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.550+0000 7fb0b3fff640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb09c0678c0 0x7fb09c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.550+0000 7fb0b3fff640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb09c0678c0 0x7fb09c069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0aaa30 tx=0x7fb0a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.554+0000 7fb0b97fa640 1 -- 172.21.15.73:0/783609448 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb0ac0c2030 con 0x7fb0bc06ccd0 2024-09-12T03:37:38.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:38.718+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb0bc156f10 con 0x7fb0bc06ccd0 2024-09-12T03:37:39.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.390+0000 7fb0b97fa640 1 -- 172.21.15.73:0/783609448 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7fb0bc13da90 con 0x7fb0bc06ccd0 2024-09-12T03:37:39.391 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T03:37:39.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb09c0678c0 msgr2=0x7fb09c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb09c0678c0 0x7fb09c069d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0aaa30 tx=0x7fb0a4008040 comp rx=0 tx=0).stop 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 msgr2=0x7fb0bc155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc155180 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0ae040 tx=0x7fb0ac019220 comp rx=0 tx=0).stop 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 shutdown_connections 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb09c0678c0 0x7fb09c069d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0bc0cf7f0 0x7fb0bc13ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb0bc0b4bd0 0x7fb0bc13e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 --2- 172.21.15.73:0/783609448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc06ccd0 0x7fb0bc155180 secure :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0ae040 tx=0x7fb0ac019220 comp rx=0 tx=0).stop 2024-09-12T03:37:39.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 >> 172.21.15.73:0/783609448 conn(0x7fb0bc072840 msgr2=0x7fb0bc072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 shutdown_connections 2024-09-12T03:37:39.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.394+0000 7fb0c29d7640 1 -- 172.21.15.73:0/783609448 wait complete. 2024-09-12T03:37:39.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T03:37:39.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.546+0000 7f0f531ed640 1 Processor -- start 2024-09-12T03:37:39.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f531ed640 1 -- start start 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f531ed640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f4c15bec0 0x7f0f4c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f531ed640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0f4c0af470 0x7f0f4c06e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f531ed640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c0b3290 con 0x7f0f4c15c2a0 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f531ed640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4c0b3570 con 0x7f0f4c15bec0 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f531ed640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4c0b3850 con 0x7f0f4c0af470 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f4c15bec0 0x7f0f4c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f4c15bec0 0x7f0f4c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57624/0 (socket says 172.21.15.73:57624) 2024-09-12T03:37:39.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f4bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f4c15c2a0 0x7f0f4c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37484/0 (socket says 172.21.15.73:37484) 2024-09-12T03:37:39.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 -- 172.21.15.73:0/2383169719 learned_addr learned my addr 172.21.15.73:0/2383169719 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:39.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f5178a640 1 --2- 172.21.15.73:0/2383169719 >> v2:172.21.15.150:3300/0 conn(0x7f0f4c0af470 0x7f0f4c06e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:39.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 -- 172.21.15.73:0/2383169719 >> v2:172.21.15.150:3300/0 conn(0x7f0f4c0af470 msgr2=0x7f0f4c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:39.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 --2- 172.21.15.73:0/2383169719 >> v2:172.21.15.150:3300/0 conn(0x7f0f4c0af470 0x7f0f4c06e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 -- 172.21.15.73:0/2383169719 >> v1:172.21.15.73:6789/0 conn(0x7f0f4c15c2a0 legacy=0x7f0f4c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:39.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 -- 172.21.15.73:0/2383169719 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c0b3b30 con 0x7f0f4c15bec0 2024-09-12T03:37:39.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f5178a640 1 --2- 172.21.15.73:0/2383169719 >> v2:172.21.15.150:3300/0 conn(0x7f0f4c0af470 0x7f0f4c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:39.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f50f89640 1 --2- 172.21.15.73:0/2383169719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c0ad200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b2fb0 tx=0x7f0f3401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d9f75e069753a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:39.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f4b7fe640 1 -- 172.21.15.73:0/2383169719 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340ab600 con 0x7f0f4c15bec0 2024-09-12T03:37:39.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f4b7fe640 1 -- 172.21.15.73:0/2383169719 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f340b0070 con 0x7f0f4c15bec0 2024-09-12T03:37:39.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.550+0000 7f0f4b7fe640 1 -- 172.21.15.73:0/2383169719 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340ab9c0 con 0x7f0f4c15bec0 2024-09-12T03:37:39.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- 172.21.15.73:0/2383169719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 msgr2=0x7f0f4c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:39.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2383169719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c0ad200 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b2fb0 tx=0x7f0f3401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- 172.21.15.73:0/2383169719 shutdown_connections 2024-09-12T03:37:39.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2383169719 >> v2:172.21.15.150:3300/0 conn(0x7f0f4c0af470 0x7f0f4c06e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2383169719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c0ad200 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- 172.21.15.73:0/2383169719 >> 172.21.15.73:0/2383169719 conn(0x7f0f4c0b1f90 msgr2=0x7f0f4c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:39.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- 172.21.15.73:0/2383169719 shutdown_connections 2024-09-12T03:37:39.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- 172.21.15.73:0/2383169719 wait complete. 2024-09-12T03:37:39.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 Processor -- start 2024-09-12T03:37:39.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- start start 2024-09-12T03:37:39.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f4c0af470 0x7f0f4c14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f4c15c2a0 0x7f0f4c153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c06ed50 con 0x7f0f4c15bec0 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c0ad740 con 0x7f0f4c15c2a0 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c06eed0 con 0x7f0f4c0af470 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57638/0 (socket says 172.21.15.73:57638) 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 -- 172.21.15.73:0/2747409375 learned_addr learned my addr 172.21.15.73:0/2747409375 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f50f89640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f4c0af470 0x7f0f4c14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f5178a640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f4c15c2a0 0x7f0f4c153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:39.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 -- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f4c0af470 msgr2=0x7f0f4c14ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f4c0af470 0x7f0f4c14ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 -- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f4c15c2a0 msgr2=0x7f0f4c153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f4c15c2a0 0x7f0f4c153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 -- 172.21.15.73:0/2747409375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c151870 con 0x7f0f4c15bec0 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f4bfff640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c152630 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c730 tx=0x7f0f4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f497fa640 1 -- 172.21.15.73:0/2747409375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44017070 con 0x7f0f4c15bec0 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f497fa640 1 -- 172.21.15.73:0/2747409375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400ce40 con 0x7f0f4c15bec0 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c151b50 con 0x7f0f4c15bec0 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f497fa640 1 -- 172.21.15.73:0/2747409375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400a7e0 con 0x7f0f4c15bec0 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.554+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c152110 con 0x7f0f4c15bec0 2024-09-12T03:37:39.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.558+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4c152310 con 0x7f0f4c15bec0 2024-09-12T03:37:39.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.558+0000 7f0f497fa640 1 -- 172.21.15.73:0/2747409375 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f4401a070 con 0x7f0f4c15bec0 2024-09-12T03:37:39.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.558+0000 7f0f497fa640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0f2c0678c0 0x7f0f2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:39.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.558+0000 7f0f50f89640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0f2c0678c0 0x7f0f2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:39.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.558+0000 7f0f497fa640 1 -- 172.21.15.73:0/2747409375 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6001+0+0 (secure 0 0 0) 0x7f0f440856e0 con 0x7f0f4c15bec0 2024-09-12T03:37:39.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.558+0000 7f0f50f89640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0f2c0678c0 0x7f0f2c069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0f340af000 tx=0x7f0f34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:39.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.562+0000 7f0f497fa640 1 -- 172.21.15.73:0/2747409375 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0f4c152310 con 0x7f0f4c15bec0 2024-09-12T03:37:39.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:39.758+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0f4c06f230 con 0x7f0f4c15bec0 2024-09-12T03:37:40.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.390+0000 7f0f497fa640 1 -- 172.21.15.73:0/2747409375 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v46) ==== 174+0+0 (secure 0 0 0) 0x7f0f44055b10 con 0x7f0f4c15bec0 2024-09-12T03:37:40.393 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 13 and data pool 14 2024-09-12T03:37:40.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.394+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0f2c0678c0 msgr2=0x7f0f2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.398+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0f2c0678c0 0x7f0f2c069d80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0f340af000 tx=0x7f0f34008040 comp rx=0 tx=0).stop 2024-09-12T03:37:40.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.398+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 msgr2=0x7f0f4c152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.398+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c152630 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c730 tx=0x7f0f4400cbf0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.402+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 shutdown_connections 2024-09-12T03:37:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.402+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0f2c0678c0 0x7f0f2c069d80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.402+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f4c15bec0 0x7f0f4c152630 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.402+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f4c15c2a0 0x7f0f4c153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.402+0000 7f0f531ed640 1 --2- 172.21.15.73:0/2747409375 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0f4c0af470 0x7f0f4c14ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.402+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 >> 172.21.15.73:0/2747409375 conn(0x7f0f4c0b1f90 msgr2=0x7f0f4c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:40.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.406+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 shutdown_connections 2024-09-12T03:37:40.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.406+0000 7f0f531ed640 1 -- 172.21.15.73:0/2747409375 wait complete. 2024-09-12T03:37:40.450 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:40.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba3779640 1 Processor -- start 2024-09-12T03:37:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba3779640 1 -- start start 2024-09-12T03:37:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba3779640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b9c15bec0 0x7f8b9c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba3779640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8b9c15c2a0 0x7f8b9c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba3779640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b9c0b3290 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba3779640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9c0b3570 con 0x7f8b9c15bec0 2024-09-12T03:37:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba3779640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9c0b3850 con 0x7f8b9c15c2a0 2024-09-12T03:37:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba1515640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b9c15bec0 0x7f8b9c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba1515640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b9c15bec0 0x7f8b9c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57648/0 (socket says 172.21.15.73:57648) 2024-09-12T03:37:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.562+0000 7f8ba1515640 1 -- 172.21.15.73:0/125628925 learned_addr learned my addr 172.21.15.73:0/125628925 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba0d14640 1 --2- 172.21.15.73:0/125628925 >> v2:172.21.15.150:3300/0 conn(0x7f8b9c15c2a0 0x7f8b9c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba1515640 1 -- 172.21.15.73:0/125628925 >> v2:172.21.15.150:3300/0 conn(0x7f8b9c15c2a0 msgr2=0x7f8b9c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba1515640 1 --2- 172.21.15.73:0/125628925 >> v2:172.21.15.150:3300/0 conn(0x7f8b9c15c2a0 0x7f8b9c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba1515640 1 -- 172.21.15.73:0/125628925 >> v1:172.21.15.150:6789/0 conn(0x7f8b9c0af2a0 legacy=0x7f8b9c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba1515640 1 -- 172.21.15.73:0/125628925 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c0b3b30 con 0x7f8b9c15bec0 2024-09-12T03:37:40.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba0d14640 1 --2- 172.21.15.73:0/125628925 >> v2:172.21.15.150:3300/0 conn(0x7f8b9c15c2a0 0x7f8b9c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba1515640 1 --2- 172.21.15.73:0/125628925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c15bec0 0x7f8b9c0ad200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0ae510 tx=0x7f8b9801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6c2190a272066b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8b93fff640 1 -- 172.21.15.73:0/125628925 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b980aa650 con 0x7f8b9c15bec0 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8b93fff640 1 -- 172.21.15.73:0/125628925 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b980af070 con 0x7f8b9c15bec0 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8b93fff640 1 -- 172.21.15.73:0/125628925 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b980aaa10 con 0x7f8b9c15bec0 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 -- 172.21.15.73:0/125628925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c15bec0 msgr2=0x7f8b9c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 --2- 172.21.15.73:0/125628925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c15bec0 0x7f8b9c0ad200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0ae510 tx=0x7f8b9801c4f0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 -- 172.21.15.73:0/125628925 shutdown_connections 2024-09-12T03:37:40.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 --2- 172.21.15.73:0/125628925 >> v2:172.21.15.150:3300/0 conn(0x7f8b9c15c2a0 0x7f8b9c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 --2- 172.21.15.73:0/125628925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c15bec0 0x7f8b9c0ad200 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 -- 172.21.15.73:0/125628925 >> 172.21.15.73:0/125628925 conn(0x7f8b9c0b1f90 msgr2=0x7f8b9c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:40.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 -- 172.21.15.73:0/125628925 shutdown_connections 2024-09-12T03:37:40.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.566+0000 7f8ba3779640 1 -- 172.21.15.73:0/125628925 wait complete. 2024-09-12T03:37:40.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 Processor -- start 2024-09-12T03:37:40.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 -- start start 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c0af2a0 0x7f8b9c15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b9c15bec0 0x7f8b9c09b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b9c15c2a0 0x7f8b9c09a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c0af6b0 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c0ad740 con 0x7f8b9c15bec0 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c169000 con 0x7f8b9c15c2a0 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c0af2a0 0x7f8b9c15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c0af2a0 0x7f8b9c15d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57654/0 (socket says 172.21.15.73:57654) 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 -- 172.21.15.73:0/1756660385 learned_addr learned my addr 172.21.15.73:0/1756660385 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba0d14640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b9c15bec0 0x7f8b9c09b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1d16640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b9c15c2a0 0x7f8b9c09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 -- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b9c15c2a0 msgr2=0x7f8b9c09a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b9c15c2a0 0x7f8b9c09a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 -- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b9c15bec0 msgr2=0x7f8b9c09b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b9c15bec0 0x7f8b9c09b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 -- 172.21.15.73:0/1756660385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c09ad20 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1d16640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b9c15c2a0 0x7f8b9c09a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba1515640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c0af2a0 0x7f8b9c15d2f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8b9801a120 tx=0x7f8b9801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8b91ffb640 1 -- 172.21.15.73:0/1756660385 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b980bd5f0 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8b91ffb640 1 -- 172.21.15.73:0/1756660385 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b980a6040 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c15c810 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8b91ffb640 1 -- 172.21.15.73:0/1756660385 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b980bd9b0 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c15cdd0 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.570+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c0ad200 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.574+0000 7f8b91ffb640 1 -- 172.21.15.73:0/1756660385 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8b980b33f0 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.574+0000 7f8b91ffb640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b800678c0 0x7f8b80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.574+0000 7f8b91ffb640 1 -- 172.21.15.73:0/1756660385 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f8b981201f0 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.574+0000 7f8ba0d14640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b800678c0 0x7f8b80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.574+0000 7f8ba0d14640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b800678c0 0x7f8b80069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c166f00 tx=0x7f8b8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:40.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.578+0000 7f8b91ffb640 1 -- 172.21.15.73:0/1756660385 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8b980c3060 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.742+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b9c06fcd0 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.742+0000 7f8b91ffb640 1 -- 172.21.15.73:0/1756660385 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16970 (secure 0 0 0) 0x7f8b98016110 con 0x7f8b9c0af2a0 2024-09-12T03:37:40.745 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:40.745 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:39.761187+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:37.412919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:38.757412+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b800678c0 msgr2=0x7f8b80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b800678c0 0x7f8b80069d80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c166f00 tx=0x7f8b8c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c0af2a0 msgr2=0x7f8b9c15d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c0af2a0 0x7f8b9c15d2f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8b9801a120 tx=0x7f8b9801ad30 comp rx=0 tx=0).stop 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 shutdown_connections 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8b800678c0 0x7f8b80069d80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8b9c15c2a0 0x7f8b9c09a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b9c15bec0 0x7f8b9c09b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 --2- 172.21.15.73:0/1756660385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b9c0af2a0 0x7f8b9c15d2f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 >> 172.21.15.73:0/1756660385 conn(0x7f8b9c0b1f90 msgr2=0x7f8b9c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 shutdown_connections 2024-09-12T03:37:40.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.746+0000 7f8ba3779640 1 -- 172.21.15.73:0/1756660385 wait complete. 2024-09-12T03:37:40.765 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:40.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7d0f4640 1 Processor -- start 2024-09-12T03:37:40.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7d0f4640 1 -- start start 2024-09-12T03:37:40.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7d0f4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a7815f3a0 0x7f4a78165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7d0f4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a780aede0 con 0x7f4a781520a0 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7d0f4640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a7815fa10 con 0x7f4a78070020 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7d0f4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4a78152480 con 0x7f4a7815f3a0 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7759e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a7815f3a0 0x7f4a78165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a76d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4a781520a0 0x7f4a7806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37494/0 (socket says 172.21.15.73:37494) 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a76d9d640 1 -- 172.21.15.73:0/56854626 learned_addr learned my addr 172.21.15.73:0/56854626 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7759e640 1 -- 172.21.15.73:0/56854626 >> v1:172.21.15.150:6789/0 conn(0x7f4a78070020 legacy=0x7f4a7815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7759e640 1 -- 172.21.15.73:0/56854626 >> v1:172.21.15.73:6789/0 conn(0x7f4a781520a0 legacy=0x7f4a7806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a75d9b640 1 -- 172.21.15.73:0/56854626 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852906059 0 0) 0x7f4a780aede0 con 0x7f4a781520a0 2024-09-12T03:37:40.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.886+0000 7f4a7759e640 1 -- 172.21.15.73:0/56854626 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a78074250 con 0x7f4a7815f3a0 2024-09-12T03:37:40.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7759e640 1 --2- 172.21.15.73:0/56854626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a78165f00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009d90 tx=0x7f4a7001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecf66762965c734 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:40.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a75d9b640 1 -- 172.21.15.73:0/56854626 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a700b2070 con 0x7f4a7815f3a0 2024-09-12T03:37:40.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a75d9b640 1 -- 172.21.15.73:0/56854626 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a700a59f0 con 0x7f4a7815f3a0 2024-09-12T03:37:40.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a75d9b640 1 -- 172.21.15.73:0/56854626 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a700a5dc0 con 0x7f4a7815f3a0 2024-09-12T03:37:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/56854626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 msgr2=0x7f4a78165f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/56854626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a78165f00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4a70009d90 tx=0x7f4a7001c930 comp rx=0 tx=0).stop 2024-09-12T03:37:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/56854626 shutdown_connections 2024-09-12T03:37:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/56854626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a78165f00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/56854626 >> 172.21.15.73:0/56854626 conn(0x7f4a780b1f90 msgr2=0x7f4a780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/56854626 shutdown_connections 2024-09-12T03:37:40.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/56854626 wait complete. 2024-09-12T03:37:40.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 Processor -- start 2024-09-12T03:37:40.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- start start 2024-09-12T03:37:40.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a78070020 0x7f4a7814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a781520a0 0x7f4a7814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a781640d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78168c60 con 0x7f4a7815f3a0 2024-09-12T03:37:40.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78073d30 con 0x7f4a78070020 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7d0f4640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4a78168de0 con 0x7f4a781520a0 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a781640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a781640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57670/0 (socket says 172.21.15.73:57670) 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7759e640 1 -- 172.21.15.73:0/2569593497 learned_addr learned my addr 172.21.15.73:0/2569593497 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a76d9d640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a78070020 0x7f4a7814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7759e640 1 -- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a781520a0 msgr2=0x7f4a7814c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.890+0000 7f4a7659c640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a781520a0 0x7f4a7814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7759e640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a781520a0 0x7f4a7814c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7759e640 1 -- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a78070020 msgr2=0x7f4a7814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7759e640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a78070020 0x7f4a7814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7759e640 1 -- 172.21.15.73:0/2569593497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a78151ad0 con 0x7f4a7815f3a0 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a76d9d640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a78070020 0x7f4a7814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7759e640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a781640d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4a700b0040 tx=0x7f4a700196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a5f7fe640 1 -- 172.21.15.73:0/2569593497 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a700bd020 con 0x7f4a7815f3a0 2024-09-12T03:37:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a5f7fe640 1 -- 172.21.15.73:0/2569593497 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a700ad7c0 con 0x7f4a7815f3a0 2024-09-12T03:37:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a5f7fe640 1 -- 172.21.15.73:0/2569593497 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a700b2040 con 0x7f4a7815f3a0 2024-09-12T03:37:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a78151db0 con 0x7f4a7815f3a0 2024-09-12T03:37:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a780cdde0 con 0x7f4a7815f3a0 2024-09-12T03:37:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7815ec90 con 0x7f4a7815f3a0 2024-09-12T03:37:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a5f7fe640 1 -- 172.21.15.73:0/2569593497 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a700c0020 con 0x7f4a7815f3a0 2024-09-12T03:37:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a5f7fe640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a640678c0 0x7f4a64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a76d9d640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a640678c0 0x7f4a64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a5f7fe640 1 -- 172.21.15.73:0/2569593497 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7f4a70120ed0 con 0x7f4a7815f3a0 2024-09-12T03:37:40.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.894+0000 7f4a76d9d640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a640678c0 0x7f4a64069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000f70 tx=0x7f4a68009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:40.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:40.898+0000 7f4a5f7fe640 1 -- 172.21.15.73:0/2569593497 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a700c7030 con 0x7f4a7815f3a0 2024-09-12T03:37:41.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.062+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a780ce2e0 con 0x7f4a7815f3a0 2024-09-12T03:37:41.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a5f7fe640 1 -- 172.21.15.73:0/2569593497 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+16970 (secure 0 0 0) 0x7f4a70016520 con 0x7f4a7815f3a0 2024-09-12T03:37:41.067 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:41.067 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":85,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:39.761187+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:37.412919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:38.757412+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a640678c0 msgr2=0x7f4a64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a640678c0 0x7f4a64069d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000f70 tx=0x7f4a68009040 comp rx=0 tx=0).stop 2024-09-12T03:37:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 msgr2=0x7f4a781640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a781640d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4a700b0040 tx=0x7f4a700196d0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 shutdown_connections 2024-09-12T03:37:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f4a640678c0 0x7f4a64069d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a7815f3a0 0x7f4a781640d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4a781520a0 0x7f4a7814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 --2- 172.21.15.73:0/2569593497 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a78070020 0x7f4a7814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 >> 172.21.15.73:0/2569593497 conn(0x7f4a780b1f90 msgr2=0x7f4a780b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 shutdown_connections 2024-09-12T03:37:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.066+0000 7f4a7d0f4640 1 -- 172.21.15.73:0/2569593497 wait complete. 2024-09-12T03:37:41.087 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T03:37:41.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.206+0000 7fdac9a69640 1 Processor -- start 2024-09-12T03:37:41.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.206+0000 7fdac9a69640 1 -- start start 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac9a69640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fdac415bec0 0x7fdac40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac9a69640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac415c2a0 0x7fdac40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac9a69640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac40af2a0 0x7fdac415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac9a69640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fdac40b3290 con 0x7fdac40af2a0 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac9a69640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fdac40b3570 con 0x7fdac415bec0 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac9a69640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdac40b3850 con 0x7fdac415c2a0 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac40af2a0 0x7fdac415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac40af2a0 0x7fdac415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57676/0 (socket says 172.21.15.73:57676) 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 -- 172.21.15.73:0/3966045505 learned_addr learned my addr 172.21.15.73:0/3966045505 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac2ffd640 1 --2- 172.21.15.73:0/3966045505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac415c2a0 0x7fdac40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac37fe640 1 --2- 172.21.15.73:0/3966045505 >> v2:172.21.15.150:3300/0 conn(0x7fdac415bec0 0x7fdac40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 -- 172.21.15.73:0/3966045505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac415c2a0 msgr2=0x7fdac40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 --2- 172.21.15.73:0/3966045505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac415c2a0 0x7fdac40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 -- 172.21.15.73:0/3966045505 >> v2:172.21.15.150:3300/0 conn(0x7fdac415bec0 msgr2=0x7fdac40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 --2- 172.21.15.73:0/3966045505 >> v2:172.21.15.150:3300/0 conn(0x7fdac415bec0 0x7fdac40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 -- 172.21.15.73:0/3966045505 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac40b3b30 con 0x7fdac40af2a0 2024-09-12T03:37:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac3fff640 1 --2- 172.21.15.73:0/3966045505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40af2a0 0x7fdac415fc60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdac4071710 tx=0x7fdabc01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de89ca2cd64cecc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac27fc640 1 -- 172.21.15.73:0/3966045505 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0b0070 con 0x7fdac40af2a0 2024-09-12T03:37:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac27fc640 1 -- 172.21.15.73:0/3966045505 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdabc0ab600 con 0x7fdac40af2a0 2024-09-12T03:37:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.210+0000 7fdac27fc640 1 -- 172.21.15.73:0/3966045505 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0ab9d0 con 0x7fdac40af2a0 2024-09-12T03:37:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- 172.21.15.73:0/3966045505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40af2a0 msgr2=0x7fdac415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3966045505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40af2a0 0x7fdac415fc60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdac4071710 tx=0x7fdabc01c230 comp rx=0 tx=0).stop 2024-09-12T03:37:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- 172.21.15.73:0/3966045505 shutdown_connections 2024-09-12T03:37:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3966045505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac40af2a0 0x7fdac415fc60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3966045505 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac415c2a0 0x7fdac40aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3966045505 >> v2:172.21.15.150:3300/0 conn(0x7fdac415bec0 0x7fdac40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- 172.21.15.73:0/3966045505 >> 172.21.15.73:0/3966045505 conn(0x7fdac40b1f90 msgr2=0x7fdac40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- 172.21.15.73:0/3966045505 shutdown_connections 2024-09-12T03:37:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- 172.21.15.73:0/3966045505 wait complete. 2024-09-12T03:37:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 Processor -- start 2024-09-12T03:37:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- start start 2024-09-12T03:37:41.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac40af2a0 0x7fdac4099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac415bec0 0x7fdac4152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdac415c2a0 0x7fdac41401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40ad740 con 0x7fdac415bec0 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40afc90 con 0x7fdac415c2a0 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdac406e000 con 0x7fdac40af2a0 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac415bec0 0x7fdac4152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac415bec0 0x7fdac4152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57678/0 (socket says 172.21.15.73:57678) 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3341491239 learned_addr learned my addr 172.21.15.73:0/3341491239 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac37fe640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac40af2a0 0x7fdac4099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac3fff640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdac415c2a0 0x7fdac41401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac40af2a0 msgr2=0x7fdac4099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac40af2a0 0x7fdac4099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdac415c2a0 msgr2=0x7fdac41401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdac415c2a0 0x7fdac41401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 -- 172.21.15.73:0/3341491239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac409c470 con 0x7fdac415bec0 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac37fe640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac40af2a0 0x7fdac4099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac3fff640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdac415c2a0 0x7fdac41401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac2ffd640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac415bec0 0x7fdac4152320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d620 tx=0x7fdaac00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdabbfff640 1 -- 172.21.15.73:0/3341491239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00b620 con 0x7fdac415bec0 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdabbfff640 1 -- 172.21.15.73:0/3341491239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac019070 con 0x7fdac415bec0 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.214+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac409c710 con 0x7fdac415bec0 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdabbfff640 1 -- 172.21.15.73:0/3341491239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00ba20 con 0x7fdac415bec0 2024-09-12T03:37:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac409ccd0 con 0x7fdac415bec0 2024-09-12T03:37:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac40ad200 con 0x7fdac415bec0 2024-09-12T03:37:41.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdabbfff640 1 -- 172.21.15.73:0/3341491239 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdaac00bbc0 con 0x7fdac415bec0 2024-09-12T03:37:41.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdabbfff640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdaa40678c0 0x7fdaa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdabbfff640 1 -- 172.21.15.73:0/3341491239 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6101+0+0 (secure 0 0 0) 0x7fdaac086290 con 0x7fdac415bec0 2024-09-12T03:37:41.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdac37fe640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdaa40678c0 0x7fdaa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.218+0000 7fdac37fe640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdaa40678c0 0x7fdaa4069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdab4007330 tx=0x7fdab400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.222+0000 7fdabbfff640 1 -- 172.21.15.73:0/3341491239 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdaac056c20 con 0x7fdac415bec0 2024-09-12T03:37:41.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.418+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdac406fcd0 con 0x7fdac415bec0 2024-09-12T03:37:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.434+0000 7fdabbfff640 1 -- 172.21.15.73:0/3341491239 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) ==== 118+0+0 (secure 0 0 0) 0x7fdaac056520 con 0x7fdac415bec0 2024-09-12T03:37:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdaa40678c0 msgr2=0x7fdaa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdaa40678c0 0x7fdaa4069d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdab4007330 tx=0x7fdab400b040 comp rx=0 tx=0).stop 2024-09-12T03:37:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac415bec0 msgr2=0x7fdac4152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac415bec0 0x7fdac4152320 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d620 tx=0x7fdaac00dae0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 shutdown_connections 2024-09-12T03:37:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdaa40678c0 0x7fdaa4069d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac415bec0 0x7fdac4152320 secure :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00d620 tx=0x7fdaac00dae0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdac415c2a0 0x7fdac41401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 --2- 172.21.15.73:0/3341491239 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdac40af2a0 0x7fdac4099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 >> 172.21.15.73:0/3341491239 conn(0x7fdac40b1f90 msgr2=0x7fdac4159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:41.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 shutdown_connections 2024-09-12T03:37:41.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.438+0000 7fdac9a69640 1 -- 172.21.15.73:0/3341491239 wait complete. 2024-09-12T03:37:41.454 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T03:37:41.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T03:37:41.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ceb4ce640 1 Processor -- start 2024-09-12T03:37:41.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ceb4ce640 1 -- start start 2024-09-12T03:37:41.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ceb4ce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce41520a0 0x7f8ce406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ceb4ce640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ce415f3a0 0x7f8ce40adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ceb4ce640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce4070250 con 0x7f8ce406fe50 2024-09-12T03:37:41.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ceb4ce640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce4152480 con 0x7f8ce415f3a0 2024-09-12T03:37:41.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ceb4ce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce40aede0 con 0x7f8ce41520a0 2024-09-12T03:37:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce926a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce41520a0 0x7f8ce406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce926a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce41520a0 0x7f8ce406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:54384/0 (socket says 172.21.15.73:54384) 2024-09-12T03:37:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce926a640 1 -- 172.21.15.73:0/2502451306 learned_addr learned my addr 172.21.15.73:0/2502451306 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce9a6b640 1 --2- 172.21.15.73:0/2502451306 >> v2:172.21.15.150:3300/0 conn(0x7f8ce415f3a0 0x7f8ce40adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce926a640 1 -- 172.21.15.73:0/2502451306 >> v2:172.21.15.150:3300/0 conn(0x7f8ce415f3a0 msgr2=0x7f8ce40adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce926a640 1 --2- 172.21.15.73:0/2502451306 >> v2:172.21.15.150:3300/0 conn(0x7f8ce415f3a0 0x7f8ce40adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce926a640 1 -- 172.21.15.73:0/2502451306 >> v1:172.21.15.150:6789/0 conn(0x7f8ce406fe50 legacy=0x7f8ce415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce926a640 1 -- 172.21.15.73:0/2502451306 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce415fa10 con 0x7f8ce41520a0 2024-09-12T03:37:41.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.582+0000 7f8ce9a6b640 1 --2- 172.21.15.73:0/2502451306 >> v2:172.21.15.150:3300/0 conn(0x7f8ce415f3a0 0x7f8ce40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:37:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ce926a640 1 --2- 172.21.15.73:0/2502451306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce41520a0 0x7f8ce406f910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009870 tx=0x7f8ce001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9d849e68659afa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8cdbfff640 1 -- 172.21.15.73:0/2502451306 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00a9620 con 0x7f8ce41520a0 2024-09-12T03:37:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8cdbfff640 1 -- 172.21.15.73:0/2502451306 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce00a97c0 con 0x7f8ce41520a0 2024-09-12T03:37:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8cdbfff640 1 -- 172.21.15.73:0/2502451306 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00a9b90 con 0x7f8ce41520a0 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/2502451306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce41520a0 msgr2=0x7f8ce406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/2502451306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce41520a0 0x7f8ce406f910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009870 tx=0x7f8ce001c560 comp rx=0 tx=0).stop 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/2502451306 shutdown_connections 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/2502451306 >> v2:172.21.15.150:3300/0 conn(0x7f8ce415f3a0 0x7f8ce40adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/2502451306 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce41520a0 0x7f8ce406f910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/2502451306 >> 172.21.15.73:0/2502451306 conn(0x7f8ce40b1f90 msgr2=0x7f8ce40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/2502451306 shutdown_connections 2024-09-12T03:37:41.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/2502451306 wait complete. 2024-09-12T03:37:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 Processor -- start 2024-09-12T03:37:41.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.586+0000 7f8ceb4ce640 1 -- start start 2024-09-12T03:37:41.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce406fe50 0x7f8ce414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41520a0 0x7f8ce414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ce415f3a0 0x7f8ce41483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4073d30 con 0x7f8ce415f3a0 2024-09-12T03:37:41.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce4073a50 con 0x7f8ce41520a0 2024-09-12T03:37:41.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce406e800 con 0x7f8ce406fe50 2024-09-12T03:37:41.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ce415f3a0 0x7f8ce41483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ce415f3a0 0x7f8ce41483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57690/0 (socket says 172.21.15.73:57690) 2024-09-12T03:37:41.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 -- 172.21.15.73:0/173292747 learned_addr learned my addr 172.21.15.73:0/173292747 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:41.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce926a640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce406fe50 0x7f8ce414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce8a69640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41520a0 0x7f8ce414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 -- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce406fe50 msgr2=0x7f8ce414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce406fe50 0x7f8ce414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 -- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41520a0 msgr2=0x7f8ce414bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:41.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41520a0 0x7f8ce414bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:41.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 -- 172.21.15.73:0/173292747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce414a8c0 con 0x7f8ce415f3a0 2024-09-12T03:37:41.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce9a6b640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ce415f3a0 0x7f8ce41483f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc008300 tx=0x7f8cdc0087c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:41.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8cd9ffb640 1 -- 172.21.15.73:0/173292747 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc003ba0 con 0x7f8ce415f3a0 2024-09-12T03:37:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8cd9ffb640 1 -- 172.21.15.73:0/173292747 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc003d40 con 0x7f8ce415f3a0 2024-09-12T03:37:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce4150340 con 0x7f8ce415f3a0 2024-09-12T03:37:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8cd9ffb640 1 -- 172.21.15.73:0/173292747 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc004250 con 0x7f8ce415f3a0 2024-09-12T03:37:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce414fd80 con 0x7f8ce415f3a0 2024-09-12T03:37:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce40adc80 con 0x7f8ce415f3a0 2024-09-12T03:37:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8cd9ffb640 1 -- 172.21.15.73:0/173292747 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8cdc0043f0 con 0x7f8ce415f3a0 2024-09-12T03:37:41.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8cd9ffb640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8cc80678c0 0x7f8cc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:41.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8cd9ffb640 1 -- 172.21.15.73:0/173292747 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f8cdc0864e0 con 0x7f8ce415f3a0 2024-09-12T03:37:41.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.590+0000 7f8ce926a640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8cc80678c0 0x7f8cc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:41.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.594+0000 7f8ce926a640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8cc80678c0 0x7f8cc8069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ae000 tx=0x7f8ce00b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:41.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.594+0000 7f8cd9ffb640 1 -- 172.21.15.73:0/173292747 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8cdc056e90 con 0x7f8ce415f3a0 2024-09-12T03:37:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:41.794+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8ce40cc300 con 0x7f8ce415f3a0 2024-09-12T03:37:42.373 INFO:tasks.ceph.mds.b.smithi150.stderr:2024-09-12T03:37:42.371+0000 7fd79b393640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:37:42.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.446+0000 7f8cd9ffb640 1 -- 172.21.15.73:0/173292747 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f8cdc056790 con 0x7f8ce415f3a0 2024-09-12T03:37:42.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8cc80678c0 msgr2=0x7f8cc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8cc80678c0 0x7f8cc8069d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00ae000 tx=0x7f8ce00b3040 comp rx=0 tx=0).stop 2024-09-12T03:37:42.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ce415f3a0 msgr2=0x7f8ce41483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ce415f3a0 0x7f8ce41483f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc008300 tx=0x7f8cdc0087c0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 shutdown_connections 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8cc80678c0 0x7f8cc8069d80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ce415f3a0 0x7f8ce41483f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ce41520a0 0x7f8ce414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 --2- 172.21.15.73:0/173292747 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ce406fe50 0x7f8ce414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 >> 172.21.15.73:0/173292747 conn(0x7f8ce40b1f90 msgr2=0x7f8ce415a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 shutdown_connections 2024-09-12T03:37:42.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.450+0000 7f8ceb4ce640 1 -- 172.21.15.73:0/173292747 wait complete. 2024-09-12T03:37:42.474 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T03:37:42.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:42.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.598+0000 7fe1ddba5640 1 Processor -- start 2024-09-12T03:37:42.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.598+0000 7fe1ddba5640 1 -- start start 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1ddba5640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe1d8161a60 0x7fe1d80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1ddba5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe1d80d2e90 0x7fe1d80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1ddba5640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d80d32b0 con 0x7fe1d80cf450 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1ddba5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d80d0300 con 0x7fe1d80d2e90 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1ddba5640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d806e6c0 con 0x7fe1d8161a60 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe1d80d2e90 0x7fe1d80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe1d80d2e90 0x7fe1d80cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57704/0 (socket says 172.21.15.73:57704) 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 -- 172.21.15.73:0/3700532744 learned_addr learned my addr 172.21.15.73:0/3700532744 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 -- 172.21.15.73:0/3700532744 >> v2:172.21.15.150:3300/0 conn(0x7fe1d8161a60 msgr2=0x7fe1d80d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d77fe640 1 --2- 172.21.15.73:0/3700532744 >> v2:172.21.15.150:3300/0 conn(0x7fe1d8161a60 0x7fe1d80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 --2- 172.21.15.73:0/3700532744 >> v2:172.21.15.150:3300/0 conn(0x7fe1d8161a60 0x7fe1d80d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 -- 172.21.15.73:0/3700532744 >> v1:172.21.15.150:6789/0 conn(0x7fe1d80cf450 legacy=0x7fe1d80d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 -- 172.21.15.73:0/3700532744 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d80b0f60 con 0x7fe1d80d2e90 2024-09-12T03:37:42.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d6ffd640 1 --2- 172.21.15.73:0/3700532744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80d2e90 0x7fe1d80cef10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe1d808e010 tx=0x7fe1cc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6025ea8b3235446 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:42.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d67fc640 1 -- 172.21.15.73:0/3700532744 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80d1930 con 0x7fe1d80d2e90 2024-09-12T03:37:42.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d67fc640 1 -- 172.21.15.73:0/3700532744 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0b0070 con 0x7fe1d80d2e90 2024-09-12T03:37:42.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.602+0000 7fe1d67fc640 1 -- 172.21.15.73:0/3700532744 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc0ab840 con 0x7fe1d80d2e90 2024-09-12T03:37:42.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- 172.21.15.73:0/3700532744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80d2e90 msgr2=0x7fe1d80cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/3700532744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80d2e90 0x7fe1d80cef10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe1d808e010 tx=0x7fe1cc01c420 comp rx=0 tx=0).stop 2024-09-12T03:37:42.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- 172.21.15.73:0/3700532744 shutdown_connections 2024-09-12T03:37:42.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/3700532744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80d2e90 0x7fe1d80cef10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/3700532744 >> v2:172.21.15.150:3300/0 conn(0x7fe1d8161a60 0x7fe1d80d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- 172.21.15.73:0/3700532744 >> 172.21.15.73:0/3700532744 conn(0x7fe1d808bf90 msgr2=0x7fe1d809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:42.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- 172.21.15.73:0/3700532744 shutdown_connections 2024-09-12T03:37:42.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- 172.21.15.73:0/3700532744 wait complete. 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 Processor -- start 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- start start 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80cf450 0x7fe1d8159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d80d2e90 0x7fe1d815df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d8161a60 0x7fe1d815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d80cf8c0 con 0x7fe1d80cf450 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d806d190 con 0x7fe1d80d2e90 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d80cfa40 con 0x7fe1d8161a60 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80cf450 0x7fe1d8159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80cf450 0x7fe1d8159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57720/0 (socket says 172.21.15.73:57720) 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 -- 172.21.15.73:0/25194006 learned_addr learned my addr 172.21.15.73:0/25194006 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d6ffd640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d80d2e90 0x7fe1d815df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d7fff640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d8161a60 0x7fe1d815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 -- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d8161a60 msgr2=0x7fe1d815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d8161a60 0x7fe1d815e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 -- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d80d2e90 msgr2=0x7fe1d815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d80d2e90 0x7fe1d815df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 -- 172.21.15.73:0/25194006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d81588f0 con 0x7fe1d80cf450 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1d77fe640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80cf450 0x7fe1d8159280 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c7f0 tx=0x7fe1c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1bffff640 1 -- 172.21.15.73:0/25194006 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8015070 con 0x7fe1d80cf450 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1bffff640 1 -- 172.21.15.73:0/25194006 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c8007820 con 0x7fe1d80cf450 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d8158bd0 con 0x7fe1d80cf450 2024-09-12T03:37:42.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1bffff640 1 -- 172.21.15.73:0/25194006 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8007c10 con 0x7fe1d80cf450 2024-09-12T03:37:42.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.606+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d8157790 con 0x7fe1d80cf450 2024-09-12T03:37:42.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.610+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d80cef10 con 0x7fe1d80cf450 2024-09-12T03:37:42.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.610+0000 7fe1bffff640 1 -- 172.21.15.73:0/25194006 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe1c8018070 con 0x7fe1d80cf450 2024-09-12T03:37:42.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.610+0000 7fe1bffff640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1c40678c0 0x7fe1c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.610+0000 7fe1bffff640 1 -- 172.21.15.73:0/25194006 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fe1c8085e70 con 0x7fe1d80cf450 2024-09-12T03:37:42.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.610+0000 7fe1d6ffd640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1c40678c0 0x7fe1c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.610+0000 7fe1d6ffd640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1c40678c0 0x7fe1c4069d80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0af000 tx=0x7fe1cc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:42.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.614+0000 7fe1bffff640 1 -- 172.21.15.73:0/25194006 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe1c80568b0 con 0x7fe1d80cf450 2024-09-12T03:37:42.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1d80d4d10 con 0x7fe1d80cf450 2024-09-12T03:37:42.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1bffff640 1 -- 172.21.15.73:0/25194006 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5222 (secure 0 0 0) 0x7fe1c80561b0 con 0x7fe1d80cf450 2024-09-12T03:37:42.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:42.799 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"btime":"2024-09-12T03:37:42:437910+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/54392956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54392956},{"type":"v1","addr":"172.21.15.150:6835","nonce":54392956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6240,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/583240547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":583240547},{"type":"v1","addr":"172.21.15.73:6835","nonce":583240547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3438655973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3438655973},{"type":"v1","addr":"172.21.15.73:6837","nonce":3438655973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:39.761504+0000","modified":"2024-09-12T03:37:41.797723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6833/3979723408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3979723408},{"type":"v1","addr":"172.21.15.150:6833","nonce":3979723408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":6}]} 2024-09-12T03:37:42.799 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 48 2024-09-12T03:37:42.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1c40678c0 msgr2=0x7fe1c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1c40678c0 0x7fe1c4069d80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0af000 tx=0x7fe1cc0a7000 comp rx=0 tx=0).stop 2024-09-12T03:37:42.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80cf450 msgr2=0x7fe1d8159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80cf450 0x7fe1d8159280 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800c7f0 tx=0x7fe1c800ccb0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 shutdown_connections 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe1c40678c0 0x7fe1c4069d80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe1d8161a60 0x7fe1d815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1d80d2e90 0x7fe1d815df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.798+0000 7fe1ddba5640 1 --2- 172.21.15.73:0/25194006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80cf450 0x7fe1d8159280 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.802+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 >> 172.21.15.73:0/25194006 conn(0x7fe1d808bf90 msgr2=0x7fe1d815d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.802+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 shutdown_connections 2024-09-12T03:37:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.802+0000 7fe1ddba5640 1 -- 172.21.15.73:0/25194006 wait complete. 2024-09-12T03:37:42.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:42.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.934+0000 7fae2692c640 1 Processor -- start 2024-09-12T03:37:42.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.934+0000 7fae2692c640 1 -- start start 2024-09-12T03:37:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae2692c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae201630c0 0x7fae2006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae2692c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae200b3290 0x7fae200b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae2692c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae20163bb0 con 0x7fae2006df70 2024-09-12T03:37:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae2692c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fae2006e470 con 0x7fae200b3290 2024-09-12T03:37:42.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae2692c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fae2006e750 con 0x7fae201630c0 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae201630c0 0x7fae2006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae24ec9640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fae200b3290 0x7fae200b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae201630c0 0x7fae2006f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:54418/0 (socket says 172.21.15.73:54418) 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae1ffff640 1 -- 172.21.15.73:0/4148540899 learned_addr learned my addr 172.21.15.73:0/4148540899 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae24ec9640 1 -- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae201630c0 msgr2=0x7fae2006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae24ec9640 1 --2- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae201630c0 0x7fae2006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae24ec9640 1 -- 172.21.15.73:0/4148540899 >> v1:172.21.15.150:6789/0 conn(0x7fae2006df70 legacy=0x7fae201634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae24ec9640 1 -- 172.21.15.73:0/4148540899 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2006ea30 con 0x7fae200b3290 2024-09-12T03:37:42.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.938+0000 7fae1ffff640 1 --2- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae201630c0 0x7fae2006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:37:42.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 --2- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae200b3290 0x7fae200b3720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae180097c0 tx=0x7fae1801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2376fba7a32c1c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:42.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae1effd640 1 -- 172.21.15.73:0/4148540899 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae180b0070 con 0x7fae200b3290 2024-09-12T03:37:42.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae1effd640 1 -- 172.21.15.73:0/4148540899 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae180ab600 con 0x7fae200b3290 2024-09-12T03:37:42.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae1effd640 1 -- 172.21.15.73:0/4148540899 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae180ab9d0 con 0x7fae200b3290 2024-09-12T03:37:42.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae200b3290 msgr2=0x7fae200b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 --2- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae200b3290 0x7fae200b3720 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fae180097c0 tx=0x7fae1801c4a0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- 172.21.15.73:0/4148540899 shutdown_connections 2024-09-12T03:37:42.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 --2- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae200b3290 0x7fae200b3720 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 --2- 172.21.15.73:0/4148540899 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae201630c0 0x7fae2006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- 172.21.15.73:0/4148540899 >> 172.21.15.73:0/4148540899 conn(0x7fae200b1f90 msgr2=0x7fae200b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:42.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- 172.21.15.73:0/4148540899 shutdown_connections 2024-09-12T03:37:42.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- 172.21.15.73:0/4148540899 wait complete. 2024-09-12T03:37:42.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 Processor -- start 2024-09-12T03:37:42.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- start start 2024-09-12T03:37:42.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae2006df70 0x7fae2009ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae200b3290 0x7fae201588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae201630c0 0x7fae20159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae2016f5f0 con 0x7fae201630c0 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fae2006fc60 con 0x7fae2006df70 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae2692c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fae2016f770 con 0x7fae200b3290 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae201630c0 0x7fae20159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae201630c0 0x7fae20159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57730/0 (socket says 172.21.15.73:57730) 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 -- 172.21.15.73:0/4225049169 learned_addr learned my addr 172.21.15.73:0/4225049169 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae1f7fe640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae200b3290 0x7fae201588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae1ffff640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae2006df70 0x7fae2009ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 -- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae200b3290 msgr2=0x7fae201588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae200b3290 0x7fae201588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 -- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae2006df70 msgr2=0x7fae2009ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae2006df70 0x7fae2009ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 -- 172.21.15.73:0/4225049169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2009e330 con 0x7fae201630c0 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.942+0000 7fae24ec9640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae201630c0 0x7fae20159070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fae1801ab50 tx=0x7fae18019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1cff9640 1 -- 172.21.15.73:0/4225049169 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae180ba070 con 0x7fae201630c0 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1cff9640 1 -- 172.21.15.73:0/4225049169 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae180b43f0 con 0x7fae201630c0 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1cff9640 1 -- 172.21.15.73:0/4225049169 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae180b0040 con 0x7fae201630c0 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae20158e20 con 0x7fae201630c0 2024-09-12T03:37:42.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae200ce140 con 0x7fae201630c0 2024-09-12T03:37:42.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2009b980 con 0x7fae201630c0 2024-09-12T03:37:42.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1cff9640 1 -- 172.21.15.73:0/4225049169 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fae180bd070 con 0x7fae201630c0 2024-09-12T03:37:42.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1cff9640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae000678c0 0x7fae00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:42.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1cff9640 1 -- 172.21.15.73:0/4225049169 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fae1811ed80 con 0x7fae201630c0 2024-09-12T03:37:42.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1ffff640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae000678c0 0x7fae00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:42.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.946+0000 7fae1ffff640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae000678c0 0x7fae00069d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fae08009a40 tx=0x7fae08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:42.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:42.950+0000 7fae1cff9640 1 -- 172.21.15.73:0/4225049169 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fae18016090 con 0x7fae201630c0 2024-09-12T03:37:43.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.118+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae20070080 con 0x7fae201630c0 2024-09-12T03:37:43.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.118+0000 7fae1cff9640 1 -- 172.21.15.73:0/4225049169 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16957 (secure 0 0 0) 0x7fae180ef730 con 0x7fae201630c0 2024-09-12T03:37:43.121 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:43.121 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":86,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:41.394697+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:37.412919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:38.757412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae000678c0 msgr2=0x7fae00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae000678c0 0x7fae00069d80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fae08009a40 tx=0x7fae08008040 comp rx=0 tx=0).stop 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae201630c0 msgr2=0x7fae20159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae201630c0 0x7fae20159070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fae1801ab50 tx=0x7fae18019240 comp rx=0 tx=0).stop 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 shutdown_connections 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fae000678c0 0x7fae00069d80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae201630c0 0x7fae20159070 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fae200b3290 0x7fae201588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 --2- 172.21.15.73:0/4225049169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae2006df70 0x7fae2009ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 >> 172.21.15.73:0/4225049169 conn(0x7fae200b1f90 msgr2=0x7fae201634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 shutdown_connections 2024-09-12T03:37:43.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.122+0000 7fae2692c640 1 -- 172.21.15.73:0/4225049169 wait complete. 2024-09-12T03:37:43.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:37:43.142 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:43.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.258+0000 7f5a294df640 1 Processor -- start 2024-09-12T03:37:43.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.258+0000 7f5a294df640 1 -- start start 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a294df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a241520a0 0x7f5a2406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a294df640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a2406fe50 0x7f5a2415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a294df640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a24070250 con 0x7f5a2415f1d0 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a294df640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5a24152480 con 0x7f5a2406fe50 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a294df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5a240aede0 con 0x7f5a241520a0 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a2406fe50 0x7f5a2415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a2406fe50 0x7f5a2415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57734/0 (socket says 172.21.15.73:57734) 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 -- 172.21.15.73:0/4192500892 learned_addr learned my addr 172.21.15.73:0/4192500892 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a22ffd640 1 --2- 172.21.15.73:0/4192500892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a241520a0 0x7f5a2406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 -- 172.21.15.73:0/4192500892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a241520a0 msgr2=0x7f5a2406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:43.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 --2- 172.21.15.73:0/4192500892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a241520a0 0x7f5a2406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 -- 172.21.15.73:0/4192500892 >> v1:172.21.15.150:6789/0 conn(0x7f5a2415f1d0 legacy=0x7f5a24071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:43.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 -- 172.21.15.73:0/4192500892 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2415fa10 con 0x7f5a2406fe50 2024-09-12T03:37:43.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a22ffd640 1 --2- 172.21.15.73:0/4192500892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a241520a0 0x7f5a2406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:43.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a227fc640 1 --2- 172.21.15.73:0/4192500892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2406fe50 0x7f5a2415ec90 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009870 tx=0x7f5a1801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301f5f25f6c32b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a21ffb640 1 -- 172.21.15.73:0/4192500892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a180b1070 con 0x7f5a2406fe50 2024-09-12T03:37:43.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a21ffb640 1 -- 172.21.15.73:0/4192500892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a180a8050 con 0x7f5a2406fe50 2024-09-12T03:37:43.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.262+0000 7f5a21ffb640 1 -- 172.21.15.73:0/4192500892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a180ac860 con 0x7f5a2406fe50 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/4192500892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2406fe50 msgr2=0x7f5a2415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 --2- 172.21.15.73:0/4192500892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2406fe50 0x7f5a2415ec90 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009870 tx=0x7f5a1801c500 comp rx=0 tx=0).stop 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/4192500892 shutdown_connections 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 --2- 172.21.15.73:0/4192500892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2406fe50 0x7f5a2415ec90 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 --2- 172.21.15.73:0/4192500892 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a241520a0 0x7f5a2406f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/4192500892 >> 172.21.15.73:0/4192500892 conn(0x7f5a240b1f90 msgr2=0x7f5a240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/4192500892 shutdown_connections 2024-09-12T03:37:43.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/4192500892 wait complete. 2024-09-12T03:37:43.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 Processor -- start 2024-09-12T03:37:43.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- start start 2024-09-12T03:37:43.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a2406fe50 0x7f5a240ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a241520a0 0x7f5a24165600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2415f1d0 0x7f5a2414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5a24073d30 con 0x7f5a2415f1d0 2024-09-12T03:37:43.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5a24073a50 con 0x7f5a241520a0 2024-09-12T03:37:43.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2415f680 con 0x7f5a2406fe50 2024-09-12T03:37:43.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2415f1d0 0x7f5a2414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2415f1d0 0x7f5a2414e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57746/0 (socket says 172.21.15.73:57746) 2024-09-12T03:37:43.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 -- 172.21.15.73:0/2701065482 learned_addr learned my addr 172.21.15.73:0/2701065482 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:43.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a227fc640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a241520a0 0x7f5a24165600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a22ffd640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a2406fe50 0x7f5a240ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 -- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a2406fe50 msgr2=0x7f5a240ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a2406fe50 0x7f5a240ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 -- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a241520a0 msgr2=0x7f5a24165600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a241520a0 0x7f5a24165600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 -- 172.21.15.73:0/2701065482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a240cd1f0 con 0x7f5a2415f1d0 2024-09-12T03:37:43.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a227fc640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a241520a0 0x7f5a24165600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a22ffd640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a2406fe50 0x7f5a240ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a237fe640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2415f1d0 0x7f5a2414e570 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00c780 tx=0x7f5a1c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2701065482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c017070 con 0x7f5a2415f1d0 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a240cd7b0 con 0x7f5a2415f1d0 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2701065482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1c003db0 con 0x7f5a2415f1d0 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2701065482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c0052b0 con 0x7f5a2415f1d0 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a240cdd70 con 0x7f5a2415f1d0 2024-09-12T03:37:43.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.266+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2415ec90 con 0x7f5a2415f1d0 2024-09-12T03:37:43.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.270+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2701065482 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a1c005450 con 0x7f5a2415f1d0 2024-09-12T03:37:43.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.270+0000 7f5a0b7fe640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5a100678c0 0x7f5a10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.270+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2701065482 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f5a1c085430 con 0x7f5a2415f1d0 2024-09-12T03:37:43.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.270+0000 7f5a22ffd640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5a100678c0 0x7f5a10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.270+0000 7f5a22ffd640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5a100678c0 0x7f5a10069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5a241fa7d0 tx=0x7f5a14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.274+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2701065482 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a1c055df0 con 0x7f5a2415f1d0 2024-09-12T03:37:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.418+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a241649d0 con 0x7f5a100678c0 2024-09-12T03:37:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.430+0000 7f5a0b7fe640 1 -- 172.21.15.73:0/2701065482 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241354 (secure 0 0 0) 0x7f5a241649d0 con 0x7f5a100678c0 2024-09-12T03:37:43.431 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:43.433 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:43.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5a100678c0 msgr2=0x7f5a10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5a100678c0 0x7f5a10069d80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5a241fa7d0 tx=0x7f5a14008040 comp rx=0 tx=0).stop 2024-09-12T03:37:43.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2415f1d0 msgr2=0x7f5a2414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2415f1d0 0x7f5a2414e570 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c00c780 tx=0x7f5a1c00cc40 comp rx=0 tx=0).stop 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 shutdown_connections 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5a100678c0 0x7f5a10069d80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a2415f1d0 0x7f5a2414e570 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a241520a0 0x7f5a24165600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 --2- 172.21.15.73:0/2701065482 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5a2406fe50 0x7f5a240ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 >> 172.21.15.73:0/2701065482 conn(0x7f5a240b1f90 msgr2=0x7f5a2406f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 shutdown_connections 2024-09-12T03:37:43.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.434+0000 7f5a294df640 1 -- 172.21.15.73:0/2701065482 wait complete. 2024-09-12T03:37:43.450 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T03:37:41.843590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":254460,"kb_used_data":9080,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720260,"statfs":{"total":773094113280,"available":772833546240,"internally_reserved":0,"allocated":9297920,"data_stored":4848231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001032"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430456+0000","last_change":"2024-09-12T03:37:40.429021+0000","last_active":"2024-09-12T03:37:40.430456+0000","last_peered":"2024-09-12T03:37:40.430456+0000","last_clean":"2024-09-12T03:37:40.430456+0000","last_became_active":"2024-09-12T03:37:40.428595+0000","last_became_peered":"2024-09-12T03:37:40.428595+0000","last_unstale":"2024-09-12T03:37:40.430456+0000","last_undegraded":"2024-09-12T03:37:40.430456+0000","last_fullsized":"2024-09-12T03:37:40.430456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:27.282926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424594+0000","last_change":"2024-09-12T03:37:40.418759+0000","last_active":"2024-09-12T03:37:40.424594+0000","last_peered":"2024-09-12T03:37:40.424594+0000","last_clean":"2024-09-12T03:37:40.424594+0000","last_became_active":"2024-09-12T03:37:40.418302+0000","last_became_peered":"2024-09-12T03:37:40.418302+0000","last_unstale":"2024-09-12T03:37:40.424594+0000","last_undegraded":"2024-09-12T03:37:40.424594+0000","last_fullsized":"2024-09-12T03:37:40.424594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:05.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424419+0000","last_change":"2024-09-12T03:37:40.419713+0000","last_active":"2024-09-12T03:37:40.424419+0000","last_peered":"2024-09-12T03:37:40.424419+0000","last_clean":"2024-09-12T03:37:40.424419+0000","last_became_active":"2024-09-12T03:37:40.419377+0000","last_became_peered":"2024-09-12T03:37:40.419377+0000","last_unstale":"2024-09-12T03:37:40.424419+0000","last_undegraded":"2024-09-12T03:37:40.424419+0000","last_fullsized":"2024-09-12T03:37:40.424419+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.849186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436199+0000","last_change":"2024-09-12T03:37:40.425754+0000","last_active":"2024-09-12T03:37:40.436199+0000","last_peered":"2024-09-12T03:37:40.436199+0000","last_clean":"2024-09-12T03:37:40.436199+0000","last_became_active":"2024-09-12T03:37:40.425148+0000","last_became_peered":"2024-09-12T03:37:40.425148+0000","last_unstale":"2024-09-12T03:37:40.436199+0000","last_undegraded":"2024-09-12T03:37:40.436199+0000","last_fullsized":"2024-09-12T03:37:40.436199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:14.157378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430236+0000","last_change":"2024-09-12T03:37:40.424603+0000","last_active":"2024-09-12T03:37:40.430236+0000","last_peered":"2024-09-12T03:37:40.430236+0000","last_clean":"2024-09-12T03:37:40.430236+0000","last_became_active":"2024-09-12T03:37:40.424281+0000","last_became_peered":"2024-09-12T03:37:40.424281+0000","last_unstale":"2024-09-12T03:37:40.430236+0000","last_undegraded":"2024-09-12T03:37:40.430236+0000","last_fullsized":"2024-09-12T03:37:40.430236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:41.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430310+0000","last_change":"2024-09-12T03:37:40.425608+0000","last_active":"2024-09-12T03:37:40.430310+0000","last_peered":"2024-09-12T03:37:40.430310+0000","last_clean":"2024-09-12T03:37:40.430310+0000","last_became_active":"2024-09-12T03:37:40.424515+0000","last_became_peered":"2024-09-12T03:37:40.424515+0000","last_unstale":"2024-09-12T03:37:40.430310+0000","last_undegraded":"2024-09-12T03:37:40.430310+0000","last_fullsized":"2024-09-12T03:37:40.430310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:06.834378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.440639+0000","last_change":"2024-09-12T03:37:39.416198+0000","last_active":"2024-09-12T03:37:40.440639+0000","last_peered":"2024-09-12T03:37:40.440639+0000","last_clean":"2024-09-12T03:37:40.440639+0000","last_became_active":"2024-09-12T03:37:39.415495+0000","last_became_peered":"2024-09-12T03:37:39.415495+0000","last_unstale":"2024-09-12T03:37:40.440639+0000","last_undegraded":"2024-09-12T03:37:40.440639+0000","last_fullsized":"2024-09-12T03:37:40.440639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:34.724760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430302+0000","last_change":"2024-09-12T03:37:40.424326+0000","last_active":"2024-09-12T03:37:40.430302+0000","last_peered":"2024-09-12T03:37:40.430302+0000","last_clean":"2024-09-12T03:37:40.430302+0000","last_became_active":"2024-09-12T03:37:40.424042+0000","last_became_peered":"2024-09-12T03:37:40.424042+0000","last_unstale":"2024-09-12T03:37:40.430302+0000","last_undegraded":"2024-09-12T03:37:40.430302+0000","last_fullsized":"2024-09-12T03:37:40.430302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.045762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437117+0000","last_change":"2024-09-12T03:37:40.435971+0000","last_active":"2024-09-12T03:37:40.437117+0000","last_peered":"2024-09-12T03:37:40.437117+0000","last_clean":"2024-09-12T03:37:40.437117+0000","last_became_active":"2024-09-12T03:37:40.435660+0000","last_became_peered":"2024-09-12T03:37:40.435660+0000","last_unstale":"2024-09-12T03:37:40.437117+0000","last_undegraded":"2024-09-12T03:37:40.437117+0000","last_fullsized":"2024-09-12T03:37:40.437117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:46.170305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.432677+0000","last_change":"2024-09-12T03:37:39.413393+0000","last_active":"2024-09-12T03:37:40.432677+0000","last_peered":"2024-09-12T03:37:40.432677+0000","last_clean":"2024-09-12T03:37:40.432677+0000","last_became_active":"2024-09-12T03:37:39.412623+0000","last_became_peered":"2024-09-12T03:37:39.412623+0000","last_unstale":"2024-09-12T03:37:40.432677+0000","last_undegraded":"2024-09-12T03:37:40.432677+0000","last_fullsized":"2024-09-12T03:37:40.432677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:57.769487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436168+0000","last_change":"2024-09-12T03:37:40.418137+0000","last_active":"2024-09-12T03:37:40.436168+0000","last_peered":"2024-09-12T03:37:40.436168+0000","last_clean":"2024-09-12T03:37:40.436168+0000","last_became_active":"2024-09-12T03:37:40.416243+0000","last_became_peered":"2024-09-12T03:37:40.416243+0000","last_unstale":"2024-09-12T03:37:40.436168+0000","last_undegraded":"2024-09-12T03:37:40.436168+0000","last_fullsized":"2024-09-12T03:37:40.436168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:43.363057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.439177+0000","last_change":"2024-09-12T03:37:40.437610+0000","last_active":"2024-09-12T03:37:40.439177+0000","last_peered":"2024-09-12T03:37:40.439177+0000","last_clean":"2024-09-12T03:37:40.439177+0000","last_became_active":"2024-09-12T03:37:40.437312+0000","last_became_peered":"2024-09-12T03:37:40.437312+0000","last_unstale":"2024-09-12T03:37:40.439177+0000","last_undegraded":"2024-09-12T03:37:40.439177+0000","last_fullsized":"2024-09-12T03:37:40.439177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:08.418783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.441756+0000","last_change":"2024-09-12T03:37:39.425400+0000","last_active":"2024-09-12T03:37:40.441756+0000","last_peered":"2024-09-12T03:37:40.441756+0000","last_clean":"2024-09-12T03:37:40.441756+0000","last_became_active":"2024-09-12T03:37:39.425134+0000","last_became_peered":"2024-09-12T03:37:39.425134+0000","last_unstale":"2024-09-12T03:37:40.441756+0000","last_undegraded":"2024-09-12T03:37:40.441756+0000","last_fullsized":"2024-09-12T03:37:40.441756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:12.236274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.401479+0000","last_change":"2024-09-12T03:37:39.422461+0000","last_active":"2024-09-12T03:37:40.401479+0000","last_peered":"2024-09-12T03:37:40.401479+0000","last_clean":"2024-09-12T03:37:40.401479+0000","last_became_active":"2024-09-12T03:37:39.421555+0000","last_became_peered":"2024-09-12T03:37:39.421555+0000","last_unstale":"2024-09-12T03:37:40.401479+0000","last_undegraded":"2024-09-12T03:37:40.401479+0000","last_fullsized":"2024-09-12T03:37:40.401479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:42.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430333+0000","last_change":"2024-09-12T03:37:40.428686+0000","last_active":"2024-09-12T03:37:40.430333+0000","last_peered":"2024-09-12T03:37:40.430333+0000","last_clean":"2024-09-12T03:37:40.430333+0000","last_became_active":"2024-09-12T03:37:40.423872+0000","last_became_peered":"2024-09-12T03:37:40.423872+0000","last_unstale":"2024-09-12T03:37:40.430333+0000","last_undegraded":"2024-09-12T03:37:40.430333+0000","last_fullsized":"2024-09-12T03:37:40.430333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.082371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436868+0000","last_change":"2024-09-12T03:37:39.432638+0000","last_active":"2024-09-12T03:37:40.436868+0000","last_peered":"2024-09-12T03:37:40.436868+0000","last_clean":"2024-09-12T03:37:40.436868+0000","last_became_active":"2024-09-12T03:37:39.431762+0000","last_became_peered":"2024-09-12T03:37:39.431762+0000","last_unstale":"2024-09-12T03:37:40.436868+0000","last_undegraded":"2024-09-12T03:37:40.436868+0000","last_fullsized":"2024-09-12T03:37:40.436868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:55.197250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436291+0000","last_change":"2024-09-12T03:37:40.417439+0000","last_active":"2024-09-12T03:37:40.436291+0000","last_peered":"2024-09-12T03:37:40.436291+0000","last_clean":"2024-09-12T03:37:40.436291+0000","last_became_active":"2024-09-12T03:37:40.416773+0000","last_became_peered":"2024-09-12T03:37:40.416773+0000","last_unstale":"2024-09-12T03:37:40.436291+0000","last_undegraded":"2024-09-12T03:37:40.436291+0000","last_fullsized":"2024-09-12T03:37:40.436291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:53.808509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.438617+0000","last_change":"2024-09-12T03:37:40.436044+0000","last_active":"2024-09-12T03:37:40.438617+0000","last_peered":"2024-09-12T03:37:40.438617+0000","last_clean":"2024-09-12T03:37:40.438617+0000","last_became_active":"2024-09-12T03:37:40.432077+0000","last_became_peered":"2024-09-12T03:37:40.432077+0000","last_unstale":"2024-09-12T03:37:40.438617+0000","last_undegraded":"2024-09-12T03:37:40.438617+0000","last_fullsized":"2024-09-12T03:37:40.438617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:35.840013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430264+0000","last_change":"2024-09-12T03:37:40.424564+0000","last_active":"2024-09-12T03:37:40.430264+0000","last_peered":"2024-09-12T03:37:40.430264+0000","last_clean":"2024-09-12T03:37:40.430264+0000","last_became_active":"2024-09-12T03:37:40.424199+0000","last_became_peered":"2024-09-12T03:37:40.424199+0000","last_unstale":"2024-09-12T03:37:40.430264+0000","last_undegraded":"2024-09-12T03:37:40.430264+0000","last_fullsized":"2024-09-12T03:37:40.430264+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:36.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437142+0000","last_change":"2024-09-12T03:37:40.424253+0000","last_active":"2024-09-12T03:37:40.437142+0000","last_peered":"2024-09-12T03:37:40.437142+0000","last_clean":"2024-09-12T03:37:40.437142+0000","last_became_active":"2024-09-12T03:37:40.422441+0000","last_became_peered":"2024-09-12T03:37:40.422441+0000","last_unstale":"2024-09-12T03:37:40.437142+0000","last_undegraded":"2024-09-12T03:37:40.437142+0000","last_fullsized":"2024-09-12T03:37:40.437142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.414454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429479+0000","last_change":"2024-09-12T03:37:40.417407+0000","last_active":"2024-09-12T03:37:40.429479+0000","last_peered":"2024-09-12T03:37:40.429479+0000","last_clean":"2024-09-12T03:37:40.429479+0000","last_became_active":"2024-09-12T03:37:40.416874+0000","last_became_peered":"2024-09-12T03:37:40.416874+0000","last_unstale":"2024-09-12T03:37:40.429479+0000","last_undegraded":"2024-09-12T03:37:40.429479+0000","last_fullsized":"2024-09-12T03:37:40.429479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.689588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429584+0000","last_change":"2024-09-12T03:37:40.421941+0000","last_active":"2024-09-12T03:37:40.429584+0000","last_peered":"2024-09-12T03:37:40.429584+0000","last_clean":"2024-09-12T03:37:40.429584+0000","last_became_active":"2024-09-12T03:37:40.421609+0000","last_became_peered":"2024-09-12T03:37:40.421609+0000","last_unstale":"2024-09-12T03:37:40.429584+0000","last_undegraded":"2024-09-12T03:37:40.429584+0000","last_fullsized":"2024-09-12T03:37:40.429584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.675530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.412612+0000","last_change":"2024-09-12T03:37:39.427202+0000","last_active":"2024-09-12T03:37:40.412612+0000","last_peered":"2024-09-12T03:37:40.412612+0000","last_clean":"2024-09-12T03:37:40.412612+0000","last_became_active":"2024-09-12T03:37:39.425841+0000","last_became_peered":"2024-09-12T03:37:39.425841+0000","last_unstale":"2024-09-12T03:37:40.412612+0000","last_undegraded":"2024-09-12T03:37:40.412612+0000","last_fullsized":"2024-09-12T03:37:40.412612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:21.625912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.400378+0000","last_change":"2024-09-12T03:37:39.430328+0000","last_active":"2024-09-12T03:37:40.400378+0000","last_peered":"2024-09-12T03:37:40.400378+0000","last_clean":"2024-09-12T03:37:40.400378+0000","last_became_active":"2024-09-12T03:37:39.430047+0000","last_became_peered":"2024-09-12T03:37:39.430047+0000","last_unstale":"2024-09-12T03:37:40.400378+0000","last_undegraded":"2024-09-12T03:37:40.400378+0000","last_fullsized":"2024-09-12T03:37:40.400378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.008253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436339+0000","last_change":"2024-09-12T03:37:40.432493+0000","last_active":"2024-09-12T03:37:40.436339+0000","last_peered":"2024-09-12T03:37:40.436339+0000","last_clean":"2024-09-12T03:37:40.436339+0000","last_became_active":"2024-09-12T03:37:40.431967+0000","last_became_peered":"2024-09-12T03:37:40.431967+0000","last_unstale":"2024-09-12T03:37:40.436339+0000","last_undegraded":"2024-09-12T03:37:40.436339+0000","last_fullsized":"2024-09-12T03:37:40.436339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:30.156578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.408238+0000","last_change":"2024-09-12T03:37:39.426991+0000","last_active":"2024-09-12T03:37:40.408238+0000","last_peered":"2024-09-12T03:37:40.408238+0000","last_clean":"2024-09-12T03:37:40.408238+0000","last_became_active":"2024-09-12T03:37:39.425872+0000","last_became_peered":"2024-09-12T03:37:39.425872+0000","last_unstale":"2024-09-12T03:37:40.408238+0000","last_undegraded":"2024-09-12T03:37:40.408238+0000","last_fullsized":"2024-09-12T03:37:40.408238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:30.367921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424633+0000","last_change":"2024-09-12T03:37:40.417611+0000","last_active":"2024-09-12T03:37:40.424633+0000","last_peered":"2024-09-12T03:37:40.424633+0000","last_clean":"2024-09-12T03:37:40.424633+0000","last_became_active":"2024-09-12T03:37:40.417268+0000","last_became_peered":"2024-09-12T03:37:40.417268+0000","last_unstale":"2024-09-12T03:37:40.424633+0000","last_undegraded":"2024-09-12T03:37:40.424633+0000","last_fullsized":"2024-09-12T03:37:40.424633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.432284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":277,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T03:37:36.833567+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:36.833567+0000","last_peered":"2024-09-12T03:37:36.833567+0000","last_clean":"2024-09-12T03:37:36.833567+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:36.833567+0000","last_undegraded":"2024-09-12T03:37:36.833567+0000","last_fullsized":"2024-09-12T03:37:36.833567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":16,"acting":16,"num_store_stats":2},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1597440,"data_stored":1044413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28016,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":476304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":1057289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:43.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:43.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.598+0000 7f24cd592640 1 Processor -- start 2024-09-12T03:37:43.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.598+0000 7f24cd592640 1 -- start start 2024-09-12T03:37:43.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24c815c2a0 0x7f24c80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c80af2a0 0x7f24c806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24c80b3290 con 0x7f24c815bec0 2024-09-12T03:37:43.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f24c80b3570 con 0x7f24c815c2a0 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f24c80b3850 con 0x7f24c80af2a0 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c6ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f24c815bec0 0x7f24c80ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37508/0 (socket says 172.21.15.73:37508) 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c6ffd640 1 -- 172.21.15.73:0/2043478413 learned_addr learned my addr 172.21.15.73:0/2043478413 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c67fc640 1 --2- 172.21.15.73:0/2043478413 >> v2:172.21.15.73:3300/0 conn(0x7f24c815c2a0 0x7f24c80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c77fe640 1 --2- 172.21.15.73:0/2043478413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c80af2a0 0x7f24c806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c67fc640 1 -- 172.21.15.73:0/2043478413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c80af2a0 msgr2=0x7f24c806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c67fc640 1 --2- 172.21.15.73:0/2043478413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c80af2a0 0x7f24c806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c67fc640 1 -- 172.21.15.73:0/2043478413 >> v1:172.21.15.73:6789/0 conn(0x7f24c815bec0 legacy=0x7f24c80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c67fc640 1 -- 172.21.15.73:0/2043478413 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c80b3b30 con 0x7f24c815c2a0 2024-09-12T03:37:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c5ffb640 1 -- 172.21.15.73:0/2043478413 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379471049 0 0) 0x7f24c80b3290 con 0x7f24c815bec0 2024-09-12T03:37:43.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c77fe640 1 --2- 172.21.15.73:0/2043478413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c80af2a0 0x7f24c806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:43.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c67fc640 1 --2- 172.21.15.73:0/2043478413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c80aed60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009d90 tx=0x7f24b801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925c5bff91cb489 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c5ffb640 1 -- 172.21.15.73:0/2043478413 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b80b2070 con 0x7f24c815c2a0 2024-09-12T03:37:43.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c5ffb640 1 -- 172.21.15.73:0/2043478413 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24b80a5a00 con 0x7f24c815c2a0 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24c5ffb640 1 -- 172.21.15.73:0/2043478413 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24b80a5dd0 con 0x7f24c815c2a0 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- 172.21.15.73:0/2043478413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 msgr2=0x7f24c80aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 --2- 172.21.15.73:0/2043478413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c80aed60 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f24b8009d90 tx=0x7f24b801c940 comp rx=0 tx=0).stop 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- 172.21.15.73:0/2043478413 shutdown_connections 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 --2- 172.21.15.73:0/2043478413 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c80af2a0 0x7f24c806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 --2- 172.21.15.73:0/2043478413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c80aed60 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- 172.21.15.73:0/2043478413 >> 172.21.15.73:0/2043478413 conn(0x7f24c80b1f90 msgr2=0x7f24c80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- 172.21.15.73:0/2043478413 shutdown_connections 2024-09-12T03:37:43.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.602+0000 7f24cd592640 1 -- 172.21.15.73:0/2043478413 wait complete. 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 Processor -- start 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 -- start start 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24c80af2a0 0x7f24c8073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c815bec0 0x7f24c8164590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c8154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f24c806ed50 con 0x7f24c815c2a0 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f24c80af6b0 con 0x7f24c80af2a0 2024-09-12T03:37:43.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f24c806eed0 con 0x7f24c815bec0 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c8154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c8154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57768/0 (socket says 172.21.15.73:57768) 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 -- 172.21.15.73:0/161030502 learned_addr learned my addr 172.21.15.73:0/161030502 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c67fc640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c815bec0 0x7f24c8164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 -- 172.21.15.73:0/161030502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c815bec0 msgr2=0x7f24c8164590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c815bec0 0x7f24c8164590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 -- 172.21.15.73:0/161030502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24c80af2a0 msgr2=0x7f24c8073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24c80af2a0 0x7f24c8073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 -- 172.21.15.73:0/161030502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c8166510 con 0x7f24c815c2a0 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24c77fe640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c8154dc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c820 tx=0x7f24bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24af7fe640 1 -- 172.21.15.73:0/161030502 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc015070 con 0x7f24c815c2a0 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24af7fe640 1 -- 172.21.15.73:0/161030502 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc007a70 con 0x7f24c815c2a0 2024-09-12T03:37:43.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24c81667f0 con 0x7f24c815c2a0 2024-09-12T03:37:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24af7fe640 1 -- 172.21.15.73:0/161030502 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc007e60 con 0x7f24c815c2a0 2024-09-12T03:37:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24c8166db0 con 0x7f24c815c2a0 2024-09-12T03:37:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.606+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24c806e000 con 0x7f24c815c2a0 2024-09-12T03:37:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.610+0000 7f24af7fe640 1 -- 172.21.15.73:0/161030502 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24bc018070 con 0x7f24c815c2a0 2024-09-12T03:37:43.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.610+0000 7f24af7fe640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f24b40678c0 0x7f24b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.610+0000 7f24c6ffd640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f24b40678c0 0x7f24b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.610+0000 7f24af7fe640 1 -- 172.21.15.73:0/161030502 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f24bc085db0 con 0x7f24c815c2a0 2024-09-12T03:37:43.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.610+0000 7f24c6ffd640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f24b40678c0 0x7f24b4069d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24c00011f0 tx=0x7f24c0007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.614+0000 7f24af7fe640 1 -- 172.21.15.73:0/161030502 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f24bc056760 con 0x7f24c815c2a0 2024-09-12T03:37:43.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.758+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24c8151910 con 0x7f24b40678c0 2024-09-12T03:37:43.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.774+0000 7f24af7fe640 1 -- 172.21.15.73:0/161030502 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241354 (secure 0 0 0) 0x7f24c8151910 con 0x7f24b40678c0 2024-09-12T03:37:43.778 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:43.779 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:43.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f24b40678c0 msgr2=0x7f24b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f24b40678c0 0x7f24b4069d80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f24c00011f0 tx=0x7f24c0007930 comp rx=0 tx=0).stop 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 msgr2=0x7f24c8154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c8154dc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c820 tx=0x7f24bc00cce0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 shutdown_connections 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f24b40678c0 0x7f24b4069d80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24c815c2a0 0x7f24c8154dc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f24c815bec0 0x7f24c8164590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 --2- 172.21.15.73:0/161030502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24c80af2a0 0x7f24c8073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 >> 172.21.15.73:0/161030502 conn(0x7f24c80b1f90 msgr2=0x7f24c815a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 shutdown_connections 2024-09-12T03:37:43.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.778+0000 7f24cd592640 1 -- 172.21.15.73:0/161030502 wait complete. 2024-09-12T03:37:43.795 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-12T03:37:41.843590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":254460,"kb_used_data":9080,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720260,"statfs":{"total":773094113280,"available":772833546240,"internally_reserved":0,"allocated":9297920,"data_stored":4848231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001032"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430456+0000","last_change":"2024-09-12T03:37:40.429021+0000","last_active":"2024-09-12T03:37:40.430456+0000","last_peered":"2024-09-12T03:37:40.430456+0000","last_clean":"2024-09-12T03:37:40.430456+0000","last_became_active":"2024-09-12T03:37:40.428595+0000","last_became_peered":"2024-09-12T03:37:40.428595+0000","last_unstale":"2024-09-12T03:37:40.430456+0000","last_undegraded":"2024-09-12T03:37:40.430456+0000","last_fullsized":"2024-09-12T03:37:40.430456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:27.282926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424594+0000","last_change":"2024-09-12T03:37:40.418759+0000","last_active":"2024-09-12T03:37:40.424594+0000","last_peered":"2024-09-12T03:37:40.424594+0000","last_clean":"2024-09-12T03:37:40.424594+0000","last_became_active":"2024-09-12T03:37:40.418302+0000","last_became_peered":"2024-09-12T03:37:40.418302+0000","last_unstale":"2024-09-12T03:37:40.424594+0000","last_undegraded":"2024-09-12T03:37:40.424594+0000","last_fullsized":"2024-09-12T03:37:40.424594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:05.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424419+0000","last_change":"2024-09-12T03:37:40.419713+0000","last_active":"2024-09-12T03:37:40.424419+0000","last_peered":"2024-09-12T03:37:40.424419+0000","last_clean":"2024-09-12T03:37:40.424419+0000","last_became_active":"2024-09-12T03:37:40.419377+0000","last_became_peered":"2024-09-12T03:37:40.419377+0000","last_unstale":"2024-09-12T03:37:40.424419+0000","last_undegraded":"2024-09-12T03:37:40.424419+0000","last_fullsized":"2024-09-12T03:37:40.424419+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.849186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436199+0000","last_change":"2024-09-12T03:37:40.425754+0000","last_active":"2024-09-12T03:37:40.436199+0000","last_peered":"2024-09-12T03:37:40.436199+0000","last_clean":"2024-09-12T03:37:40.436199+0000","last_became_active":"2024-09-12T03:37:40.425148+0000","last_became_peered":"2024-09-12T03:37:40.425148+0000","last_unstale":"2024-09-12T03:37:40.436199+0000","last_undegraded":"2024-09-12T03:37:40.436199+0000","last_fullsized":"2024-09-12T03:37:40.436199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:14.157378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430236+0000","last_change":"2024-09-12T03:37:40.424603+0000","last_active":"2024-09-12T03:37:40.430236+0000","last_peered":"2024-09-12T03:37:40.430236+0000","last_clean":"2024-09-12T03:37:40.430236+0000","last_became_active":"2024-09-12T03:37:40.424281+0000","last_became_peered":"2024-09-12T03:37:40.424281+0000","last_unstale":"2024-09-12T03:37:40.430236+0000","last_undegraded":"2024-09-12T03:37:40.430236+0000","last_fullsized":"2024-09-12T03:37:40.430236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:41.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430310+0000","last_change":"2024-09-12T03:37:40.425608+0000","last_active":"2024-09-12T03:37:40.430310+0000","last_peered":"2024-09-12T03:37:40.430310+0000","last_clean":"2024-09-12T03:37:40.430310+0000","last_became_active":"2024-09-12T03:37:40.424515+0000","last_became_peered":"2024-09-12T03:37:40.424515+0000","last_unstale":"2024-09-12T03:37:40.430310+0000","last_undegraded":"2024-09-12T03:37:40.430310+0000","last_fullsized":"2024-09-12T03:37:40.430310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:06.834378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.440639+0000","last_change":"2024-09-12T03:37:39.416198+0000","last_active":"2024-09-12T03:37:40.440639+0000","last_peered":"2024-09-12T03:37:40.440639+0000","last_clean":"2024-09-12T03:37:40.440639+0000","last_became_active":"2024-09-12T03:37:39.415495+0000","last_became_peered":"2024-09-12T03:37:39.415495+0000","last_unstale":"2024-09-12T03:37:40.440639+0000","last_undegraded":"2024-09-12T03:37:40.440639+0000","last_fullsized":"2024-09-12T03:37:40.440639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:34.724760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430302+0000","last_change":"2024-09-12T03:37:40.424326+0000","last_active":"2024-09-12T03:37:40.430302+0000","last_peered":"2024-09-12T03:37:40.430302+0000","last_clean":"2024-09-12T03:37:40.430302+0000","last_became_active":"2024-09-12T03:37:40.424042+0000","last_became_peered":"2024-09-12T03:37:40.424042+0000","last_unstale":"2024-09-12T03:37:40.430302+0000","last_undegraded":"2024-09-12T03:37:40.430302+0000","last_fullsized":"2024-09-12T03:37:40.430302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.045762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437117+0000","last_change":"2024-09-12T03:37:40.435971+0000","last_active":"2024-09-12T03:37:40.437117+0000","last_peered":"2024-09-12T03:37:40.437117+0000","last_clean":"2024-09-12T03:37:40.437117+0000","last_became_active":"2024-09-12T03:37:40.435660+0000","last_became_peered":"2024-09-12T03:37:40.435660+0000","last_unstale":"2024-09-12T03:37:40.437117+0000","last_undegraded":"2024-09-12T03:37:40.437117+0000","last_fullsized":"2024-09-12T03:37:40.437117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:46.170305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.432677+0000","last_change":"2024-09-12T03:37:39.413393+0000","last_active":"2024-09-12T03:37:40.432677+0000","last_peered":"2024-09-12T03:37:40.432677+0000","last_clean":"2024-09-12T03:37:40.432677+0000","last_became_active":"2024-09-12T03:37:39.412623+0000","last_became_peered":"2024-09-12T03:37:39.412623+0000","last_unstale":"2024-09-12T03:37:40.432677+0000","last_undegraded":"2024-09-12T03:37:40.432677+0000","last_fullsized":"2024-09-12T03:37:40.432677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:57.769487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436168+0000","last_change":"2024-09-12T03:37:40.418137+0000","last_active":"2024-09-12T03:37:40.436168+0000","last_peered":"2024-09-12T03:37:40.436168+0000","last_clean":"2024-09-12T03:37:40.436168+0000","last_became_active":"2024-09-12T03:37:40.416243+0000","last_became_peered":"2024-09-12T03:37:40.416243+0000","last_unstale":"2024-09-12T03:37:40.436168+0000","last_undegraded":"2024-09-12T03:37:40.436168+0000","last_fullsized":"2024-09-12T03:37:40.436168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:43.363057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.439177+0000","last_change":"2024-09-12T03:37:40.437610+0000","last_active":"2024-09-12T03:37:40.439177+0000","last_peered":"2024-09-12T03:37:40.439177+0000","last_clean":"2024-09-12T03:37:40.439177+0000","last_became_active":"2024-09-12T03:37:40.437312+0000","last_became_peered":"2024-09-12T03:37:40.437312+0000","last_unstale":"2024-09-12T03:37:40.439177+0000","last_undegraded":"2024-09-12T03:37:40.439177+0000","last_fullsized":"2024-09-12T03:37:40.439177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:08.418783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.441756+0000","last_change":"2024-09-12T03:37:39.425400+0000","last_active":"2024-09-12T03:37:40.441756+0000","last_peered":"2024-09-12T03:37:40.441756+0000","last_clean":"2024-09-12T03:37:40.441756+0000","last_became_active":"2024-09-12T03:37:39.425134+0000","last_became_peered":"2024-09-12T03:37:39.425134+0000","last_unstale":"2024-09-12T03:37:40.441756+0000","last_undegraded":"2024-09-12T03:37:40.441756+0000","last_fullsized":"2024-09-12T03:37:40.441756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:12.236274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.401479+0000","last_change":"2024-09-12T03:37:39.422461+0000","last_active":"2024-09-12T03:37:40.401479+0000","last_peered":"2024-09-12T03:37:40.401479+0000","last_clean":"2024-09-12T03:37:40.401479+0000","last_became_active":"2024-09-12T03:37:39.421555+0000","last_became_peered":"2024-09-12T03:37:39.421555+0000","last_unstale":"2024-09-12T03:37:40.401479+0000","last_undegraded":"2024-09-12T03:37:40.401479+0000","last_fullsized":"2024-09-12T03:37:40.401479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:42.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430333+0000","last_change":"2024-09-12T03:37:40.428686+0000","last_active":"2024-09-12T03:37:40.430333+0000","last_peered":"2024-09-12T03:37:40.430333+0000","last_clean":"2024-09-12T03:37:40.430333+0000","last_became_active":"2024-09-12T03:37:40.423872+0000","last_became_peered":"2024-09-12T03:37:40.423872+0000","last_unstale":"2024-09-12T03:37:40.430333+0000","last_undegraded":"2024-09-12T03:37:40.430333+0000","last_fullsized":"2024-09-12T03:37:40.430333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.082371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436868+0000","last_change":"2024-09-12T03:37:39.432638+0000","last_active":"2024-09-12T03:37:40.436868+0000","last_peered":"2024-09-12T03:37:40.436868+0000","last_clean":"2024-09-12T03:37:40.436868+0000","last_became_active":"2024-09-12T03:37:39.431762+0000","last_became_peered":"2024-09-12T03:37:39.431762+0000","last_unstale":"2024-09-12T03:37:40.436868+0000","last_undegraded":"2024-09-12T03:37:40.436868+0000","last_fullsized":"2024-09-12T03:37:40.436868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:55.197250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436291+0000","last_change":"2024-09-12T03:37:40.417439+0000","last_active":"2024-09-12T03:37:40.436291+0000","last_peered":"2024-09-12T03:37:40.436291+0000","last_clean":"2024-09-12T03:37:40.436291+0000","last_became_active":"2024-09-12T03:37:40.416773+0000","last_became_peered":"2024-09-12T03:37:40.416773+0000","last_unstale":"2024-09-12T03:37:40.436291+0000","last_undegraded":"2024-09-12T03:37:40.436291+0000","last_fullsized":"2024-09-12T03:37:40.436291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:53.808509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.438617+0000","last_change":"2024-09-12T03:37:40.436044+0000","last_active":"2024-09-12T03:37:40.438617+0000","last_peered":"2024-09-12T03:37:40.438617+0000","last_clean":"2024-09-12T03:37:40.438617+0000","last_became_active":"2024-09-12T03:37:40.432077+0000","last_became_peered":"2024-09-12T03:37:40.432077+0000","last_unstale":"2024-09-12T03:37:40.438617+0000","last_undegraded":"2024-09-12T03:37:40.438617+0000","last_fullsized":"2024-09-12T03:37:40.438617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:35.840013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430264+0000","last_change":"2024-09-12T03:37:40.424564+0000","last_active":"2024-09-12T03:37:40.430264+0000","last_peered":"2024-09-12T03:37:40.430264+0000","last_clean":"2024-09-12T03:37:40.430264+0000","last_became_active":"2024-09-12T03:37:40.424199+0000","last_became_peered":"2024-09-12T03:37:40.424199+0000","last_unstale":"2024-09-12T03:37:40.430264+0000","last_undegraded":"2024-09-12T03:37:40.430264+0000","last_fullsized":"2024-09-12T03:37:40.430264+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:36.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437142+0000","last_change":"2024-09-12T03:37:40.424253+0000","last_active":"2024-09-12T03:37:40.437142+0000","last_peered":"2024-09-12T03:37:40.437142+0000","last_clean":"2024-09-12T03:37:40.437142+0000","last_became_active":"2024-09-12T03:37:40.422441+0000","last_became_peered":"2024-09-12T03:37:40.422441+0000","last_unstale":"2024-09-12T03:37:40.437142+0000","last_undegraded":"2024-09-12T03:37:40.437142+0000","last_fullsized":"2024-09-12T03:37:40.437142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.414454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429479+0000","last_change":"2024-09-12T03:37:40.417407+0000","last_active":"2024-09-12T03:37:40.429479+0000","last_peered":"2024-09-12T03:37:40.429479+0000","last_clean":"2024-09-12T03:37:40.429479+0000","last_became_active":"2024-09-12T03:37:40.416874+0000","last_became_peered":"2024-09-12T03:37:40.416874+0000","last_unstale":"2024-09-12T03:37:40.429479+0000","last_undegraded":"2024-09-12T03:37:40.429479+0000","last_fullsized":"2024-09-12T03:37:40.429479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.689588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429584+0000","last_change":"2024-09-12T03:37:40.421941+0000","last_active":"2024-09-12T03:37:40.429584+0000","last_peered":"2024-09-12T03:37:40.429584+0000","last_clean":"2024-09-12T03:37:40.429584+0000","last_became_active":"2024-09-12T03:37:40.421609+0000","last_became_peered":"2024-09-12T03:37:40.421609+0000","last_unstale":"2024-09-12T03:37:40.429584+0000","last_undegraded":"2024-09-12T03:37:40.429584+0000","last_fullsized":"2024-09-12T03:37:40.429584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.675530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.412612+0000","last_change":"2024-09-12T03:37:39.427202+0000","last_active":"2024-09-12T03:37:40.412612+0000","last_peered":"2024-09-12T03:37:40.412612+0000","last_clean":"2024-09-12T03:37:40.412612+0000","last_became_active":"2024-09-12T03:37:39.425841+0000","last_became_peered":"2024-09-12T03:37:39.425841+0000","last_unstale":"2024-09-12T03:37:40.412612+0000","last_undegraded":"2024-09-12T03:37:40.412612+0000","last_fullsized":"2024-09-12T03:37:40.412612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:21.625912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.400378+0000","last_change":"2024-09-12T03:37:39.430328+0000","last_active":"2024-09-12T03:37:40.400378+0000","last_peered":"2024-09-12T03:37:40.400378+0000","last_clean":"2024-09-12T03:37:40.400378+0000","last_became_active":"2024-09-12T03:37:39.430047+0000","last_became_peered":"2024-09-12T03:37:39.430047+0000","last_unstale":"2024-09-12T03:37:40.400378+0000","last_undegraded":"2024-09-12T03:37:40.400378+0000","last_fullsized":"2024-09-12T03:37:40.400378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.008253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436339+0000","last_change":"2024-09-12T03:37:40.432493+0000","last_active":"2024-09-12T03:37:40.436339+0000","last_peered":"2024-09-12T03:37:40.436339+0000","last_clean":"2024-09-12T03:37:40.436339+0000","last_became_active":"2024-09-12T03:37:40.431967+0000","last_became_peered":"2024-09-12T03:37:40.431967+0000","last_unstale":"2024-09-12T03:37:40.436339+0000","last_undegraded":"2024-09-12T03:37:40.436339+0000","last_fullsized":"2024-09-12T03:37:40.436339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:30.156578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.408238+0000","last_change":"2024-09-12T03:37:39.426991+0000","last_active":"2024-09-12T03:37:40.408238+0000","last_peered":"2024-09-12T03:37:40.408238+0000","last_clean":"2024-09-12T03:37:40.408238+0000","last_became_active":"2024-09-12T03:37:39.425872+0000","last_became_peered":"2024-09-12T03:37:39.425872+0000","last_unstale":"2024-09-12T03:37:40.408238+0000","last_undegraded":"2024-09-12T03:37:40.408238+0000","last_fullsized":"2024-09-12T03:37:40.408238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:30.367921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424633+0000","last_change":"2024-09-12T03:37:40.417611+0000","last_active":"2024-09-12T03:37:40.424633+0000","last_peered":"2024-09-12T03:37:40.424633+0000","last_clean":"2024-09-12T03:37:40.424633+0000","last_became_active":"2024-09-12T03:37:40.417268+0000","last_became_peered":"2024-09-12T03:37:40.417268+0000","last_unstale":"2024-09-12T03:37:40.424633+0000","last_undegraded":"2024-09-12T03:37:40.424633+0000","last_fullsized":"2024-09-12T03:37:40.424633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.432284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:39.377845+0000","last_change":"2024-09-12T03:37:39.377845+0000","last_active":"2024-09-12T03:37:39.377845+0000","last_peered":"2024-09-12T03:37:39.377845+0000","last_clean":"2024-09-12T03:37:39.377845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:39.377845+0000","last_undegraded":"2024-09-12T03:37:39.377845+0000","last_fullsized":"2024-09-12T03:37:39.377845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T03:37:38.368587+0000","last_change":"2024-09-12T03:37:38.368587+0000","last_active":"2024-09-12T03:37:38.368587+0000","last_peered":"2024-09-12T03:37:38.368587+0000","last_clean":"2024-09-12T03:37:38.368587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:37:38.368587+0000","last_undegraded":"2024-09-12T03:37:38.368587+0000","last_fullsized":"2024-09-12T03:37:38.368587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":277,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-12T03:37:36.833567+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:36.833567+0000","last_peered":"2024-09-12T03:37:36.833567+0000","last_clean":"2024-09-12T03:37:36.833567+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:36.833567+0000","last_undegraded":"2024-09-12T03:37:36.833567+0000","last_fullsized":"2024-09-12T03:37:36.833567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":16,"acting":16,"num_store_stats":2},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":38,"acting":38,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1597440,"data_stored":1044413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28016,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32176,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1003520,"data_stored":454045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":476304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":1057289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:43.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:43.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.954+0000 7fe28be2a640 1 Processor -- start 2024-09-12T03:37:43.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.954+0000 7fe28be2a640 1 -- start start 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28be2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 0x7fe28415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28be2a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe28415f1d0 0x7fe2840adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28be2a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2840aede0 con 0x7fe2841520a0 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28be2a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe284152480 con 0x7fe28415f1d0 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28be2a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe28415fa10 con 0x7fe284070020 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe289bc6640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe2841520a0 0x7fe28406f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37522/0 (socket says 172.21.15.73:37522) 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe289bc6640 1 -- 172.21.15.73:0/1203063800 learned_addr learned my addr 172.21.15.73:0/1203063800 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:43.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe2893c5640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 0x7fe28415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315878360 0 0) 0x7fe2840aede0 con 0x7fe2841520a0 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe270003530 con 0x7fe2841520a0 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/1203063800 >> v2:172.21.15.150:3300/0 conn(0x7fe28415f1d0 0x7fe2840adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3881174840 0 0) 0x7fe270003530 con 0x7fe2841520a0 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 msgr2=0x7fe28415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 0x7fe28415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 >> v2:172.21.15.150:3300/0 conn(0x7fe28415f1d0 msgr2=0x7fe2840adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 --2- 172.21.15.73:0/1203063800 >> v2:172.21.15.150:3300/0 conn(0x7fe28415f1d0 0x7fe2840adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe284074250 con 0x7fe2841520a0 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fe280001680 con 0x7fe2841520a0 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 >> v1:172.21.15.73:6789/0 conn(0x7fe2841520a0 legacy=0x7fe28406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 0x7fe2700039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270003f40 0x7fe270004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe270004d50 0x7fe2700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe28415fa10 con 0x7fe270004d50 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe27000b9d0 con 0x7fe270003f40 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe27000bba0 con 0x7fe284070020 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe270004d50 0x7fe2700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe289bc6640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 0x7fe2700039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe2893c5640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270003f40 0x7fe270004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28a3c7640 1 -- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 msgr2=0x7fe2700039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe284070020 0x7fe2700039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28a3c7640 1 -- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270003f40 msgr2=0x7fe270004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:43.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270003f40 0x7fe270004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.958+0000 7fe28a3c7640 1 -- 172.21.15.73:0/1203063800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe270003530 con 0x7fe270004d50 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe270004d50 0x7fe2700051d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009ba0 tx=0x7fe27c01f0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3df688151113fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0b3070 con 0x7fe270004d50 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c0ae600 con 0x7fe270004d50 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe288bc4640 1 -- 172.21.15.73:0/1203063800 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c009be0 con 0x7fe270004d50 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- 172.21.15.73:0/1203063800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe270004d50 msgr2=0x7fe2700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 --2- 172.21.15.73:0/1203063800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe270004d50 0x7fe2700051d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009ba0 tx=0x7fe27c01f0b0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 -- 172.21.15.73:0/1203063800 reap_dead start 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- 172.21.15.73:0/1203063800 shutdown_connections 2024-09-12T03:37:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- 172.21.15.73:0/1203063800 >> 172.21.15.73:0/1203063800 conn(0x7fe2840b1f90 msgr2=0x7fe2840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- 172.21.15.73:0/1203063800 shutdown_connections 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- 172.21.15.73:0/1203063800 wait complete. 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 Processor -- start 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- start start 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270004d50 0x7fe2841502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2840cf1f0 0x7fe284159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2840cf650 0x7fe28415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe284073a50 con 0x7fe2840cf650 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe284073770 con 0x7fe270004d50 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28be2a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe284073d30 con 0x7fe2840cf1f0 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2840cf650 0x7fe28415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2840cf650 0x7fe28415a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57778/0 (socket says 172.21.15.73:57778) 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 -- 172.21.15.73:0/3621836585 learned_addr learned my addr 172.21.15.73:0/3621836585 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe2893c5640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2840cf1f0 0x7fe284159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe289bc6640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270004d50 0x7fe2841502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 -- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2840cf1f0 msgr2=0x7fe284159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2840cf1f0 0x7fe284159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 -- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270004d50 msgr2=0x7fe2841502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270004d50 0x7fe2841502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 -- 172.21.15.73:0/3621836585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2841f4130 con 0x7fe2840cf650 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe2893c5640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2840cf1f0 0x7fe284159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe28a3c7640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2840cf650 0x7fe28415a500 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe27c09aad0 tx=0x7fe270005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.962+0000 7fe27a7fc640 1 -- 172.21.15.73:0/3621836585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0b3040 con 0x7fe2840cf650 2024-09-12T03:37:43.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe27a7fc640 1 -- 172.21.15.73:0/3621836585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c0bc070 con 0x7fe2840cf650 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2841f4410 con 0x7fe2840cf650 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe27a7fc640 1 -- 172.21.15.73:0/3621836585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c009be0 con 0x7fe2840cf650 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2841f49d0 con 0x7fe2840cf650 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe284068e50 con 0x7fe2840cf650 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe27a7fc640 1 -- 172.21.15.73:0/3621836585 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe27c0c1460 con 0x7fe2840cf650 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe27a7fc640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2680678f0 0x7fe268069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe289bc6640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2680678f0 0x7fe268069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe27a7fc640 1 -- 172.21.15.73:0/3621836585 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fe27c120c10 con 0x7fe2840cf650 2024-09-12T03:37:43.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.966+0000 7fe289bc6640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2680678f0 0x7fe268069db0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe2800017f0 tx=0x7fe280009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:43.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:43.970+0000 7fe27a7fc640 1 -- 172.21.15.73:0/3621836585 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe27c018dc0 con 0x7fe2840cf650 2024-09-12T03:37:44.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.130+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2840aede0 con 0x7fe2680678f0 2024-09-12T03:37:44.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.146+0000 7fe27a7fc640 1 -- 172.21.15.73:0/3621836585 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252052 (secure 0 0 0) 0x7fe2840aede0 con 0x7fe2680678f0 2024-09-12T03:37:44.150 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:44.152 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2680678f0 msgr2=0x7fe268069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2680678f0 0x7fe268069db0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe2800017f0 tx=0x7fe280009040 comp rx=0 tx=0).stop 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2840cf650 msgr2=0x7fe28415a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2840cf650 0x7fe28415a500 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe27c09aad0 tx=0x7fe270005840 comp rx=0 tx=0).stop 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 shutdown_connections 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2680678f0 0x7fe268069db0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2840cf650 0x7fe28415a500 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2840cf1f0 0x7fe284159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 --2- 172.21.15.73:0/3621836585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe270004d50 0x7fe2841502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 >> 172.21.15.73:0/3621836585 conn(0x7fe2840b1f90 msgr2=0x7fe28406f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:44.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 shutdown_connections 2024-09-12T03:37:44.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.150+0000 7fe28be2a640 1 -- 172.21.15.73:0/3621836585 wait complete. 2024-09-12T03:37:44.170 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-12T03:37:43.844189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254724,"kb_used_data":9364,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719996,"statfs":{"total":773094113280,"available":772833275904,"internally_reserved":0,"allocated":9588736,"data_stored":4995543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.465977"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728420+0000","last_change":"2024-09-12T03:37:40.418524+0000","last_active":"2024-09-12T03:37:41.728420+0000","last_peered":"2024-09-12T03:37:41.728420+0000","last_clean":"2024-09-12T03:37:41.728420+0000","last_became_active":"2024-09-12T03:37:40.417456+0000","last_became_peered":"2024-09-12T03:37:40.417456+0000","last_unstale":"2024-09-12T03:37:41.728420+0000","last_undegraded":"2024-09-12T03:37:41.728420+0000","last_fullsized":"2024-09-12T03:37:41.728420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:51.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088190+0000","last_change":"2024-09-12T03:37:40.417871+0000","last_active":"2024-09-12T03:37:42.088190+0000","last_peered":"2024-09-12T03:37:42.088190+0000","last_clean":"2024-09-12T03:37:42.088190+0000","last_became_active":"2024-09-12T03:37:40.417195+0000","last_became_peered":"2024-09-12T03:37:40.417195+0000","last_unstale":"2024-09-12T03:37:42.088190+0000","last_undegraded":"2024-09-12T03:37:42.088190+0000","last_fullsized":"2024-09-12T03:37:42.088190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727920+0000","last_change":"2024-09-12T03:37:40.425683+0000","last_active":"2024-09-12T03:37:41.727920+0000","last_peered":"2024-09-12T03:37:41.727920+0000","last_clean":"2024-09-12T03:37:41.727920+0000","last_became_active":"2024-09-12T03:37:40.425250+0000","last_became_peered":"2024-09-12T03:37:40.425250+0000","last_unstale":"2024-09-12T03:37:41.727920+0000","last_undegraded":"2024-09-12T03:37:41.727920+0000","last_fullsized":"2024-09-12T03:37:41.727920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:04.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089667+0000","last_change":"2024-09-12T03:37:40.438674+0000","last_active":"2024-09-12T03:37:42.089667+0000","last_peered":"2024-09-12T03:37:42.089667+0000","last_clean":"2024-09-12T03:37:42.089667+0000","last_became_active":"2024-09-12T03:37:40.438182+0000","last_became_peered":"2024-09-12T03:37:40.438182+0000","last_unstale":"2024-09-12T03:37:42.089667+0000","last_undegraded":"2024-09-12T03:37:42.089667+0000","last_fullsized":"2024-09-12T03:37:42.089667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.158323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402829+0000","last_change":"2024-09-12T03:37:40.434204+0000","last_active":"2024-09-12T03:37:41.402829+0000","last_peered":"2024-09-12T03:37:41.402829+0000","last_clean":"2024-09-12T03:37:41.402829+0000","last_became_active":"2024-09-12T03:37:40.433795+0000","last_became_peered":"2024-09-12T03:37:40.433795+0000","last_unstale":"2024-09-12T03:37:41.402829+0000","last_undegraded":"2024-09-12T03:37:41.402829+0000","last_fullsized":"2024-09-12T03:37:41.402829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:53.990681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430456+0000","last_change":"2024-09-12T03:37:40.429021+0000","last_active":"2024-09-12T03:37:40.430456+0000","last_peered":"2024-09-12T03:37:40.430456+0000","last_clean":"2024-09-12T03:37:40.430456+0000","last_became_active":"2024-09-12T03:37:40.428595+0000","last_became_peered":"2024-09-12T03:37:40.428595+0000","last_unstale":"2024-09-12T03:37:40.430456+0000","last_undegraded":"2024-09-12T03:37:40.430456+0000","last_fullsized":"2024-09-12T03:37:40.430456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:27.282926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503627+0000","last_change":"2024-09-12T03:37:40.419795+0000","last_active":"2024-09-12T03:37:41.503627+0000","last_peered":"2024-09-12T03:37:41.503627+0000","last_clean":"2024-09-12T03:37:41.503627+0000","last_became_active":"2024-09-12T03:37:40.418899+0000","last_became_peered":"2024-09-12T03:37:40.418899+0000","last_unstale":"2024-09-12T03:37:41.503627+0000","last_undegraded":"2024-09-12T03:37:41.503627+0000","last_fullsized":"2024-09-12T03:37:41.503627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:56.112723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087683+0000","last_change":"2024-09-12T03:37:40.431454+0000","last_active":"2024-09-12T03:37:42.087683+0000","last_peered":"2024-09-12T03:37:42.087683+0000","last_clean":"2024-09-12T03:37:42.087683+0000","last_became_active":"2024-09-12T03:37:40.431024+0000","last_became_peered":"2024-09-12T03:37:40.431024+0000","last_unstale":"2024-09-12T03:37:42.087683+0000","last_undegraded":"2024-09-12T03:37:42.087683+0000","last_fullsized":"2024-09-12T03:37:42.087683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.112387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405943+0000","last_change":"2024-09-12T03:37:40.426674+0000","last_active":"2024-09-12T03:37:41.405943+0000","last_peered":"2024-09-12T03:37:41.405943+0000","last_clean":"2024-09-12T03:37:41.405943+0000","last_became_active":"2024-09-12T03:37:40.425626+0000","last_became_peered":"2024-09-12T03:37:40.425626+0000","last_unstale":"2024-09-12T03:37:41.405943+0000","last_undegraded":"2024-09-12T03:37:41.405943+0000","last_fullsized":"2024-09-12T03:37:41.405943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:42.768726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401731+0000","last_change":"2024-09-12T03:37:40.427701+0000","last_active":"2024-09-12T03:37:41.401731+0000","last_peered":"2024-09-12T03:37:41.401731+0000","last_clean":"2024-09-12T03:37:41.401731+0000","last_became_active":"2024-09-12T03:37:40.427374+0000","last_became_peered":"2024-09-12T03:37:40.427374+0000","last_unstale":"2024-09-12T03:37:41.401731+0000","last_undegraded":"2024-09-12T03:37:41.401731+0000","last_fullsized":"2024-09-12T03:37:41.401731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:51.375752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404435+0000","last_change":"2024-09-12T03:37:40.429489+0000","last_active":"2024-09-12T03:37:41.404435+0000","last_peered":"2024-09-12T03:37:41.404435+0000","last_clean":"2024-09-12T03:37:41.404435+0000","last_became_active":"2024-09-12T03:37:40.429236+0000","last_became_peered":"2024-09-12T03:37:40.429236+0000","last_unstale":"2024-09-12T03:37:41.404435+0000","last_undegraded":"2024-09-12T03:37:41.404435+0000","last_fullsized":"2024-09-12T03:37:41.404435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:55.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401563+0000","last_change":"2024-09-12T03:37:40.425714+0000","last_active":"2024-09-12T03:37:41.401563+0000","last_peered":"2024-09-12T03:37:41.401563+0000","last_clean":"2024-09-12T03:37:41.401563+0000","last_became_active":"2024-09-12T03:37:40.425333+0000","last_became_peered":"2024-09-12T03:37:40.425333+0000","last_unstale":"2024-09-12T03:37:41.401563+0000","last_undegraded":"2024-09-12T03:37:41.401563+0000","last_fullsized":"2024-09-12T03:37:41.401563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:49.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087790+0000","last_change":"2024-09-12T03:37:40.426993+0000","last_active":"2024-09-12T03:37:42.087790+0000","last_peered":"2024-09-12T03:37:42.087790+0000","last_clean":"2024-09-12T03:37:42.087790+0000","last_became_active":"2024-09-12T03:37:40.426625+0000","last_became_peered":"2024-09-12T03:37:40.426625+0000","last_unstale":"2024-09-12T03:37:42.087790+0000","last_undegraded":"2024-09-12T03:37:42.087790+0000","last_fullsized":"2024-09-12T03:37:42.087790+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:40.479744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402081+0000","last_change":"2024-09-12T03:37:40.428079+0000","last_active":"2024-09-12T03:37:41.402081+0000","last_peered":"2024-09-12T03:37:41.402081+0000","last_clean":"2024-09-12T03:37:41.402081+0000","last_became_active":"2024-09-12T03:37:40.427411+0000","last_became_peered":"2024-09-12T03:37:40.427411+0000","last_unstale":"2024-09-12T03:37:41.402081+0000","last_undegraded":"2024-09-12T03:37:41.402081+0000","last_fullsized":"2024-09-12T03:37:41.402081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:48.886084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088376+0000","last_change":"2024-09-12T03:37:40.433673+0000","last_active":"2024-09-12T03:37:42.088376+0000","last_peered":"2024-09-12T03:37:42.088376+0000","last_clean":"2024-09-12T03:37:42.088376+0000","last_became_active":"2024-09-12T03:37:40.431573+0000","last_became_peered":"2024-09-12T03:37:40.431573+0000","last_unstale":"2024-09-12T03:37:42.088376+0000","last_undegraded":"2024-09-12T03:37:42.088376+0000","last_fullsized":"2024-09-12T03:37:42.088376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:55.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424594+0000","last_change":"2024-09-12T03:37:40.418759+0000","last_active":"2024-09-12T03:37:40.424594+0000","last_peered":"2024-09-12T03:37:40.424594+0000","last_clean":"2024-09-12T03:37:40.424594+0000","last_became_active":"2024-09-12T03:37:40.418302+0000","last_became_peered":"2024-09-12T03:37:40.418302+0000","last_unstale":"2024-09-12T03:37:40.424594+0000","last_undegraded":"2024-09-12T03:37:40.424594+0000","last_fullsized":"2024-09-12T03:37:40.424594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:05.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424419+0000","last_change":"2024-09-12T03:37:40.419713+0000","last_active":"2024-09-12T03:37:40.424419+0000","last_peered":"2024-09-12T03:37:40.424419+0000","last_clean":"2024-09-12T03:37:40.424419+0000","last_became_active":"2024-09-12T03:37:40.419377+0000","last_became_peered":"2024-09-12T03:37:40.419377+0000","last_unstale":"2024-09-12T03:37:40.424419+0000","last_undegraded":"2024-09-12T03:37:40.424419+0000","last_fullsized":"2024-09-12T03:37:40.424419+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.849186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728187+0000","last_change":"2024-09-12T03:37:40.415748+0000","last_active":"2024-09-12T03:37:41.728187+0000","last_peered":"2024-09-12T03:37:41.728187+0000","last_clean":"2024-09-12T03:37:41.728187+0000","last_became_active":"2024-09-12T03:37:40.414805+0000","last_became_peered":"2024-09-12T03:37:40.414805+0000","last_unstale":"2024-09-12T03:37:41.728187+0000","last_undegraded":"2024-09-12T03:37:41.728187+0000","last_fullsized":"2024-09-12T03:37:41.728187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.245207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404811+0000","last_change":"2024-09-12T03:37:40.425946+0000","last_active":"2024-09-12T03:37:41.404811+0000","last_peered":"2024-09-12T03:37:41.404811+0000","last_clean":"2024-09-12T03:37:41.404811+0000","last_became_active":"2024-09-12T03:37:40.425618+0000","last_became_peered":"2024-09-12T03:37:40.425618+0000","last_unstale":"2024-09-12T03:37:41.404811+0000","last_undegraded":"2024-09-12T03:37:41.404811+0000","last_fullsized":"2024-09-12T03:37:41.404811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:16.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089892+0000","last_change":"2024-09-12T03:37:40.433908+0000","last_active":"2024-09-12T03:37:42.089892+0000","last_peered":"2024-09-12T03:37:42.089892+0000","last_clean":"2024-09-12T03:37:42.089892+0000","last_became_active":"2024-09-12T03:37:40.431730+0000","last_became_peered":"2024-09-12T03:37:40.431730+0000","last_unstale":"2024-09-12T03:37:42.089892+0000","last_undegraded":"2024-09-12T03:37:42.089892+0000","last_fullsized":"2024-09-12T03:37:42.089892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:11.193587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402443+0000","last_change":"2024-09-12T03:37:40.421449+0000","last_active":"2024-09-12T03:37:41.402443+0000","last_peered":"2024-09-12T03:37:41.402443+0000","last_clean":"2024-09-12T03:37:41.402443+0000","last_became_active":"2024-09-12T03:37:40.420532+0000","last_became_peered":"2024-09-12T03:37:40.420532+0000","last_unstale":"2024-09-12T03:37:41.402443+0000","last_undegraded":"2024-09-12T03:37:41.402443+0000","last_fullsized":"2024-09-12T03:37:41.402443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:19.117928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402447+0000","last_change":"2024-09-12T03:37:40.428303+0000","last_active":"2024-09-12T03:37:41.402447+0000","last_peered":"2024-09-12T03:37:41.402447+0000","last_clean":"2024-09-12T03:37:41.402447+0000","last_became_active":"2024-09-12T03:37:40.427809+0000","last_became_peered":"2024-09-12T03:37:40.427809+0000","last_unstale":"2024-09-12T03:37:41.402447+0000","last_undegraded":"2024-09-12T03:37:41.402447+0000","last_fullsized":"2024-09-12T03:37:41.402447+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:53.359857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436199+0000","last_change":"2024-09-12T03:37:40.425754+0000","last_active":"2024-09-12T03:37:40.436199+0000","last_peered":"2024-09-12T03:37:40.436199+0000","last_clean":"2024-09-12T03:37:40.436199+0000","last_became_active":"2024-09-12T03:37:40.425148+0000","last_became_peered":"2024-09-12T03:37:40.425148+0000","last_unstale":"2024-09-12T03:37:40.436199+0000","last_undegraded":"2024-09-12T03:37:40.436199+0000","last_fullsized":"2024-09-12T03:37:40.436199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:14.157378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727334+0000","last_change":"2024-09-12T03:37:40.422739+0000","last_active":"2024-09-12T03:37:41.727334+0000","last_peered":"2024-09-12T03:37:41.727334+0000","last_clean":"2024-09-12T03:37:41.727334+0000","last_became_active":"2024-09-12T03:37:40.422394+0000","last_became_peered":"2024-09-12T03:37:40.422394+0000","last_unstale":"2024-09-12T03:37:41.727334+0000","last_undegraded":"2024-09-12T03:37:41.727334+0000","last_fullsized":"2024-09-12T03:37:41.727334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:49.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088452+0000","last_change":"2024-09-12T03:37:40.428871+0000","last_active":"2024-09-12T03:37:42.088452+0000","last_peered":"2024-09-12T03:37:42.088452+0000","last_clean":"2024-09-12T03:37:42.088452+0000","last_became_active":"2024-09-12T03:37:40.426961+0000","last_became_peered":"2024-09-12T03:37:40.426961+0000","last_unstale":"2024-09-12T03:37:42.088452+0000","last_undegraded":"2024-09-12T03:37:42.088452+0000","last_fullsized":"2024-09-12T03:37:42.088452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.245207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404013+0000","last_change":"2024-09-12T03:37:40.432570+0000","last_active":"2024-09-12T03:37:41.404013+0000","last_peered":"2024-09-12T03:37:41.404013+0000","last_clean":"2024-09-12T03:37:41.404013+0000","last_became_active":"2024-09-12T03:37:40.432262+0000","last_became_peered":"2024-09-12T03:37:40.432262+0000","last_unstale":"2024-09-12T03:37:41.404013+0000","last_undegraded":"2024-09-12T03:37:41.404013+0000","last_fullsized":"2024-09-12T03:37:41.404013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.112387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401720+0000","last_change":"2024-09-12T03:37:40.433918+0000","last_active":"2024-09-12T03:37:41.401720+0000","last_peered":"2024-09-12T03:37:41.401720+0000","last_clean":"2024-09-12T03:37:41.401720+0000","last_became_active":"2024-09-12T03:37:40.433594+0000","last_became_peered":"2024-09-12T03:37:40.433594+0000","last_unstale":"2024-09-12T03:37:41.401720+0000","last_undegraded":"2024-09-12T03:37:41.401720+0000","last_fullsized":"2024-09-12T03:37:41.401720+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.090075+0000","last_change":"2024-09-12T03:37:40.439228+0000","last_active":"2024-09-12T03:37:42.090075+0000","last_peered":"2024-09-12T03:37:42.090075+0000","last_clean":"2024-09-12T03:37:42.090075+0000","last_became_active":"2024-09-12T03:37:40.438878+0000","last_became_peered":"2024-09-12T03:37:40.438878+0000","last_unstale":"2024-09-12T03:37:42.090075+0000","last_undegraded":"2024-09-12T03:37:42.090075+0000","last_fullsized":"2024-09-12T03:37:42.090075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:31.398726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503852+0000","last_change":"2024-09-12T03:37:40.423565+0000","last_active":"2024-09-12T03:37:41.503852+0000","last_peered":"2024-09-12T03:37:41.503852+0000","last_clean":"2024-09-12T03:37:41.503852+0000","last_became_active":"2024-09-12T03:37:40.423275+0000","last_became_peered":"2024-09-12T03:37:40.423275+0000","last_unstale":"2024-09-12T03:37:41.503852+0000","last_undegraded":"2024-09-12T03:37:41.503852+0000","last_fullsized":"2024-09-12T03:37:41.503852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:15.892839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402833+0000","last_change":"2024-09-12T03:37:40.421609+0000","last_active":"2024-09-12T03:37:41.402833+0000","last_peered":"2024-09-12T03:37:41.402833+0000","last_clean":"2024-09-12T03:37:41.402833+0000","last_became_active":"2024-09-12T03:37:40.421247+0000","last_became_peered":"2024-09-12T03:37:40.421247+0000","last_unstale":"2024-09-12T03:37:41.402833+0000","last_undegraded":"2024-09-12T03:37:41.402833+0000","last_fullsized":"2024-09-12T03:37:41.402833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:34.571896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087706+0000","last_change":"2024-09-12T03:37:40.427689+0000","last_active":"2024-09-12T03:37:42.087706+0000","last_peered":"2024-09-12T03:37:42.087706+0000","last_clean":"2024-09-12T03:37:42.087706+0000","last_became_active":"2024-09-12T03:37:40.427389+0000","last_became_peered":"2024-09-12T03:37:40.427389+0000","last_unstale":"2024-09-12T03:37:42.087706+0000","last_undegraded":"2024-09-12T03:37:42.087706+0000","last_fullsized":"2024-09-12T03:37:42.087706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:31.398726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430236+0000","last_change":"2024-09-12T03:37:40.424603+0000","last_active":"2024-09-12T03:37:40.430236+0000","last_peered":"2024-09-12T03:37:40.430236+0000","last_clean":"2024-09-12T03:37:40.430236+0000","last_became_active":"2024-09-12T03:37:40.424281+0000","last_became_peered":"2024-09-12T03:37:40.424281+0000","last_unstale":"2024-09-12T03:37:40.430236+0000","last_undegraded":"2024-09-12T03:37:40.430236+0000","last_fullsized":"2024-09-12T03:37:40.430236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:41.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430310+0000","last_change":"2024-09-12T03:37:40.425608+0000","last_active":"2024-09-12T03:37:40.430310+0000","last_peered":"2024-09-12T03:37:40.430310+0000","last_clean":"2024-09-12T03:37:40.430310+0000","last_became_active":"2024-09-12T03:37:40.424515+0000","last_became_peered":"2024-09-12T03:37:40.424515+0000","last_unstale":"2024-09-12T03:37:40.430310+0000","last_undegraded":"2024-09-12T03:37:40.430310+0000","last_fullsized":"2024-09-12T03:37:40.430310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:06.834378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.440639+0000","last_change":"2024-09-12T03:37:39.416198+0000","last_active":"2024-09-12T03:37:40.440639+0000","last_peered":"2024-09-12T03:37:40.440639+0000","last_clean":"2024-09-12T03:37:40.440639+0000","last_became_active":"2024-09-12T03:37:39.415495+0000","last_became_peered":"2024-09-12T03:37:39.415495+0000","last_unstale":"2024-09-12T03:37:40.440639+0000","last_undegraded":"2024-09-12T03:37:40.440639+0000","last_fullsized":"2024-09-12T03:37:40.440639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:34.724760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430302+0000","last_change":"2024-09-12T03:37:40.424326+0000","last_active":"2024-09-12T03:37:40.430302+0000","last_peered":"2024-09-12T03:37:40.430302+0000","last_clean":"2024-09-12T03:37:40.430302+0000","last_became_active":"2024-09-12T03:37:40.424042+0000","last_became_peered":"2024-09-12T03:37:40.424042+0000","last_unstale":"2024-09-12T03:37:40.430302+0000","last_undegraded":"2024-09-12T03:37:40.430302+0000","last_fullsized":"2024-09-12T03:37:40.430302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.045762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405703+0000","last_change":"2024-09-12T03:37:39.439560+0000","last_active":"2024-09-12T03:37:41.405703+0000","last_peered":"2024-09-12T03:37:41.405703+0000","last_clean":"2024-09-12T03:37:41.405703+0000","last_became_active":"2024-09-12T03:37:39.438961+0000","last_became_peered":"2024-09-12T03:37:39.438961+0000","last_unstale":"2024-09-12T03:37:41.405703+0000","last_undegraded":"2024-09-12T03:37:41.405703+0000","last_fullsized":"2024-09-12T03:37:41.405703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:05.889743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504148+0000","last_change":"2024-09-12T03:37:40.431632+0000","last_active":"2024-09-12T03:37:41.504148+0000","last_peered":"2024-09-12T03:37:41.504148+0000","last_clean":"2024-09-12T03:37:41.504148+0000","last_became_active":"2024-09-12T03:37:40.431205+0000","last_became_peered":"2024-09-12T03:37:40.431205+0000","last_unstale":"2024-09-12T03:37:41.504148+0000","last_undegraded":"2024-09-12T03:37:41.504148+0000","last_fullsized":"2024-09-12T03:37:41.504148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.186242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503990+0000","last_change":"2024-09-12T03:37:39.418039+0000","last_active":"2024-09-12T03:37:41.503990+0000","last_peered":"2024-09-12T03:37:41.503990+0000","last_clean":"2024-09-12T03:37:41.503990+0000","last_became_active":"2024-09-12T03:37:39.417238+0000","last_became_peered":"2024-09-12T03:37:39.417238+0000","last_unstale":"2024-09-12T03:37:41.503990+0000","last_undegraded":"2024-09-12T03:37:41.503990+0000","last_fullsized":"2024-09-12T03:37:41.503990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:48.775397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437117+0000","last_change":"2024-09-12T03:37:40.435971+0000","last_active":"2024-09-12T03:37:40.437117+0000","last_peered":"2024-09-12T03:37:40.437117+0000","last_clean":"2024-09-12T03:37:40.437117+0000","last_became_active":"2024-09-12T03:37:40.435660+0000","last_became_peered":"2024-09-12T03:37:40.435660+0000","last_unstale":"2024-09-12T03:37:40.437117+0000","last_undegraded":"2024-09-12T03:37:40.437117+0000","last_fullsized":"2024-09-12T03:37:40.437117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:46.170305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.432677+0000","last_change":"2024-09-12T03:37:39.413393+0000","last_active":"2024-09-12T03:37:40.432677+0000","last_peered":"2024-09-12T03:37:40.432677+0000","last_clean":"2024-09-12T03:37:40.432677+0000","last_became_active":"2024-09-12T03:37:39.412623+0000","last_became_peered":"2024-09-12T03:37:39.412623+0000","last_unstale":"2024-09-12T03:37:40.432677+0000","last_undegraded":"2024-09-12T03:37:40.432677+0000","last_fullsized":"2024-09-12T03:37:40.432677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:57.769487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088471+0000","last_change":"2024-09-12T03:37:40.434360+0000","last_active":"2024-09-12T03:37:42.088471+0000","last_peered":"2024-09-12T03:37:42.088471+0000","last_clean":"2024-09-12T03:37:42.088471+0000","last_became_active":"2024-09-12T03:37:40.431775+0000","last_became_peered":"2024-09-12T03:37:40.431775+0000","last_unstale":"2024-09-12T03:37:42.088471+0000","last_undegraded":"2024-09-12T03:37:42.088471+0000","last_fullsized":"2024-09-12T03:37:42.088471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:16.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403244+0000","last_change":"2024-09-12T03:37:39.430992+0000","last_active":"2024-09-12T03:37:41.403244+0000","last_peered":"2024-09-12T03:37:41.403244+0000","last_clean":"2024-09-12T03:37:41.403244+0000","last_became_active":"2024-09-12T03:37:39.429864+0000","last_became_peered":"2024-09-12T03:37:39.429864+0000","last_unstale":"2024-09-12T03:37:41.403244+0000","last_undegraded":"2024-09-12T03:37:41.403244+0000","last_fullsized":"2024-09-12T03:37:41.403244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:19.789792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436168+0000","last_change":"2024-09-12T03:37:40.418137+0000","last_active":"2024-09-12T03:37:40.436168+0000","last_peered":"2024-09-12T03:37:40.436168+0000","last_clean":"2024-09-12T03:37:40.436168+0000","last_became_active":"2024-09-12T03:37:40.416243+0000","last_became_peered":"2024-09-12T03:37:40.416243+0000","last_unstale":"2024-09-12T03:37:40.436168+0000","last_undegraded":"2024-09-12T03:37:40.436168+0000","last_fullsized":"2024-09-12T03:37:40.436168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:43.363057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088834+0000","last_change":"2024-09-12T03:37:39.409402+0000","last_active":"2024-09-12T03:37:42.088834+0000","last_peered":"2024-09-12T03:37:42.088834+0000","last_clean":"2024-09-12T03:37:42.088834+0000","last_became_active":"2024-09-12T03:37:39.408846+0000","last_became_peered":"2024-09-12T03:37:39.408846+0000","last_unstale":"2024-09-12T03:37:42.088834+0000","last_undegraded":"2024-09-12T03:37:42.088834+0000","last_fullsized":"2024-09-12T03:37:42.088834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:37.186413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.439177+0000","last_change":"2024-09-12T03:37:40.437610+0000","last_active":"2024-09-12T03:37:40.439177+0000","last_peered":"2024-09-12T03:37:40.439177+0000","last_clean":"2024-09-12T03:37:40.439177+0000","last_became_active":"2024-09-12T03:37:40.437312+0000","last_became_peered":"2024-09-12T03:37:40.437312+0000","last_unstale":"2024-09-12T03:37:40.439177+0000","last_undegraded":"2024-09-12T03:37:40.439177+0000","last_fullsized":"2024-09-12T03:37:40.439177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:08.418783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727767+0000","last_change":"2024-09-12T03:37:39.421452+0000","last_active":"2024-09-12T03:37:41.727767+0000","last_peered":"2024-09-12T03:37:41.727767+0000","last_clean":"2024-09-12T03:37:41.727767+0000","last_became_active":"2024-09-12T03:37:39.420940+0000","last_became_peered":"2024-09-12T03:37:39.420940+0000","last_unstale":"2024-09-12T03:37:41.727767+0000","last_undegraded":"2024-09-12T03:37:41.727767+0000","last_fullsized":"2024-09-12T03:37:41.727767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:26.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089337+0000","last_change":"2024-09-12T03:37:40.438471+0000","last_active":"2024-09-12T03:37:42.089337+0000","last_peered":"2024-09-12T03:37:42.089337+0000","last_clean":"2024-09-12T03:37:42.089337+0000","last_became_active":"2024-09-12T03:37:40.438101+0000","last_became_peered":"2024-09-12T03:37:40.438101+0000","last_unstale":"2024-09-12T03:37:42.089337+0000","last_undegraded":"2024-09-12T03:37:42.089337+0000","last_fullsized":"2024-09-12T03:37:42.089337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:42.768726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503958+0000","last_change":"2024-09-12T03:37:39.419265+0000","last_active":"2024-09-12T03:37:41.503958+0000","last_peered":"2024-09-12T03:37:41.503958+0000","last_clean":"2024-09-12T03:37:41.503958+0000","last_became_active":"2024-09-12T03:37:39.417550+0000","last_became_peered":"2024-09-12T03:37:39.417550+0000","last_unstale":"2024-09-12T03:37:41.503958+0000","last_undegraded":"2024-09-12T03:37:41.503958+0000","last_fullsized":"2024-09-12T03:37:41.503958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:30.389468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404185+0000","last_change":"2024-09-12T03:37:40.421218+0000","last_active":"2024-09-12T03:37:41.404185+0000","last_peered":"2024-09-12T03:37:41.404185+0000","last_clean":"2024-09-12T03:37:41.404185+0000","last_became_active":"2024-09-12T03:37:40.420251+0000","last_became_peered":"2024-09-12T03:37:40.420251+0000","last_unstale":"2024-09-12T03:37:41.404185+0000","last_undegraded":"2024-09-12T03:37:41.404185+0000","last_fullsized":"2024-09-12T03:37:41.404185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:40.479744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088487+0000","last_change":"2024-09-12T03:37:39.429482+0000","last_active":"2024-09-12T03:37:42.088487+0000","last_peered":"2024-09-12T03:37:42.088487+0000","last_clean":"2024-09-12T03:37:42.088487+0000","last_became_active":"2024-09-12T03:37:39.420950+0000","last_became_peered":"2024-09-12T03:37:39.420950+0000","last_unstale":"2024-09-12T03:37:42.088487+0000","last_undegraded":"2024-09-12T03:37:42.088487+0000","last_fullsized":"2024-09-12T03:37:42.088487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:39.470485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503794+0000","last_change":"2024-09-12T03:37:40.432650+0000","last_active":"2024-09-12T03:37:41.503794+0000","last_peered":"2024-09-12T03:37:41.503794+0000","last_clean":"2024-09-12T03:37:41.503794+0000","last_became_active":"2024-09-12T03:37:40.432391+0000","last_became_peered":"2024-09-12T03:37:40.432391+0000","last_unstale":"2024-09-12T03:37:41.503794+0000","last_undegraded":"2024-09-12T03:37:41.503794+0000","last_fullsized":"2024-09-12T03:37:41.503794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:47.382688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728399+0000","last_change":"2024-09-12T03:37:39.406402+0000","last_active":"2024-09-12T03:37:41.728399+0000","last_peered":"2024-09-12T03:37:41.728399+0000","last_clean":"2024-09-12T03:37:41.728399+0000","last_became_active":"2024-09-12T03:37:39.406108+0000","last_became_peered":"2024-09-12T03:37:39.406108+0000","last_unstale":"2024-09-12T03:37:41.728399+0000","last_undegraded":"2024-09-12T03:37:41.728399+0000","last_fullsized":"2024-09-12T03:37:41.728399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:54.573945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728342+0000","last_change":"2024-09-12T03:37:40.410282+0000","last_active":"2024-09-12T03:37:41.728342+0000","last_peered":"2024-09-12T03:37:41.728342+0000","last_clean":"2024-09-12T03:37:41.728342+0000","last_became_active":"2024-09-12T03:37:40.409958+0000","last_became_peered":"2024-09-12T03:37:40.409958+0000","last_unstale":"2024-09-12T03:37:41.728342+0000","last_undegraded":"2024-09-12T03:37:41.728342+0000","last_fullsized":"2024-09-12T03:37:41.728342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:01.744440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405189+0000","last_change":"2024-09-12T03:37:39.438651+0000","last_active":"2024-09-12T03:37:41.405189+0000","last_peered":"2024-09-12T03:37:41.405189+0000","last_clean":"2024-09-12T03:37:41.405189+0000","last_became_active":"2024-09-12T03:37:39.434714+0000","last_became_peered":"2024-09-12T03:37:39.434714+0000","last_unstale":"2024-09-12T03:37:41.405189+0000","last_undegraded":"2024-09-12T03:37:41.405189+0000","last_fullsized":"2024-09-12T03:37:41.405189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:23.830605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089695+0000","last_change":"2024-09-12T03:37:40.427079+0000","last_active":"2024-09-12T03:37:42.089695+0000","last_peered":"2024-09-12T03:37:42.089695+0000","last_clean":"2024-09-12T03:37:42.089695+0000","last_became_active":"2024-09-12T03:37:40.426730+0000","last_became_peered":"2024-09-12T03:37:40.426730+0000","last_unstale":"2024-09-12T03:37:42.089695+0000","last_undegraded":"2024-09-12T03:37:42.089695+0000","last_fullsized":"2024-09-12T03:37:42.089695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:57.716910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.441756+0000","last_change":"2024-09-12T03:37:39.425400+0000","last_active":"2024-09-12T03:37:40.441756+0000","last_peered":"2024-09-12T03:37:40.441756+0000","last_clean":"2024-09-12T03:37:40.441756+0000","last_became_active":"2024-09-12T03:37:39.425134+0000","last_became_peered":"2024-09-12T03:37:39.425134+0000","last_unstale":"2024-09-12T03:37:40.441756+0000","last_undegraded":"2024-09-12T03:37:40.441756+0000","last_fullsized":"2024-09-12T03:37:40.441756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:12.236274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088078+0000","last_change":"2024-09-12T03:37:40.431048+0000","last_active":"2024-09-12T03:37:42.088078+0000","last_peered":"2024-09-12T03:37:42.088078+0000","last_clean":"2024-09-12T03:37:42.088078+0000","last_became_active":"2024-09-12T03:37:40.430593+0000","last_became_peered":"2024-09-12T03:37:40.430593+0000","last_unstale":"2024-09-12T03:37:42.088078+0000","last_undegraded":"2024-09-12T03:37:42.088078+0000","last_fullsized":"2024-09-12T03:37:42.088078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.161815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503737+0000","last_change":"2024-09-12T03:37:39.421660+0000","last_active":"2024-09-12T03:37:41.503737+0000","last_peered":"2024-09-12T03:37:41.503737+0000","last_clean":"2024-09-12T03:37:41.503737+0000","last_became_active":"2024-09-12T03:37:39.420962+0000","last_became_peered":"2024-09-12T03:37:39.420962+0000","last_unstale":"2024-09-12T03:37:41.503737+0000","last_undegraded":"2024-09-12T03:37:41.503737+0000","last_fullsized":"2024-09-12T03:37:41.503737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:21.235949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401958+0000","last_change":"2024-09-12T03:37:40.438346+0000","last_active":"2024-09-12T03:37:41.401958+0000","last_peered":"2024-09-12T03:37:41.401958+0000","last_clean":"2024-09-12T03:37:41.401958+0000","last_became_active":"2024-09-12T03:37:40.437961+0000","last_became_peered":"2024-09-12T03:37:40.437961+0000","last_unstale":"2024-09-12T03:37:41.401958+0000","last_undegraded":"2024-09-12T03:37:41.401958+0000","last_fullsized":"2024-09-12T03:37:41.401958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:21.181419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.401479+0000","last_change":"2024-09-12T03:37:39.422461+0000","last_active":"2024-09-12T03:37:40.401479+0000","last_peered":"2024-09-12T03:37:40.401479+0000","last_clean":"2024-09-12T03:37:40.401479+0000","last_became_active":"2024-09-12T03:37:39.421555+0000","last_became_peered":"2024-09-12T03:37:39.421555+0000","last_unstale":"2024-09-12T03:37:40.401479+0000","last_undegraded":"2024-09-12T03:37:40.401479+0000","last_fullsized":"2024-09-12T03:37:40.401479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:42.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401207+0000","last_change":"2024-09-12T03:37:40.427938+0000","last_active":"2024-09-12T03:37:41.401207+0000","last_peered":"2024-09-12T03:37:41.401207+0000","last_clean":"2024-09-12T03:37:41.401207+0000","last_became_active":"2024-09-12T03:37:40.427412+0000","last_became_peered":"2024-09-12T03:37:40.427412+0000","last_unstale":"2024-09-12T03:37:41.401207+0000","last_undegraded":"2024-09-12T03:37:41.401207+0000","last_fullsized":"2024-09-12T03:37:41.401207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.043089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088599+0000","last_change":"2024-09-12T03:37:39.426750+0000","last_active":"2024-09-12T03:37:42.088599+0000","last_peered":"2024-09-12T03:37:42.088599+0000","last_clean":"2024-09-12T03:37:42.088599+0000","last_became_active":"2024-09-12T03:37:39.426357+0000","last_became_peered":"2024-09-12T03:37:39.426357+0000","last_unstale":"2024-09-12T03:37:42.088599+0000","last_undegraded":"2024-09-12T03:37:42.088599+0000","last_fullsized":"2024-09-12T03:37:42.088599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:12.810221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401486+0000","last_change":"2024-09-12T03:37:40.423255+0000","last_active":"2024-09-12T03:37:41.401486+0000","last_peered":"2024-09-12T03:37:41.401486+0000","last_clean":"2024-09-12T03:37:41.401486+0000","last_became_active":"2024-09-12T03:37:40.422843+0000","last_became_peered":"2024-09-12T03:37:40.422843+0000","last_unstale":"2024-09-12T03:37:41.401486+0000","last_undegraded":"2024-09-12T03:37:41.401486+0000","last_fullsized":"2024-09-12T03:37:41.401486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:25.477796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088357+0000","last_change":"2024-09-12T03:37:39.408602+0000","last_active":"2024-09-12T03:37:42.088357+0000","last_peered":"2024-09-12T03:37:42.088357+0000","last_clean":"2024-09-12T03:37:42.088357+0000","last_became_active":"2024-09-12T03:37:39.408327+0000","last_became_peered":"2024-09-12T03:37:39.408327+0000","last_unstale":"2024-09-12T03:37:42.088357+0000","last_undegraded":"2024-09-12T03:37:42.088357+0000","last_fullsized":"2024-09-12T03:37:42.088357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:51.127339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430333+0000","last_change":"2024-09-12T03:37:40.428686+0000","last_active":"2024-09-12T03:37:40.430333+0000","last_peered":"2024-09-12T03:37:40.430333+0000","last_clean":"2024-09-12T03:37:40.430333+0000","last_became_active":"2024-09-12T03:37:40.423872+0000","last_became_peered":"2024-09-12T03:37:40.423872+0000","last_unstale":"2024-09-12T03:37:40.430333+0000","last_undegraded":"2024-09-12T03:37:40.430333+0000","last_fullsized":"2024-09-12T03:37:40.430333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.082371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436868+0000","last_change":"2024-09-12T03:37:39.432638+0000","last_active":"2024-09-12T03:37:40.436868+0000","last_peered":"2024-09-12T03:37:40.436868+0000","last_clean":"2024-09-12T03:37:40.436868+0000","last_became_active":"2024-09-12T03:37:39.431762+0000","last_became_peered":"2024-09-12T03:37:39.431762+0000","last_unstale":"2024-09-12T03:37:40.436868+0000","last_undegraded":"2024-09-12T03:37:40.436868+0000","last_fullsized":"2024-09-12T03:37:40.436868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:55.197250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436291+0000","last_change":"2024-09-12T03:37:40.417439+0000","last_active":"2024-09-12T03:37:40.436291+0000","last_peered":"2024-09-12T03:37:40.436291+0000","last_clean":"2024-09-12T03:37:40.436291+0000","last_became_active":"2024-09-12T03:37:40.416773+0000","last_became_peered":"2024-09-12T03:37:40.416773+0000","last_unstale":"2024-09-12T03:37:40.436291+0000","last_undegraded":"2024-09-12T03:37:40.436291+0000","last_fullsized":"2024-09-12T03:37:40.436291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:53.808509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503853+0000","last_change":"2024-09-12T03:37:39.434146+0000","last_active":"2024-09-12T03:37:41.503853+0000","last_peered":"2024-09-12T03:37:41.503853+0000","last_clean":"2024-09-12T03:37:41.503853+0000","last_became_active":"2024-09-12T03:37:39.433427+0000","last_became_peered":"2024-09-12T03:37:39.433427+0000","last_unstale":"2024-09-12T03:37:41.503853+0000","last_undegraded":"2024-09-12T03:37:41.503853+0000","last_fullsized":"2024-09-12T03:37:41.503853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:03.747853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404221+0000","last_change":"2024-09-12T03:37:40.425320+0000","last_active":"2024-09-12T03:37:41.404221+0000","last_peered":"2024-09-12T03:37:41.404221+0000","last_clean":"2024-09-12T03:37:41.404221+0000","last_became_active":"2024-09-12T03:37:40.424983+0000","last_became_peered":"2024-09-12T03:37:40.424983+0000","last_unstale":"2024-09-12T03:37:41.404221+0000","last_undegraded":"2024-09-12T03:37:41.404221+0000","last_fullsized":"2024-09-12T03:37:41.404221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.161815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405329+0000","last_change":"2024-09-12T03:37:39.437820+0000","last_active":"2024-09-12T03:37:41.405329+0000","last_peered":"2024-09-12T03:37:41.405329+0000","last_clean":"2024-09-12T03:37:41.405329+0000","last_became_active":"2024-09-12T03:37:39.434293+0000","last_became_peered":"2024-09-12T03:37:39.434293+0000","last_unstale":"2024-09-12T03:37:41.405329+0000","last_undegraded":"2024-09-12T03:37:41.405329+0000","last_fullsized":"2024-09-12T03:37:41.405329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:06.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.438617+0000","last_change":"2024-09-12T03:37:40.436044+0000","last_active":"2024-09-12T03:37:40.438617+0000","last_peered":"2024-09-12T03:37:40.438617+0000","last_clean":"2024-09-12T03:37:40.438617+0000","last_became_active":"2024-09-12T03:37:40.432077+0000","last_became_peered":"2024-09-12T03:37:40.432077+0000","last_unstale":"2024-09-12T03:37:40.438617+0000","last_undegraded":"2024-09-12T03:37:40.438617+0000","last_fullsized":"2024-09-12T03:37:40.438617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:35.840013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087753+0000","last_change":"2024-09-12T03:37:39.428828+0000","last_active":"2024-09-12T03:37:42.087753+0000","last_peered":"2024-09-12T03:37:42.087753+0000","last_clean":"2024-09-12T03:37:42.087753+0000","last_became_active":"2024-09-12T03:37:39.419776+0000","last_became_peered":"2024-09-12T03:37:39.419776+0000","last_unstale":"2024-09-12T03:37:42.087753+0000","last_undegraded":"2024-09-12T03:37:42.087753+0000","last_fullsized":"2024-09-12T03:37:42.087753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:30.103129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087840+0000","last_change":"2024-09-12T03:37:40.405047+0000","last_active":"2024-09-12T03:37:42.087840+0000","last_peered":"2024-09-12T03:37:42.087840+0000","last_clean":"2024-09-12T03:37:42.087840+0000","last_became_active":"2024-09-12T03:37:40.404830+0000","last_became_peered":"2024-09-12T03:37:40.404830+0000","last_unstale":"2024-09-12T03:37:42.087840+0000","last_undegraded":"2024-09-12T03:37:42.087840+0000","last_fullsized":"2024-09-12T03:37:42.087840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:25.238047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401379+0000","last_change":"2024-09-12T03:37:39.407477+0000","last_active":"2024-09-12T03:37:41.401379+0000","last_peered":"2024-09-12T03:37:41.401379+0000","last_clean":"2024-09-12T03:37:41.401379+0000","last_became_active":"2024-09-12T03:37:39.407054+0000","last_became_peered":"2024-09-12T03:37:39.407054+0000","last_unstale":"2024-09-12T03:37:41.401379+0000","last_undegraded":"2024-09-12T03:37:41.401379+0000","last_fullsized":"2024-09-12T03:37:41.401379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:11.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088052+0000","last_change":"2024-09-12T03:37:40.427696+0000","last_active":"2024-09-12T03:37:42.088052+0000","last_peered":"2024-09-12T03:37:42.088052+0000","last_clean":"2024-09-12T03:37:42.088052+0000","last_became_active":"2024-09-12T03:37:40.427417+0000","last_became_peered":"2024-09-12T03:37:40.427417+0000","last_unstale":"2024-09-12T03:37:42.088052+0000","last_undegraded":"2024-09-12T03:37:42.088052+0000","last_fullsized":"2024-09-12T03:37:42.088052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:49.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088016+0000","last_change":"2024-09-12T03:37:39.429082+0000","last_active":"2024-09-12T03:37:42.088016+0000","last_peered":"2024-09-12T03:37:42.088016+0000","last_clean":"2024-09-12T03:37:42.088016+0000","last_became_active":"2024-09-12T03:37:39.421393+0000","last_became_peered":"2024-09-12T03:37:39.421393+0000","last_unstale":"2024-09-12T03:37:42.088016+0000","last_undegraded":"2024-09-12T03:37:42.088016+0000","last_fullsized":"2024-09-12T03:37:42.088016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:26.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430264+0000","last_change":"2024-09-12T03:37:40.424564+0000","last_active":"2024-09-12T03:37:40.430264+0000","last_peered":"2024-09-12T03:37:40.430264+0000","last_clean":"2024-09-12T03:37:40.430264+0000","last_became_active":"2024-09-12T03:37:40.424199+0000","last_became_peered":"2024-09-12T03:37:40.424199+0000","last_unstale":"2024-09-12T03:37:40.430264+0000","last_undegraded":"2024-09-12T03:37:40.430264+0000","last_fullsized":"2024-09-12T03:37:40.430264+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:36.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401029+0000","last_change":"2024-09-12T03:37:39.432475+0000","last_active":"2024-09-12T03:37:41.401029+0000","last_peered":"2024-09-12T03:37:41.401029+0000","last_clean":"2024-09-12T03:37:41.401029+0000","last_became_active":"2024-09-12T03:37:39.432210+0000","last_became_peered":"2024-09-12T03:37:39.432210+0000","last_unstale":"2024-09-12T03:37:41.401029+0000","last_undegraded":"2024-09-12T03:37:41.401029+0000","last_fullsized":"2024-09-12T03:37:41.401029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:43.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437142+0000","last_change":"2024-09-12T03:37:40.424253+0000","last_active":"2024-09-12T03:37:40.437142+0000","last_peered":"2024-09-12T03:37:40.437142+0000","last_clean":"2024-09-12T03:37:40.437142+0000","last_became_active":"2024-09-12T03:37:40.422441+0000","last_became_peered":"2024-09-12T03:37:40.422441+0000","last_unstale":"2024-09-12T03:37:40.437142+0000","last_undegraded":"2024-09-12T03:37:40.437142+0000","last_fullsized":"2024-09-12T03:37:40.437142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.414454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504106+0000","last_change":"2024-09-12T03:37:39.437978+0000","last_active":"2024-09-12T03:37:41.504106+0000","last_peered":"2024-09-12T03:37:41.504106+0000","last_clean":"2024-09-12T03:37:41.504106+0000","last_became_active":"2024-09-12T03:37:39.437140+0000","last_became_peered":"2024-09-12T03:37:39.437140+0000","last_unstale":"2024-09-12T03:37:41.504106+0000","last_undegraded":"2024-09-12T03:37:41.504106+0000","last_fullsized":"2024-09-12T03:37:41.504106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.851466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429479+0000","last_change":"2024-09-12T03:37:40.417407+0000","last_active":"2024-09-12T03:37:40.429479+0000","last_peered":"2024-09-12T03:37:40.429479+0000","last_clean":"2024-09-12T03:37:40.429479+0000","last_became_active":"2024-09-12T03:37:40.416874+0000","last_became_peered":"2024-09-12T03:37:40.416874+0000","last_unstale":"2024-09-12T03:37:40.429479+0000","last_undegraded":"2024-09-12T03:37:40.429479+0000","last_fullsized":"2024-09-12T03:37:40.429479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.689588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.404471+0000","last_change":"2024-09-12T03:37:39.441255+0000","last_active":"2024-09-12T03:37:42.404471+0000","last_peered":"2024-09-12T03:37:42.404471+0000","last_clean":"2024-09-12T03:37:42.404471+0000","last_became_active":"2024-09-12T03:37:39.440569+0000","last_became_peered":"2024-09-12T03:37:39.440569+0000","last_unstale":"2024-09-12T03:37:42.404471+0000","last_undegraded":"2024-09-12T03:37:42.404471+0000","last_fullsized":"2024-09-12T03:37:42.404471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.959634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429584+0000","last_change":"2024-09-12T03:37:40.421941+0000","last_active":"2024-09-12T03:37:40.429584+0000","last_peered":"2024-09-12T03:37:40.429584+0000","last_clean":"2024-09-12T03:37:40.429584+0000","last_became_active":"2024-09-12T03:37:40.421609+0000","last_became_peered":"2024-09-12T03:37:40.421609+0000","last_unstale":"2024-09-12T03:37:40.429584+0000","last_undegraded":"2024-09-12T03:37:40.429584+0000","last_fullsized":"2024-09-12T03:37:40.429584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.675530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405555+0000","last_change":"2024-09-12T03:37:39.433859+0000","last_active":"2024-09-12T03:37:41.405555+0000","last_peered":"2024-09-12T03:37:41.405555+0000","last_clean":"2024-09-12T03:37:41.405555+0000","last_became_active":"2024-09-12T03:37:39.431773+0000","last_became_peered":"2024-09-12T03:37:39.431773+0000","last_unstale":"2024-09-12T03:37:41.405555+0000","last_undegraded":"2024-09-12T03:37:41.405555+0000","last_fullsized":"2024-09-12T03:37:41.405555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:03.608970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088354+0000","last_change":"2024-09-12T03:37:40.422434+0000","last_active":"2024-09-12T03:37:42.088354+0000","last_peered":"2024-09-12T03:37:42.088354+0000","last_clean":"2024-09-12T03:37:42.088354+0000","last_became_active":"2024-09-12T03:37:40.422054+0000","last_became_peered":"2024-09-12T03:37:40.422054+0000","last_unstale":"2024-09-12T03:37:42.088354+0000","last_undegraded":"2024-09-12T03:37:42.088354+0000","last_fullsized":"2024-09-12T03:37:42.088354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:04.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.412612+0000","last_change":"2024-09-12T03:37:39.427202+0000","last_active":"2024-09-12T03:37:40.412612+0000","last_peered":"2024-09-12T03:37:40.412612+0000","last_clean":"2024-09-12T03:37:40.412612+0000","last_became_active":"2024-09-12T03:37:39.425841+0000","last_became_peered":"2024-09-12T03:37:39.425841+0000","last_unstale":"2024-09-12T03:37:40.412612+0000","last_undegraded":"2024-09-12T03:37:40.412612+0000","last_fullsized":"2024-09-12T03:37:40.412612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:21.625912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401051+0000","last_change":"2024-09-12T03:37:40.425926+0000","last_active":"2024-09-12T03:37:41.401051+0000","last_peered":"2024-09-12T03:37:41.401051+0000","last_clean":"2024-09-12T03:37:41.401051+0000","last_became_active":"2024-09-12T03:37:40.425544+0000","last_became_peered":"2024-09-12T03:37:40.425544+0000","last_unstale":"2024-09-12T03:37:41.401051+0000","last_undegraded":"2024-09-12T03:37:41.401051+0000","last_fullsized":"2024-09-12T03:37:41.401051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:52.195835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.400378+0000","last_change":"2024-09-12T03:37:39.430328+0000","last_active":"2024-09-12T03:37:40.400378+0000","last_peered":"2024-09-12T03:37:40.400378+0000","last_clean":"2024-09-12T03:37:40.400378+0000","last_became_active":"2024-09-12T03:37:39.430047+0000","last_became_peered":"2024-09-12T03:37:39.430047+0000","last_unstale":"2024-09-12T03:37:40.400378+0000","last_undegraded":"2024-09-12T03:37:40.400378+0000","last_fullsized":"2024-09-12T03:37:40.400378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.008253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727599+0000","last_change":"2024-09-12T03:37:40.420995+0000","last_active":"2024-09-12T03:37:41.727599+0000","last_peered":"2024-09-12T03:37:41.727599+0000","last_clean":"2024-09-12T03:37:41.727599+0000","last_became_active":"2024-09-12T03:37:40.420539+0000","last_became_peered":"2024-09-12T03:37:40.420539+0000","last_unstale":"2024-09-12T03:37:41.727599+0000","last_undegraded":"2024-09-12T03:37:41.727599+0000","last_fullsized":"2024-09-12T03:37:41.727599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087846+0000","last_change":"2024-09-12T03:37:39.431751+0000","last_active":"2024-09-12T03:37:42.087846+0000","last_peered":"2024-09-12T03:37:42.087846+0000","last_clean":"2024-09-12T03:37:42.087846+0000","last_became_active":"2024-09-12T03:37:39.431181+0000","last_became_peered":"2024-09-12T03:37:39.431181+0000","last_unstale":"2024-09-12T03:37:42.087846+0000","last_undegraded":"2024-09-12T03:37:42.087846+0000","last_fullsized":"2024-09-12T03:37:42.087846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:33.562638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436339+0000","last_change":"2024-09-12T03:37:40.432493+0000","last_active":"2024-09-12T03:37:40.436339+0000","last_peered":"2024-09-12T03:37:40.436339+0000","last_clean":"2024-09-12T03:37:40.436339+0000","last_became_active":"2024-09-12T03:37:40.431967+0000","last_became_peered":"2024-09-12T03:37:40.431967+0000","last_unstale":"2024-09-12T03:37:40.436339+0000","last_undegraded":"2024-09-12T03:37:40.436339+0000","last_fullsized":"2024-09-12T03:37:40.436339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:30.156578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.408238+0000","last_change":"2024-09-12T03:37:39.426991+0000","last_active":"2024-09-12T03:37:40.408238+0000","last_peered":"2024-09-12T03:37:40.408238+0000","last_clean":"2024-09-12T03:37:40.408238+0000","last_became_active":"2024-09-12T03:37:39.425872+0000","last_became_peered":"2024-09-12T03:37:39.425872+0000","last_unstale":"2024-09-12T03:37:40.408238+0000","last_undegraded":"2024-09-12T03:37:40.408238+0000","last_fullsized":"2024-09-12T03:37:40.408238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:30.367921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424633+0000","last_change":"2024-09-12T03:37:40.417611+0000","last_active":"2024-09-12T03:37:40.424633+0000","last_peered":"2024-09-12T03:37:40.424633+0000","last_clean":"2024-09-12T03:37:40.424633+0000","last_became_active":"2024-09-12T03:37:40.417268+0000","last_became_peered":"2024-09-12T03:37:40.417268+0000","last_unstale":"2024-09-12T03:37:40.424633+0000","last_undegraded":"2024-09-12T03:37:40.424633+0000","last_fullsized":"2024-09-12T03:37:40.424633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.432284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503453+0000","last_change":"2024-09-12T03:37:39.419403+0000","last_active":"2024-09-12T03:37:41.503453+0000","last_peered":"2024-09-12T03:37:41.503453+0000","last_clean":"2024-09-12T03:37:41.503453+0000","last_became_active":"2024-09-12T03:37:39.418693+0000","last_became_peered":"2024-09-12T03:37:39.418693+0000","last_unstale":"2024-09-12T03:37:41.503453+0000","last_undegraded":"2024-09-12T03:37:41.503453+0000","last_fullsized":"2024-09-12T03:37:41.503453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:24.228789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504042+0000","last_change":"2024-09-12T03:37:40.426508+0000","last_active":"2024-09-12T03:37:41.504042+0000","last_peered":"2024-09-12T03:37:41.504042+0000","last_clean":"2024-09-12T03:37:41.504042+0000","last_became_active":"2024-09-12T03:37:40.426285+0000","last_became_peered":"2024-09-12T03:37:40.426285+0000","last_unstale":"2024-09-12T03:37:41.504042+0000","last_undegraded":"2024-09-12T03:37:41.504042+0000","last_fullsized":"2024-09-12T03:37:41.504042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.440780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.090079+0000","last_change":"2024-09-12T03:37:39.432928+0000","last_active":"2024-09-12T03:37:42.090079+0000","last_peered":"2024-09-12T03:37:42.090079+0000","last_clean":"2024-09-12T03:37:42.090079+0000","last_became_active":"2024-09-12T03:37:39.432570+0000","last_became_peered":"2024-09-12T03:37:39.432570+0000","last_unstale":"2024-09-12T03:37:42.090079+0000","last_undegraded":"2024-09-12T03:37:42.090079+0000","last_fullsized":"2024-09-12T03:37:42.090079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:07.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":285,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503603+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:41.503603+0000","last_peered":"2024-09-12T03:37:41.503603+0000","last_clean":"2024-09-12T03:37:41.503603+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:41.503603+0000","last_undegraded":"2024-09-12T03:37:41.503603+0000","last_fullsized":"2024-09-12T03:37:41.503603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1654784,"data_stored":1071204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":474088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":480940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":480780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":480780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1044480,"data_stored":474158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":476304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":1057289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:44.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T03:37:44.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f896b038640 1 Processor -- start 2024-09-12T03:37:44.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f896b038640 1 -- start start 2024-09-12T03:37:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f896b038640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f896415bec0 0x7f89640ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f896b038640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89640af470 0x7f896406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f896b038640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89640b3290 con 0x7f896415c2a0 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f896b038640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f89640b3570 con 0x7f89640af470 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f896b038640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f89640b3850 con 0x7f896415bec0 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f89695d5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89640af470 0x7f896406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f89695d5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f89640af470 0x7f896406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57782/0 (socket says 172.21.15.73:57782) 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f89695d5640 1 -- 172.21.15.73:0/4024210691 learned_addr learned my addr 172.21.15.73:0/4024210691 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f89695d5640 1 -- 172.21.15.73:0/4024210691 >> v2:172.21.15.150:3300/0 conn(0x7f896415bec0 msgr2=0x7f89640ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f8968dd4640 1 --2- 172.21.15.73:0/4024210691 >> v2:172.21.15.150:3300/0 conn(0x7f896415bec0 0x7f89640ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f89695d5640 1 --2- 172.21.15.73:0/4024210691 >> v2:172.21.15.150:3300/0 conn(0x7f896415bec0 0x7f89640ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f89695d5640 1 -- 172.21.15.73:0/4024210691 >> v1:172.21.15.150:6789/0 conn(0x7f896415c2a0 legacy=0x7f89640aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:44.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.334+0000 7f89695d5640 1 -- 172.21.15.73:0/4024210691 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89640b3b30 con 0x7f89640af470 2024-09-12T03:37:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f89695d5640 1 --2- 172.21.15.73:0/4024210691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89640af470 0x7f896406e000 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8964071710 tx=0x7f895c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1da090ffbe0e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f89637fe640 1 -- 172.21.15.73:0/4024210691 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0a5840 con 0x7f89640af470 2024-09-12T03:37:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f89637fe640 1 -- 172.21.15.73:0/4024210691 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c0a59e0 con 0x7f89640af470 2024-09-12T03:37:44.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f89637fe640 1 -- 172.21.15.73:0/4024210691 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c0a5db0 con 0x7f89640af470 2024-09-12T03:37:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 -- 172.21.15.73:0/4024210691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89640af470 msgr2=0x7f896406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 --2- 172.21.15.73:0/4024210691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89640af470 0x7f896406e000 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f8964071710 tx=0x7f895c01c980 comp rx=0 tx=0).stop 2024-09-12T03:37:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 -- 172.21.15.73:0/4024210691 shutdown_connections 2024-09-12T03:37:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 --2- 172.21.15.73:0/4024210691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89640af470 0x7f896406e000 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 --2- 172.21.15.73:0/4024210691 >> v2:172.21.15.150:3300/0 conn(0x7f896415bec0 0x7f89640ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 -- 172.21.15.73:0/4024210691 >> 172.21.15.73:0/4024210691 conn(0x7f89640b1f90 msgr2=0x7f89640b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 -- 172.21.15.73:0/4024210691 shutdown_connections 2024-09-12T03:37:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 -- 172.21.15.73:0/4024210691 wait complete. 2024-09-12T03:37:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 Processor -- start 2024-09-12T03:37:44.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.338+0000 7f896b038640 1 -- start start 2024-09-12T03:37:44.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89640af470 0x7f8964155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f896415bec0 0x7f896414a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f896415c2a0 0x7f896414acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f896406ed50 con 0x7f896415bec0 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f89640ad740 con 0x7f896415c2a0 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f896406eed0 con 0x7f89640af470 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f896415bec0 0x7f896414a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f896415bec0 0x7f896414a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57788/0 (socket says 172.21.15.73:57788) 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 -- 172.21.15.73:0/997538464 learned_addr learned my addr 172.21.15.73:0/997538464 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:44.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8968dd4640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89640af470 0x7f8964155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f89695d5640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f896415c2a0 0x7f896414acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 -- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89640af470 msgr2=0x7f8964155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89640af470 0x7f8964155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 -- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f896415c2a0 msgr2=0x7f896414acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f896415c2a0 0x7f896414acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 -- 172.21.15.73:0/997538464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f896415c780 con 0x7f896415bec0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8963fff640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f896415bec0 0x7f896414a790 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f895400b3e0 tx=0x7f895400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f89617fa640 1 -- 172.21.15.73:0/997538464 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954015020 con 0x7f896415bec0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f89617fa640 1 -- 172.21.15.73:0/997538464 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8954011830 con 0x7f896415bec0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f896415ca60 con 0x7f896415bec0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f89617fa640 1 -- 172.21.15.73:0/997538464 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954011c20 con 0x7f896415bec0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f896415edb0 con 0x7f896415bec0 2024-09-12T03:37:44.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f896406f260 con 0x7f896415bec0 2024-09-12T03:37:44.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f89617fa640 1 -- 172.21.15.73:0/997538464 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8954018020 con 0x7f896415bec0 2024-09-12T03:37:44.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f89617fa640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89500678c0 0x7f8950069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f89617fa640 1 -- 172.21.15.73:0/997538464 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f8954085a80 con 0x7f896415bec0 2024-09-12T03:37:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8968dd4640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89500678c0 0x7f8950069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.342+0000 7f8968dd4640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89500678c0 0x7f8950069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f89640cf510 tx=0x7f8958008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:44.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.346+0000 7f89617fa640 1 -- 172.21.15.73:0/997538464 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f895401f030 con 0x7f896415bec0 2024-09-12T03:37:44.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.562+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f896406fcd0 con 0x7f896415bec0 2024-09-12T03:37:44.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.562+0000 7f89617fa640 1 -- 172.21.15.73:0/997538464 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1474 (secure 0 0 0) 0x7f89540172c0 con 0x7f896415bec0 2024-09-12T03:37:44.564 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:44.564 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":209,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":86,"num_osds":8,"num_up_osds":8,"osd_up_since":1726112066,"num_in_osds":8,"osd_in_since":1726112057,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":260837376,"bytes_avail":772833275904,"bytes_total":773094113280,"write_bytes_sec":2622,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":48,"btime":"2024-09-12T03:37:42:437910+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":6255}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-12T03:37:29.840591+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T03:37:44.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89500678c0 msgr2=0x7f8950069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89500678c0 0x7f8950069d80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f89640cf510 tx=0x7f8958008040 comp rx=0 tx=0).stop 2024-09-12T03:37:44.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f896415bec0 msgr2=0x7f896414a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f896415bec0 0x7f896414a790 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f895400b3e0 tx=0x7f895400b8a0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 shutdown_connections 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89500678c0 0x7f8950069d80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f896415bec0 0x7f896414a790 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f896415c2a0 0x7f896414acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 --2- 172.21.15.73:0/997538464 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f89640af470 0x7f8964155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 >> 172.21.15.73:0/997538464 conn(0x7f89640b1f90 msgr2=0x7f89640cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 shutdown_connections 2024-09-12T03:37:44.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.566+0000 7f896b038640 1 -- 172.21.15.73:0/997538464 wait complete. 2024-09-12T03:37:44.582 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T03:37:44.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.694+0000 7fc2a537e640 1 Processor -- start 2024-09-12T03:37:44.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.694+0000 7fc2a537e640 1 -- start start 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2a00d3060 0x7fc2a00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00cf450 0x7fc2a006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a00d0300 con 0x7fc2a0161a60 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a00b0f60 con 0x7fc2a00d3060 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a00cfd40 con 0x7fc2a00cf450 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2a00d3060 0x7fc2a00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2a00d3060 0x7fc2a00cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57796/0 (socket says 172.21.15.73:57796) 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 -- 172.21.15.73:0/185845737 learned_addr learned my addr 172.21.15.73:0/185845737 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:44.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29effd640 1 --1- 172.21.15.73:0/185845737 >> v1:172.21.15.73:6789/0 conn(0x7fc2a0161a60 0x7fc2a00d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37526/0 (socket says 172.21.15.73:37526) 2024-09-12T03:37:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 -- 172.21.15.73:0/185845737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00cf450 msgr2=0x7fc2a006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 --2- 172.21.15.73:0/185845737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00cf450 0x7fc2a006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 -- 172.21.15.73:0/185845737 >> v1:172.21.15.73:6789/0 conn(0x7fc2a0161a60 legacy=0x7fc2a00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 -- 172.21.15.73:0/185845737 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a00d0020 con 0x7fc2a00d3060 2024-09-12T03:37:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29e7fc640 1 --2- 172.21.15.73:0/185845737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00d3060 0x7fc2a00cef10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc288009870 tx=0x7fc28801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8beea36c109ddc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29dffb640 1 -- 172.21.15.73:0/185845737 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2880aa600 con 0x7fc2a00d3060 2024-09-12T03:37:44.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29dffb640 1 -- 172.21.15.73:0/185845737 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2880af070 con 0x7fc2a00d3060 2024-09-12T03:37:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc29dffb640 1 -- 172.21.15.73:0/185845737 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2880aa9c0 con 0x7fc2a00d3060 2024-09-12T03:37:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 -- 172.21.15.73:0/185845737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00d3060 msgr2=0x7fc2a00cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 --2- 172.21.15.73:0/185845737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00d3060 0x7fc2a00cef10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc288009870 tx=0x7fc28801c4a0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 -- 172.21.15.73:0/185845737 shutdown_connections 2024-09-12T03:37:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 --2- 172.21.15.73:0/185845737 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00cf450 0x7fc2a006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 --2- 172.21.15.73:0/185845737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00d3060 0x7fc2a00cef10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.698+0000 7fc2a537e640 1 -- 172.21.15.73:0/185845737 >> 172.21.15.73:0/185845737 conn(0x7fc2a008bf90 msgr2=0x7fc2a009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- 172.21.15.73:0/185845737 shutdown_connections 2024-09-12T03:37:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- 172.21.15.73:0/185845737 wait complete. 2024-09-12T03:37:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 Processor -- start 2024-09-12T03:37:44.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- start start 2024-09-12T03:37:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00cf450 0x7fc2a0153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00d3060 0x7fc2a01fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a0161a60 0x7fc2a00c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a006e400 con 0x7fc2a00cf450 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a006e580 con 0x7fc2a0161a60 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a006e700 con 0x7fc2a00d3060 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00cf450 0x7fc2a0153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00cf450 0x7fc2a0153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57808/0 (socket says 172.21.15.73:57808) 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 -- 172.21.15.73:0/1016291839 learned_addr learned my addr 172.21.15.73:0/1016291839 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29e7fc640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00d3060 0x7fc2a01fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29f7fe640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a0161a60 0x7fc2a00c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 -- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00d3060 msgr2=0x7fc2a01fb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00d3060 0x7fc2a01fb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 -- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a0161a60 msgr2=0x7fc2a00c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a0161a60 0x7fc2a00c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 -- 172.21.15.73:0/1016291839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a00cc090 con 0x7fc2a00cf450 2024-09-12T03:37:44.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29e7fc640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00d3060 0x7fc2a01fb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc29effd640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00cf450 0x7fc2a0153980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc29000c790 tx=0x7fc29000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2977fe640 1 -- 172.21.15.73:0/1016291839 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290017070 con 0x7fc2a00cf450 2024-09-12T03:37:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2977fe640 1 -- 172.21.15.73:0/1016291839 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc29000a640 con 0x7fc2a00cf450 2024-09-12T03:37:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a00cc370 con 0x7fc2a00cf450 2024-09-12T03:37:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2977fe640 1 -- 172.21.15.73:0/1016291839 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29000a9f0 con 0x7fc2a00cf450 2024-09-12T03:37:44.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a01faca0 con 0x7fc2a00cf450 2024-09-12T03:37:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.702+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a006d6b0 con 0x7fc2a00cf450 2024-09-12T03:37:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.706+0000 7fc2977fe640 1 -- 172.21.15.73:0/1016291839 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc29001a070 con 0x7fc2a00cf450 2024-09-12T03:37:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.706+0000 7fc2977fe640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2800678f0 0x7fc280069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.706+0000 7fc29e7fc640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2800678f0 0x7fc280069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.706+0000 7fc2977fe640 1 -- 172.21.15.73:0/1016291839 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fc2900853b0 con 0x7fc2a00cf450 2024-09-12T03:37:44.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.706+0000 7fc29e7fc640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2800678f0 0x7fc280069db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc2880ae000 tx=0x7fc288008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:44.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.710+0000 7fc2977fe640 1 -- 172.21.15.73:0/1016291839 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc2a00d0300 con 0x7fc2a00cf450 2024-09-12T03:37:44.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.858+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2a01fae70 con 0x7fc2800678f0 2024-09-12T03:37:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.874+0000 7fc2977fe640 1 -- 172.21.15.73:0/1016291839 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252052 (secure 0 0 0) 0x7fc2a01fae70 con 0x7fc2800678f0 2024-09-12T03:37:44.877 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:44.878 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:44.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2800678f0 msgr2=0x7fc280069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2800678f0 0x7fc280069db0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc2880ae000 tx=0x7fc288008040 comp rx=0 tx=0).stop 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00cf450 msgr2=0x7fc2a0153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00cf450 0x7fc2a0153980 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc29000c790 tx=0x7fc29000cc50 comp rx=0 tx=0).stop 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 shutdown_connections 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc2800678f0 0x7fc280069db0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc2a0161a60 0x7fc2a00c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc2a00d3060 0x7fc2a01fb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 --2- 172.21.15.73:0/1016291839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2a00cf450 0x7fc2a0153980 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 >> 172.21.15.73:0/1016291839 conn(0x7fc2a008bf90 msgr2=0x7fc2a0159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 shutdown_connections 2024-09-12T03:37:44.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:44.878+0000 7fc2a537e640 1 -- 172.21.15.73:0/1016291839 wait complete. 2024-09-12T03:37:44.894 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-12T03:37:43.844189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254724,"kb_used_data":9364,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719996,"statfs":{"total":773094113280,"available":772833275904,"internally_reserved":0,"allocated":9588736,"data_stored":4995543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.465977"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728420+0000","last_change":"2024-09-12T03:37:40.418524+0000","last_active":"2024-09-12T03:37:41.728420+0000","last_peered":"2024-09-12T03:37:41.728420+0000","last_clean":"2024-09-12T03:37:41.728420+0000","last_became_active":"2024-09-12T03:37:40.417456+0000","last_became_peered":"2024-09-12T03:37:40.417456+0000","last_unstale":"2024-09-12T03:37:41.728420+0000","last_undegraded":"2024-09-12T03:37:41.728420+0000","last_fullsized":"2024-09-12T03:37:41.728420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:51.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088190+0000","last_change":"2024-09-12T03:37:40.417871+0000","last_active":"2024-09-12T03:37:42.088190+0000","last_peered":"2024-09-12T03:37:42.088190+0000","last_clean":"2024-09-12T03:37:42.088190+0000","last_became_active":"2024-09-12T03:37:40.417195+0000","last_became_peered":"2024-09-12T03:37:40.417195+0000","last_unstale":"2024-09-12T03:37:42.088190+0000","last_undegraded":"2024-09-12T03:37:42.088190+0000","last_fullsized":"2024-09-12T03:37:42.088190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727920+0000","last_change":"2024-09-12T03:37:40.425683+0000","last_active":"2024-09-12T03:37:41.727920+0000","last_peered":"2024-09-12T03:37:41.727920+0000","last_clean":"2024-09-12T03:37:41.727920+0000","last_became_active":"2024-09-12T03:37:40.425250+0000","last_became_peered":"2024-09-12T03:37:40.425250+0000","last_unstale":"2024-09-12T03:37:41.727920+0000","last_undegraded":"2024-09-12T03:37:41.727920+0000","last_fullsized":"2024-09-12T03:37:41.727920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:04.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089667+0000","last_change":"2024-09-12T03:37:40.438674+0000","last_active":"2024-09-12T03:37:42.089667+0000","last_peered":"2024-09-12T03:37:42.089667+0000","last_clean":"2024-09-12T03:37:42.089667+0000","last_became_active":"2024-09-12T03:37:40.438182+0000","last_became_peered":"2024-09-12T03:37:40.438182+0000","last_unstale":"2024-09-12T03:37:42.089667+0000","last_undegraded":"2024-09-12T03:37:42.089667+0000","last_fullsized":"2024-09-12T03:37:42.089667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.158323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402829+0000","last_change":"2024-09-12T03:37:40.434204+0000","last_active":"2024-09-12T03:37:41.402829+0000","last_peered":"2024-09-12T03:37:41.402829+0000","last_clean":"2024-09-12T03:37:41.402829+0000","last_became_active":"2024-09-12T03:37:40.433795+0000","last_became_peered":"2024-09-12T03:37:40.433795+0000","last_unstale":"2024-09-12T03:37:41.402829+0000","last_undegraded":"2024-09-12T03:37:41.402829+0000","last_fullsized":"2024-09-12T03:37:41.402829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:53.990681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430456+0000","last_change":"2024-09-12T03:37:40.429021+0000","last_active":"2024-09-12T03:37:40.430456+0000","last_peered":"2024-09-12T03:37:40.430456+0000","last_clean":"2024-09-12T03:37:40.430456+0000","last_became_active":"2024-09-12T03:37:40.428595+0000","last_became_peered":"2024-09-12T03:37:40.428595+0000","last_unstale":"2024-09-12T03:37:40.430456+0000","last_undegraded":"2024-09-12T03:37:40.430456+0000","last_fullsized":"2024-09-12T03:37:40.430456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:27.282926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503627+0000","last_change":"2024-09-12T03:37:40.419795+0000","last_active":"2024-09-12T03:37:41.503627+0000","last_peered":"2024-09-12T03:37:41.503627+0000","last_clean":"2024-09-12T03:37:41.503627+0000","last_became_active":"2024-09-12T03:37:40.418899+0000","last_became_peered":"2024-09-12T03:37:40.418899+0000","last_unstale":"2024-09-12T03:37:41.503627+0000","last_undegraded":"2024-09-12T03:37:41.503627+0000","last_fullsized":"2024-09-12T03:37:41.503627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:56.112723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087683+0000","last_change":"2024-09-12T03:37:40.431454+0000","last_active":"2024-09-12T03:37:42.087683+0000","last_peered":"2024-09-12T03:37:42.087683+0000","last_clean":"2024-09-12T03:37:42.087683+0000","last_became_active":"2024-09-12T03:37:40.431024+0000","last_became_peered":"2024-09-12T03:37:40.431024+0000","last_unstale":"2024-09-12T03:37:42.087683+0000","last_undegraded":"2024-09-12T03:37:42.087683+0000","last_fullsized":"2024-09-12T03:37:42.087683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.112387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405943+0000","last_change":"2024-09-12T03:37:40.426674+0000","last_active":"2024-09-12T03:37:41.405943+0000","last_peered":"2024-09-12T03:37:41.405943+0000","last_clean":"2024-09-12T03:37:41.405943+0000","last_became_active":"2024-09-12T03:37:40.425626+0000","last_became_peered":"2024-09-12T03:37:40.425626+0000","last_unstale":"2024-09-12T03:37:41.405943+0000","last_undegraded":"2024-09-12T03:37:41.405943+0000","last_fullsized":"2024-09-12T03:37:41.405943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:42.768726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401731+0000","last_change":"2024-09-12T03:37:40.427701+0000","last_active":"2024-09-12T03:37:41.401731+0000","last_peered":"2024-09-12T03:37:41.401731+0000","last_clean":"2024-09-12T03:37:41.401731+0000","last_became_active":"2024-09-12T03:37:40.427374+0000","last_became_peered":"2024-09-12T03:37:40.427374+0000","last_unstale":"2024-09-12T03:37:41.401731+0000","last_undegraded":"2024-09-12T03:37:41.401731+0000","last_fullsized":"2024-09-12T03:37:41.401731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:51.375752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404435+0000","last_change":"2024-09-12T03:37:40.429489+0000","last_active":"2024-09-12T03:37:41.404435+0000","last_peered":"2024-09-12T03:37:41.404435+0000","last_clean":"2024-09-12T03:37:41.404435+0000","last_became_active":"2024-09-12T03:37:40.429236+0000","last_became_peered":"2024-09-12T03:37:40.429236+0000","last_unstale":"2024-09-12T03:37:41.404435+0000","last_undegraded":"2024-09-12T03:37:41.404435+0000","last_fullsized":"2024-09-12T03:37:41.404435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:55.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401563+0000","last_change":"2024-09-12T03:37:40.425714+0000","last_active":"2024-09-12T03:37:41.401563+0000","last_peered":"2024-09-12T03:37:41.401563+0000","last_clean":"2024-09-12T03:37:41.401563+0000","last_became_active":"2024-09-12T03:37:40.425333+0000","last_became_peered":"2024-09-12T03:37:40.425333+0000","last_unstale":"2024-09-12T03:37:41.401563+0000","last_undegraded":"2024-09-12T03:37:41.401563+0000","last_fullsized":"2024-09-12T03:37:41.401563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:49.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087790+0000","last_change":"2024-09-12T03:37:40.426993+0000","last_active":"2024-09-12T03:37:42.087790+0000","last_peered":"2024-09-12T03:37:42.087790+0000","last_clean":"2024-09-12T03:37:42.087790+0000","last_became_active":"2024-09-12T03:37:40.426625+0000","last_became_peered":"2024-09-12T03:37:40.426625+0000","last_unstale":"2024-09-12T03:37:42.087790+0000","last_undegraded":"2024-09-12T03:37:42.087790+0000","last_fullsized":"2024-09-12T03:37:42.087790+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:40.479744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402081+0000","last_change":"2024-09-12T03:37:40.428079+0000","last_active":"2024-09-12T03:37:41.402081+0000","last_peered":"2024-09-12T03:37:41.402081+0000","last_clean":"2024-09-12T03:37:41.402081+0000","last_became_active":"2024-09-12T03:37:40.427411+0000","last_became_peered":"2024-09-12T03:37:40.427411+0000","last_unstale":"2024-09-12T03:37:41.402081+0000","last_undegraded":"2024-09-12T03:37:41.402081+0000","last_fullsized":"2024-09-12T03:37:41.402081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:48.886084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088376+0000","last_change":"2024-09-12T03:37:40.433673+0000","last_active":"2024-09-12T03:37:42.088376+0000","last_peered":"2024-09-12T03:37:42.088376+0000","last_clean":"2024-09-12T03:37:42.088376+0000","last_became_active":"2024-09-12T03:37:40.431573+0000","last_became_peered":"2024-09-12T03:37:40.431573+0000","last_unstale":"2024-09-12T03:37:42.088376+0000","last_undegraded":"2024-09-12T03:37:42.088376+0000","last_fullsized":"2024-09-12T03:37:42.088376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:55.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424594+0000","last_change":"2024-09-12T03:37:40.418759+0000","last_active":"2024-09-12T03:37:40.424594+0000","last_peered":"2024-09-12T03:37:40.424594+0000","last_clean":"2024-09-12T03:37:40.424594+0000","last_became_active":"2024-09-12T03:37:40.418302+0000","last_became_peered":"2024-09-12T03:37:40.418302+0000","last_unstale":"2024-09-12T03:37:40.424594+0000","last_undegraded":"2024-09-12T03:37:40.424594+0000","last_fullsized":"2024-09-12T03:37:40.424594+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:05.244866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424419+0000","last_change":"2024-09-12T03:37:40.419713+0000","last_active":"2024-09-12T03:37:40.424419+0000","last_peered":"2024-09-12T03:37:40.424419+0000","last_clean":"2024-09-12T03:37:40.424419+0000","last_became_active":"2024-09-12T03:37:40.419377+0000","last_became_peered":"2024-09-12T03:37:40.419377+0000","last_unstale":"2024-09-12T03:37:40.424419+0000","last_undegraded":"2024-09-12T03:37:40.424419+0000","last_fullsized":"2024-09-12T03:37:40.424419+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.849186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728187+0000","last_change":"2024-09-12T03:37:40.415748+0000","last_active":"2024-09-12T03:37:41.728187+0000","last_peered":"2024-09-12T03:37:41.728187+0000","last_clean":"2024-09-12T03:37:41.728187+0000","last_became_active":"2024-09-12T03:37:40.414805+0000","last_became_peered":"2024-09-12T03:37:40.414805+0000","last_unstale":"2024-09-12T03:37:41.728187+0000","last_undegraded":"2024-09-12T03:37:41.728187+0000","last_fullsized":"2024-09-12T03:37:41.728187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.245207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404811+0000","last_change":"2024-09-12T03:37:40.425946+0000","last_active":"2024-09-12T03:37:41.404811+0000","last_peered":"2024-09-12T03:37:41.404811+0000","last_clean":"2024-09-12T03:37:41.404811+0000","last_became_active":"2024-09-12T03:37:40.425618+0000","last_became_peered":"2024-09-12T03:37:40.425618+0000","last_unstale":"2024-09-12T03:37:41.404811+0000","last_undegraded":"2024-09-12T03:37:41.404811+0000","last_fullsized":"2024-09-12T03:37:41.404811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:16.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089892+0000","last_change":"2024-09-12T03:37:40.433908+0000","last_active":"2024-09-12T03:37:42.089892+0000","last_peered":"2024-09-12T03:37:42.089892+0000","last_clean":"2024-09-12T03:37:42.089892+0000","last_became_active":"2024-09-12T03:37:40.431730+0000","last_became_peered":"2024-09-12T03:37:40.431730+0000","last_unstale":"2024-09-12T03:37:42.089892+0000","last_undegraded":"2024-09-12T03:37:42.089892+0000","last_fullsized":"2024-09-12T03:37:42.089892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:11.193587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402443+0000","last_change":"2024-09-12T03:37:40.421449+0000","last_active":"2024-09-12T03:37:41.402443+0000","last_peered":"2024-09-12T03:37:41.402443+0000","last_clean":"2024-09-12T03:37:41.402443+0000","last_became_active":"2024-09-12T03:37:40.420532+0000","last_became_peered":"2024-09-12T03:37:40.420532+0000","last_unstale":"2024-09-12T03:37:41.402443+0000","last_undegraded":"2024-09-12T03:37:41.402443+0000","last_fullsized":"2024-09-12T03:37:41.402443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:19.117928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402447+0000","last_change":"2024-09-12T03:37:40.428303+0000","last_active":"2024-09-12T03:37:41.402447+0000","last_peered":"2024-09-12T03:37:41.402447+0000","last_clean":"2024-09-12T03:37:41.402447+0000","last_became_active":"2024-09-12T03:37:40.427809+0000","last_became_peered":"2024-09-12T03:37:40.427809+0000","last_unstale":"2024-09-12T03:37:41.402447+0000","last_undegraded":"2024-09-12T03:37:41.402447+0000","last_fullsized":"2024-09-12T03:37:41.402447+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:53.359857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436199+0000","last_change":"2024-09-12T03:37:40.425754+0000","last_active":"2024-09-12T03:37:40.436199+0000","last_peered":"2024-09-12T03:37:40.436199+0000","last_clean":"2024-09-12T03:37:40.436199+0000","last_became_active":"2024-09-12T03:37:40.425148+0000","last_became_peered":"2024-09-12T03:37:40.425148+0000","last_unstale":"2024-09-12T03:37:40.436199+0000","last_undegraded":"2024-09-12T03:37:40.436199+0000","last_fullsized":"2024-09-12T03:37:40.436199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:14.157378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727334+0000","last_change":"2024-09-12T03:37:40.422739+0000","last_active":"2024-09-12T03:37:41.727334+0000","last_peered":"2024-09-12T03:37:41.727334+0000","last_clean":"2024-09-12T03:37:41.727334+0000","last_became_active":"2024-09-12T03:37:40.422394+0000","last_became_peered":"2024-09-12T03:37:40.422394+0000","last_unstale":"2024-09-12T03:37:41.727334+0000","last_undegraded":"2024-09-12T03:37:41.727334+0000","last_fullsized":"2024-09-12T03:37:41.727334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:49.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088452+0000","last_change":"2024-09-12T03:37:40.428871+0000","last_active":"2024-09-12T03:37:42.088452+0000","last_peered":"2024-09-12T03:37:42.088452+0000","last_clean":"2024-09-12T03:37:42.088452+0000","last_became_active":"2024-09-12T03:37:40.426961+0000","last_became_peered":"2024-09-12T03:37:40.426961+0000","last_unstale":"2024-09-12T03:37:42.088452+0000","last_undegraded":"2024-09-12T03:37:42.088452+0000","last_fullsized":"2024-09-12T03:37:42.088452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.245207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404013+0000","last_change":"2024-09-12T03:37:40.432570+0000","last_active":"2024-09-12T03:37:41.404013+0000","last_peered":"2024-09-12T03:37:41.404013+0000","last_clean":"2024-09-12T03:37:41.404013+0000","last_became_active":"2024-09-12T03:37:40.432262+0000","last_became_peered":"2024-09-12T03:37:40.432262+0000","last_unstale":"2024-09-12T03:37:41.404013+0000","last_undegraded":"2024-09-12T03:37:41.404013+0000","last_fullsized":"2024-09-12T03:37:41.404013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.112387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401720+0000","last_change":"2024-09-12T03:37:40.433918+0000","last_active":"2024-09-12T03:37:41.401720+0000","last_peered":"2024-09-12T03:37:41.401720+0000","last_clean":"2024-09-12T03:37:41.401720+0000","last_became_active":"2024-09-12T03:37:40.433594+0000","last_became_peered":"2024-09-12T03:37:40.433594+0000","last_unstale":"2024-09-12T03:37:41.401720+0000","last_undegraded":"2024-09-12T03:37:41.401720+0000","last_fullsized":"2024-09-12T03:37:41.401720+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.090075+0000","last_change":"2024-09-12T03:37:40.439228+0000","last_active":"2024-09-12T03:37:42.090075+0000","last_peered":"2024-09-12T03:37:42.090075+0000","last_clean":"2024-09-12T03:37:42.090075+0000","last_became_active":"2024-09-12T03:37:40.438878+0000","last_became_peered":"2024-09-12T03:37:40.438878+0000","last_unstale":"2024-09-12T03:37:42.090075+0000","last_undegraded":"2024-09-12T03:37:42.090075+0000","last_fullsized":"2024-09-12T03:37:42.090075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:31.398726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503852+0000","last_change":"2024-09-12T03:37:40.423565+0000","last_active":"2024-09-12T03:37:41.503852+0000","last_peered":"2024-09-12T03:37:41.503852+0000","last_clean":"2024-09-12T03:37:41.503852+0000","last_became_active":"2024-09-12T03:37:40.423275+0000","last_became_peered":"2024-09-12T03:37:40.423275+0000","last_unstale":"2024-09-12T03:37:41.503852+0000","last_undegraded":"2024-09-12T03:37:41.503852+0000","last_fullsized":"2024-09-12T03:37:41.503852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:15.892839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402833+0000","last_change":"2024-09-12T03:37:40.421609+0000","last_active":"2024-09-12T03:37:41.402833+0000","last_peered":"2024-09-12T03:37:41.402833+0000","last_clean":"2024-09-12T03:37:41.402833+0000","last_became_active":"2024-09-12T03:37:40.421247+0000","last_became_peered":"2024-09-12T03:37:40.421247+0000","last_unstale":"2024-09-12T03:37:41.402833+0000","last_undegraded":"2024-09-12T03:37:41.402833+0000","last_fullsized":"2024-09-12T03:37:41.402833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:34.571896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087706+0000","last_change":"2024-09-12T03:37:40.427689+0000","last_active":"2024-09-12T03:37:42.087706+0000","last_peered":"2024-09-12T03:37:42.087706+0000","last_clean":"2024-09-12T03:37:42.087706+0000","last_became_active":"2024-09-12T03:37:40.427389+0000","last_became_peered":"2024-09-12T03:37:40.427389+0000","last_unstale":"2024-09-12T03:37:42.087706+0000","last_undegraded":"2024-09-12T03:37:42.087706+0000","last_fullsized":"2024-09-12T03:37:42.087706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:31.398726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430236+0000","last_change":"2024-09-12T03:37:40.424603+0000","last_active":"2024-09-12T03:37:40.430236+0000","last_peered":"2024-09-12T03:37:40.430236+0000","last_clean":"2024-09-12T03:37:40.430236+0000","last_became_active":"2024-09-12T03:37:40.424281+0000","last_became_peered":"2024-09-12T03:37:40.424281+0000","last_unstale":"2024-09-12T03:37:40.430236+0000","last_undegraded":"2024-09-12T03:37:40.430236+0000","last_fullsized":"2024-09-12T03:37:40.430236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:41.613891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430310+0000","last_change":"2024-09-12T03:37:40.425608+0000","last_active":"2024-09-12T03:37:40.430310+0000","last_peered":"2024-09-12T03:37:40.430310+0000","last_clean":"2024-09-12T03:37:40.430310+0000","last_became_active":"2024-09-12T03:37:40.424515+0000","last_became_peered":"2024-09-12T03:37:40.424515+0000","last_unstale":"2024-09-12T03:37:40.430310+0000","last_undegraded":"2024-09-12T03:37:40.430310+0000","last_fullsized":"2024-09-12T03:37:40.430310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:06.834378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.440639+0000","last_change":"2024-09-12T03:37:39.416198+0000","last_active":"2024-09-12T03:37:40.440639+0000","last_peered":"2024-09-12T03:37:40.440639+0000","last_clean":"2024-09-12T03:37:40.440639+0000","last_became_active":"2024-09-12T03:37:39.415495+0000","last_became_peered":"2024-09-12T03:37:39.415495+0000","last_unstale":"2024-09-12T03:37:40.440639+0000","last_undegraded":"2024-09-12T03:37:40.440639+0000","last_fullsized":"2024-09-12T03:37:40.440639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:34.724760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430302+0000","last_change":"2024-09-12T03:37:40.424326+0000","last_active":"2024-09-12T03:37:40.430302+0000","last_peered":"2024-09-12T03:37:40.430302+0000","last_clean":"2024-09-12T03:37:40.430302+0000","last_became_active":"2024-09-12T03:37:40.424042+0000","last_became_peered":"2024-09-12T03:37:40.424042+0000","last_unstale":"2024-09-12T03:37:40.430302+0000","last_undegraded":"2024-09-12T03:37:40.430302+0000","last_fullsized":"2024-09-12T03:37:40.430302+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:17.045762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405703+0000","last_change":"2024-09-12T03:37:39.439560+0000","last_active":"2024-09-12T03:37:41.405703+0000","last_peered":"2024-09-12T03:37:41.405703+0000","last_clean":"2024-09-12T03:37:41.405703+0000","last_became_active":"2024-09-12T03:37:39.438961+0000","last_became_peered":"2024-09-12T03:37:39.438961+0000","last_unstale":"2024-09-12T03:37:41.405703+0000","last_undegraded":"2024-09-12T03:37:41.405703+0000","last_fullsized":"2024-09-12T03:37:41.405703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:05.889743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504148+0000","last_change":"2024-09-12T03:37:40.431632+0000","last_active":"2024-09-12T03:37:41.504148+0000","last_peered":"2024-09-12T03:37:41.504148+0000","last_clean":"2024-09-12T03:37:41.504148+0000","last_became_active":"2024-09-12T03:37:40.431205+0000","last_became_peered":"2024-09-12T03:37:40.431205+0000","last_unstale":"2024-09-12T03:37:41.504148+0000","last_undegraded":"2024-09-12T03:37:41.504148+0000","last_fullsized":"2024-09-12T03:37:41.504148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.186242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503990+0000","last_change":"2024-09-12T03:37:39.418039+0000","last_active":"2024-09-12T03:37:41.503990+0000","last_peered":"2024-09-12T03:37:41.503990+0000","last_clean":"2024-09-12T03:37:41.503990+0000","last_became_active":"2024-09-12T03:37:39.417238+0000","last_became_peered":"2024-09-12T03:37:39.417238+0000","last_unstale":"2024-09-12T03:37:41.503990+0000","last_undegraded":"2024-09-12T03:37:41.503990+0000","last_fullsized":"2024-09-12T03:37:41.503990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:48.775397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437117+0000","last_change":"2024-09-12T03:37:40.435971+0000","last_active":"2024-09-12T03:37:40.437117+0000","last_peered":"2024-09-12T03:37:40.437117+0000","last_clean":"2024-09-12T03:37:40.437117+0000","last_became_active":"2024-09-12T03:37:40.435660+0000","last_became_peered":"2024-09-12T03:37:40.435660+0000","last_unstale":"2024-09-12T03:37:40.437117+0000","last_undegraded":"2024-09-12T03:37:40.437117+0000","last_fullsized":"2024-09-12T03:37:40.437117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:46.170305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.432677+0000","last_change":"2024-09-12T03:37:39.413393+0000","last_active":"2024-09-12T03:37:40.432677+0000","last_peered":"2024-09-12T03:37:40.432677+0000","last_clean":"2024-09-12T03:37:40.432677+0000","last_became_active":"2024-09-12T03:37:39.412623+0000","last_became_peered":"2024-09-12T03:37:39.412623+0000","last_unstale":"2024-09-12T03:37:40.432677+0000","last_undegraded":"2024-09-12T03:37:40.432677+0000","last_fullsized":"2024-09-12T03:37:40.432677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:57.769487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088471+0000","last_change":"2024-09-12T03:37:40.434360+0000","last_active":"2024-09-12T03:37:42.088471+0000","last_peered":"2024-09-12T03:37:42.088471+0000","last_clean":"2024-09-12T03:37:42.088471+0000","last_became_active":"2024-09-12T03:37:40.431775+0000","last_became_peered":"2024-09-12T03:37:40.431775+0000","last_unstale":"2024-09-12T03:37:42.088471+0000","last_undegraded":"2024-09-12T03:37:42.088471+0000","last_fullsized":"2024-09-12T03:37:42.088471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:16.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403244+0000","last_change":"2024-09-12T03:37:39.430992+0000","last_active":"2024-09-12T03:37:41.403244+0000","last_peered":"2024-09-12T03:37:41.403244+0000","last_clean":"2024-09-12T03:37:41.403244+0000","last_became_active":"2024-09-12T03:37:39.429864+0000","last_became_peered":"2024-09-12T03:37:39.429864+0000","last_unstale":"2024-09-12T03:37:41.403244+0000","last_undegraded":"2024-09-12T03:37:41.403244+0000","last_fullsized":"2024-09-12T03:37:41.403244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:19.789792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436168+0000","last_change":"2024-09-12T03:37:40.418137+0000","last_active":"2024-09-12T03:37:40.436168+0000","last_peered":"2024-09-12T03:37:40.436168+0000","last_clean":"2024-09-12T03:37:40.436168+0000","last_became_active":"2024-09-12T03:37:40.416243+0000","last_became_peered":"2024-09-12T03:37:40.416243+0000","last_unstale":"2024-09-12T03:37:40.436168+0000","last_undegraded":"2024-09-12T03:37:40.436168+0000","last_fullsized":"2024-09-12T03:37:40.436168+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:43.363057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088834+0000","last_change":"2024-09-12T03:37:39.409402+0000","last_active":"2024-09-12T03:37:42.088834+0000","last_peered":"2024-09-12T03:37:42.088834+0000","last_clean":"2024-09-12T03:37:42.088834+0000","last_became_active":"2024-09-12T03:37:39.408846+0000","last_became_peered":"2024-09-12T03:37:39.408846+0000","last_unstale":"2024-09-12T03:37:42.088834+0000","last_undegraded":"2024-09-12T03:37:42.088834+0000","last_fullsized":"2024-09-12T03:37:42.088834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:37.186413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.439177+0000","last_change":"2024-09-12T03:37:40.437610+0000","last_active":"2024-09-12T03:37:40.439177+0000","last_peered":"2024-09-12T03:37:40.439177+0000","last_clean":"2024-09-12T03:37:40.439177+0000","last_became_active":"2024-09-12T03:37:40.437312+0000","last_became_peered":"2024-09-12T03:37:40.437312+0000","last_unstale":"2024-09-12T03:37:40.439177+0000","last_undegraded":"2024-09-12T03:37:40.439177+0000","last_fullsized":"2024-09-12T03:37:40.439177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:08.418783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727767+0000","last_change":"2024-09-12T03:37:39.421452+0000","last_active":"2024-09-12T03:37:41.727767+0000","last_peered":"2024-09-12T03:37:41.727767+0000","last_clean":"2024-09-12T03:37:41.727767+0000","last_became_active":"2024-09-12T03:37:39.420940+0000","last_became_peered":"2024-09-12T03:37:39.420940+0000","last_unstale":"2024-09-12T03:37:41.727767+0000","last_undegraded":"2024-09-12T03:37:41.727767+0000","last_fullsized":"2024-09-12T03:37:41.727767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:26.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089337+0000","last_change":"2024-09-12T03:37:40.438471+0000","last_active":"2024-09-12T03:37:42.089337+0000","last_peered":"2024-09-12T03:37:42.089337+0000","last_clean":"2024-09-12T03:37:42.089337+0000","last_became_active":"2024-09-12T03:37:40.438101+0000","last_became_peered":"2024-09-12T03:37:40.438101+0000","last_unstale":"2024-09-12T03:37:42.089337+0000","last_undegraded":"2024-09-12T03:37:42.089337+0000","last_fullsized":"2024-09-12T03:37:42.089337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:42.768726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503958+0000","last_change":"2024-09-12T03:37:39.419265+0000","last_active":"2024-09-12T03:37:41.503958+0000","last_peered":"2024-09-12T03:37:41.503958+0000","last_clean":"2024-09-12T03:37:41.503958+0000","last_became_active":"2024-09-12T03:37:39.417550+0000","last_became_peered":"2024-09-12T03:37:39.417550+0000","last_unstale":"2024-09-12T03:37:41.503958+0000","last_undegraded":"2024-09-12T03:37:41.503958+0000","last_fullsized":"2024-09-12T03:37:41.503958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:30.389468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404185+0000","last_change":"2024-09-12T03:37:40.421218+0000","last_active":"2024-09-12T03:37:41.404185+0000","last_peered":"2024-09-12T03:37:41.404185+0000","last_clean":"2024-09-12T03:37:41.404185+0000","last_became_active":"2024-09-12T03:37:40.420251+0000","last_became_peered":"2024-09-12T03:37:40.420251+0000","last_unstale":"2024-09-12T03:37:41.404185+0000","last_undegraded":"2024-09-12T03:37:41.404185+0000","last_fullsized":"2024-09-12T03:37:41.404185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:40.479744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088487+0000","last_change":"2024-09-12T03:37:39.429482+0000","last_active":"2024-09-12T03:37:42.088487+0000","last_peered":"2024-09-12T03:37:42.088487+0000","last_clean":"2024-09-12T03:37:42.088487+0000","last_became_active":"2024-09-12T03:37:39.420950+0000","last_became_peered":"2024-09-12T03:37:39.420950+0000","last_unstale":"2024-09-12T03:37:42.088487+0000","last_undegraded":"2024-09-12T03:37:42.088487+0000","last_fullsized":"2024-09-12T03:37:42.088487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:39.470485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503794+0000","last_change":"2024-09-12T03:37:40.432650+0000","last_active":"2024-09-12T03:37:41.503794+0000","last_peered":"2024-09-12T03:37:41.503794+0000","last_clean":"2024-09-12T03:37:41.503794+0000","last_became_active":"2024-09-12T03:37:40.432391+0000","last_became_peered":"2024-09-12T03:37:40.432391+0000","last_unstale":"2024-09-12T03:37:41.503794+0000","last_undegraded":"2024-09-12T03:37:41.503794+0000","last_fullsized":"2024-09-12T03:37:41.503794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:47.382688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728399+0000","last_change":"2024-09-12T03:37:39.406402+0000","last_active":"2024-09-12T03:37:41.728399+0000","last_peered":"2024-09-12T03:37:41.728399+0000","last_clean":"2024-09-12T03:37:41.728399+0000","last_became_active":"2024-09-12T03:37:39.406108+0000","last_became_peered":"2024-09-12T03:37:39.406108+0000","last_unstale":"2024-09-12T03:37:41.728399+0000","last_undegraded":"2024-09-12T03:37:41.728399+0000","last_fullsized":"2024-09-12T03:37:41.728399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:54.573945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728342+0000","last_change":"2024-09-12T03:37:40.410282+0000","last_active":"2024-09-12T03:37:41.728342+0000","last_peered":"2024-09-12T03:37:41.728342+0000","last_clean":"2024-09-12T03:37:41.728342+0000","last_became_active":"2024-09-12T03:37:40.409958+0000","last_became_peered":"2024-09-12T03:37:40.409958+0000","last_unstale":"2024-09-12T03:37:41.728342+0000","last_undegraded":"2024-09-12T03:37:41.728342+0000","last_fullsized":"2024-09-12T03:37:41.728342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:01.744440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405189+0000","last_change":"2024-09-12T03:37:39.438651+0000","last_active":"2024-09-12T03:37:41.405189+0000","last_peered":"2024-09-12T03:37:41.405189+0000","last_clean":"2024-09-12T03:37:41.405189+0000","last_became_active":"2024-09-12T03:37:39.434714+0000","last_became_peered":"2024-09-12T03:37:39.434714+0000","last_unstale":"2024-09-12T03:37:41.405189+0000","last_undegraded":"2024-09-12T03:37:41.405189+0000","last_fullsized":"2024-09-12T03:37:41.405189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:23.830605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089695+0000","last_change":"2024-09-12T03:37:40.427079+0000","last_active":"2024-09-12T03:37:42.089695+0000","last_peered":"2024-09-12T03:37:42.089695+0000","last_clean":"2024-09-12T03:37:42.089695+0000","last_became_active":"2024-09-12T03:37:40.426730+0000","last_became_peered":"2024-09-12T03:37:40.426730+0000","last_unstale":"2024-09-12T03:37:42.089695+0000","last_undegraded":"2024-09-12T03:37:42.089695+0000","last_fullsized":"2024-09-12T03:37:42.089695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:57.716910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.441756+0000","last_change":"2024-09-12T03:37:39.425400+0000","last_active":"2024-09-12T03:37:40.441756+0000","last_peered":"2024-09-12T03:37:40.441756+0000","last_clean":"2024-09-12T03:37:40.441756+0000","last_became_active":"2024-09-12T03:37:39.425134+0000","last_became_peered":"2024-09-12T03:37:39.425134+0000","last_unstale":"2024-09-12T03:37:40.441756+0000","last_undegraded":"2024-09-12T03:37:40.441756+0000","last_fullsized":"2024-09-12T03:37:40.441756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:12.236274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088078+0000","last_change":"2024-09-12T03:37:40.431048+0000","last_active":"2024-09-12T03:37:42.088078+0000","last_peered":"2024-09-12T03:37:42.088078+0000","last_clean":"2024-09-12T03:37:42.088078+0000","last_became_active":"2024-09-12T03:37:40.430593+0000","last_became_peered":"2024-09-12T03:37:40.430593+0000","last_unstale":"2024-09-12T03:37:42.088078+0000","last_undegraded":"2024-09-12T03:37:42.088078+0000","last_fullsized":"2024-09-12T03:37:42.088078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.161815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503737+0000","last_change":"2024-09-12T03:37:39.421660+0000","last_active":"2024-09-12T03:37:41.503737+0000","last_peered":"2024-09-12T03:37:41.503737+0000","last_clean":"2024-09-12T03:37:41.503737+0000","last_became_active":"2024-09-12T03:37:39.420962+0000","last_became_peered":"2024-09-12T03:37:39.420962+0000","last_unstale":"2024-09-12T03:37:41.503737+0000","last_undegraded":"2024-09-12T03:37:41.503737+0000","last_fullsized":"2024-09-12T03:37:41.503737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:21.235949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401958+0000","last_change":"2024-09-12T03:37:40.438346+0000","last_active":"2024-09-12T03:37:41.401958+0000","last_peered":"2024-09-12T03:37:41.401958+0000","last_clean":"2024-09-12T03:37:41.401958+0000","last_became_active":"2024-09-12T03:37:40.437961+0000","last_became_peered":"2024-09-12T03:37:40.437961+0000","last_unstale":"2024-09-12T03:37:41.401958+0000","last_undegraded":"2024-09-12T03:37:41.401958+0000","last_fullsized":"2024-09-12T03:37:41.401958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:21.181419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.401479+0000","last_change":"2024-09-12T03:37:39.422461+0000","last_active":"2024-09-12T03:37:40.401479+0000","last_peered":"2024-09-12T03:37:40.401479+0000","last_clean":"2024-09-12T03:37:40.401479+0000","last_became_active":"2024-09-12T03:37:39.421555+0000","last_became_peered":"2024-09-12T03:37:39.421555+0000","last_unstale":"2024-09-12T03:37:40.401479+0000","last_undegraded":"2024-09-12T03:37:40.401479+0000","last_fullsized":"2024-09-12T03:37:40.401479+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:42.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401207+0000","last_change":"2024-09-12T03:37:40.427938+0000","last_active":"2024-09-12T03:37:41.401207+0000","last_peered":"2024-09-12T03:37:41.401207+0000","last_clean":"2024-09-12T03:37:41.401207+0000","last_became_active":"2024-09-12T03:37:40.427412+0000","last_became_peered":"2024-09-12T03:37:40.427412+0000","last_unstale":"2024-09-12T03:37:41.401207+0000","last_undegraded":"2024-09-12T03:37:41.401207+0000","last_fullsized":"2024-09-12T03:37:41.401207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.043089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088599+0000","last_change":"2024-09-12T03:37:39.426750+0000","last_active":"2024-09-12T03:37:42.088599+0000","last_peered":"2024-09-12T03:37:42.088599+0000","last_clean":"2024-09-12T03:37:42.088599+0000","last_became_active":"2024-09-12T03:37:39.426357+0000","last_became_peered":"2024-09-12T03:37:39.426357+0000","last_unstale":"2024-09-12T03:37:42.088599+0000","last_undegraded":"2024-09-12T03:37:42.088599+0000","last_fullsized":"2024-09-12T03:37:42.088599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:12.810221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401486+0000","last_change":"2024-09-12T03:37:40.423255+0000","last_active":"2024-09-12T03:37:41.401486+0000","last_peered":"2024-09-12T03:37:41.401486+0000","last_clean":"2024-09-12T03:37:41.401486+0000","last_became_active":"2024-09-12T03:37:40.422843+0000","last_became_peered":"2024-09-12T03:37:40.422843+0000","last_unstale":"2024-09-12T03:37:41.401486+0000","last_undegraded":"2024-09-12T03:37:41.401486+0000","last_fullsized":"2024-09-12T03:37:41.401486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:25.477796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088357+0000","last_change":"2024-09-12T03:37:39.408602+0000","last_active":"2024-09-12T03:37:42.088357+0000","last_peered":"2024-09-12T03:37:42.088357+0000","last_clean":"2024-09-12T03:37:42.088357+0000","last_became_active":"2024-09-12T03:37:39.408327+0000","last_became_peered":"2024-09-12T03:37:39.408327+0000","last_unstale":"2024-09-12T03:37:42.088357+0000","last_undegraded":"2024-09-12T03:37:42.088357+0000","last_fullsized":"2024-09-12T03:37:42.088357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:51.127339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430333+0000","last_change":"2024-09-12T03:37:40.428686+0000","last_active":"2024-09-12T03:37:40.430333+0000","last_peered":"2024-09-12T03:37:40.430333+0000","last_clean":"2024-09-12T03:37:40.430333+0000","last_became_active":"2024-09-12T03:37:40.423872+0000","last_became_peered":"2024-09-12T03:37:40.423872+0000","last_unstale":"2024-09-12T03:37:40.430333+0000","last_undegraded":"2024-09-12T03:37:40.430333+0000","last_fullsized":"2024-09-12T03:37:40.430333+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:32.082371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436868+0000","last_change":"2024-09-12T03:37:39.432638+0000","last_active":"2024-09-12T03:37:40.436868+0000","last_peered":"2024-09-12T03:37:40.436868+0000","last_clean":"2024-09-12T03:37:40.436868+0000","last_became_active":"2024-09-12T03:37:39.431762+0000","last_became_peered":"2024-09-12T03:37:39.431762+0000","last_unstale":"2024-09-12T03:37:40.436868+0000","last_undegraded":"2024-09-12T03:37:40.436868+0000","last_fullsized":"2024-09-12T03:37:40.436868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:55.197250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436291+0000","last_change":"2024-09-12T03:37:40.417439+0000","last_active":"2024-09-12T03:37:40.436291+0000","last_peered":"2024-09-12T03:37:40.436291+0000","last_clean":"2024-09-12T03:37:40.436291+0000","last_became_active":"2024-09-12T03:37:40.416773+0000","last_became_peered":"2024-09-12T03:37:40.416773+0000","last_unstale":"2024-09-12T03:37:40.436291+0000","last_undegraded":"2024-09-12T03:37:40.436291+0000","last_fullsized":"2024-09-12T03:37:40.436291+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:53.808509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503853+0000","last_change":"2024-09-12T03:37:39.434146+0000","last_active":"2024-09-12T03:37:41.503853+0000","last_peered":"2024-09-12T03:37:41.503853+0000","last_clean":"2024-09-12T03:37:41.503853+0000","last_became_active":"2024-09-12T03:37:39.433427+0000","last_became_peered":"2024-09-12T03:37:39.433427+0000","last_unstale":"2024-09-12T03:37:41.503853+0000","last_undegraded":"2024-09-12T03:37:41.503853+0000","last_fullsized":"2024-09-12T03:37:41.503853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:03.747853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404221+0000","last_change":"2024-09-12T03:37:40.425320+0000","last_active":"2024-09-12T03:37:41.404221+0000","last_peered":"2024-09-12T03:37:41.404221+0000","last_clean":"2024-09-12T03:37:41.404221+0000","last_became_active":"2024-09-12T03:37:40.424983+0000","last_became_peered":"2024-09-12T03:37:40.424983+0000","last_unstale":"2024-09-12T03:37:41.404221+0000","last_undegraded":"2024-09-12T03:37:41.404221+0000","last_fullsized":"2024-09-12T03:37:41.404221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.161815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405329+0000","last_change":"2024-09-12T03:37:39.437820+0000","last_active":"2024-09-12T03:37:41.405329+0000","last_peered":"2024-09-12T03:37:41.405329+0000","last_clean":"2024-09-12T03:37:41.405329+0000","last_became_active":"2024-09-12T03:37:39.434293+0000","last_became_peered":"2024-09-12T03:37:39.434293+0000","last_unstale":"2024-09-12T03:37:41.405329+0000","last_undegraded":"2024-09-12T03:37:41.405329+0000","last_fullsized":"2024-09-12T03:37:41.405329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:06.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.438617+0000","last_change":"2024-09-12T03:37:40.436044+0000","last_active":"2024-09-12T03:37:40.438617+0000","last_peered":"2024-09-12T03:37:40.438617+0000","last_clean":"2024-09-12T03:37:40.438617+0000","last_became_active":"2024-09-12T03:37:40.432077+0000","last_became_peered":"2024-09-12T03:37:40.432077+0000","last_unstale":"2024-09-12T03:37:40.438617+0000","last_undegraded":"2024-09-12T03:37:40.438617+0000","last_fullsized":"2024-09-12T03:37:40.438617+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:55:35.840013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087753+0000","last_change":"2024-09-12T03:37:39.428828+0000","last_active":"2024-09-12T03:37:42.087753+0000","last_peered":"2024-09-12T03:37:42.087753+0000","last_clean":"2024-09-12T03:37:42.087753+0000","last_became_active":"2024-09-12T03:37:39.419776+0000","last_became_peered":"2024-09-12T03:37:39.419776+0000","last_unstale":"2024-09-12T03:37:42.087753+0000","last_undegraded":"2024-09-12T03:37:42.087753+0000","last_fullsized":"2024-09-12T03:37:42.087753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:30.103129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087840+0000","last_change":"2024-09-12T03:37:40.405047+0000","last_active":"2024-09-12T03:37:42.087840+0000","last_peered":"2024-09-12T03:37:42.087840+0000","last_clean":"2024-09-12T03:37:42.087840+0000","last_became_active":"2024-09-12T03:37:40.404830+0000","last_became_peered":"2024-09-12T03:37:40.404830+0000","last_unstale":"2024-09-12T03:37:42.087840+0000","last_undegraded":"2024-09-12T03:37:42.087840+0000","last_fullsized":"2024-09-12T03:37:42.087840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:25.238047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401379+0000","last_change":"2024-09-12T03:37:39.407477+0000","last_active":"2024-09-12T03:37:41.401379+0000","last_peered":"2024-09-12T03:37:41.401379+0000","last_clean":"2024-09-12T03:37:41.401379+0000","last_became_active":"2024-09-12T03:37:39.407054+0000","last_became_peered":"2024-09-12T03:37:39.407054+0000","last_unstale":"2024-09-12T03:37:41.401379+0000","last_undegraded":"2024-09-12T03:37:41.401379+0000","last_fullsized":"2024-09-12T03:37:41.401379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:11.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088052+0000","last_change":"2024-09-12T03:37:40.427696+0000","last_active":"2024-09-12T03:37:42.088052+0000","last_peered":"2024-09-12T03:37:42.088052+0000","last_clean":"2024-09-12T03:37:42.088052+0000","last_became_active":"2024-09-12T03:37:40.427417+0000","last_became_peered":"2024-09-12T03:37:40.427417+0000","last_unstale":"2024-09-12T03:37:42.088052+0000","last_undegraded":"2024-09-12T03:37:42.088052+0000","last_fullsized":"2024-09-12T03:37:42.088052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:49.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088016+0000","last_change":"2024-09-12T03:37:39.429082+0000","last_active":"2024-09-12T03:37:42.088016+0000","last_peered":"2024-09-12T03:37:42.088016+0000","last_clean":"2024-09-12T03:37:42.088016+0000","last_became_active":"2024-09-12T03:37:39.421393+0000","last_became_peered":"2024-09-12T03:37:39.421393+0000","last_unstale":"2024-09-12T03:37:42.088016+0000","last_undegraded":"2024-09-12T03:37:42.088016+0000","last_fullsized":"2024-09-12T03:37:42.088016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:26.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.430264+0000","last_change":"2024-09-12T03:37:40.424564+0000","last_active":"2024-09-12T03:37:40.430264+0000","last_peered":"2024-09-12T03:37:40.430264+0000","last_clean":"2024-09-12T03:37:40.430264+0000","last_became_active":"2024-09-12T03:37:40.424199+0000","last_became_peered":"2024-09-12T03:37:40.424199+0000","last_unstale":"2024-09-12T03:37:40.430264+0000","last_undegraded":"2024-09-12T03:37:40.430264+0000","last_fullsized":"2024-09-12T03:37:40.430264+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:36.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401029+0000","last_change":"2024-09-12T03:37:39.432475+0000","last_active":"2024-09-12T03:37:41.401029+0000","last_peered":"2024-09-12T03:37:41.401029+0000","last_clean":"2024-09-12T03:37:41.401029+0000","last_became_active":"2024-09-12T03:37:39.432210+0000","last_became_peered":"2024-09-12T03:37:39.432210+0000","last_unstale":"2024-09-12T03:37:41.401029+0000","last_undegraded":"2024-09-12T03:37:41.401029+0000","last_fullsized":"2024-09-12T03:37:41.401029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:43.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.437142+0000","last_change":"2024-09-12T03:37:40.424253+0000","last_active":"2024-09-12T03:37:40.437142+0000","last_peered":"2024-09-12T03:37:40.437142+0000","last_clean":"2024-09-12T03:37:40.437142+0000","last_became_active":"2024-09-12T03:37:40.422441+0000","last_became_peered":"2024-09-12T03:37:40.422441+0000","last_unstale":"2024-09-12T03:37:40.437142+0000","last_undegraded":"2024-09-12T03:37:40.437142+0000","last_fullsized":"2024-09-12T03:37:40.437142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:54.414454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504106+0000","last_change":"2024-09-12T03:37:39.437978+0000","last_active":"2024-09-12T03:37:41.504106+0000","last_peered":"2024-09-12T03:37:41.504106+0000","last_clean":"2024-09-12T03:37:41.504106+0000","last_became_active":"2024-09-12T03:37:39.437140+0000","last_became_peered":"2024-09-12T03:37:39.437140+0000","last_unstale":"2024-09-12T03:37:41.504106+0000","last_undegraded":"2024-09-12T03:37:41.504106+0000","last_fullsized":"2024-09-12T03:37:41.504106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.851466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429479+0000","last_change":"2024-09-12T03:37:40.417407+0000","last_active":"2024-09-12T03:37:40.429479+0000","last_peered":"2024-09-12T03:37:40.429479+0000","last_clean":"2024-09-12T03:37:40.429479+0000","last_became_active":"2024-09-12T03:37:40.416874+0000","last_became_peered":"2024-09-12T03:37:40.416874+0000","last_unstale":"2024-09-12T03:37:40.429479+0000","last_undegraded":"2024-09-12T03:37:40.429479+0000","last_fullsized":"2024-09-12T03:37:40.429479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.689588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.404471+0000","last_change":"2024-09-12T03:37:39.441255+0000","last_active":"2024-09-12T03:37:42.404471+0000","last_peered":"2024-09-12T03:37:42.404471+0000","last_clean":"2024-09-12T03:37:42.404471+0000","last_became_active":"2024-09-12T03:37:39.440569+0000","last_became_peered":"2024-09-12T03:37:39.440569+0000","last_unstale":"2024-09-12T03:37:42.404471+0000","last_undegraded":"2024-09-12T03:37:42.404471+0000","last_fullsized":"2024-09-12T03:37:42.404471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.959634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.429584+0000","last_change":"2024-09-12T03:37:40.421941+0000","last_active":"2024-09-12T03:37:40.429584+0000","last_peered":"2024-09-12T03:37:40.429584+0000","last_clean":"2024-09-12T03:37:40.429584+0000","last_became_active":"2024-09-12T03:37:40.421609+0000","last_became_peered":"2024-09-12T03:37:40.421609+0000","last_unstale":"2024-09-12T03:37:40.429584+0000","last_undegraded":"2024-09-12T03:37:40.429584+0000","last_fullsized":"2024-09-12T03:37:40.429584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:19.675530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405555+0000","last_change":"2024-09-12T03:37:39.433859+0000","last_active":"2024-09-12T03:37:41.405555+0000","last_peered":"2024-09-12T03:37:41.405555+0000","last_clean":"2024-09-12T03:37:41.405555+0000","last_became_active":"2024-09-12T03:37:39.431773+0000","last_became_peered":"2024-09-12T03:37:39.431773+0000","last_unstale":"2024-09-12T03:37:41.405555+0000","last_undegraded":"2024-09-12T03:37:41.405555+0000","last_fullsized":"2024-09-12T03:37:41.405555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:03.608970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088354+0000","last_change":"2024-09-12T03:37:40.422434+0000","last_active":"2024-09-12T03:37:42.088354+0000","last_peered":"2024-09-12T03:37:42.088354+0000","last_clean":"2024-09-12T03:37:42.088354+0000","last_became_active":"2024-09-12T03:37:40.422054+0000","last_became_peered":"2024-09-12T03:37:40.422054+0000","last_unstale":"2024-09-12T03:37:42.088354+0000","last_undegraded":"2024-09-12T03:37:42.088354+0000","last_fullsized":"2024-09-12T03:37:42.088354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:04.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.412612+0000","last_change":"2024-09-12T03:37:39.427202+0000","last_active":"2024-09-12T03:37:40.412612+0000","last_peered":"2024-09-12T03:37:40.412612+0000","last_clean":"2024-09-12T03:37:40.412612+0000","last_became_active":"2024-09-12T03:37:39.425841+0000","last_became_peered":"2024-09-12T03:37:39.425841+0000","last_unstale":"2024-09-12T03:37:40.412612+0000","last_undegraded":"2024-09-12T03:37:40.412612+0000","last_fullsized":"2024-09-12T03:37:40.412612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:21.625912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401051+0000","last_change":"2024-09-12T03:37:40.425926+0000","last_active":"2024-09-12T03:37:41.401051+0000","last_peered":"2024-09-12T03:37:41.401051+0000","last_clean":"2024-09-12T03:37:41.401051+0000","last_became_active":"2024-09-12T03:37:40.425544+0000","last_became_peered":"2024-09-12T03:37:40.425544+0000","last_unstale":"2024-09-12T03:37:41.401051+0000","last_undegraded":"2024-09-12T03:37:41.401051+0000","last_fullsized":"2024-09-12T03:37:41.401051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:52.195835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.400378+0000","last_change":"2024-09-12T03:37:39.430328+0000","last_active":"2024-09-12T03:37:40.400378+0000","last_peered":"2024-09-12T03:37:40.400378+0000","last_clean":"2024-09-12T03:37:40.400378+0000","last_became_active":"2024-09-12T03:37:39.430047+0000","last_became_peered":"2024-09-12T03:37:39.430047+0000","last_unstale":"2024-09-12T03:37:40.400378+0000","last_undegraded":"2024-09-12T03:37:40.400378+0000","last_fullsized":"2024-09-12T03:37:40.400378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.008253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727599+0000","last_change":"2024-09-12T03:37:40.420995+0000","last_active":"2024-09-12T03:37:41.727599+0000","last_peered":"2024-09-12T03:37:41.727599+0000","last_clean":"2024-09-12T03:37:41.727599+0000","last_became_active":"2024-09-12T03:37:40.420539+0000","last_became_peered":"2024-09-12T03:37:40.420539+0000","last_unstale":"2024-09-12T03:37:41.727599+0000","last_undegraded":"2024-09-12T03:37:41.727599+0000","last_fullsized":"2024-09-12T03:37:41.727599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087846+0000","last_change":"2024-09-12T03:37:39.431751+0000","last_active":"2024-09-12T03:37:42.087846+0000","last_peered":"2024-09-12T03:37:42.087846+0000","last_clean":"2024-09-12T03:37:42.087846+0000","last_became_active":"2024-09-12T03:37:39.431181+0000","last_became_peered":"2024-09-12T03:37:39.431181+0000","last_unstale":"2024-09-12T03:37:42.087846+0000","last_undegraded":"2024-09-12T03:37:42.087846+0000","last_fullsized":"2024-09-12T03:37:42.087846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:33.562638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.436339+0000","last_change":"2024-09-12T03:37:40.432493+0000","last_active":"2024-09-12T03:37:40.436339+0000","last_peered":"2024-09-12T03:37:40.436339+0000","last_clean":"2024-09-12T03:37:40.436339+0000","last_became_active":"2024-09-12T03:37:40.431967+0000","last_became_peered":"2024-09-12T03:37:40.431967+0000","last_unstale":"2024-09-12T03:37:40.436339+0000","last_undegraded":"2024-09-12T03:37:40.436339+0000","last_fullsized":"2024-09-12T03:37:40.436339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:30.156578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.408238+0000","last_change":"2024-09-12T03:37:39.426991+0000","last_active":"2024-09-12T03:37:40.408238+0000","last_peered":"2024-09-12T03:37:40.408238+0000","last_clean":"2024-09-12T03:37:40.408238+0000","last_became_active":"2024-09-12T03:37:39.425872+0000","last_became_peered":"2024-09-12T03:37:39.425872+0000","last_unstale":"2024-09-12T03:37:40.408238+0000","last_undegraded":"2024-09-12T03:37:40.408238+0000","last_fullsized":"2024-09-12T03:37:40.408238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:30.367921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-12T03:37:40.424633+0000","last_change":"2024-09-12T03:37:40.417611+0000","last_active":"2024-09-12T03:37:40.424633+0000","last_peered":"2024-09-12T03:37:40.424633+0000","last_clean":"2024-09-12T03:37:40.424633+0000","last_became_active":"2024-09-12T03:37:40.417268+0000","last_became_peered":"2024-09-12T03:37:40.417268+0000","last_unstale":"2024-09-12T03:37:40.424633+0000","last_undegraded":"2024-09-12T03:37:40.424633+0000","last_fullsized":"2024-09-12T03:37:40.424633+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.432284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503453+0000","last_change":"2024-09-12T03:37:39.419403+0000","last_active":"2024-09-12T03:37:41.503453+0000","last_peered":"2024-09-12T03:37:41.503453+0000","last_clean":"2024-09-12T03:37:41.503453+0000","last_became_active":"2024-09-12T03:37:39.418693+0000","last_became_peered":"2024-09-12T03:37:39.418693+0000","last_unstale":"2024-09-12T03:37:41.503453+0000","last_undegraded":"2024-09-12T03:37:41.503453+0000","last_fullsized":"2024-09-12T03:37:41.503453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:24.228789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504042+0000","last_change":"2024-09-12T03:37:40.426508+0000","last_active":"2024-09-12T03:37:41.504042+0000","last_peered":"2024-09-12T03:37:41.504042+0000","last_clean":"2024-09-12T03:37:41.504042+0000","last_became_active":"2024-09-12T03:37:40.426285+0000","last_became_peered":"2024-09-12T03:37:40.426285+0000","last_unstale":"2024-09-12T03:37:41.504042+0000","last_undegraded":"2024-09-12T03:37:41.504042+0000","last_fullsized":"2024-09-12T03:37:41.504042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.440780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.090079+0000","last_change":"2024-09-12T03:37:39.432928+0000","last_active":"2024-09-12T03:37:42.090079+0000","last_peered":"2024-09-12T03:37:42.090079+0000","last_clean":"2024-09-12T03:37:42.090079+0000","last_became_active":"2024-09-12T03:37:39.432570+0000","last_became_peered":"2024-09-12T03:37:39.432570+0000","last_unstale":"2024-09-12T03:37:42.090079+0000","last_undegraded":"2024-09-12T03:37:42.090079+0000","last_fullsized":"2024-09-12T03:37:42.090079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:07.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":285,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503603+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:41.503603+0000","last_peered":"2024-09-12T03:37:41.503603+0000","last_clean":"2024-09-12T03:37:41.503603+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:41.503603+0000","last_undegraded":"2024-09-12T03:37:41.503603+0000","last_fullsized":"2024-09-12T03:37:41.503603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1654784,"data_stored":1071204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":474088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":480940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509484,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":480780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":480780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509482,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1044480,"data_stored":474158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":476304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":1057289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:47.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:37:48.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3988b04640 1 Processor -- start 2024-09-12T03:37:48.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3988b04640 1 -- start start 2024-09-12T03:37:48.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3988b04640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39841520a0 0x7f398406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3988b04640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398415f3a0 0x7f39840adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3988b04640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3984070250 con 0x7f398406fe50 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3988b04640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3984152480 con 0x7f39841520a0 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3988b04640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f39840aede0 con 0x7f398415f3a0 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39841520a0 0x7f398406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39841520a0 0x7f398406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39748/0 (socket says 172.21.15.73:39748) 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 -- 172.21.15.73:0/3427859167 learned_addr learned my addr 172.21.15.73:0/3427859167 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 -- 172.21.15.73:0/3427859167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398415f3a0 msgr2=0x7f39840adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f3982d9d640 1 --2- 172.21.15.73:0/3427859167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398415f3a0 0x7f39840adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 --2- 172.21.15.73:0/3427859167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398415f3a0 0x7f39840adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 -- 172.21.15.73:0/3427859167 >> v1:172.21.15.150:6789/0 conn(0x7f398406fe50 legacy=0x7f398415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 -- 172.21.15.73:0/3427859167 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398415fa10 con 0x7f39841520a0 2024-09-12T03:37:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398259c640 1 --2- 172.21.15.73:0/3427859167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398406f910 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f397c009e50 tx=0x7f397c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97e5396a34ce80d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.029+0000 7f398159a640 1 -- 172.21.15.73:0/3427859167 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0a5760 con 0x7f39841520a0 2024-09-12T03:37:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f398159a640 1 -- 172.21.15.73:0/3427859167 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f397c0a5900 con 0x7f39841520a0 2024-09-12T03:37:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f398159a640 1 -- 172.21.15.73:0/3427859167 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0a5cd0 con 0x7f39841520a0 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- 172.21.15.73:0/3427859167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 msgr2=0x7f398406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 --2- 172.21.15.73:0/3427859167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398406f910 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f397c009e50 tx=0x7f397c01c9f0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- 172.21.15.73:0/3427859167 shutdown_connections 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 --2- 172.21.15.73:0/3427859167 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398415f3a0 0x7f39840adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 --2- 172.21.15.73:0/3427859167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398406f910 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- 172.21.15.73:0/3427859167 >> 172.21.15.73:0/3427859167 conn(0x7f39840b1f90 msgr2=0x7f39840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- 172.21.15.73:0/3427859167 shutdown_connections 2024-09-12T03:37:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- 172.21.15.73:0/3427859167 wait complete. 2024-09-12T03:37:48.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 Processor -- start 2024-09-12T03:37:48.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- start start 2024-09-12T03:37:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398406fe50 0x7f3984145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f398415f3a0 0x7f398414d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3984073d30 con 0x7f39841520a0 2024-09-12T03:37:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3984073a50 con 0x7f398415f3a0 2024-09-12T03:37:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3984167f10 con 0x7f398406fe50 2024-09-12T03:37:48.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398414d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39750/0 (socket says 172.21.15.73:39750) 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 -- 172.21.15.73:0/3788547678 learned_addr learned my addr 172.21.15.73:0/3788547678 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f398259c640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398406fe50 0x7f3984145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3982d9d640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f398415f3a0 0x7f398414d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 -- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398406fe50 msgr2=0x7f3984145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398406fe50 0x7f3984145b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 -- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f398415f3a0 msgr2=0x7f398414d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f398415f3a0 0x7f398414d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 -- 172.21.15.73:0/3788547678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398414f500 con 0x7f39841520a0 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3982d9d640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f398415f3a0 0x7f398414d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3981d9b640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398414d210 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f397800b440 tx=0x7f397800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3972ffd640 1 -- 172.21.15.73:0/3788547678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978015020 con 0x7f39841520a0 2024-09-12T03:37:48.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3972ffd640 1 -- 172.21.15.73:0/3788547678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3978011890 con 0x7f39841520a0 2024-09-12T03:37:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398414ad70 con 0x7f39841520a0 2024-09-12T03:37:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3972ffd640 1 -- 172.21.15.73:0/3788547678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978011c80 con 0x7f39841520a0 2024-09-12T03:37:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.033+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398414ed00 con 0x7f39841520a0 2024-09-12T03:37:48.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.037+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398415ac50 con 0x7f39841520a0 2024-09-12T03:37:48.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.037+0000 7f3972ffd640 1 -- 172.21.15.73:0/3788547678 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3978018020 con 0x7f39841520a0 2024-09-12T03:37:48.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.037+0000 7f3972ffd640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f39640678f0 0x7f3964069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.037+0000 7f3972ffd640 1 -- 172.21.15.73:0/3788547678 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f3978085c10 con 0x7f39841520a0 2024-09-12T03:37:48.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.037+0000 7f398259c640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f39640678f0 0x7f3964069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.037+0000 7f398259c640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f39640678f0 0x7f3964069db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f397c0ae000 tx=0x7f397c0a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.041+0000 7f3972ffd640 1 -- 172.21.15.73:0/3788547678 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f397801f030 con 0x7f39841520a0 2024-09-12T03:37:48.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.201+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39841508c0 con 0x7f39640678f0 2024-09-12T03:37:48.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.221+0000 7f3972ffd640 1 -- 172.21.15.73:0/3788547678 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252037 (secure 0 0 0) 0x7f39841508c0 con 0x7f39640678f0 2024-09-12T03:37:48.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:48.226 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:37:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f39640678f0 msgr2=0x7f3964069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f39640678f0 0x7f3964069db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f397c0ae000 tx=0x7f397c0a7070 comp rx=0 tx=0).stop 2024-09-12T03:37:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 msgr2=0x7f398414d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398414d210 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f397800b440 tx=0x7f397800b900 comp rx=0 tx=0).stop 2024-09-12T03:37:48.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 shutdown_connections 2024-09-12T03:37:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f39640678f0 0x7f3964069db0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39841520a0 0x7f398414d210 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f398415f3a0 0x7f398414d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 --2- 172.21.15.73:0/3788547678 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f398406fe50 0x7f3984145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 >> 172.21.15.73:0/3788547678 conn(0x7f39840b1f90 msgr2=0x7f39840b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 shutdown_connections 2024-09-12T03:37:48.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.225+0000 7f3988b04640 1 -- 172.21.15.73:0/3788547678 wait complete. 2024-09-12T03:37:48.243 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-12T03:37:47.845323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254800,"kb_used_data":9436,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719920,"statfs":{"total":773094113280,"available":772833198080,"internally_reserved":0,"allocated":9662464,"data_stored":5025104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":251055667},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002277"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728420+0000","last_change":"2024-09-12T03:37:40.418524+0000","last_active":"2024-09-12T03:37:41.728420+0000","last_peered":"2024-09-12T03:37:41.728420+0000","last_clean":"2024-09-12T03:37:41.728420+0000","last_became_active":"2024-09-12T03:37:40.417456+0000","last_became_peered":"2024-09-12T03:37:40.417456+0000","last_unstale":"2024-09-12T03:37:41.728420+0000","last_undegraded":"2024-09-12T03:37:41.728420+0000","last_fullsized":"2024-09-12T03:37:41.728420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:51.640882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088190+0000","last_change":"2024-09-12T03:37:40.417871+0000","last_active":"2024-09-12T03:37:42.088190+0000","last_peered":"2024-09-12T03:37:42.088190+0000","last_clean":"2024-09-12T03:37:42.088190+0000","last_became_active":"2024-09-12T03:37:40.417195+0000","last_became_peered":"2024-09-12T03:37:40.417195+0000","last_unstale":"2024-09-12T03:37:42.088190+0000","last_undegraded":"2024-09-12T03:37:42.088190+0000","last_fullsized":"2024-09-12T03:37:42.088190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727920+0000","last_change":"2024-09-12T03:37:40.425683+0000","last_active":"2024-09-12T03:37:41.727920+0000","last_peered":"2024-09-12T03:37:41.727920+0000","last_clean":"2024-09-12T03:37:41.727920+0000","last_became_active":"2024-09-12T03:37:40.425250+0000","last_became_peered":"2024-09-12T03:37:40.425250+0000","last_unstale":"2024-09-12T03:37:41.727920+0000","last_undegraded":"2024-09-12T03:37:41.727920+0000","last_fullsized":"2024-09-12T03:37:41.727920+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:04.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089667+0000","last_change":"2024-09-12T03:37:40.438674+0000","last_active":"2024-09-12T03:37:42.089667+0000","last_peered":"2024-09-12T03:37:42.089667+0000","last_clean":"2024-09-12T03:37:42.089667+0000","last_became_active":"2024-09-12T03:37:40.438182+0000","last_became_peered":"2024-09-12T03:37:40.438182+0000","last_unstale":"2024-09-12T03:37:42.089667+0000","last_undegraded":"2024-09-12T03:37:42.089667+0000","last_fullsized":"2024-09-12T03:37:42.089667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:06.158323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402829+0000","last_change":"2024-09-12T03:37:40.434204+0000","last_active":"2024-09-12T03:37:41.402829+0000","last_peered":"2024-09-12T03:37:41.402829+0000","last_clean":"2024-09-12T03:37:41.402829+0000","last_became_active":"2024-09-12T03:37:40.433795+0000","last_became_peered":"2024-09-12T03:37:40.433795+0000","last_unstale":"2024-09-12T03:37:41.402829+0000","last_undegraded":"2024-09-12T03:37:41.402829+0000","last_fullsized":"2024-09-12T03:37:41.402829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:53.990681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087630+0000","last_change":"2024-09-12T03:37:40.429021+0000","last_active":"2024-09-12T03:37:42.087630+0000","last_peered":"2024-09-12T03:37:42.087630+0000","last_clean":"2024-09-12T03:37:42.087630+0000","last_became_active":"2024-09-12T03:37:40.428595+0000","last_became_peered":"2024-09-12T03:37:40.428595+0000","last_unstale":"2024-09-12T03:37:42.087630+0000","last_undegraded":"2024-09-12T03:37:42.087630+0000","last_fullsized":"2024-09-12T03:37:42.087630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:57.275288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503627+0000","last_change":"2024-09-12T03:37:40.419795+0000","last_active":"2024-09-12T03:37:41.503627+0000","last_peered":"2024-09-12T03:37:41.503627+0000","last_clean":"2024-09-12T03:37:41.503627+0000","last_became_active":"2024-09-12T03:37:40.418899+0000","last_became_peered":"2024-09-12T03:37:40.418899+0000","last_unstale":"2024-09-12T03:37:41.503627+0000","last_undegraded":"2024-09-12T03:37:41.503627+0000","last_fullsized":"2024-09-12T03:37:41.503627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:56.112723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087683+0000","last_change":"2024-09-12T03:37:40.431454+0000","last_active":"2024-09-12T03:37:42.087683+0000","last_peered":"2024-09-12T03:37:42.087683+0000","last_clean":"2024-09-12T03:37:42.087683+0000","last_became_active":"2024-09-12T03:37:40.431024+0000","last_became_peered":"2024-09-12T03:37:40.431024+0000","last_unstale":"2024-09-12T03:37:42.087683+0000","last_undegraded":"2024-09-12T03:37:42.087683+0000","last_fullsized":"2024-09-12T03:37:42.087683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.112387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405943+0000","last_change":"2024-09-12T03:37:40.426674+0000","last_active":"2024-09-12T03:37:41.405943+0000","last_peered":"2024-09-12T03:37:41.405943+0000","last_clean":"2024-09-12T03:37:41.405943+0000","last_became_active":"2024-09-12T03:37:40.425626+0000","last_became_peered":"2024-09-12T03:37:40.425626+0000","last_unstale":"2024-09-12T03:37:41.405943+0000","last_undegraded":"2024-09-12T03:37:41.405943+0000","last_fullsized":"2024-09-12T03:37:41.405943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:42.768726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401731+0000","last_change":"2024-09-12T03:37:40.427701+0000","last_active":"2024-09-12T03:37:41.401731+0000","last_peered":"2024-09-12T03:37:41.401731+0000","last_clean":"2024-09-12T03:37:41.401731+0000","last_became_active":"2024-09-12T03:37:40.427374+0000","last_became_peered":"2024-09-12T03:37:40.427374+0000","last_unstale":"2024-09-12T03:37:41.401731+0000","last_undegraded":"2024-09-12T03:37:41.401731+0000","last_fullsized":"2024-09-12T03:37:41.401731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:51.375752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404435+0000","last_change":"2024-09-12T03:37:40.429489+0000","last_active":"2024-09-12T03:37:41.404435+0000","last_peered":"2024-09-12T03:37:41.404435+0000","last_clean":"2024-09-12T03:37:41.404435+0000","last_became_active":"2024-09-12T03:37:40.429236+0000","last_became_peered":"2024-09-12T03:37:40.429236+0000","last_unstale":"2024-09-12T03:37:41.404435+0000","last_undegraded":"2024-09-12T03:37:41.404435+0000","last_fullsized":"2024-09-12T03:37:41.404435+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:55.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401563+0000","last_change":"2024-09-12T03:37:40.425714+0000","last_active":"2024-09-12T03:37:41.401563+0000","last_peered":"2024-09-12T03:37:41.401563+0000","last_clean":"2024-09-12T03:37:41.401563+0000","last_became_active":"2024-09-12T03:37:40.425333+0000","last_became_peered":"2024-09-12T03:37:40.425333+0000","last_unstale":"2024-09-12T03:37:41.401563+0000","last_undegraded":"2024-09-12T03:37:41.401563+0000","last_fullsized":"2024-09-12T03:37:41.401563+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:49.544031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087790+0000","last_change":"2024-09-12T03:37:40.426993+0000","last_active":"2024-09-12T03:37:42.087790+0000","last_peered":"2024-09-12T03:37:42.087790+0000","last_clean":"2024-09-12T03:37:42.087790+0000","last_became_active":"2024-09-12T03:37:40.426625+0000","last_became_peered":"2024-09-12T03:37:40.426625+0000","last_unstale":"2024-09-12T03:37:42.087790+0000","last_undegraded":"2024-09-12T03:37:42.087790+0000","last_fullsized":"2024-09-12T03:37:42.087790+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:40.479744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402081+0000","last_change":"2024-09-12T03:37:40.428079+0000","last_active":"2024-09-12T03:37:41.402081+0000","last_peered":"2024-09-12T03:37:41.402081+0000","last_clean":"2024-09-12T03:37:41.402081+0000","last_became_active":"2024-09-12T03:37:40.427411+0000","last_became_peered":"2024-09-12T03:37:40.427411+0000","last_unstale":"2024-09-12T03:37:41.402081+0000","last_undegraded":"2024-09-12T03:37:41.402081+0000","last_fullsized":"2024-09-12T03:37:41.402081+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:48.886084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088376+0000","last_change":"2024-09-12T03:37:40.433673+0000","last_active":"2024-09-12T03:37:42.088376+0000","last_peered":"2024-09-12T03:37:42.088376+0000","last_clean":"2024-09-12T03:37:42.088376+0000","last_became_active":"2024-09-12T03:37:40.431573+0000","last_became_peered":"2024-09-12T03:37:40.431573+0000","last_unstale":"2024-09-12T03:37:42.088376+0000","last_undegraded":"2024-09-12T03:37:42.088376+0000","last_fullsized":"2024-09-12T03:37:42.088376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:55.583203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087603+0000","last_change":"2024-09-12T03:37:40.418759+0000","last_active":"2024-09-12T03:37:42.087603+0000","last_peered":"2024-09-12T03:37:42.087603+0000","last_clean":"2024-09-12T03:37:42.087603+0000","last_became_active":"2024-09-12T03:37:40.418302+0000","last_became_peered":"2024-09-12T03:37:40.418302+0000","last_unstale":"2024-09-12T03:37:42.087603+0000","last_undegraded":"2024-09-12T03:37:42.087603+0000","last_fullsized":"2024-09-12T03:37:42.087603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:56.312828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089194+0000","last_change":"2024-09-12T03:37:40.419713+0000","last_active":"2024-09-12T03:37:42.089194+0000","last_peered":"2024-09-12T03:37:42.089194+0000","last_clean":"2024-09-12T03:37:42.089194+0000","last_became_active":"2024-09-12T03:37:40.419377+0000","last_became_peered":"2024-09-12T03:37:40.419377+0000","last_unstale":"2024-09-12T03:37:42.089194+0000","last_undegraded":"2024-09-12T03:37:42.089194+0000","last_fullsized":"2024-09-12T03:37:42.089194+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:50.574911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728187+0000","last_change":"2024-09-12T03:37:40.415748+0000","last_active":"2024-09-12T03:37:41.728187+0000","last_peered":"2024-09-12T03:37:41.728187+0000","last_clean":"2024-09-12T03:37:41.728187+0000","last_became_active":"2024-09-12T03:37:40.414805+0000","last_became_peered":"2024-09-12T03:37:40.414805+0000","last_unstale":"2024-09-12T03:37:41.728187+0000","last_undegraded":"2024-09-12T03:37:41.728187+0000","last_fullsized":"2024-09-12T03:37:41.728187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.245207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404811+0000","last_change":"2024-09-12T03:37:40.425946+0000","last_active":"2024-09-12T03:37:41.404811+0000","last_peered":"2024-09-12T03:37:41.404811+0000","last_clean":"2024-09-12T03:37:41.404811+0000","last_became_active":"2024-09-12T03:37:40.425618+0000","last_became_peered":"2024-09-12T03:37:40.425618+0000","last_unstale":"2024-09-12T03:37:41.404811+0000","last_undegraded":"2024-09-12T03:37:41.404811+0000","last_fullsized":"2024-09-12T03:37:41.404811+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:16.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089892+0000","last_change":"2024-09-12T03:37:40.433908+0000","last_active":"2024-09-12T03:37:42.089892+0000","last_peered":"2024-09-12T03:37:42.089892+0000","last_clean":"2024-09-12T03:37:42.089892+0000","last_became_active":"2024-09-12T03:37:40.431730+0000","last_became_peered":"2024-09-12T03:37:40.431730+0000","last_unstale":"2024-09-12T03:37:42.089892+0000","last_undegraded":"2024-09-12T03:37:42.089892+0000","last_fullsized":"2024-09-12T03:37:42.089892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:11.193587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402443+0000","last_change":"2024-09-12T03:37:40.421449+0000","last_active":"2024-09-12T03:37:41.402443+0000","last_peered":"2024-09-12T03:37:41.402443+0000","last_clean":"2024-09-12T03:37:41.402443+0000","last_became_active":"2024-09-12T03:37:40.420532+0000","last_became_peered":"2024-09-12T03:37:40.420532+0000","last_unstale":"2024-09-12T03:37:41.402443+0000","last_undegraded":"2024-09-12T03:37:41.402443+0000","last_fullsized":"2024-09-12T03:37:41.402443+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:19.117928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402447+0000","last_change":"2024-09-12T03:37:40.428303+0000","last_active":"2024-09-12T03:37:41.402447+0000","last_peered":"2024-09-12T03:37:41.402447+0000","last_clean":"2024-09-12T03:37:41.402447+0000","last_became_active":"2024-09-12T03:37:40.427809+0000","last_became_peered":"2024-09-12T03:37:40.427809+0000","last_unstale":"2024-09-12T03:37:41.402447+0000","last_undegraded":"2024-09-12T03:37:41.402447+0000","last_fullsized":"2024-09-12T03:37:41.402447+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:37:53.359857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402788+0000","last_change":"2024-09-12T03:37:40.425754+0000","last_active":"2024-09-12T03:37:41.402788+0000","last_peered":"2024-09-12T03:37:41.402788+0000","last_clean":"2024-09-12T03:37:41.402788+0000","last_became_active":"2024-09-12T03:37:40.425148+0000","last_became_peered":"2024-09-12T03:37:40.425148+0000","last_unstale":"2024-09-12T03:37:41.402788+0000","last_undegraded":"2024-09-12T03:37:41.402788+0000","last_fullsized":"2024-09-12T03:37:41.402788+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:49.520348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727334+0000","last_change":"2024-09-12T03:37:40.422739+0000","last_active":"2024-09-12T03:37:41.727334+0000","last_peered":"2024-09-12T03:37:41.727334+0000","last_clean":"2024-09-12T03:37:41.727334+0000","last_became_active":"2024-09-12T03:37:40.422394+0000","last_became_peered":"2024-09-12T03:37:40.422394+0000","last_unstale":"2024-09-12T03:37:41.727334+0000","last_undegraded":"2024-09-12T03:37:41.727334+0000","last_fullsized":"2024-09-12T03:37:41.727334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:49.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088452+0000","last_change":"2024-09-12T03:37:40.428871+0000","last_active":"2024-09-12T03:37:42.088452+0000","last_peered":"2024-09-12T03:37:42.088452+0000","last_clean":"2024-09-12T03:37:42.088452+0000","last_became_active":"2024-09-12T03:37:40.426961+0000","last_became_peered":"2024-09-12T03:37:40.426961+0000","last_unstale":"2024-09-12T03:37:42.088452+0000","last_undegraded":"2024-09-12T03:37:42.088452+0000","last_fullsized":"2024-09-12T03:37:42.088452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:22.245207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404013+0000","last_change":"2024-09-12T03:37:40.432570+0000","last_active":"2024-09-12T03:37:41.404013+0000","last_peered":"2024-09-12T03:37:41.404013+0000","last_clean":"2024-09-12T03:37:41.404013+0000","last_became_active":"2024-09-12T03:37:40.432262+0000","last_became_peered":"2024-09-12T03:37:40.432262+0000","last_unstale":"2024-09-12T03:37:41.404013+0000","last_undegraded":"2024-09-12T03:37:41.404013+0000","last_fullsized":"2024-09-12T03:37:41.404013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:31.112387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401720+0000","last_change":"2024-09-12T03:37:40.433918+0000","last_active":"2024-09-12T03:37:41.401720+0000","last_peered":"2024-09-12T03:37:41.401720+0000","last_clean":"2024-09-12T03:37:41.401720+0000","last_became_active":"2024-09-12T03:37:40.433594+0000","last_became_peered":"2024-09-12T03:37:40.433594+0000","last_unstale":"2024-09-12T03:37:41.401720+0000","last_undegraded":"2024-09-12T03:37:41.401720+0000","last_fullsized":"2024-09-12T03:37:41.401720+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.599479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.090075+0000","last_change":"2024-09-12T03:37:40.439228+0000","last_active":"2024-09-12T03:37:42.090075+0000","last_peered":"2024-09-12T03:37:42.090075+0000","last_clean":"2024-09-12T03:37:42.090075+0000","last_became_active":"2024-09-12T03:37:40.438878+0000","last_became_peered":"2024-09-12T03:37:40.438878+0000","last_unstale":"2024-09-12T03:37:42.090075+0000","last_undegraded":"2024-09-12T03:37:42.090075+0000","last_fullsized":"2024-09-12T03:37:42.090075+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:31.398726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503852+0000","last_change":"2024-09-12T03:37:40.423565+0000","last_active":"2024-09-12T03:37:41.503852+0000","last_peered":"2024-09-12T03:37:41.503852+0000","last_clean":"2024-09-12T03:37:41.503852+0000","last_became_active":"2024-09-12T03:37:40.423275+0000","last_became_peered":"2024-09-12T03:37:40.423275+0000","last_unstale":"2024-09-12T03:37:41.503852+0000","last_undegraded":"2024-09-12T03:37:41.503852+0000","last_fullsized":"2024-09-12T03:37:41.503852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:15.892839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402833+0000","last_change":"2024-09-12T03:37:40.421609+0000","last_active":"2024-09-12T03:37:41.402833+0000","last_peered":"2024-09-12T03:37:41.402833+0000","last_clean":"2024-09-12T03:37:41.402833+0000","last_became_active":"2024-09-12T03:37:40.421247+0000","last_became_peered":"2024-09-12T03:37:40.421247+0000","last_unstale":"2024-09-12T03:37:41.402833+0000","last_undegraded":"2024-09-12T03:37:41.402833+0000","last_fullsized":"2024-09-12T03:37:41.402833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:34.571896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087706+0000","last_change":"2024-09-12T03:37:40.427689+0000","last_active":"2024-09-12T03:37:42.087706+0000","last_peered":"2024-09-12T03:37:42.087706+0000","last_clean":"2024-09-12T03:37:42.087706+0000","last_became_active":"2024-09-12T03:37:40.427389+0000","last_became_peered":"2024-09-12T03:37:40.427389+0000","last_unstale":"2024-09-12T03:37:42.087706+0000","last_undegraded":"2024-09-12T03:37:42.087706+0000","last_fullsized":"2024-09-12T03:37:42.087706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:31.398726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088597+0000","last_change":"2024-09-12T03:37:40.424603+0000","last_active":"2024-09-12T03:37:42.088597+0000","last_peered":"2024-09-12T03:37:42.088597+0000","last_clean":"2024-09-12T03:37:42.088597+0000","last_became_active":"2024-09-12T03:37:40.424281+0000","last_became_peered":"2024-09-12T03:37:40.424281+0000","last_unstale":"2024-09-12T03:37:42.088597+0000","last_undegraded":"2024-09-12T03:37:42.088597+0000","last_fullsized":"2024-09-12T03:37:42.088597+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:48.405618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088518+0000","last_change":"2024-09-12T03:37:40.425608+0000","last_active":"2024-09-12T03:37:42.088518+0000","last_peered":"2024-09-12T03:37:42.088518+0000","last_clean":"2024-09-12T03:37:42.088518+0000","last_became_active":"2024-09-12T03:37:40.424515+0000","last_became_peered":"2024-09-12T03:37:40.424515+0000","last_unstale":"2024-09-12T03:37:42.088518+0000","last_undegraded":"2024-09-12T03:37:42.088518+0000","last_fullsized":"2024-09-12T03:37:42.088518+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:25:32.792689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"85'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404163+0000","last_change":"2024-09-12T03:37:39.416198+0000","last_active":"2024-09-12T03:37:41.404163+0000","last_peered":"2024-09-12T03:37:41.404163+0000","last_clean":"2024-09-12T03:37:41.404163+0000","last_became_active":"2024-09-12T03:37:39.415495+0000","last_became_peered":"2024-09-12T03:37:39.415495+0000","last_unstale":"2024-09-12T03:37:41.404163+0000","last_undegraded":"2024-09-12T03:37:41.404163+0000","last_fullsized":"2024-09-12T03:37:41.404163+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:34.724760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089575+0000","last_change":"2024-09-12T03:37:40.424326+0000","last_active":"2024-09-12T03:37:42.089575+0000","last_peered":"2024-09-12T03:37:42.089575+0000","last_clean":"2024-09-12T03:37:42.089575+0000","last_became_active":"2024-09-12T03:37:40.424042+0000","last_became_peered":"2024-09-12T03:37:40.424042+0000","last_unstale":"2024-09-12T03:37:42.089575+0000","last_undegraded":"2024-09-12T03:37:42.089575+0000","last_fullsized":"2024-09-12T03:37:42.089575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:07.621174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405703+0000","last_change":"2024-09-12T03:37:39.439560+0000","last_active":"2024-09-12T03:37:41.405703+0000","last_peered":"2024-09-12T03:37:41.405703+0000","last_clean":"2024-09-12T03:37:41.405703+0000","last_became_active":"2024-09-12T03:37:39.438961+0000","last_became_peered":"2024-09-12T03:37:39.438961+0000","last_unstale":"2024-09-12T03:37:41.405703+0000","last_undegraded":"2024-09-12T03:37:41.405703+0000","last_fullsized":"2024-09-12T03:37:41.405703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:05.889743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504148+0000","last_change":"2024-09-12T03:37:40.431632+0000","last_active":"2024-09-12T03:37:41.504148+0000","last_peered":"2024-09-12T03:37:41.504148+0000","last_clean":"2024-09-12T03:37:41.504148+0000","last_became_active":"2024-09-12T03:37:40.431205+0000","last_became_peered":"2024-09-12T03:37:40.431205+0000","last_unstale":"2024-09-12T03:37:41.504148+0000","last_undegraded":"2024-09-12T03:37:41.504148+0000","last_fullsized":"2024-09-12T03:37:41.504148+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:29.186242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503990+0000","last_change":"2024-09-12T03:37:39.418039+0000","last_active":"2024-09-12T03:37:41.503990+0000","last_peered":"2024-09-12T03:37:41.503990+0000","last_clean":"2024-09-12T03:37:41.503990+0000","last_became_active":"2024-09-12T03:37:39.417238+0000","last_became_peered":"2024-09-12T03:37:39.417238+0000","last_unstale":"2024-09-12T03:37:41.503990+0000","last_undegraded":"2024-09-12T03:37:41.503990+0000","last_fullsized":"2024-09-12T03:37:41.503990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:48.775397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089376+0000","last_change":"2024-09-12T03:37:40.435971+0000","last_active":"2024-09-12T03:37:42.089376+0000","last_peered":"2024-09-12T03:37:42.089376+0000","last_clean":"2024-09-12T03:37:42.089376+0000","last_became_active":"2024-09-12T03:37:40.435660+0000","last_became_peered":"2024-09-12T03:37:40.435660+0000","last_unstale":"2024-09-12T03:37:42.089376+0000","last_undegraded":"2024-09-12T03:37:42.089376+0000","last_fullsized":"2024-09-12T03:37:42.089376+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:55.067120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403516+0000","last_change":"2024-09-12T03:37:39.413393+0000","last_active":"2024-09-12T03:37:41.403516+0000","last_peered":"2024-09-12T03:37:41.403516+0000","last_clean":"2024-09-12T03:37:41.403516+0000","last_became_active":"2024-09-12T03:37:39.412623+0000","last_became_peered":"2024-09-12T03:37:39.412623+0000","last_unstale":"2024-09-12T03:37:41.403516+0000","last_undegraded":"2024-09-12T03:37:41.403516+0000","last_fullsized":"2024-09-12T03:37:41.403516+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:57.769487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088471+0000","last_change":"2024-09-12T03:37:40.434360+0000","last_active":"2024-09-12T03:37:42.088471+0000","last_peered":"2024-09-12T03:37:42.088471+0000","last_clean":"2024-09-12T03:37:42.088471+0000","last_became_active":"2024-09-12T03:37:40.431775+0000","last_became_peered":"2024-09-12T03:37:40.431775+0000","last_unstale":"2024-09-12T03:37:42.088471+0000","last_undegraded":"2024-09-12T03:37:42.088471+0000","last_fullsized":"2024-09-12T03:37:42.088471+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:16.295705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403244+0000","last_change":"2024-09-12T03:37:39.430992+0000","last_active":"2024-09-12T03:37:41.403244+0000","last_peered":"2024-09-12T03:37:41.403244+0000","last_clean":"2024-09-12T03:37:41.403244+0000","last_became_active":"2024-09-12T03:37:39.429864+0000","last_became_peered":"2024-09-12T03:37:39.429864+0000","last_unstale":"2024-09-12T03:37:41.403244+0000","last_undegraded":"2024-09-12T03:37:41.403244+0000","last_fullsized":"2024-09-12T03:37:41.403244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:19.789792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402397+0000","last_change":"2024-09-12T03:37:40.418137+0000","last_active":"2024-09-12T03:37:41.402397+0000","last_peered":"2024-09-12T03:37:41.402397+0000","last_clean":"2024-09-12T03:37:41.402397+0000","last_became_active":"2024-09-12T03:37:40.416243+0000","last_became_peered":"2024-09-12T03:37:40.416243+0000","last_unstale":"2024-09-12T03:37:41.402397+0000","last_undegraded":"2024-09-12T03:37:41.402397+0000","last_fullsized":"2024-09-12T03:37:41.402397+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:20.513702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088834+0000","last_change":"2024-09-12T03:37:39.409402+0000","last_active":"2024-09-12T03:37:42.088834+0000","last_peered":"2024-09-12T03:37:42.088834+0000","last_clean":"2024-09-12T03:37:42.088834+0000","last_became_active":"2024-09-12T03:37:39.408846+0000","last_became_peered":"2024-09-12T03:37:39.408846+0000","last_unstale":"2024-09-12T03:37:42.088834+0000","last_undegraded":"2024-09-12T03:37:42.088834+0000","last_fullsized":"2024-09-12T03:37:42.088834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:37.186413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087952+0000","last_change":"2024-09-12T03:37:40.437610+0000","last_active":"2024-09-12T03:37:42.087952+0000","last_peered":"2024-09-12T03:37:42.087952+0000","last_clean":"2024-09-12T03:37:42.087952+0000","last_became_active":"2024-09-12T03:37:40.437312+0000","last_became_peered":"2024-09-12T03:37:40.437312+0000","last_unstale":"2024-09-12T03:37:42.087952+0000","last_undegraded":"2024-09-12T03:37:42.087952+0000","last_fullsized":"2024-09-12T03:37:42.087952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:50.343015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727767+0000","last_change":"2024-09-12T03:37:39.421452+0000","last_active":"2024-09-12T03:37:41.727767+0000","last_peered":"2024-09-12T03:37:41.727767+0000","last_clean":"2024-09-12T03:37:41.727767+0000","last_became_active":"2024-09-12T03:37:39.420940+0000","last_became_peered":"2024-09-12T03:37:39.420940+0000","last_unstale":"2024-09-12T03:37:41.727767+0000","last_undegraded":"2024-09-12T03:37:41.727767+0000","last_fullsized":"2024-09-12T03:37:41.727767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:26.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089337+0000","last_change":"2024-09-12T03:37:40.438471+0000","last_active":"2024-09-12T03:37:42.089337+0000","last_peered":"2024-09-12T03:37:42.089337+0000","last_clean":"2024-09-12T03:37:42.089337+0000","last_became_active":"2024-09-12T03:37:40.438101+0000","last_became_peered":"2024-09-12T03:37:40.438101+0000","last_unstale":"2024-09-12T03:37:42.089337+0000","last_undegraded":"2024-09-12T03:37:42.089337+0000","last_fullsized":"2024-09-12T03:37:42.089337+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:42.768726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503958+0000","last_change":"2024-09-12T03:37:39.419265+0000","last_active":"2024-09-12T03:37:41.503958+0000","last_peered":"2024-09-12T03:37:41.503958+0000","last_clean":"2024-09-12T03:37:41.503958+0000","last_became_active":"2024-09-12T03:37:39.417550+0000","last_became_peered":"2024-09-12T03:37:39.417550+0000","last_unstale":"2024-09-12T03:37:41.503958+0000","last_undegraded":"2024-09-12T03:37:41.503958+0000","last_fullsized":"2024-09-12T03:37:41.503958+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:30.389468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404185+0000","last_change":"2024-09-12T03:37:40.421218+0000","last_active":"2024-09-12T03:37:41.404185+0000","last_peered":"2024-09-12T03:37:41.404185+0000","last_clean":"2024-09-12T03:37:41.404185+0000","last_became_active":"2024-09-12T03:37:40.420251+0000","last_became_peered":"2024-09-12T03:37:40.420251+0000","last_unstale":"2024-09-12T03:37:41.404185+0000","last_undegraded":"2024-09-12T03:37:41.404185+0000","last_fullsized":"2024-09-12T03:37:41.404185+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:40.479744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088487+0000","last_change":"2024-09-12T03:37:39.429482+0000","last_active":"2024-09-12T03:37:42.088487+0000","last_peered":"2024-09-12T03:37:42.088487+0000","last_clean":"2024-09-12T03:37:42.088487+0000","last_became_active":"2024-09-12T03:37:39.420950+0000","last_became_peered":"2024-09-12T03:37:39.420950+0000","last_unstale":"2024-09-12T03:37:42.088487+0000","last_undegraded":"2024-09-12T03:37:42.088487+0000","last_fullsized":"2024-09-12T03:37:42.088487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:39.470485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503794+0000","last_change":"2024-09-12T03:37:40.432650+0000","last_active":"2024-09-12T03:37:41.503794+0000","last_peered":"2024-09-12T03:37:41.503794+0000","last_clean":"2024-09-12T03:37:41.503794+0000","last_became_active":"2024-09-12T03:37:40.432391+0000","last_became_peered":"2024-09-12T03:37:40.432391+0000","last_unstale":"2024-09-12T03:37:41.503794+0000","last_undegraded":"2024-09-12T03:37:41.503794+0000","last_fullsized":"2024-09-12T03:37:41.503794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:47.382688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728399+0000","last_change":"2024-09-12T03:37:39.406402+0000","last_active":"2024-09-12T03:37:41.728399+0000","last_peered":"2024-09-12T03:37:41.728399+0000","last_clean":"2024-09-12T03:37:41.728399+0000","last_became_active":"2024-09-12T03:37:39.406108+0000","last_became_peered":"2024-09-12T03:37:39.406108+0000","last_unstale":"2024-09-12T03:37:41.728399+0000","last_undegraded":"2024-09-12T03:37:41.728399+0000","last_fullsized":"2024-09-12T03:37:41.728399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:54.573945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.728342+0000","last_change":"2024-09-12T03:37:40.410282+0000","last_active":"2024-09-12T03:37:41.728342+0000","last_peered":"2024-09-12T03:37:41.728342+0000","last_clean":"2024-09-12T03:37:41.728342+0000","last_became_active":"2024-09-12T03:37:40.409958+0000","last_became_peered":"2024-09-12T03:37:40.409958+0000","last_unstale":"2024-09-12T03:37:41.728342+0000","last_undegraded":"2024-09-12T03:37:41.728342+0000","last_fullsized":"2024-09-12T03:37:41.728342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:01.744440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"85'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405189+0000","last_change":"2024-09-12T03:37:39.438651+0000","last_active":"2024-09-12T03:37:41.405189+0000","last_peered":"2024-09-12T03:37:41.405189+0000","last_clean":"2024-09-12T03:37:41.405189+0000","last_became_active":"2024-09-12T03:37:39.434714+0000","last_became_peered":"2024-09-12T03:37:39.434714+0000","last_unstale":"2024-09-12T03:37:41.405189+0000","last_undegraded":"2024-09-12T03:37:41.405189+0000","last_fullsized":"2024-09-12T03:37:41.405189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:23.830605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089695+0000","last_change":"2024-09-12T03:37:40.427079+0000","last_active":"2024-09-12T03:37:42.089695+0000","last_peered":"2024-09-12T03:37:42.089695+0000","last_clean":"2024-09-12T03:37:42.089695+0000","last_became_active":"2024-09-12T03:37:40.426730+0000","last_became_peered":"2024-09-12T03:37:40.426730+0000","last_unstale":"2024-09-12T03:37:42.089695+0000","last_undegraded":"2024-09-12T03:37:42.089695+0000","last_fullsized":"2024-09-12T03:37:42.089695+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:57.716910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"85'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088769+0000","last_change":"2024-09-12T03:37:39.425400+0000","last_active":"2024-09-12T03:37:42.088769+0000","last_peered":"2024-09-12T03:37:42.088769+0000","last_clean":"2024-09-12T03:37:42.088769+0000","last_became_active":"2024-09-12T03:37:39.425134+0000","last_became_peered":"2024-09-12T03:37:39.425134+0000","last_unstale":"2024-09-12T03:37:42.088769+0000","last_undegraded":"2024-09-12T03:37:42.088769+0000","last_fullsized":"2024-09-12T03:37:42.088769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:12.236274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088078+0000","last_change":"2024-09-12T03:37:40.431048+0000","last_active":"2024-09-12T03:37:42.088078+0000","last_peered":"2024-09-12T03:37:42.088078+0000","last_clean":"2024-09-12T03:37:42.088078+0000","last_became_active":"2024-09-12T03:37:40.430593+0000","last_became_peered":"2024-09-12T03:37:40.430593+0000","last_unstale":"2024-09-12T03:37:42.088078+0000","last_undegraded":"2024-09-12T03:37:42.088078+0000","last_fullsized":"2024-09-12T03:37:42.088078+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.161815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503737+0000","last_change":"2024-09-12T03:37:39.421660+0000","last_active":"2024-09-12T03:37:41.503737+0000","last_peered":"2024-09-12T03:37:41.503737+0000","last_clean":"2024-09-12T03:37:41.503737+0000","last_became_active":"2024-09-12T03:37:39.420962+0000","last_became_peered":"2024-09-12T03:37:39.420962+0000","last_unstale":"2024-09-12T03:37:41.503737+0000","last_undegraded":"2024-09-12T03:37:41.503737+0000","last_fullsized":"2024-09-12T03:37:41.503737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:21.235949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401958+0000","last_change":"2024-09-12T03:37:40.438346+0000","last_active":"2024-09-12T03:37:41.401958+0000","last_peered":"2024-09-12T03:37:41.401958+0000","last_clean":"2024-09-12T03:37:41.401958+0000","last_became_active":"2024-09-12T03:37:40.437961+0000","last_became_peered":"2024-09-12T03:37:40.437961+0000","last_unstale":"2024-09-12T03:37:41.401958+0000","last_undegraded":"2024-09-12T03:37:41.401958+0000","last_fullsized":"2024-09-12T03:37:41.401958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:21.181419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087885+0000","last_change":"2024-09-12T03:37:39.422461+0000","last_active":"2024-09-12T03:37:42.087885+0000","last_peered":"2024-09-12T03:37:42.087885+0000","last_clean":"2024-09-12T03:37:42.087885+0000","last_became_active":"2024-09-12T03:37:39.421555+0000","last_became_peered":"2024-09-12T03:37:39.421555+0000","last_unstale":"2024-09-12T03:37:42.087885+0000","last_undegraded":"2024-09-12T03:37:42.087885+0000","last_fullsized":"2024-09-12T03:37:42.087885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:42.439027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401207+0000","last_change":"2024-09-12T03:37:40.427938+0000","last_active":"2024-09-12T03:37:41.401207+0000","last_peered":"2024-09-12T03:37:41.401207+0000","last_clean":"2024-09-12T03:37:41.401207+0000","last_became_active":"2024-09-12T03:37:40.427412+0000","last_became_peered":"2024-09-12T03:37:40.427412+0000","last_unstale":"2024-09-12T03:37:41.401207+0000","last_undegraded":"2024-09-12T03:37:41.401207+0000","last_fullsized":"2024-09-12T03:37:41.401207+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:54.043089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088599+0000","last_change":"2024-09-12T03:37:39.426750+0000","last_active":"2024-09-12T03:37:42.088599+0000","last_peered":"2024-09-12T03:37:42.088599+0000","last_clean":"2024-09-12T03:37:42.088599+0000","last_became_active":"2024-09-12T03:37:39.426357+0000","last_became_peered":"2024-09-12T03:37:39.426357+0000","last_unstale":"2024-09-12T03:37:42.088599+0000","last_undegraded":"2024-09-12T03:37:42.088599+0000","last_fullsized":"2024-09-12T03:37:42.088599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:12.810221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401486+0000","last_change":"2024-09-12T03:37:40.423255+0000","last_active":"2024-09-12T03:37:41.401486+0000","last_peered":"2024-09-12T03:37:41.401486+0000","last_clean":"2024-09-12T03:37:41.401486+0000","last_became_active":"2024-09-12T03:37:40.422843+0000","last_became_peered":"2024-09-12T03:37:40.422843+0000","last_unstale":"2024-09-12T03:37:41.401486+0000","last_undegraded":"2024-09-12T03:37:41.401486+0000","last_fullsized":"2024-09-12T03:37:41.401486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:25.477796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"85'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088357+0000","last_change":"2024-09-12T03:37:39.408602+0000","last_active":"2024-09-12T03:37:42.088357+0000","last_peered":"2024-09-12T03:37:42.088357+0000","last_clean":"2024-09-12T03:37:42.088357+0000","last_became_active":"2024-09-12T03:37:39.408327+0000","last_became_peered":"2024-09-12T03:37:39.408327+0000","last_unstale":"2024-09-12T03:37:42.088357+0000","last_undegraded":"2024-09-12T03:37:42.088357+0000","last_fullsized":"2024-09-12T03:37:42.088357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:51.127339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088753+0000","last_change":"2024-09-12T03:37:40.428686+0000","last_active":"2024-09-12T03:37:42.088753+0000","last_peered":"2024-09-12T03:37:42.088753+0000","last_clean":"2024-09-12T03:37:42.088753+0000","last_became_active":"2024-09-12T03:37:40.423872+0000","last_became_peered":"2024-09-12T03:37:40.423872+0000","last_unstale":"2024-09-12T03:37:42.088753+0000","last_undegraded":"2024-09-12T03:37:42.088753+0000","last_fullsized":"2024-09-12T03:37:42.088753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:24.192872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404451+0000","last_change":"2024-09-12T03:37:39.432638+0000","last_active":"2024-09-12T03:37:41.404451+0000","last_peered":"2024-09-12T03:37:41.404451+0000","last_clean":"2024-09-12T03:37:41.404451+0000","last_became_active":"2024-09-12T03:37:39.431762+0000","last_became_peered":"2024-09-12T03:37:39.431762+0000","last_unstale":"2024-09-12T03:37:41.404451+0000","last_undegraded":"2024-09-12T03:37:41.404451+0000","last_fullsized":"2024-09-12T03:37:41.404451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:55.197250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403810+0000","last_change":"2024-09-12T03:37:40.417439+0000","last_active":"2024-09-12T03:37:41.403810+0000","last_peered":"2024-09-12T03:37:41.403810+0000","last_clean":"2024-09-12T03:37:41.403810+0000","last_became_active":"2024-09-12T03:37:40.416773+0000","last_became_peered":"2024-09-12T03:37:40.416773+0000","last_unstale":"2024-09-12T03:37:41.403810+0000","last_undegraded":"2024-09-12T03:37:41.403810+0000","last_fullsized":"2024-09-12T03:37:41.403810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:21.302076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503853+0000","last_change":"2024-09-12T03:37:39.434146+0000","last_active":"2024-09-12T03:37:41.503853+0000","last_peered":"2024-09-12T03:37:41.503853+0000","last_clean":"2024-09-12T03:37:41.503853+0000","last_became_active":"2024-09-12T03:37:39.433427+0000","last_became_peered":"2024-09-12T03:37:39.433427+0000","last_unstale":"2024-09-12T03:37:41.503853+0000","last_undegraded":"2024-09-12T03:37:41.503853+0000","last_fullsized":"2024-09-12T03:37:41.503853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:03.747853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.404221+0000","last_change":"2024-09-12T03:37:40.425320+0000","last_active":"2024-09-12T03:37:41.404221+0000","last_peered":"2024-09-12T03:37:41.404221+0000","last_clean":"2024-09-12T03:37:41.404221+0000","last_became_active":"2024-09-12T03:37:40.424983+0000","last_became_peered":"2024-09-12T03:37:40.424983+0000","last_unstale":"2024-09-12T03:37:41.404221+0000","last_undegraded":"2024-09-12T03:37:41.404221+0000","last_fullsized":"2024-09-12T03:37:41.404221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:27.161815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"85'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405329+0000","last_change":"2024-09-12T03:37:39.437820+0000","last_active":"2024-09-12T03:37:41.405329+0000","last_peered":"2024-09-12T03:37:41.405329+0000","last_clean":"2024-09-12T03:37:41.405329+0000","last_became_active":"2024-09-12T03:37:39.434293+0000","last_became_peered":"2024-09-12T03:37:39.434293+0000","last_unstale":"2024-09-12T03:37:41.405329+0000","last_undegraded":"2024-09-12T03:37:41.405329+0000","last_fullsized":"2024-09-12T03:37:41.405329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:06.793468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088166+0000","last_change":"2024-09-12T03:37:40.436044+0000","last_active":"2024-09-12T03:37:42.088166+0000","last_peered":"2024-09-12T03:37:42.088166+0000","last_clean":"2024-09-12T03:37:42.088166+0000","last_became_active":"2024-09-12T03:37:40.432077+0000","last_became_peered":"2024-09-12T03:37:40.432077+0000","last_unstale":"2024-09-12T03:37:42.088166+0000","last_undegraded":"2024-09-12T03:37:42.088166+0000","last_fullsized":"2024-09-12T03:37:42.088166+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:49:32.547446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087753+0000","last_change":"2024-09-12T03:37:39.428828+0000","last_active":"2024-09-12T03:37:42.087753+0000","last_peered":"2024-09-12T03:37:42.087753+0000","last_clean":"2024-09-12T03:37:42.087753+0000","last_became_active":"2024-09-12T03:37:39.419776+0000","last_became_peered":"2024-09-12T03:37:39.419776+0000","last_unstale":"2024-09-12T03:37:42.087753+0000","last_undegraded":"2024-09-12T03:37:42.087753+0000","last_fullsized":"2024-09-12T03:37:42.087753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:30.103129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087840+0000","last_change":"2024-09-12T03:37:40.405047+0000","last_active":"2024-09-12T03:37:42.087840+0000","last_peered":"2024-09-12T03:37:42.087840+0000","last_clean":"2024-09-12T03:37:42.087840+0000","last_became_active":"2024-09-12T03:37:40.404830+0000","last_became_peered":"2024-09-12T03:37:40.404830+0000","last_unstale":"2024-09-12T03:37:42.087840+0000","last_undegraded":"2024-09-12T03:37:42.087840+0000","last_fullsized":"2024-09-12T03:37:42.087840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:25.238047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401379+0000","last_change":"2024-09-12T03:37:39.407477+0000","last_active":"2024-09-12T03:37:41.401379+0000","last_peered":"2024-09-12T03:37:41.401379+0000","last_clean":"2024-09-12T03:37:41.401379+0000","last_became_active":"2024-09-12T03:37:39.407054+0000","last_became_peered":"2024-09-12T03:37:39.407054+0000","last_unstale":"2024-09-12T03:37:41.401379+0000","last_undegraded":"2024-09-12T03:37:41.401379+0000","last_fullsized":"2024-09-12T03:37:41.401379+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:11.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088052+0000","last_change":"2024-09-12T03:37:40.427696+0000","last_active":"2024-09-12T03:37:42.088052+0000","last_peered":"2024-09-12T03:37:42.088052+0000","last_clean":"2024-09-12T03:37:42.088052+0000","last_became_active":"2024-09-12T03:37:40.427417+0000","last_became_peered":"2024-09-12T03:37:40.427417+0000","last_unstale":"2024-09-12T03:37:42.088052+0000","last_undegraded":"2024-09-12T03:37:42.088052+0000","last_fullsized":"2024-09-12T03:37:42.088052+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:49.784655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088016+0000","last_change":"2024-09-12T03:37:39.429082+0000","last_active":"2024-09-12T03:37:42.088016+0000","last_peered":"2024-09-12T03:37:42.088016+0000","last_clean":"2024-09-12T03:37:42.088016+0000","last_became_active":"2024-09-12T03:37:39.421393+0000","last_became_peered":"2024-09-12T03:37:39.421393+0000","last_unstale":"2024-09-12T03:37:42.088016+0000","last_undegraded":"2024-09-12T03:37:42.088016+0000","last_fullsized":"2024-09-12T03:37:42.088016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:26.152556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088493+0000","last_change":"2024-09-12T03:37:40.424564+0000","last_active":"2024-09-12T03:37:42.088493+0000","last_peered":"2024-09-12T03:37:42.088493+0000","last_clean":"2024-09-12T03:37:42.088493+0000","last_became_active":"2024-09-12T03:37:40.424199+0000","last_became_peered":"2024-09-12T03:37:40.424199+0000","last_unstale":"2024-09-12T03:37:42.088493+0000","last_undegraded":"2024-09-12T03:37:42.088493+0000","last_fullsized":"2024-09-12T03:37:42.088493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:09.621304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401029+0000","last_change":"2024-09-12T03:37:39.432475+0000","last_active":"2024-09-12T03:37:41.401029+0000","last_peered":"2024-09-12T03:37:41.401029+0000","last_clean":"2024-09-12T03:37:41.401029+0000","last_became_active":"2024-09-12T03:37:39.432210+0000","last_became_peered":"2024-09-12T03:37:39.432210+0000","last_unstale":"2024-09-12T03:37:41.401029+0000","last_undegraded":"2024-09-12T03:37:41.401029+0000","last_fullsized":"2024-09-12T03:37:41.401029+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:43.942678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403532+0000","last_change":"2024-09-12T03:37:40.424253+0000","last_active":"2024-09-12T03:37:41.403532+0000","last_peered":"2024-09-12T03:37:41.403532+0000","last_clean":"2024-09-12T03:37:41.403532+0000","last_became_active":"2024-09-12T03:37:40.422441+0000","last_became_peered":"2024-09-12T03:37:40.422441+0000","last_unstale":"2024-09-12T03:37:41.403532+0000","last_undegraded":"2024-09-12T03:37:41.403532+0000","last_fullsized":"2024-09-12T03:37:41.403532+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:00.813140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"85'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504106+0000","last_change":"2024-09-12T03:37:39.437978+0000","last_active":"2024-09-12T03:37:41.504106+0000","last_peered":"2024-09-12T03:37:41.504106+0000","last_clean":"2024-09-12T03:37:41.504106+0000","last_became_active":"2024-09-12T03:37:39.437140+0000","last_became_peered":"2024-09-12T03:37:39.437140+0000","last_unstale":"2024-09-12T03:37:41.504106+0000","last_undegraded":"2024-09-12T03:37:41.504106+0000","last_fullsized":"2024-09-12T03:37:41.504106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:15.851466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.090066+0000","last_change":"2024-09-12T03:37:40.417407+0000","last_active":"2024-09-12T03:37:42.090066+0000","last_peered":"2024-09-12T03:37:42.090066+0000","last_clean":"2024-09-12T03:37:42.090066+0000","last_became_active":"2024-09-12T03:37:40.416874+0000","last_became_peered":"2024-09-12T03:37:40.416874+0000","last_unstale":"2024-09-12T03:37:42.090066+0000","last_undegraded":"2024-09-12T03:37:42.090066+0000","last_fullsized":"2024-09-12T03:37:42.090066+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:38.797047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.404471+0000","last_change":"2024-09-12T03:37:39.441255+0000","last_active":"2024-09-12T03:37:42.404471+0000","last_peered":"2024-09-12T03:37:42.404471+0000","last_clean":"2024-09-12T03:37:42.404471+0000","last_became_active":"2024-09-12T03:37:39.440569+0000","last_became_peered":"2024-09-12T03:37:39.440569+0000","last_unstale":"2024-09-12T03:37:42.404471+0000","last_undegraded":"2024-09-12T03:37:42.404471+0000","last_fullsized":"2024-09-12T03:37:42.404471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.959634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089219+0000","last_change":"2024-09-12T03:37:40.421941+0000","last_active":"2024-09-12T03:37:42.089219+0000","last_peered":"2024-09-12T03:37:42.089219+0000","last_clean":"2024-09-12T03:37:42.089219+0000","last_became_active":"2024-09-12T03:37:40.421609+0000","last_became_peered":"2024-09-12T03:37:40.421609+0000","last_unstale":"2024-09-12T03:37:42.089219+0000","last_undegraded":"2024-09-12T03:37:42.089219+0000","last_fullsized":"2024-09-12T03:37:42.089219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:48.753769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.405555+0000","last_change":"2024-09-12T03:37:39.433859+0000","last_active":"2024-09-12T03:37:41.405555+0000","last_peered":"2024-09-12T03:37:41.405555+0000","last_clean":"2024-09-12T03:37:41.405555+0000","last_became_active":"2024-09-12T03:37:39.431773+0000","last_became_peered":"2024-09-12T03:37:39.431773+0000","last_unstale":"2024-09-12T03:37:41.405555+0000","last_undegraded":"2024-09-12T03:37:41.405555+0000","last_fullsized":"2024-09-12T03:37:41.405555+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:03.608970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088354+0000","last_change":"2024-09-12T03:37:40.422434+0000","last_active":"2024-09-12T03:37:42.088354+0000","last_peered":"2024-09-12T03:37:42.088354+0000","last_clean":"2024-09-12T03:37:42.088354+0000","last_became_active":"2024-09-12T03:37:40.422054+0000","last_became_peered":"2024-09-12T03:37:40.422054+0000","last_unstale":"2024-09-12T03:37:42.088354+0000","last_undegraded":"2024-09-12T03:37:42.088354+0000","last_fullsized":"2024-09-12T03:37:42.088354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:46:04.757111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403720+0000","last_change":"2024-09-12T03:37:39.427202+0000","last_active":"2024-09-12T03:37:41.403720+0000","last_peered":"2024-09-12T03:37:41.403720+0000","last_clean":"2024-09-12T03:37:41.403720+0000","last_became_active":"2024-09-12T03:37:39.425841+0000","last_became_peered":"2024-09-12T03:37:39.425841+0000","last_unstale":"2024-09-12T03:37:41.403720+0000","last_undegraded":"2024-09-12T03:37:41.403720+0000","last_fullsized":"2024-09-12T03:37:41.403720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:43:21.625912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.401051+0000","last_change":"2024-09-12T03:37:40.425926+0000","last_active":"2024-09-12T03:37:41.401051+0000","last_peered":"2024-09-12T03:37:41.401051+0000","last_clean":"2024-09-12T03:37:41.401051+0000","last_became_active":"2024-09-12T03:37:40.425544+0000","last_became_peered":"2024-09-12T03:37:40.425544+0000","last_unstale":"2024-09-12T03:37:41.401051+0000","last_undegraded":"2024-09-12T03:37:41.401051+0000","last_fullsized":"2024-09-12T03:37:41.401051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:52.195835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.089125+0000","last_change":"2024-09-12T03:37:39.430328+0000","last_active":"2024-09-12T03:37:42.089125+0000","last_peered":"2024-09-12T03:37:42.089125+0000","last_clean":"2024-09-12T03:37:42.089125+0000","last_became_active":"2024-09-12T03:37:39.430047+0000","last_became_peered":"2024-09-12T03:37:39.430047+0000","last_unstale":"2024-09-12T03:37:42.089125+0000","last_undegraded":"2024-09-12T03:37:42.089125+0000","last_fullsized":"2024-09-12T03:37:42.089125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:51.008253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.727599+0000","last_change":"2024-09-12T03:37:40.420995+0000","last_active":"2024-09-12T03:37:41.727599+0000","last_peered":"2024-09-12T03:37:41.727599+0000","last_clean":"2024-09-12T03:37:41.727599+0000","last_became_active":"2024-09-12T03:37:40.420539+0000","last_became_peered":"2024-09-12T03:37:40.420539+0000","last_unstale":"2024-09-12T03:37:41.727599+0000","last_undegraded":"2024-09-12T03:37:41.727599+0000","last_fullsized":"2024-09-12T03:37:41.727599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:16.860724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.087846+0000","last_change":"2024-09-12T03:37:39.431751+0000","last_active":"2024-09-12T03:37:42.087846+0000","last_peered":"2024-09-12T03:37:42.087846+0000","last_clean":"2024-09-12T03:37:42.087846+0000","last_became_active":"2024-09-12T03:37:39.431181+0000","last_became_peered":"2024-09-12T03:37:39.431181+0000","last_unstale":"2024-09-12T03:37:42.087846+0000","last_undegraded":"2024-09-12T03:37:42.087846+0000","last_fullsized":"2024-09-12T03:37:42.087846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:20:33.562638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.402297+0000","last_change":"2024-09-12T03:37:40.432493+0000","last_active":"2024-09-12T03:37:41.402297+0000","last_peered":"2024-09-12T03:37:41.402297+0000","last_clean":"2024-09-12T03:37:41.402297+0000","last_became_active":"2024-09-12T03:37:40.431967+0000","last_became_peered":"2024-09-12T03:37:40.431967+0000","last_unstale":"2024-09-12T03:37:41.402297+0000","last_undegraded":"2024-09-12T03:37:41.402297+0000","last_fullsized":"2024-09-12T03:37:41.402297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.135487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.403012+0000","last_change":"2024-09-12T03:37:39.426991+0000","last_active":"2024-09-12T03:37:41.403012+0000","last_peered":"2024-09-12T03:37:41.403012+0000","last_clean":"2024-09-12T03:37:41.403012+0000","last_became_active":"2024-09-12T03:37:39.425872+0000","last_became_peered":"2024-09-12T03:37:39.425872+0000","last_unstale":"2024-09-12T03:37:41.403012+0000","last_undegraded":"2024-09-12T03:37:41.403012+0000","last_fullsized":"2024-09-12T03:37:41.403012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:30.367921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.088886+0000","last_change":"2024-09-12T03:37:40.417611+0000","last_active":"2024-09-12T03:37:42.088886+0000","last_peered":"2024-09-12T03:37:42.088886+0000","last_clean":"2024-09-12T03:37:42.088886+0000","last_became_active":"2024-09-12T03:37:40.417268+0000","last_became_peered":"2024-09-12T03:37:40.417268+0000","last_unstale":"2024-09-12T03:37:42.088886+0000","last_undegraded":"2024-09-12T03:37:42.088886+0000","last_fullsized":"2024-09-12T03:37:42.088886+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:11.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503453+0000","last_change":"2024-09-12T03:37:39.419403+0000","last_active":"2024-09-12T03:37:41.503453+0000","last_peered":"2024-09-12T03:37:41.503453+0000","last_clean":"2024-09-12T03:37:41.503453+0000","last_became_active":"2024-09-12T03:37:39.418693+0000","last_became_peered":"2024-09-12T03:37:39.418693+0000","last_unstale":"2024-09-12T03:37:41.503453+0000","last_undegraded":"2024-09-12T03:37:41.503453+0000","last_fullsized":"2024-09-12T03:37:41.503453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:24.228789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.504042+0000","last_change":"2024-09-12T03:37:40.426508+0000","last_active":"2024-09-12T03:37:41.504042+0000","last_peered":"2024-09-12T03:37:41.504042+0000","last_clean":"2024-09-12T03:37:41.504042+0000","last_became_active":"2024-09-12T03:37:40.426285+0000","last_became_peered":"2024-09-12T03:37:40.426285+0000","last_unstale":"2024-09-12T03:37:41.504042+0000","last_undegraded":"2024-09-12T03:37:41.504042+0000","last_fullsized":"2024-09-12T03:37:41.504042+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:39.377845+0000","last_clean_scrub_stamp":"2024-09-12T03:37:39.377845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:53.440780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:42.090079+0000","last_change":"2024-09-12T03:37:39.432928+0000","last_active":"2024-09-12T03:37:42.090079+0000","last_peered":"2024-09-12T03:37:42.090079+0000","last_clean":"2024-09-12T03:37:42.090079+0000","last_became_active":"2024-09-12T03:37:39.432570+0000","last_became_peered":"2024-09-12T03:37:39.432570+0000","last_unstale":"2024-09-12T03:37:42.090079+0000","last_undegraded":"2024-09-12T03:37:42.090079+0000","last_fullsized":"2024-09-12T03:37:42.090079+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:37:38.368587+0000","last_clean_scrub_stamp":"2024-09-12T03:37:38.368587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:07.923717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":285,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-12T03:37:41.503603+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:37:41.503603+0000","last_peered":"2024-09-12T03:37:41.503603+0000","last_clean":"2024-09-12T03:37:41.503603+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:37:41.503603+0000","last_undegraded":"2024-09-12T03:37:41.503603+0000","last_fullsized":"2024-09-12T03:37:41.503603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1654784,"data_stored":1071204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509484,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1040384,"data_stored":474088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32224,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339616,"statfs":{"total":96636764160,"available":96603766784,"internally_reserved":0,"allocated":1060864,"data_stored":480940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":480780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":480780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1056768,"data_stored":480850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":482996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32828,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339012,"statfs":{"total":96636764160,"available":96603148288,"internally_reserved":0,"allocated":1671168,"data_stored":1073466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:37:48.247 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:37:48.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T03:37:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3fe0b640 1 Processor -- start 2024-09-12T03:37:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3fe0b640 1 -- start start 2024-09-12T03:37:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3fe0b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 0x7fda380b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3fe0b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fda380d1ce0 0x7fda380d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3fe0b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380d2ad0 con 0x7fda3815bf50 2024-09-12T03:37:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3fe0b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fda380cc970 con 0x7fda380d1ce0 2024-09-12T03:37:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3fe0b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fda380ccc50 con 0x7fda38160630 2024-09-12T03:37:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3dba7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fda3815bf50 0x7fda380ce4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45006/0 (socket says 172.21.15.73:45006) 2024-09-12T03:37:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3dba7640 1 -- 172.21.15.73:0/2382040951 learned_addr learned my addr 172.21.15.73:0/2382040951 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3d3a6640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 0x7fda380b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3e3a8640 1 --2- 172.21.15.73:0/2382040951 >> v2:172.21.15.150:3300/0 conn(0x7fda380d1ce0 0x7fda380d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262696471 0 0) 0x7fda380d2ad0 con 0x7fda3815bf50 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.417+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda24003530 con 0x7fda3815bf50 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1423642669 0 0) 0x7fda24003530 con 0x7fda3815bf50 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 msgr2=0x7fda380b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 0x7fda380b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 >> v2:172.21.15.150:3300/0 conn(0x7fda380d1ce0 msgr2=0x7fda380d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 --2- 172.21.15.73:0/2382040951 >> v2:172.21.15.150:3300/0 conn(0x7fda380d1ce0 0x7fda380d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda38160b80 con 0x7fda3815bf50 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fda34001680 con 0x7fda3815bf50 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 >> v1:172.21.15.73:6789/0 conn(0x7fda3815bf50 legacy=0x7fda380ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda240039c0 0x7fda24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 0x7fda24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24004d50 0x7fda240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fda380cc970 con 0x7fda240039c0 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fda380ccc50 con 0x7fda24004d50 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fda2400b9d0 con 0x7fda38160630 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3dba7640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda240039c0 0x7fda24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3e3a8640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24004d50 0x7fda240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3d3a6640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 0x7fda24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3dba7640 1 -- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 msgr2=0x7fda24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3dba7640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38160630 0x7fda24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3dba7640 1 -- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24004d50 msgr2=0x7fda240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3dba7640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda24004d50 0x7fda240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3dba7640 1 -- 172.21.15.73:0/2382040951 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda24003530 con 0x7fda240039c0 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3dba7640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda240039c0 0x7fda24003de0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fda34001060 tx=0x7fda3401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e89e2b4a3164ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda34007d80 con 0x7fda240039c0 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda340a9020 con 0x7fda240039c0 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.421+0000 7fda3cba5640 1 -- 172.21.15.73:0/2382040951 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda34005b00 con 0x7fda240039c0 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- 172.21.15.73:0/2382040951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda240039c0 msgr2=0x7fda24003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 --2- 172.21.15.73:0/2382040951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda240039c0 0x7fda24003de0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fda34001060 tx=0x7fda3401cca0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 -- 172.21.15.73:0/2382040951 reap_dead start 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- 172.21.15.73:0/2382040951 shutdown_connections 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- 172.21.15.73:0/2382040951 >> 172.21.15.73:0/2382040951 conn(0x7fda380700a0 msgr2=0x7fda380704b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- 172.21.15.73:0/2382040951 shutdown_connections 2024-09-12T03:37:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- 172.21.15.73:0/2382040951 wait complete. 2024-09-12T03:37:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 Processor -- start 2024-09-12T03:37:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- start start 2024-09-12T03:37:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda38145b30 0x7fda3815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38145f10 0x7fda381f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda381f89c0 0x7fda38161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fda380d06f0 con 0x7fda381f89c0 2024-09-12T03:37:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fda380d0570 con 0x7fda38145b30 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fda380d0870 con 0x7fda38145f10 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda381f89c0 0x7fda38161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda381f89c0 0x7fda38161ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39766/0 (socket says 172.21.15.73:39766) 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 -- 172.21.15.73:0/3760045685 learned_addr learned my addr 172.21.15.73:0/3760045685 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3d3a6640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38145f10 0x7fda381f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3dba7640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda38145b30 0x7fda3815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 -- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38145f10 msgr2=0x7fda381f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38145f10 0x7fda381f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 -- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda38145b30 msgr2=0x7fda3815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda38145b30 0x7fda3815cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 -- 172.21.15.73:0/3760045685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda381f8ed0 con 0x7fda381f89c0 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3e3a8640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda381f89c0 0x7fda38161ed0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fda380d1c30 tx=0x7fda300115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda2e7fc640 1 -- 172.21.15.73:0/3760045685 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda30011de0 con 0x7fda381f89c0 2024-09-12T03:37:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda2e7fc640 1 -- 172.21.15.73:0/3760045685 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3001b070 con 0x7fda381f89c0 2024-09-12T03:37:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.425+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda381f91b0 con 0x7fda381f89c0 2024-09-12T03:37:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda2e7fc640 1 -- 172.21.15.73:0/3760045685 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda300039a0 con 0x7fda381f89c0 2024-09-12T03:37:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda38154300 con 0x7fda381f89c0 2024-09-12T03:37:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda380697b0 con 0x7fda381f89c0 2024-09-12T03:37:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda2e7fc640 1 -- 172.21.15.73:0/3760045685 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fda30003b40 con 0x7fda381f89c0 2024-09-12T03:37:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda2e7fc640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda1c0678c0 0x7fda1c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda2e7fc640 1 -- 172.21.15.73:0/3760045685 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fda30086580 con 0x7fda381f89c0 2024-09-12T03:37:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda3dba7640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda1c0678c0 0x7fda1c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.429+0000 7fda3dba7640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda1c0678c0 0x7fda1c069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda340aa000 tx=0x7fda34001a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.433+0000 7fda2e7fc640 1 -- 172.21.15.73:0/3760045685 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fda30056f30 con 0x7fda381f89c0 2024-09-12T03:37:48.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.657+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fda381f9380 con 0x7fda381f89c0 2024-09-12T03:37:48.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.661+0000 7fda2e7fc640 1 -- 172.21.15.73:0/3760045685 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fda30056830 con 0x7fda381f89c0 2024-09-12T03:37:48.663 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T03:37:48.663 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:37:48.663 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-09-12T03:37:48.663 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-09-12T03:37:48.663 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T03:37:48.663 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-09-12T03:37:48.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.661+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda1c0678c0 msgr2=0x7fda1c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.661+0000 7fda3fe0b640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda1c0678c0 0x7fda1c069d80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fda340aa000 tx=0x7fda34001a50 comp rx=0 tx=0).stop 2024-09-12T03:37:48.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.661+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda381f89c0 msgr2=0x7fda38161ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.661+0000 7fda3fe0b640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda381f89c0 0x7fda38161ed0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fda380d1c30 tx=0x7fda300115a0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 shutdown_connections 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fda1c0678c0 0x7fda1c069d80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda381f89c0 0x7fda38161ed0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fda38145f10 0x7fda381f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 --2- 172.21.15.73:0/3760045685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fda38145b30 0x7fda3815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 >> 172.21.15.73:0/3760045685 conn(0x7fda380700a0 msgr2=0x7fda38159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 shutdown_connections 2024-09-12T03:37:48.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.665+0000 7fda3fe0b640 1 -- 172.21.15.73:0/3760045685 wait complete. 2024-09-12T03:37:48.682 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4033b8b640 1 Processor -- start 2024-09-12T03:37:48.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4033b8b640 1 -- start start 2024-09-12T03:37:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4033b8b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0d3060 0x7f402c0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4033b8b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f402c0d0300 con 0x7f402c161a60 2024-09-12T03:37:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4033b8b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f402c0b0f60 con 0x7f402c0cf450 2024-09-12T03:37:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4033b8b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f402c0cfd40 con 0x7f402c0d3060 2024-09-12T03:37:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f402c161a60 0x7f402c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45008/0 (socket says 172.21.15.73:45008) 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 -- 172.21.15.73:0/3487227405 learned_addr learned my addr 172.21.15.73:0/3487227405 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031126640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0d3060 0x7f402c0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069795475 0 0) 0x7f4028001120 con 0x7f402c161a60 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4018003530 con 0x7f402c161a60 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4110362642 0 0) 0x7f4018003530 con 0x7f402c161a60 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0d3060 msgr2=0x7f402c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0d3060 0x7f402c0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 >> v1:172.21.15.150:6789/0 conn(0x7f402c0cf450 legacy=0x7f402c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c0d0020 con 0x7f402c161a60 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f4028001850 con 0x7f402c161a60 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 >> v1:172.21.15.73:6789/0 conn(0x7f402c161a60 legacy=0x7f402c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f4018003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4018004810 0x7f4018004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0d3060 0x7f4018005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f402c0cfd40 con 0x7f40180039f0 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f401800bb00 con 0x7f4018004810 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f401800bd00 con 0x7f402c0d3060 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f4018003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031126640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4018004810 0x7f4018004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 -- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0d3060 msgr2=0x7f4018005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0d3060 0x7f4018005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 -- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4018004810 msgr2=0x7f4018004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4018004810 0x7f4018004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.801+0000 7f4031927640 1 -- 172.21.15.73:0/3487227405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4018003530 con 0x7f40180039f0 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f4018003e10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f402800c4c0 tx=0x7f402801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63561bcf4720a4f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402800c0e0 con 0x7f40180039f0 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40280a9070 con 0x7f40180039f0 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4030925640 1 -- 172.21.15.73:0/3487227405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40280a5d90 con 0x7f40180039f0 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- 172.21.15.73:0/3487227405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 msgr2=0x7f4018003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 --2- 172.21.15.73:0/3487227405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f4018003e10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f402800c4c0 tx=0x7f402801cc50 comp rx=0 tx=0).stop 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4032128640 1 -- 172.21.15.73:0/3487227405 reap_dead start 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- 172.21.15.73:0/3487227405 shutdown_connections 2024-09-12T03:37:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- 172.21.15.73:0/3487227405 >> 172.21.15.73:0/3487227405 conn(0x7f402c08bf90 msgr2=0x7f402c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:48.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- 172.21.15.73:0/3487227405 shutdown_connections 2024-09-12T03:37:48.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- 172.21.15.73:0/3487227405 wait complete. 2024-09-12T03:37:48.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 Processor -- start 2024-09-12T03:37:48.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- start start 2024-09-12T03:37:48.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f402c15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0b71a0 0x7f402c0b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f402c0d04e0 0x7f402c0d0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f402c16a0a0 con 0x7f40180039f0 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f402c169f20 con 0x7f402c0d04e0 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4033b8b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f402c16a220 con 0x7f402c0b71a0 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f402c15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f402c15b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39790/0 (socket says 172.21.15.73:39790) 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 -- 172.21.15.73:0/3935670670 learned_addr learned my addr 172.21.15.73:0/3935670670 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 -- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0b71a0 msgr2=0x7f402c0b8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4032128640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f402c0d04e0 0x7f402c0d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031126640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0b71a0 0x7f402c0b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0b71a0 0x7f402c0b8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 -- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f402c0d04e0 msgr2=0x7f402c0d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f402c0d04e0 0x7f402c0d0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4031927640 1 -- 172.21.15.73:0/3935670670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c0b9570 con 0x7f40180039f0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.805+0000 7f4032128640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f402c0d04e0 0x7f402c0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f4031927640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f402c15b770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f402800c4c0 tx=0x7f4018005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f40227fc640 1 -- 172.21.15.73:0/3935670670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028001610 con 0x7f40180039f0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f40227fc640 1 -- 172.21.15.73:0/3935670670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40280017b0 con 0x7f40180039f0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402c0b9850 con 0x7f40180039f0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f40227fc640 1 -- 172.21.15.73:0/3935670670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40280049f0 con 0x7f40180039f0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402c0b9e10 con 0x7f40180039f0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402c0ba1f0 con 0x7f40180039f0 2024-09-12T03:37:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f40227fc640 1 -- 172.21.15.73:0/3935670670 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40280b7030 con 0x7f40180039f0 2024-09-12T03:37:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f40227fc640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40100678c0 0x7f4010069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f40227fc640 1 -- 172.21.15.73:0/3935670670 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f402811f630 con 0x7f40180039f0 2024-09-12T03:37:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f4031126640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40100678c0 0x7f4010069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.809+0000 7f4031126640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40100678c0 0x7f4010069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f402c1fb220 tx=0x7f401c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:48.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:48.813+0000 7f40227fc640 1 -- 172.21.15.73:0/3935670670 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f402c0ba1f0 con 0x7f40180039f0 2024-09-12T03:37:49.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.009+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f402c0d0e80 con 0x7f40180039f0 2024-09-12T03:37:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.009+0000 7f40227fc640 1 -- 172.21.15.73:0/3935670670 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5222 (secure 0 0 0) 0x7f40280f4e20 con 0x7f40180039f0 2024-09-12T03:37:49.013 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:49.013 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"btime":"2024-09-12T03:37:42:437910+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/54392956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54392956},{"type":"v1","addr":"172.21.15.150:6835","nonce":54392956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6240,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/583240547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":583240547},{"type":"v1","addr":"172.21.15.73:6835","nonce":583240547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3438655973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3438655973},{"type":"v1","addr":"172.21.15.73:6837","nonce":3438655973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:39.761504+0000","modified":"2024-09-12T03:37:41.797723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6833/3979723408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3979723408},{"type":"v1","addr":"172.21.15.150:6833","nonce":3979723408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":6}]} 2024-09-12T03:37:49.013 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 48 2024-09-12T03:37:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40100678c0 msgr2=0x7f4010069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40100678c0 0x7f4010069d80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f402c1fb220 tx=0x7f401c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:49.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 msgr2=0x7f402c15b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f402c15b770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f402800c4c0 tx=0x7f4018005840 comp rx=0 tx=0).stop 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 shutdown_connections 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40100678c0 0x7f4010069d80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f402c0d04e0 0x7f402c0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f402c0b71a0 0x7f402c0b8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 --2- 172.21.15.73:0/3935670670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40180039f0 0x7f402c15b770 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 >> 172.21.15.73:0/3935670670 conn(0x7f402c08bf90 msgr2=0x7f402c0b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 shutdown_connections 2024-09-12T03:37:49.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.013+0000 7f4033b8b640 1 -- 172.21.15.73:0/3935670670 wait complete. 2024-09-12T03:37:49.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:37:39.761504+0000', 'modified': '2024-09-12T03:37:41.797723+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6255}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6255': {'gid': 6255, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6833/3979723408', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6832', 'nonce': 3979723408}, {'type': 'v1', 'addr': '172.21.15.150:6833', 'nonce': 3979723408}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6255, 'qdb_cluster': [6255]} 2024-09-12T03:37:49.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:37:49.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T03:37:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f745ada2640 1 Processor -- start 2024-09-12T03:37:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f745ada2640 1 -- start start 2024-09-12T03:37:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f745ada2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f745406f010 0x7f7454166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f745ada2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74540b3290 con 0x7f745415c2a0 2024-09-12T03:37:49.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f745ada2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74540b3570 con 0x7f745415bec0 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f745ada2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f74540b3850 con 0x7f745406f010 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f7453fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f745415c2a0 0x7f74540aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45020/0 (socket says 172.21.15.73:45020) 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f7453fff640 1 -- 172.21.15.73:0/3551909955 learned_addr learned my addr 172.21.15.73:0/3551909955 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f745933f640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f745406f010 0x7f7454166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186804134 0 0) 0x7f74540b3290 con 0x7f745415c2a0 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f743c003530 con 0x7f745415c2a0 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1583742116 0 0) 0x7f743c003530 con 0x7f745415c2a0 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f745406f010 msgr2=0x7f7454166ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f745406f010 0x7f7454166ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 >> v1:172.21.15.150:6789/0 conn(0x7f745415bec0 legacy=0x7f74540ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74540b3b30 con 0x7f745415c2a0 2024-09-12T03:37:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f7448001680 con 0x7f745415c2a0 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 >> v1:172.21.15.73:6789/0 conn(0x7f745415c2a0 legacy=0x7f74540aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c0039f0 0x7f743c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f743c004810 0x7f743c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f745406f010 0x7f743c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f74540b3850 con 0x7f743c004810 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f743c00ba80 con 0x7f743c0039f0 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.565+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f743c00bc80 con 0x7f745406f010 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7453fff640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f743c004810 0x7f743c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c0039f0 0x7f743c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7453fff640 1 -- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f745406f010 msgr2=0x7f743c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7453fff640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f745406f010 0x7f743c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7453fff640 1 -- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c0039f0 msgr2=0x7f743c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7453fff640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f743c0039f0 0x7f743c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7453fff640 1 -- 172.21.15.73:0/3551909955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c003530 con 0x7f743c004810 2024-09-12T03:37:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f7453fff640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f743c004810 0x7f743c004c90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f745415c6b0 tx=0x7f744801f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb6e8025b9ba95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448007d00 con 0x7f743c004810 2024-09-12T03:37:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7448005b00 con 0x7f743c004810 2024-09-12T03:37:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f74537fe640 1 -- 172.21.15.73:0/3551909955 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448007070 con 0x7f743c004810 2024-09-12T03:37:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f745ada2640 1 -- 172.21.15.73:0/3551909955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f743c004810 msgr2=0x7f743c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f745ada2640 1 --2- 172.21.15.73:0/3551909955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f743c004810 0x7f743c004c90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f745415c6b0 tx=0x7f744801f350 comp rx=0 tx=0).stop 2024-09-12T03:37:49.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f745933f640 1 -- 172.21.15.73:0/3551909955 reap_dead start 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f745ada2640 1 -- 172.21.15.73:0/3551909955 shutdown_connections 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.569+0000 7f745ada2640 1 -- 172.21.15.73:0/3551909955 >> 172.21.15.73:0/3551909955 conn(0x7f74540b1f90 msgr2=0x7f74540b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- 172.21.15.73:0/3551909955 shutdown_connections 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- 172.21.15.73:0/3551909955 wait complete. 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 Processor -- start 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- start start 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74541558f0 0x7f74541e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454073570 0x7f74541e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74541e6830 0x7f74540ce900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f74540afc90 con 0x7f74541e6830 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f74540b40f0 con 0x7f74541558f0 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f74540af470 con 0x7f7454073570 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74541e6830 0x7f74540ce900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74541e6830 0x7f74540ce900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39818/0 (socket says 172.21.15.73:39818) 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 -- 172.21.15.73:0/1334534689 learned_addr learned my addr 172.21.15.73:0/1334534689 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f7453fff640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454073570 0x7f74541e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f7458b3e640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74541558f0 0x7f74541e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 -- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454073570 msgr2=0x7f74541e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454073570 0x7f74541e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 -- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74541558f0 msgr2=0x7f74541e48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74541558f0 0x7f74541e48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 -- 172.21.15.73:0/1334534689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74541e5250 con 0x7f74541e6830 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f7453fff640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454073570 0x7f74541e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745933f640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74541e6830 0x7f74540ce900 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f74540b5950 tx=0x7f744c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f74517fa640 1 -- 172.21.15.73:0/1334534689 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c00c680 con 0x7f74541e6830 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f74517fa640 1 -- 172.21.15.73:0/1334534689 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f744c01a070 con 0x7f74541e6830 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74541e5530 con 0x7f74541e6830 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f74517fa640 1 -- 172.21.15.73:0/1334534689 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c00ca80 con 0x7f74541e6830 2024-09-12T03:37:49.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.573+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74541e5af0 con 0x7f74541e6830 2024-09-12T03:37:49.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f74517fa640 1 -- 172.21.15.73:0/1334534689 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f744c00cc20 con 0x7f74541e6830 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f74517fa640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f74400678c0 0x7f7440069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f74517fa640 1 -- 172.21.15.73:0/1334534689 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f744c085a90 con 0x7f74541e6830 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7458b3e640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f74400678c0 0x7f7440069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7458b3e640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f74400678c0 0x7f7440069d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f745409e550 tx=0x7f7444009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 Processor -- start 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 -- start start 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d745af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7410d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7411290 0x55f5d7411670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f5d72f8b60 con 0x55f5d745b440 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f5d725fc70 con 0x55f5d7411290 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55f5d7205ed0 con 0x55f5d745ab20 2024-09-12T03:37:49.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7410d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7410d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39830/0 (socket says 172.21.15.73:39830) 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 -- 172.21.15.73:0/1128225276 learned_addr learned my addr 172.21.15.73:0/1128225276 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7458b3e640 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d745af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f745933f640 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7411290 0x55f5d7411670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 -- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 msgr2=0x55f5d745af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d745af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 -- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7411290 msgr2=0x55f5d7411670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7411290 0x55f5d7411670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 -- 172.21.15.73:0/1128225276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d7217e50 con 0x55f5d745b440 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7458b3e640 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d745af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f7453fff640 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7410d50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7448025fc0 tx=0x7f74540b3460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0c6c24d6f1937d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f743a7fc640 1 -- 172.21.15.73:0/1128225276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448001440 con 0x55f5d745b440 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f743a7fc640 1 -- 172.21.15.73:0/1128225276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74480015e0 con 0x55f5d745b440 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.577+0000 7f743a7fc640 1 -- 172.21.15.73:0/1128225276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448004ab0 con 0x55f5d745b440 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/1128225276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 msgr2=0x55f5d7410d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7410d50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7448025fc0 tx=0x7f74540b3460 comp rx=0 tx=0).stop 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/1128225276 shutdown_connections 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7410d50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7411290 0x55f5d7411670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- 172.21.15.73:0/1128225276 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d745af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/1128225276 >> 172.21.15.73:0/1128225276 conn(0x55f5d7417600 msgr2=0x55f5d740f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/1128225276 shutdown_connections 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/1128225276 wait complete. 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- start start 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 Processor -- start 2024-09-12T03:37:49.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745ab20 0x55f5d7415df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745b440 0x55f5d741bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d7416330 0x55f5d741c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f5d72c1b00 con 0x55f5d745ab20 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f5d723a360 con 0x55f5d745b440 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55f5d72372d0 con 0x55f5d7416330 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 10 client.0 _ll_register_callbacks cb 0x55f5d73fc820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745ab20 0x55f5d7415df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745ab20 0x55f5d7415df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39834/0 (socket says 172.21.15.73:39834) 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 -- 172.21.15.73:0/3440453012 learned_addr learned my addr 172.21.15.73:0/3440453012 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745933f640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d7416330 0x55f5d741c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7453fff640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745b440 0x55f5d741bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 -- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d7416330 msgr2=0x55f5d741c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d7416330 0x55f5d741c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 -- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745b440 msgr2=0x55f5d741bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745b440 0x55f5d741bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 -- 172.21.15.73:0/3440453012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d7206120 con 0x55f5d745ab20 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745933f640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d7416330 0x55f5d741c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7453fff640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745b440 0x55f5d741bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745ab20 0x55f5d7415df0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7444014750 tx=0x7f74440014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da89b613a3fdcb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f74337fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f74337fe640 1 -- 172.21.15.73:0/3440453012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444013830 con 0x55f5d745ab20 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f74337fe640 1 -- 172.21.15.73:0/3440453012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f74440139d0 con 0x55f5d745ab20 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74480015e0 con 0x55f5d745ab20 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f74337fe640 1 -- 172.21.15.73:0/3440453012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f744402d050 con 0x55f5d745ab20 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 10 client.6405 fetch_fsmap learned FSMap version 48 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x55f5d71ff450 con 0x55f5d745ab20 2024-09-12T03:37:49.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f74337fe640 1 -- 172.21.15.73:0/3440453012 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74480015e0 con 0x55f5d745ab20 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f74337fe640 1 -- 172.21.15.73:0/3440453012 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7f7444030020 con 0x55f5d745ab20 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 10 client.6405 fetch_fsmap finished waiting for FSMap version 48 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 10 client.6405 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 20 client.6405 populate_metadata read hostname 'smithi073' 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d7469280 0x55f5d746b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 4 client.6405 mds_command: new command op to 6255 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 --> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5d71f9c00 con 0x55f5d7469280 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.581+0000 7f7453fff640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d7469280 0x55f5d746b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f74337fe640 10 client.6405 ms_handle_connect on v2:172.21.15.150:6832/3979723408 2024-09-12T03:37:49.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f7453fff640 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d7469280 0x55f5d746b670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b6806046727d1a1 server_cookie=983e5a8dea5f3ec1 in_seq=0 out_seq=0 2024-09-12T03:37:49.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f74337fe640 1 -- 172.21.15.73:0/3440453012 <== mds.0 v2:172.21.15.150:6832/3979723408 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5d71f9c00 con 0x55f5d7469280 2024-09-12T03:37:49.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f74337fe640 10 client.6405 handle_command_reply: tid=0 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 client.6405 shutdown 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745ab20 msgr2=0x55f5d7415df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745ab20 0x55f5d7415df0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f7444014750 tx=0x7f74440014b0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 shutdown_connections 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d7416330 0x55f5d741c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745b440 0x55f5d741bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d7469280 0x55f5d746b670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 --2- 172.21.15.73:0/3440453012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745ab20 0x55f5d7415df0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f74337fe640 0 client.6405 ms_handle_reset on v2:172.21.15.150:6832/3979723408 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 >> 172.21.15.73:0/3440453012 conn(0x55f5d7411290 msgr2=0x55f5d740fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 shutdown_connections 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 1 -- 172.21.15.73:0/3440453012 wait complete. 2024-09-12T03:37:49.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.585+0000 7f745de5e000 20 client.6405 trim_cache size 0 max 16384 2024-09-12T03:37:49.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 Processor -- start 2024-09-12T03:37:49.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- start start 2024-09-12T03:37:49.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d7416330 0x55f5d7459c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745ab20 0x55f5d745a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745b440 0x55f5d746b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7454200cc0 con 0x55f5d7416330 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7454200020 con 0x55f5d745ab20 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7454200670 con 0x55f5d745b440 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d7416330 0x55f5d7459c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d7416330 0x55f5d7459c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39848/0 (socket says 172.21.15.73:39848) 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 -- 172.21.15.73:0/2925552518 learned_addr learned my addr 172.21.15.73:0/2925552518 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 -- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745b440 msgr2=0x55f5d746b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7453fff640 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745ab20 0x55f5d745a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745933f640 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745b440 0x55f5d746b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745b440 0x55f5d746b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 -- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745ab20 msgr2=0x55f5d745a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745ab20 0x55f5d745a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 -- 172.21.15.73:0/2925552518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d71e6fd0 con 0x55f5d7416330 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7453fff640 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745ab20 0x55f5d745a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7458b3e640 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d7416330 0x55f5d7459c90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f744400fd80 tx=0x7f7444016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9151086478ba3b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7439ffb640 1 -- 172.21.15.73:0/2925552518 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74440133b0 con 0x55f5d7416330 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7439ffb640 1 -- 172.21.15.73:0/2925552518 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7444025070 con 0x55f5d7416330 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f7439ffb640 1 -- 172.21.15.73:0/2925552518 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7444013a30 con 0x55f5d7416330 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- 172.21.15.73:0/2925552518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d7416330 msgr2=0x55f5d7459c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d7416330 0x55f5d7459c90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f744400fd80 tx=0x7f7444016000 comp rx=0 tx=0).stop 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- 172.21.15.73:0/2925552518 shutdown_connections 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745b440 0x55f5d746b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d745ab20 0x55f5d745a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 --2- 172.21.15.73:0/2925552518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d7416330 0x55f5d7459c90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- 172.21.15.73:0/2925552518 >> 172.21.15.73:0/2925552518 conn(0x55f5d7411290 msgr2=0x55f5d74155f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- 172.21.15.73:0/2925552518 shutdown_connections 2024-09-12T03:37:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.605+0000 7f745de5e000 1 -- 172.21.15.73:0/2925552518 wait complete. 2024-09-12T03:37:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- start start 2024-09-12T03:37:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 Processor -- start 2024-09-12T03:37:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7416330 0x55f5d746e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d7489960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7489ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f5d725ef80 con 0x55f5d745b440 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55f5d7217ca0 con 0x55f5d7416330 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55f5d72642a0 con 0x55f5d745ab20 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 10 client.0 _ll_register_callbacks cb 0x7f7444017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7489ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7489ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39852/0 (socket says 172.21.15.73:39852) 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 -- 172.21.15.73:0/3115290328 learned_addr learned my addr 172.21.15.73:0/3115290328 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7416330 0x55f5d746e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f7453fff640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d7489960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 -- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 msgr2=0x55f5d7489960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d7489960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 -- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7416330 msgr2=0x55f5d746e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7416330 0x55f5d746e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 -- 172.21.15.73:0/3115290328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d72e2750 con 0x55f5d745b440 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7416330 0x55f5d746e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f7453fff640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d7489960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745933f640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7489ea0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f744c00f010 tx=0x7f744c055e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7808940517e0f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 1 -- 172.21.15.73:0/3115290328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c055190 con 0x55f5d745b440 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 1 -- 172.21.15.73:0/3115290328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f744c055330 con 0x55f5d745b440 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7444025070 con 0x55f5d745b440 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 1 -- 172.21.15.73:0/3115290328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f744c05c2f0 con 0x55f5d745b440 2024-09-12T03:37:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 10 client.6411 fetch_fsmap learned FSMap version 48 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x55f5d71eda30 con 0x55f5d745b440 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 1 -- 172.21.15.73:0/3115290328 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7444025070 con 0x55f5d745b440 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 1 -- 172.21.15.73:0/3115290328 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7f744c05c490 con 0x55f5d745b440 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 10 client.6411 fetch_fsmap finished waiting for FSMap version 48 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 10 client.6411 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 20 client.6411 populate_metadata read hostname 'smithi073' 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d748a3e0 0x55f5d74cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 4 client.6411 mds_command: new command op to 6255 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 --> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] -- command(tid 0: {"prefix": "status"}) -- 0x55f5d726d3a0 con 0x55f5d748a3e0 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d748a3e0 0x55f5d74cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f7458b3e640 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d748a3e0 0x55f5d74cdc00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b4c8b91cfd45b server_cookie=72c041fb8d588326 in_seq=0 out_seq=0 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 10 client.6411 ms_handle_connect on v2:172.21.15.150:6832/3979723408 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 1 -- 172.21.15.73:0/3115290328 <== mds.0 v2:172.21.15.150:6832/3979723408 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f5d726d3a0 con 0x55f5d748a3e0 2024-09-12T03:37:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 10 client.6411 handle_command_reply: tid=0 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 client.6411 shutdown 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 msgr2=0x55f5d7489ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7489ea0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f744c00f010 tx=0x7f744c055e00 comp rx=0 tx=0).stop 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 shutdown_connections 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:6832/3979723408,v1:172.21.15.150:6833/3979723408] conn(0x55f5d748a3e0 0x55f5d74cdc00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f5d745b440 0x55f5d7489ea0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55f5d745ab20 0x55f5d7489960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f74337fe640 0 client.6411 ms_handle_reset on v2:172.21.15.150:6832/3979723408 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 --2- 172.21.15.73:0/3115290328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f5d7416330 0x55f5d746e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 >> 172.21.15.73:0/3115290328 conn(0x55f5d7411290 msgr2=0x55f5d7458c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 shutdown_connections 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 1 -- 172.21.15.73:0/3115290328 wait complete. 2024-09-12T03:37:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.609+0000 7f745de5e000 20 client.6411 trim_cache size 0 max 16384 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6255, 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 9.2177977359999996, 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 48, 2024-09-12T03:37:49.619 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 86, 2024-09-12T03:37:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 86, 2024-09-12T03:37:49.620 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 14.254815439 2024-09-12T03:37:49.620 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:37:49.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f74400678c0 msgr2=0x7f7440069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f74400678c0 0x7f7440069d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f745409e550 tx=0x7f7444009040 comp rx=0 tx=0).stop 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74541e6830 msgr2=0x7f74540ce900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74541e6830 0x7f74540ce900 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f74540b5950 tx=0x7f744c00ec00 comp rx=0 tx=0).stop 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 shutdown_connections 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f74400678c0 0x7f7440069d80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74541e6830 0x7f74540ce900 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7454073570 0x7f74541e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 --2- 172.21.15.73:0/1334534689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74541558f0 0x7f74541e48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 >> 172.21.15.73:0/1334534689 conn(0x7f74540b1f90 msgr2=0x7f7454074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 shutdown_connections 2024-09-12T03:37:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.613+0000 7f745ada2640 1 -- 172.21.15.73:0/1334534689 wait complete. 2024-09-12T03:37:49.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:37:49.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 Processor -- start 2024-09-12T03:37:49.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 -- start start 2024-09-12T03:37:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d9815c0c0 0x7f5d9815c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5d9815c9e0 0x7f5d9806ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d980b5880 0x7f5d9806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5d980cd520 con 0x7f5d9815c0c0 2024-09-12T03:37:49.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5d980cd800 con 0x7f5d9815c9e0 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d9dab8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d980cdae0 con 0x7f5d980b5880 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d9815c0c0 0x7f5d9815c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d9815c0c0 0x7f5d9815c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39864/0 (socket says 172.21.15.73:39864) 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 -- 172.21.15.73:0/423894575 learned_addr learned my addr 172.21.15.73:0/423894575 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d97fff640 1 --2- 172.21.15.73:0/423894575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d980b5880 0x7f5d9806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 -- 172.21.15.73:0/423894575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d980b5880 msgr2=0x7f5d9806d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 --2- 172.21.15.73:0/423894575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d980b5880 0x7f5d9806d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 -- 172.21.15.73:0/423894575 >> v2:172.21.15.150:3300/0 conn(0x7f5d9815c9e0 msgr2=0x7f5d9806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d96ffd640 1 --2- 172.21.15.73:0/423894575 >> v2:172.21.15.150:3300/0 conn(0x7f5d9815c9e0 0x7f5d9806ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 --2- 172.21.15.73:0/423894575 >> v2:172.21.15.150:3300/0 conn(0x7f5d9815c9e0 0x7f5d9806ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.741+0000 7f5d977fe640 1 -- 172.21.15.73:0/423894575 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d980cddc0 con 0x7f5d9815c0c0 2024-09-12T03:37:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d977fe640 1 --2- 172.21.15.73:0/423894575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d9815c0c0 0x7f5d9815c4a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5d9815fbc0 tx=0x7f5d9001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b8894f019c69e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d967fc640 1 -- 172.21.15.73:0/423894575 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900a5860 con 0x7f5d9815c0c0 2024-09-12T03:37:49.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d967fc640 1 -- 172.21.15.73:0/423894575 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d900a5a00 con 0x7f5d9815c0c0 2024-09-12T03:37:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d967fc640 1 -- 172.21.15.73:0/423894575 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900a5dd0 con 0x7f5d9815c0c0 2024-09-12T03:37:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- 172.21.15.73:0/423894575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d9815c0c0 msgr2=0x7f5d9815c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/423894575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d9815c0c0 0x7f5d9815c4a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5d9815fbc0 tx=0x7f5d9001c9c0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- 172.21.15.73:0/423894575 shutdown_connections 2024-09-12T03:37:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/423894575 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d980b5880 0x7f5d9806d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/423894575 >> v2:172.21.15.150:3300/0 conn(0x7f5d9815c9e0 0x7f5d9806ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/423894575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d9815c0c0 0x7f5d9815c4a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- 172.21.15.73:0/423894575 >> 172.21.15.73:0/423894575 conn(0x7f5d98072670 msgr2=0x7f5d98072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- 172.21.15.73:0/423894575 shutdown_connections 2024-09-12T03:37:49.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- 172.21.15.73:0/423894575 wait complete. 2024-09-12T03:37:49.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 Processor -- start 2024-09-12T03:37:49.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- start start 2024-09-12T03:37:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b5880 0x7f5d981f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9815c0c0 0x7f5d981f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9815c9e0 0x7f5d98150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9815fc60 con 0x7f5d980b5880 2024-09-12T03:37:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5d980cf020 con 0x7f5d9815c0c0 2024-09-12T03:37:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d9dab8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9815fde0 con 0x7f5d9815c9e0 2024-09-12T03:37:49.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b5880 0x7f5d981f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b5880 0x7f5d981f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39866/0 (socket says 172.21.15.73:39866) 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d977fe640 1 -- 172.21.15.73:0/1312587312 learned_addr learned my addr 172.21.15.73:0/1312587312 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d97fff640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9815c9e0 0x7f5d98150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.745+0000 7f5d96ffd640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9815c0c0 0x7f5d981f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d977fe640 1 -- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9815c9e0 msgr2=0x7f5d98150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d977fe640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9815c9e0 0x7f5d98150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d977fe640 1 -- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9815c0c0 msgr2=0x7f5d981f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d977fe640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9815c0c0 0x7f5d981f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d977fe640 1 -- 172.21.15.73:0/1312587312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d98151f30 con 0x7f5d980b5880 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d96ffd640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9815c0c0 0x7f5d981f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d977fe640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b5880 0x7f5d981f5000 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5d900af040 tx=0x7f5d90019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d7ffff640 1 -- 172.21.15.73:0/1312587312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900b8880 con 0x7f5d980b5880 2024-09-12T03:37:49.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d7ffff640 1 -- 172.21.15.73:0/1312587312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d900be070 con 0x7f5d980b5880 2024-09-12T03:37:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d98152210 con 0x7f5d980b5880 2024-09-12T03:37:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d7ffff640 1 -- 172.21.15.73:0/1312587312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d900b8c80 con 0x7f5d980b5880 2024-09-12T03:37:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d98158180 con 0x7f5d980b5880 2024-09-12T03:37:49.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d9815c4a0 con 0x7f5d980b5880 2024-09-12T03:37:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d7ffff640 1 -- 172.21.15.73:0/1312587312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5d900c3460 con 0x7f5d980b5880 2024-09-12T03:37:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d7ffff640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d840678c0 0x7f5d84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d7ffff640 1 -- 172.21.15.73:0/1312587312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f5d90121300 con 0x7f5d980b5880 2024-09-12T03:37:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d96ffd640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d840678c0 0x7f5d84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:49.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.749+0000 7f5d96ffd640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d840678c0 0x7f5d84069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c006fd0 tx=0x7f5d8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:49.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.753+0000 7f5d7ffff640 1 -- 172.21.15.73:0/1312587312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5d900165e0 con 0x7f5d980b5880 2024-09-12T03:37:49.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5d9815f130 con 0x7f5d980b5880 2024-09-12T03:37:49.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d7ffff640 1 -- 172.21.15.73:0/1312587312 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7f5d900f1780 con 0x7f5d980b5880 2024-09-12T03:37:49.947 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d840678c0 msgr2=0x7f5d84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d840678c0 0x7f5d84069d80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c006fd0 tx=0x7f5d8c008040 comp rx=0 tx=0).stop 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b5880 msgr2=0x7f5d981f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b5880 0x7f5d981f5000 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5d900af040 tx=0x7f5d90019760 comp rx=0 tx=0).stop 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 shutdown_connections 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5d840678c0 0x7f5d84069d80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5d9815c9e0 0x7f5d98150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d9815c0c0 0x7f5d981f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 --2- 172.21.15.73:0/1312587312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b5880 0x7f5d981f5000 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 >> 172.21.15.73:0/1312587312 conn(0x7f5d98072670 msgr2=0x7f5d98155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 shutdown_connections 2024-09-12T03:37:49.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:49.945+0000 7f5d9dab8640 1 -- 172.21.15.73:0/1312587312 wait complete. 2024-09-12T03:37:49.964 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:37:49.964 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:37:49.964 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:37:49.964 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T03:37:49.964 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:49.964 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:37:49.965 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:37:49.965 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:37:49.965 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:37:49.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:49.965 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:49.971 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42298sec preferred_lft 42298sec 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:37:49.972 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:49.973 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:37:49.974 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.976 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:49.976 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:49.976 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:37:49.977 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:49.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:49.977 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:37:50.023 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:37:50.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:50.025 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:37:50.072 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:37:50.072 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:37:50.072 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:37:50.072 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:37:50.073 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:37:50.073 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:37:50.073 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:37:50.073 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:50.073 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:50.073 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:50.073 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:37:50.073 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:37:50.073 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:37:50.073 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:37:50.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:37:50.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:37:50.074 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:37:50.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:37:50.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:50.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:50.185 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:37:50.234 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T03:37:50.234 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:37:50.234 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:37:50.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:50.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:37:50.289 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T03:37:50.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:50.289 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:50.337 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:37:50.338 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:50.338 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:50.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:37:50.447 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:50.494 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:37:50.495 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:37:50.496 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:50.497 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:50.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:50.498 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:37:50.545 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:37:50.546 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T03:37:50.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:37:50.606 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:37:50.654 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:37:50.655 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:50.656 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:50.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:50.657 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:37:50.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-09-12T03:37:50.661+0000 7f2586502580 -1 init, newargv = 0x5641c01dceb0 newargc=15 2024-09-12T03:37:50.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[43199]: starting ceph client 2024-09-12T03:37:50.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[43199]: starting fuse 2024-09-12T03:37:51.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:37:51.787 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:37:51.837 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:51.838 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:37:51.839 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:51.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:51.840 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:37:51.886 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:37:51.886 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:37:51.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:37:51.886 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:37:51.886 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:37:51.886 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:37:51.886 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:37:51.886 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:37:51.887 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:37:51.888 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:37:51.888 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:37:51.888 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:37:51.888 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:37:51.888 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:37:51.888 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-09-12T03:37:51.888 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:37:52.012 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.43199.asok 2024-09-12T03:37:52.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:52.024 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43199.asok 2024-09-12T03:37:52.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43199.asok status 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T03:37:52.183 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "43199", 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6423, 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6423 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:37:52.184 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3074317984 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3074317984 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.6423 192.168.0.1:0/3074317984", 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/3074317984", 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 48, 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 86, 2024-09-12T03:37:52.185 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:37:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:37:52.186 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:37:52.186 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:37:52.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.197 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:37:52.197 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:52.203 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:37:52.203 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:52.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:52.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:37:52.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6217a4d640 1 Processor -- start 2024-09-12T03:37:52.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6217a4d640 1 -- start start 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6217a4d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f621015bec0 0x7f62100ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6217a4d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f621015c2a0 0x7f62100aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6217a4d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62100b3290 con 0x7f62100af2a0 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6217a4d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f62100b3570 con 0x7f621015bec0 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6217a4d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f62100b3850 con 0x7f621015c2a0 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f62157e9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f621015bec0 0x7f62100ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6215fea640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f62100af2a0 0x7f621015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45022/0 (socket says 172.21.15.73:45022) 2024-09-12T03:37:52.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6215fea640 1 -- 172.21.15.73:0/2796096065 learned_addr learned my addr 172.21.15.73:0/2796096065 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6214fe8640 1 --2- 172.21.15.73:0/2796096065 >> v2:172.21.15.150:3300/0 conn(0x7f621015c2a0 0x7f62100aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f62157e9640 1 -- 172.21.15.73:0/2796096065 >> v2:172.21.15.150:3300/0 conn(0x7f621015c2a0 msgr2=0x7f62100aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f62157e9640 1 --2- 172.21.15.73:0/2796096065 >> v2:172.21.15.150:3300/0 conn(0x7f621015c2a0 0x7f62100aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f62157e9640 1 -- 172.21.15.73:0/2796096065 >> v1:172.21.15.73:6789/0 conn(0x7f62100af2a0 legacy=0x7f621015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f62157e9640 1 -- 172.21.15.73:0/2796096065 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100b3b30 con 0x7f621015bec0 2024-09-12T03:37:52.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.425+0000 7f6214fe8640 1 --2- 172.21.15.73:0/2796096065 >> v2:172.21.15.150:3300/0 conn(0x7f621015c2a0 0x7f62100aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 --2- 172.21.15.73:0/2796096065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f621015bec0 0x7f62100ad200 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f62100ae510 tx=0x7f620c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c863e7300c31c1ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6207fff640 1 -- 172.21.15.73:0/2796096065 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c0ab650 con 0x7f621015bec0 2024-09-12T03:37:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6207fff640 1 -- 172.21.15.73:0/2796096065 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c0b0070 con 0x7f621015bec0 2024-09-12T03:37:52.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6207fff640 1 -- 172.21.15.73:0/2796096065 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c0aba10 con 0x7f621015bec0 2024-09-12T03:37:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- 172.21.15.73:0/2796096065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f621015bec0 msgr2=0x7f62100ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 --2- 172.21.15.73:0/2796096065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f621015bec0 0x7f62100ad200 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f62100ae510 tx=0x7f620c01c450 comp rx=0 tx=0).stop 2024-09-12T03:37:52.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- 172.21.15.73:0/2796096065 shutdown_connections 2024-09-12T03:37:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 --2- 172.21.15.73:0/2796096065 >> v2:172.21.15.150:3300/0 conn(0x7f621015c2a0 0x7f62100aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 --2- 172.21.15.73:0/2796096065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f621015bec0 0x7f62100ad200 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- 172.21.15.73:0/2796096065 >> 172.21.15.73:0/2796096065 conn(0x7f62100b1f90 msgr2=0x7f62100b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- 172.21.15.73:0/2796096065 shutdown_connections 2024-09-12T03:37:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- 172.21.15.73:0/2796096065 wait complete. 2024-09-12T03:37:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 Processor -- start 2024-09-12T03:37:52.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- start start 2024-09-12T03:37:52.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62100af2a0 0x7f621015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:52.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f621015bec0 0x7f621015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f621015c2a0 0x7f621015da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f62100af6b0 con 0x7f62100af2a0 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f62100ad740 con 0x7f621015c2a0 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6217a4d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6210169000 con 0x7f621015bec0 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62100af2a0 0x7f621015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62100af2a0 0x7f621015f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39882/0 (socket says 172.21.15.73:39882) 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 -- 172.21.15.73:0/32911710 learned_addr learned my addr 172.21.15.73:0/32911710 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6214fe8640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f621015bec0 0x7f621015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 -- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f621015bec0 msgr2=0x7f621015c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f621015bec0 0x7f621015c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 -- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f621015c2a0 msgr2=0x7f621015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:52.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f6215fea640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f621015c2a0 0x7f621015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f621015c2a0 0x7f621015da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 -- 172.21.15.73:0/32911710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100aef70 con 0x7f62100af2a0 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.429+0000 7f62157e9640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62100af2a0 0x7f621015f5a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f620c019060 tx=0x7f620c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6205ffb640 1 -- 172.21.15.73:0/32911710 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c0bf610 con 0x7f62100af2a0 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6205ffb640 1 -- 172.21.15.73:0/32911710 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f620c0bf7b0 con 0x7f62100af2a0 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621015dfa0 con 0x7f62100af2a0 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6205ffb640 1 -- 172.21.15.73:0/32911710 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620c0bfba0 con 0x7f62100af2a0 2024-09-12T03:37:52.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621014ecd0 con 0x7f62100af2a0 2024-09-12T03:37:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62100ad200 con 0x7f62100af2a0 2024-09-12T03:37:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6205ffb640 1 -- 172.21.15.73:0/32911710 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f620c0bd020 con 0x7f62100af2a0 2024-09-12T03:37:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6205ffb640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61f40678c0 0x7f61f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6205ffb640 1 -- 172.21.15.73:0/32911710 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f620c120c30 con 0x7f62100af2a0 2024-09-12T03:37:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6214fe8640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61f40678c0 0x7f61f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:52.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.433+0000 7f6214fe8640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61f40678c0 0x7f61f4069d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6200006fd0 tx=0x7f6200008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:52.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.437+0000 7f6205ffb640 1 -- 172.21.15.73:0/32911710 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f620c0c4060 con 0x7f62100af2a0 2024-09-12T03:37:52.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.625+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f621006fcd0 con 0x7f62100af2a0 2024-09-12T03:37:52.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6205ffb640 1 -- 172.21.15.73:0/32911710 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7f620c016070 con 0x7f62100af2a0 2024-09-12T03:37:52.629 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:37:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61f40678c0 msgr2=0x7f61f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:52.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61f40678c0 0x7f61f4069d80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6200006fd0 tx=0x7f6200008040 comp rx=0 tx=0).stop 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62100af2a0 msgr2=0x7f621015f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62100af2a0 0x7f621015f5a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f620c019060 tx=0x7f620c01ac90 comp rx=0 tx=0).stop 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 shutdown_connections 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61f40678c0 0x7f61f4069d80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f621015c2a0 0x7f621015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f621015bec0 0x7f621015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 --2- 172.21.15.73:0/32911710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62100af2a0 0x7f621015f5a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 >> 172.21.15.73:0/32911710 conn(0x7f62100b1f90 msgr2=0x7f62100b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 shutdown_connections 2024-09-12T03:37:52.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:52.629+0000 7f6217a4d640 1 -- 172.21.15.73:0/32911710 wait complete. 2024-09-12T03:37:52.646 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:37:52.646 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:37:52.646 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:37:52.646 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:37:52.647 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:52.647 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:37:52.647 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:37:52.647 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:37:52.647 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:52.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.647 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:37:52.654 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:37:52.654 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:37:52.654 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:52.655 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42307sec preferred_lft 42307sec 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:37:52.656 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:37:52.657 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:37:52.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.658 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:37:52.707 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:37:52.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.708 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:37:52.760 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:37:52.760 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:37:52.761 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:37:52.761 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:37:52.762 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:37:52.762 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:37:52.762 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:37:52.762 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:37:52.762 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:37:52.849 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:37:52.882 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:52.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.889 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:37:52.894 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:37:52.894 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:37:52.895 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:52.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:52.895 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:37:52.952 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:37:52.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:52.953 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:53.000 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:37:53.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:37:53.000 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:53.048 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:53.105 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:53.154 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:53.154 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:53.154 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:53.154 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:53.155 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:53.156 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:53.157 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:53.157 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:53.157 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:53.157 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:53.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:53.158 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:53.204 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:37:53.204 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T03:37:53.249 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:53.263 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:53.312 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:53.313 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:53.314 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:53.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:53.315 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:53.325 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:37:53.323+0000 7fc74abed580 -1 init, newargv = 0x5600503f9700 newargc=15 2024-09-12T03:37:53.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35468]: starting ceph client 2024-09-12T03:37:53.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35468]: starting fuse 2024-09-12T03:37:54.431 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:37:54.449 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:37:54.497 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:37:54.497 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:37:54.497 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:37:54.497 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:37:54.497 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:37:54.497 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:37:54.498 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:37:54.499 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:54.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:37:54.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:54.500 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:37:54.500 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:54.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:54.501 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:37:54.548 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:37:54.548 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:37:54.549 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:37:54.550 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:37:54.673 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.35468.asok 2024-09-12T03:37:54.676 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:37:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:37:54.685 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35468.asok 2024-09-12T03:37:54.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:54.685 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35468.asok status 2024-09-12T03:37:54.841 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:37:54.841 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:37:54.841 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:37:54.841 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:37:54.841 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "35468", 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5446, 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:37:54.842 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5446 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 382830536 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 382830536 2024-09-12T03:37:54.843 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.5446 192.168.0.1:0/382830536", 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/382830536", 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 48, 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 86, 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:37:54.844 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:37:54.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:54.855 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:37:54.855 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:54.862 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:37:54.862 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:54.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:54.862 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:54.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:54.915 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-12T03:37:54.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:54.931 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-12T03:37:54.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:37:54.982 INFO:teuthology.orchestra.run.smithi073.stderr:./subdir: ceph.quota.max_files: No such attribute 2024-09-12T03:37:54.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:54.982 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-12T03:37:55.075 INFO:teuthology.orchestra.run.smithi150.stderr:./subdir: ceph.quota.max_files: No such attribute 2024-09-12T03:37:55.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:37:55.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:55.076 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir) 2024-09-12T03:37:55.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:55.090 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-12T03:37:55.143 INFO:teuthology.orchestra.run.smithi073.stdout:10 2024-09-12T03:37:55.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:55.144 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec getfattr --only-values -n ceph.quota.max_files ./subdir) 2024-09-12T03:37:55.155 INFO:teuthology.orchestra.run.smithi150.stdout:10 2024-09-12T03:37:55.155 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:37:55.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:55.251 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:37:55.309 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:37:55.309 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:55.310 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:55.310 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:55.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:37:55.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf8157640 1 Processor -- start 2024-09-12T03:37:55.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf8157640 1 -- start start 2024-09-12T03:37:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf8157640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 0x7f7bf0165f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf8157640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf00aede0 con 0x7f7bf01520a0 2024-09-12T03:37:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf8157640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf015fa10 con 0x7f7bf0070020 2024-09-12T03:37:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf8157640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf0152480 con 0x7f7bf015f3a0 2024-09-12T03:37:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf5ef3640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7bf01520a0 0x7f7bf006f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49646/0 (socket says 172.21.15.73:49646) 2024-09-12T03:37:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf5ef3640 1 -- 172.21.15.73:0/812266450 learned_addr learned my addr 172.21.15.73:0/812266450 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:55.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 0x7f7bf0165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364493765 0 0) 0x7f7bf00aede0 con 0x7f7bf01520a0 2024-09-12T03:37:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bdc003530 con 0x7f7bf01520a0 2024-09-12T03:37:55.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 668035819 0 0) 0x7f7bdc003530 con 0x7f7bf01520a0 2024-09-12T03:37:55.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 msgr2=0x7f7bf0165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 0x7f7bf0165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 >> v1:172.21.15.150:6789/0 conn(0x7f7bf0070020 legacy=0x7f7bf015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf0074250 con 0x7f7bf01520a0 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f7bec001680 con 0x7f7bf01520a0 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 >> v1:172.21.15.73:6789/0 conn(0x7f7bf01520a0 legacy=0x7f7bf006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 0x7f7bdc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bdc003f70 0x7f7bdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bdc004d50 0x7f7bdc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc00dc90 con 0x7f7bdc004d50 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc00de40 con 0x7f7bdc003f70 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7bdc00e040 con 0x7f7bf015f3a0 2024-09-12T03:37:55.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bdc004d50 0x7f7bdc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf56f2640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bdc003f70 0x7f7bdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf5ef3640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 0x7f7bdc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf66f4640 1 -- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 msgr2=0x7f7bdc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf015f3a0 0x7f7bdc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf66f4640 1 -- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bdc003f70 msgr2=0x7f7bdc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bdc003f70 0x7f7bdc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.493+0000 7f7bf66f4640 1 -- 172.21.15.73:0/812266450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc003530 con 0x7f7bdc004d50 2024-09-12T03:37:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bdc004d50 0x7f7bdc0051d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009fc0 tx=0x7f7be801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b51c012baeda95b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80b2070 con 0x7f7bdc004d50 2024-09-12T03:37:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80a5c90 con 0x7f7bdc004d50 2024-09-12T03:37:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf4ef1640 1 -- 172.21.15.73:0/812266450 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8009c10 con 0x7f7bdc004d50 2024-09-12T03:37:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 -- 172.21.15.73:0/812266450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bdc004d50 msgr2=0x7f7bdc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 --2- 172.21.15.73:0/812266450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bdc004d50 0x7f7bdc0051d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009fc0 tx=0x7f7be801cc80 comp rx=0 tx=0).stop 2024-09-12T03:37:55.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf66f4640 1 -- 172.21.15.73:0/812266450 reap_dead start 2024-09-12T03:37:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 -- 172.21.15.73:0/812266450 shutdown_connections 2024-09-12T03:37:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 -- 172.21.15.73:0/812266450 >> 172.21.15.73:0/812266450 conn(0x7f7bf00b1f90 msgr2=0x7f7bf00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 -- 172.21.15.73:0/812266450 shutdown_connections 2024-09-12T03:37:55.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 -- 172.21.15.73:0/812266450 wait complete. 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 Processor -- start 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.497+0000 7f7bf8157640 1 -- start start 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf0099a40 0x7f7bf014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf014d740 0x7f7bf00b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bf00b3ec0 0x7f7bf01f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0073a50 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0073770 con 0x7f7bf014d740 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf0073d30 con 0x7f7bf0099a40 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bf00b3ec0 0x7f7bf01f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bf00b3ec0 0x7f7bf01f44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56812/0 (socket says 172.21.15.73:56812) 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 -- 172.21.15.73:0/1167276356 learned_addr learned my addr 172.21.15.73:0/1167276356 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf56f2640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf014d740 0x7f7bf00b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf5ef3640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf0099a40 0x7f7bf014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 -- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf0099a40 msgr2=0x7f7bf014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf0099a40 0x7f7bf014e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 -- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf014d740 msgr2=0x7f7bf00b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf014d740 0x7f7bf00b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 -- 172.21.15.73:0/1167276356 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf014c440 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf56f2640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf014d740 0x7f7bf00b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf66f4640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bf00b3ec0 0x7f7bf01f44c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7be80b0040 tx=0x7f7be8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7be67fc640 1 -- 172.21.15.73:0/1167276356 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80bd070 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7be67fc640 1 -- 172.21.15.73:0/1167276356 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be80a5a90 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf014c720 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7be67fc640 1 -- 172.21.15.73:0/1167276356 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80b2040 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf0099e20 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf00b4340 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7be67fc640 1 -- 172.21.15.73:0/1167276356 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7be80c0070 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7be67fc640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7bd40678c0 0x7f7bd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7be67fc640 1 -- 172.21.15.73:0/1167276356 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f7be811fc00 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf5ef3640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7bd40678c0 0x7f7bd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:55.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.501+0000 7f7bf5ef3640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7bd40678c0 0x7f7bd4069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7bec000c10 tx=0x7f7bec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:55.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.505+0000 7f7be67fc640 1 -- 172.21.15.73:0/1167276356 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7be8126080 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7bf0068e50 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7be67fc640 1 -- 172.21.15.73:0/1167276356 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7f7be8016990 con 0x7f7bf00b3ec0 2024-09-12T03:37:55.686 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7bd40678c0 msgr2=0x7f7bd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7bd40678c0 0x7f7bd4069d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7bec000c10 tx=0x7f7bec009040 comp rx=0 tx=0).stop 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bf00b3ec0 msgr2=0x7f7bf01f44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bf00b3ec0 0x7f7bf01f44c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7be80b0040 tx=0x7f7be8009750 comp rx=0 tx=0).stop 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 shutdown_connections 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7bd40678c0 0x7f7bd4069d80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bf00b3ec0 0x7f7bf01f44c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7bf014d740 0x7f7bf00b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 --2- 172.21.15.73:0/1167276356 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7bf0099a40 0x7f7bf014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 >> 172.21.15.73:0/1167276356 conn(0x7f7bf00b1f90 msgr2=0x7f7bf00b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:55.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 shutdown_connections 2024-09-12T03:37:55.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:55.685+0000 7f7bf8157640 1 -- 172.21.15.73:0/1167276356 wait complete. 2024-09-12T03:37:55.706 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:37:55.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:55.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T03:37:55.717 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[43199]: fuse finished with error 0 and tester_r 0 2024-09-12T03:37:55.721 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:37:55.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:55.722 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:37:55.866 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:55.866 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:55.866 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:55.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:37:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe609029640 1 Processor -- start 2024-09-12T03:37:56.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe609029640 1 -- start start 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe609029640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe60415e6f0 0x7fe60406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe609029640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6040b3720 0x7fe6040cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe609029640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe604162290 con 0x7fe6040cf780 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe609029640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe604162570 con 0x7fe6040b3720 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe609029640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe604162850 con 0x7fe60415e6f0 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe60259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6040b3720 0x7fe6040cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe60359e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe6040cf780 0x7fe6040ca690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49654/0 (socket says 172.21.15.73:49654) 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe60359e640 1 -- 172.21.15.73:0/3628963597 learned_addr learned my addr 172.21.15.73:0/3628963597 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:56.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe602d9d640 1 --2- 172.21.15.73:0/3628963597 >> v2:172.21.15.150:3300/0 conn(0x7fe60415e6f0 0x7fe60406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe60259c640 1 -- 172.21.15.73:0/3628963597 >> v2:172.21.15.150:3300/0 conn(0x7fe60415e6f0 msgr2=0x7fe60406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe60259c640 1 --2- 172.21.15.73:0/3628963597 >> v2:172.21.15.150:3300/0 conn(0x7fe60415e6f0 0x7fe60406c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe60259c640 1 -- 172.21.15.73:0/3628963597 >> v1:172.21.15.73:6789/0 conn(0x7fe6040cf780 legacy=0x7fe6040ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe601d9b640 1 -- 172.21.15.73:0/3628963597 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3171600430 0 0) 0x7fe604162290 con 0x7fe6040cf780 2024-09-12T03:37:56.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.005+0000 7fe60259c640 1 -- 172.21.15.73:0/3628963597 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe604162b30 con 0x7fe6040b3720 2024-09-12T03:37:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe60259c640 1 --2- 172.21.15.73:0/3628963597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe6040cf240 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe6040cee30 tx=0x7fe5ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46043303e352d7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe601d9b640 1 -- 172.21.15.73:0/3628963597 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0b0070 con 0x7fe6040b3720 2024-09-12T03:37:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe601d9b640 1 -- 172.21.15.73:0/3628963597 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0ab600 con 0x7fe6040b3720 2024-09-12T03:37:56.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe601d9b640 1 -- 172.21.15.73:0/3628963597 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0ab9d0 con 0x7fe6040b3720 2024-09-12T03:37:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- 172.21.15.73:0/3628963597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 msgr2=0x7fe6040cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 --2- 172.21.15.73:0/3628963597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe6040cf240 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe6040cee30 tx=0x7fe5ec01c480 comp rx=0 tx=0).stop 2024-09-12T03:37:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- 172.21.15.73:0/3628963597 shutdown_connections 2024-09-12T03:37:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 --2- 172.21.15.73:0/3628963597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe6040cf240 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 --2- 172.21.15.73:0/3628963597 >> v2:172.21.15.150:3300/0 conn(0x7fe60415e6f0 0x7fe60406c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- 172.21.15.73:0/3628963597 >> 172.21.15.73:0/3628963597 conn(0x7fe60409aa00 msgr2=0x7fe6040b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- 172.21.15.73:0/3628963597 shutdown_connections 2024-09-12T03:37:56.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- 172.21.15.73:0/3628963597 wait complete. 2024-09-12T03:37:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 Processor -- start 2024-09-12T03:37:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- start start 2024-09-12T03:37:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe60415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6040cf780 0x7fe60415cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60415e6f0 0x7fe6041598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040af510 con 0x7fe6040b3720 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040cfbd0 con 0x7fe6040cf780 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe609029640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe60416b430 con 0x7fe60415e6f0 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe602d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe60415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe602d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe60415abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56836/0 (socket says 172.21.15.73:56836) 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.009+0000 7fe602d9d640 1 -- 172.21.15.73:0/4129203964 learned_addr learned my addr 172.21.15.73:0/4129203964 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe60259c640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6040cf780 0x7fe60415cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe602d9d640 1 -- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60415e6f0 msgr2=0x7fe6041598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe60359e640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60415e6f0 0x7fe6041598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe602d9d640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60415e6f0 0x7fe6041598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe602d9d640 1 -- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6040cf780 msgr2=0x7fe60415cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe602d9d640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6040cf780 0x7fe60415cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe602d9d640 1 -- 172.21.15.73:0/4129203964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6040cc0b0 con 0x7fe6040b3720 2024-09-12T03:37:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe602d9d640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe60415abc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400d620 tx=0x7fe5f400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe5fb7fe640 1 -- 172.21.15.73:0/4129203964 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400b620 con 0x7fe6040b3720 2024-09-12T03:37:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe5fb7fe640 1 -- 172.21.15.73:0/4129203964 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f4019070 con 0x7fe6040b3720 2024-09-12T03:37:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe5fb7fe640 1 -- 172.21.15.73:0/4129203964 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400ba20 con 0x7fe6040b3720 2024-09-12T03:37:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6040cc350 con 0x7fe6040b3720 2024-09-12T03:37:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6040cc910 con 0x7fe6040b3720 2024-09-12T03:37:56.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6040cf240 con 0x7fe6040b3720 2024-09-12T03:37:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe5fb7fe640 1 -- 172.21.15.73:0/4129203964 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5f400bbc0 con 0x7fe6040b3720 2024-09-12T03:37:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe5fb7fe640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678f0 0x7fe5e4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe5fb7fe640 1 -- 172.21.15.73:0/4129203964 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fe5f40862a0 con 0x7fe6040b3720 2024-09-12T03:37:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe60259c640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678f0 0x7fe5e4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.013+0000 7fe60259c640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678f0 0x7fe5e4069db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0ad000 tx=0x7fe5ec0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.017+0000 7fe5fb7fe640 1 -- 172.21.15.73:0/4129203964 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe5f4056c40 con 0x7fe6040b3720 2024-09-12T03:37:56.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe60415ebf0 con 0x7fe6040b3720 2024-09-12T03:37:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe5fb7fe640 1 -- 172.21.15.73:0/4129203964 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) ==== 80+0+0 (secure 0 0 0) 0x7fe5f4056540 con 0x7fe6040b3720 2024-09-12T03:37:56.194 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678f0 msgr2=0x7fe5e4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678f0 0x7fe5e4069db0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0ad000 tx=0x7fe5ec0a6000 comp rx=0 tx=0).stop 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 msgr2=0x7fe60415abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe60415abc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400d620 tx=0x7fe5f400dae0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 shutdown_connections 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678f0 0x7fe5e4069db0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe60415e6f0 0x7fe6041598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6040cf780 0x7fe60415cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 --2- 172.21.15.73:0/4129203964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6040b3720 0x7fe60415abc0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 >> 172.21.15.73:0/4129203964 conn(0x7fe60409aa00 msgr2=0x7fe604070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 shutdown_connections 2024-09-12T03:37:56.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.193+0000 7fe609029640 1 -- 172.21.15.73:0/4129203964 wait complete. 2024-09-12T03:37:56.213 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:37:56.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:56.213 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:37:56.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35468]: fuse finished with error 0 and tester_r 0 2024-09-12T03:37:56.228 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:37:56.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:56.228 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:37:56.316 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:56.317 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:37:56.317 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:56.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:37:56.323 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:37:56.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:56.323 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T03:37:56.369 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T03:37:56.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:37:56.371 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:37:56.371 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:37:56.371 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:37:56.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:37:56.377 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:37:56.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:37:56.378 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T03:37:56.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:37:56.425 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T03:37:56.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:56.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f345667b640 1 Processor -- start 2024-09-12T03:37:56.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f345667b640 1 -- start start 2024-09-12T03:37:56.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f345667b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f345015bec0 0x7f34500ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f345667b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34500af470 0x7f345006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f345667b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34500b3290 con 0x7f345015c2a0 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f345667b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f34500b3570 con 0x7f345015bec0 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f345667b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f34500b3850 con 0x7f34500af470 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f344ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f345015bec0 0x7f34500ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f344ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f345015bec0 0x7f34500ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56852/0 (socket says 172.21.15.73:56852) 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f344ffff640 1 -- 172.21.15.73:0/41829705 learned_addr learned my addr 172.21.15.73:0/41829705 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f3454c18640 1 --2- 172.21.15.73:0/41829705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34500af470 0x7f345006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f344ffff640 1 -- 172.21.15.73:0/41829705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34500af470 msgr2=0x7f345006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f344ffff640 1 --2- 172.21.15.73:0/41829705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34500af470 0x7f345006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f344ffff640 1 -- 172.21.15.73:0/41829705 >> v1:172.21.15.150:6789/0 conn(0x7f345015c2a0 legacy=0x7f34500aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:56.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f344ffff640 1 -- 172.21.15.73:0/41829705 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34500b3b30 con 0x7f345015bec0 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.549+0000 7f3454c18640 1 --2- 172.21.15.73:0/41829705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34500af470 0x7f345006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f344ffff640 1 --2- 172.21.15.73:0/41829705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015bec0 0x7f34500ad200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3440009870 tx=0x7f344001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cee88dd6d03f2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f344effd640 1 -- 172.21.15.73:0/41829705 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400ab620 con 0x7f345015bec0 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f344effd640 1 -- 172.21.15.73:0/41829705 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34400b0070 con 0x7f345015bec0 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f344effd640 1 -- 172.21.15.73:0/41829705 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400ab9e0 con 0x7f345015bec0 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- 172.21.15.73:0/41829705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015bec0 msgr2=0x7f34500ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 --2- 172.21.15.73:0/41829705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015bec0 0x7f34500ad200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3440009870 tx=0x7f344001c460 comp rx=0 tx=0).stop 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- 172.21.15.73:0/41829705 shutdown_connections 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 --2- 172.21.15.73:0/41829705 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f34500af470 0x7f345006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 --2- 172.21.15.73:0/41829705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f345015bec0 0x7f34500ad200 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- 172.21.15.73:0/41829705 >> 172.21.15.73:0/41829705 conn(0x7f34500b1f90 msgr2=0x7f34500b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- 172.21.15.73:0/41829705 shutdown_connections 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- 172.21.15.73:0/41829705 wait complete. 2024-09-12T03:37:56.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 Processor -- start 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- start start 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500af470 0x7f345015c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f345015bec0 0x7f3450157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345015c2a0 0x7f34501456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f345006ed50 con 0x7f34500af470 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f34500ad740 con 0x7f345015bec0 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f345667b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f345006eed0 con 0x7f345015c2a0 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f344ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500af470 0x7f345015c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f344ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500af470 0x7f345015c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56866/0 (socket says 172.21.15.73:56866) 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.553+0000 7f344ffff640 1 -- 172.21.15.73:0/1934837687 learned_addr learned my addr 172.21.15.73:0/1934837687 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344ffff640 1 -- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345015c2a0 msgr2=0x7f34501456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f3454c18640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345015c2a0 0x7f34501456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344ffff640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345015c2a0 0x7f34501456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344f7fe640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f345015bec0 0x7f3450157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344ffff640 1 -- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f345015bec0 msgr2=0x7f3450157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344ffff640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f345015bec0 0x7f3450157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344ffff640 1 -- 172.21.15.73:0/1934837687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34501581b0 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344ffff640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500af470 0x7f345015c6e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad040 tx=0x7f344001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344cff9640 1 -- 172.21.15.73:0/1934837687 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400abd90 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344cff9640 1 -- 172.21.15.73:0/1934837687 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34400be3f0 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345015cd30 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344cff9640 1 -- 172.21.15.73:0/1934837687 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400be7e0 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345015f3e0 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f345006f280 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344cff9640 1 -- 172.21.15.73:0/1934837687 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34400b43f0 con 0x7f34500af470 2024-09-12T03:37:56.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344cff9640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f343c0678c0 0x7f343c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344cff9640 1 -- 172.21.15.73:0/1934837687 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f344011fe60 con 0x7f34500af470 2024-09-12T03:37:56.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344f7fe640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f343c0678c0 0x7f343c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.557+0000 7f344f7fe640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f343c0678c0 0x7f343c069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f345015a590 tx=0x7f3444008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.561+0000 7f344cff9640 1 -- 172.21.15.73:0/1934837687 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f34400c4060 con 0x7f34500af470 2024-09-12T03:37:56.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.757+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f345006fcd0 con 0x7f34500af470 2024-09-12T03:37:56.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.757+0000 7f344cff9640 1 -- 172.21.15.73:0/1934837687 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5222 (secure 0 0 0) 0x7f34501581b0 con 0x7f34500af470 2024-09-12T03:37:56.761 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:56.761 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"btime":"2024-09-12T03:37:42:437910+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/54392956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54392956},{"type":"v1","addr":"172.21.15.150:6835","nonce":54392956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6240,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/583240547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":583240547},{"type":"v1","addr":"172.21.15.73:6835","nonce":583240547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3438655973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3438655973},{"type":"v1","addr":"172.21.15.73:6837","nonce":3438655973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:39.761504+0000","modified":"2024-09-12T03:37:41.797723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6833/3979723408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3979723408},{"type":"v1","addr":"172.21.15.150:6833","nonce":3979723408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":6}]} 2024-09-12T03:37:56.761 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 48 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f343c0678c0 msgr2=0x7f343c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f343c0678c0 0x7f343c069d80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f345015a590 tx=0x7f3444008040 comp rx=0 tx=0).stop 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500af470 msgr2=0x7f345015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500af470 0x7f345015c6e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f34400ad040 tx=0x7f344001aca0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 shutdown_connections 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f343c0678c0 0x7f343c069d80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f345015c2a0 0x7f34501456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f345015bec0 0x7f3450157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 --2- 172.21.15.73:0/1934837687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34500af470 0x7f345015c6e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 >> 172.21.15.73:0/1934837687 conn(0x7f34500b1f90 msgr2=0x7f3450159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:56.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 shutdown_connections 2024-09-12T03:37:56.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.761+0000 7f345667b640 1 -- 172.21.15.73:0/1934837687 wait complete. 2024-09-12T03:37:56.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:56.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.885+0000 7fe0851fe640 1 Processor -- start 2024-09-12T03:37:56.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.885+0000 7fe0851fe640 1 -- start start 2024-09-12T03:37:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe0851fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 0x7fe0800d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe0851fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0800d2e90 0x7fe0800cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe0851fe640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0800d32b0 con 0x7fe0800cf450 2024-09-12T03:37:56.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe0851fe640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe0800d0300 con 0x7fe0800d2e90 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe0851fe640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe08006e6c0 con 0x7fe080161a60 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0800d2e90 0x7fe0800cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0800d2e90 0x7fe0800cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56868/0 (socket says 172.21.15.73:56868) 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 -- 172.21.15.73:0/3333716056 learned_addr learned my addr 172.21.15.73:0/3333716056 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 -- 172.21.15.73:0/3333716056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 msgr2=0x7fe0800d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 --2- 172.21.15.73:0/3333716056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 0x7fe0800d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 -- 172.21.15.73:0/3333716056 >> v1:172.21.15.150:6789/0 conn(0x7fe0800cf450 legacy=0x7fe0800d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:56.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 -- 172.21.15.73:0/3333716056 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0800b0f60 con 0x7fe0800d2e90 2024-09-12T03:37:56.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07e59c640 1 --2- 172.21.15.73:0/3333716056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800cef10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe070009e50 tx=0x7fe07001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a233bacf5ba19a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07dd9b640 1 -- 172.21.15.73:0/3333716056 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0800d1930 con 0x7fe0800d2e90 2024-09-12T03:37:56.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07dd9b640 1 -- 172.21.15.73:0/3333716056 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0700a57b0 con 0x7fe0800d2e90 2024-09-12T03:37:56.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.889+0000 7fe07dd9b640 1 -- 172.21.15.73:0/3333716056 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0700a5b80 con 0x7fe0800d2e90 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/3333716056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 msgr2=0x7fe0800cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 --2- 172.21.15.73:0/3333716056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800cef10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe070009e50 tx=0x7fe07001c930 comp rx=0 tx=0).stop 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/3333716056 shutdown_connections 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 --2- 172.21.15.73:0/3333716056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800cef10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 --2- 172.21.15.73:0/3333716056 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 0x7fe0800d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/3333716056 >> 172.21.15.73:0/3333716056 conn(0x7fe08008bf90 msgr2=0x7fe08009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/3333716056 shutdown_connections 2024-09-12T03:37:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/3333716056 wait complete. 2024-09-12T03:37:56.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 Processor -- start 2024-09-12T03:37:56.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- start start 2024-09-12T03:37:56.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0800cf450 0x7fe0800b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 0x7fe0800cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0800cf900 con 0x7fe0800d2e90 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe08006d190 con 0x7fe0800cf450 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe0800cfa80 con 0x7fe080161a60 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56878/0 (socket says 172.21.15.73:56878) 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 -- 172.21.15.73:0/95739574 learned_addr learned my addr 172.21.15.73:0/95739574 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 -- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 msgr2=0x7fe0800cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07f59e640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 0x7fe0800cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07ed9d640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0800cf450 0x7fe0800b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 0x7fe0800cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 -- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0800cf450 msgr2=0x7fe0800b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0800cf450 0x7fe0800b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 -- 172.21.15.73:0/95739574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08015b5e0 con 0x7fe0800d2e90 2024-09-12T03:37:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe07e59c640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800b9940 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe07001afe0 tx=0x7fe0700196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0777fe640 1 -- 172.21.15.73:0/95739574 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0700bc020 con 0x7fe0800d2e90 2024-09-12T03:37:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0777fe640 1 -- 172.21.15.73:0/95739574 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0700b8670 con 0x7fe0800d2e90 2024-09-12T03:37:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08015b8c0 con 0x7fe0800d2e90 2024-09-12T03:37:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0777fe640 1 -- 172.21.15.73:0/95739574 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0700b8a40 con 0x7fe0800d2e90 2024-09-12T03:37:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08015c160 con 0x7fe0800d2e90 2024-09-12T03:37:56.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.893+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08015ba90 con 0x7fe0800d2e90 2024-09-12T03:37:56.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.897+0000 7fe0777fe640 1 -- 172.21.15.73:0/95739574 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0700bf020 con 0x7fe0800d2e90 2024-09-12T03:37:56.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.897+0000 7fe0777fe640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0600678c0 0x7fe060069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:56.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.897+0000 7fe07ed9d640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0600678c0 0x7fe060069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:56.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.897+0000 7fe0777fe640 1 -- 172.21.15.73:0/95739574 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fe070121110 con 0x7fe0800d2e90 2024-09-12T03:37:56.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.897+0000 7fe07ed9d640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0600678c0 0x7fe060069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe0800c7a80 tx=0x7fe078008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:56.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:56.901+0000 7fe0777fe640 1 -- 172.21.15.73:0/95739574 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe0700c6030 con 0x7fe0800d2e90 2024-09-12T03:37:57.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.081+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0800cef10 con 0x7fe0800d2e90 2024-09-12T03:37:57.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.081+0000 7fe0777fe640 1 -- 172.21.15.73:0/95739574 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5222 (secure 0 0 0) 0x7fe0700165e0 con 0x7fe0800d2e90 2024-09-12T03:37:57.084 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:57.085 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"btime":"2024-09-12T03:37:42:437910+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/54392956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54392956},{"type":"v1","addr":"172.21.15.150:6835","nonce":54392956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6240,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/583240547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":583240547},{"type":"v1","addr":"172.21.15.73:6835","nonce":583240547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3438655973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3438655973},{"type":"v1","addr":"172.21.15.73:6837","nonce":3438655973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:39.761504+0000","modified":"2024-09-12T03:37:41.797723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6833/3979723408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3979723408},{"type":"v1","addr":"172.21.15.150:6833","nonce":3979723408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":6}]} 2024-09-12T03:37:57.085 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 48 2024-09-12T03:37:57.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0600678c0 msgr2=0x7fe060069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0600678c0 0x7fe060069d80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe0800c7a80 tx=0x7fe078008040 comp rx=0 tx=0).stop 2024-09-12T03:37:57.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 msgr2=0x7fe0800b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800b9940 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe07001afe0 tx=0x7fe0700196d0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 shutdown_connections 2024-09-12T03:37:57.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe0600678c0 0x7fe060069d80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0800d2e90 0x7fe0800b9940 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe080161a60 0x7fe0800cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 --2- 172.21.15.73:0/95739574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0800cf450 0x7fe0800b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 >> 172.21.15.73:0/95739574 conn(0x7fe08008bf90 msgr2=0x7fe0800b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:57.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 shutdown_connections 2024-09-12T03:37:57.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.085+0000 7fe0851fe640 1 -- 172.21.15.73:0/95739574 wait complete. 2024-09-12T03:37:57.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:57.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.217+0000 7f63b562d640 1 Processor -- start 2024-09-12T03:37:57.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.217+0000 7f63b562d640 1 -- start start 2024-09-12T03:37:57.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f63b01520a0 0x7f63b006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b015ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63b015f1d0 0x7f63b0071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f63b0152480 con 0x7f63b015f1d0 2024-09-12T03:37:57.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f63b0070250 con 0x7f63b01520a0 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f63b00aede0 con 0x7f63b006fe50 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63b015f1d0 0x7f63b0071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63b015f1d0 0x7f63b0071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56890/0 (socket says 172.21.15.73:56890) 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 -- 172.21.15.73:0/2378551912 learned_addr learned my addr 172.21.15.73:0/2378551912 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63ae7fc640 1 --2- 172.21.15.73:0/2378551912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b015ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63aeffd640 1 --2- 172.21.15.73:0/2378551912 >> v2:172.21.15.150:3300/0 conn(0x7f63b01520a0 0x7f63b006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 -- 172.21.15.73:0/2378551912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 msgr2=0x7f63b015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 --2- 172.21.15.73:0/2378551912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b015ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 -- 172.21.15.73:0/2378551912 >> v2:172.21.15.150:3300/0 conn(0x7f63b01520a0 msgr2=0x7f63b006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 --2- 172.21.15.73:0/2378551912 >> v2:172.21.15.150:3300/0 conn(0x7f63b01520a0 0x7f63b006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 -- 172.21.15.73:0/2378551912 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b015fa10 con 0x7f63b015f1d0 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63ae7fc640 1 --2- 172.21.15.73:0/2378551912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:57.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63aeffd640 1 --2- 172.21.15.73:0/2378551912 >> v2:172.21.15.150:3300/0 conn(0x7f63b01520a0 0x7f63b006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:57.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63af7fe640 1 --2- 172.21.15.73:0/2378551912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b015f1d0 0x7f63b0071f10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f63b0071710 tx=0x7f63a801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfe6c91c91d8a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63adffb640 1 -- 172.21.15.73:0/2378551912 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80a5590 con 0x7f63b015f1d0 2024-09-12T03:37:57.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63adffb640 1 -- 172.21.15.73:0/2378551912 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a80a5730 con 0x7f63b015f1d0 2024-09-12T03:37:57.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63adffb640 1 -- 172.21.15.73:0/2378551912 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80a5b00 con 0x7f63b015f1d0 2024-09-12T03:37:57.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- 172.21.15.73:0/2378551912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b015f1d0 msgr2=0x7f63b0071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 --2- 172.21.15.73:0/2378551912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b015f1d0 0x7f63b0071f10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f63b0071710 tx=0x7f63a801c710 comp rx=0 tx=0).stop 2024-09-12T03:37:57.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- 172.21.15.73:0/2378551912 shutdown_connections 2024-09-12T03:37:57.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 --2- 172.21.15.73:0/2378551912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b015f1d0 0x7f63b0071f10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 --2- 172.21.15.73:0/2378551912 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b015ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 --2- 172.21.15.73:0/2378551912 >> v2:172.21.15.150:3300/0 conn(0x7f63b01520a0 0x7f63b006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- 172.21.15.73:0/2378551912 >> 172.21.15.73:0/2378551912 conn(0x7f63b00b1f90 msgr2=0x7f63b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:57.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- 172.21.15.73:0/2378551912 shutdown_connections 2024-09-12T03:37:57.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.221+0000 7f63b562d640 1 -- 172.21.15.73:0/2378551912 wait complete. 2024-09-12T03:37:57.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 Processor -- start 2024-09-12T03:37:57.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 -- start start 2024-09-12T03:37:57.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b009a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b01520a0 0x7f63b014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b015f1d0 0x7f63b00cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0073d30 con 0x7f63b01520a0 2024-09-12T03:37:57.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0073a50 con 0x7f63b015f1d0 2024-09-12T03:37:57.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f63b015f680 con 0x7f63b006fe50 2024-09-12T03:37:57.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b01520a0 0x7f63b014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b01520a0 0x7f63b014d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56902/0 (socket says 172.21.15.73:56902) 2024-09-12T03:37:57.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 -- 172.21.15.73:0/1101044462 learned_addr learned my addr 172.21.15.73:0/1101044462 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:57.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63aeffd640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b009a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63af7fe640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b015f1d0 0x7f63b00cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 -- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 msgr2=0x7f63b009a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b009a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 -- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b015f1d0 msgr2=0x7f63b00cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b015f1d0 0x7f63b00cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 -- 172.21.15.73:0/1101044462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b00ce4d0 con 0x7f63b01520a0 2024-09-12T03:37:57.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63ae7fc640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b01520a0 0x7f63b014d690 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c820 tx=0x7f63a400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63977fe640 1 -- 172.21.15.73:0/1101044462 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4015070 con 0x7f63b01520a0 2024-09-12T03:37:57.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63977fe640 1 -- 172.21.15.73:0/1101044462 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a4007a30 con 0x7f63b01520a0 2024-09-12T03:37:57.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b0164370 con 0x7f63b01520a0 2024-09-12T03:37:57.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63977fe640 1 -- 172.21.15.73:0/1101044462 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a4007e20 con 0x7f63b01520a0 2024-09-12T03:37:57.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b0164c10 con 0x7f63b01520a0 2024-09-12T03:37:57.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b0164540 con 0x7f63b01520a0 2024-09-12T03:37:57.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.225+0000 7f63977fe640 1 -- 172.21.15.73:0/1101044462 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63a4018070 con 0x7f63b01520a0 2024-09-12T03:37:57.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.229+0000 7f63977fe640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f639c0678c0 0x7f639c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.229+0000 7f63aeffd640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f639c0678c0 0x7f639c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.229+0000 7f63977fe640 1 -- 172.21.15.73:0/1101044462 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f63a4085cf0 con 0x7f63b01520a0 2024-09-12T03:37:57.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.229+0000 7f63aeffd640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f639c0678c0 0x7f639c069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f63a000a9a0 tx=0x7f63a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.233+0000 7f63977fe640 1 -- 172.21.15.73:0/1101044462 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63a408a070 con 0x7f63b01520a0 2024-09-12T03:37:57.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.381+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63b006e540 con 0x7f63b01520a0 2024-09-12T03:37:57.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.385+0000 7f63977fe640 1 -- 172.21.15.73:0/1101044462 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16957 (secure 0 0 0) 0x7f63a40566a0 con 0x7f63b01520a0 2024-09-12T03:37:57.388 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:57.388 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":86,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:41.394697+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:37.412919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:38.757412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f639c0678c0 msgr2=0x7f639c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f639c0678c0 0x7f639c069d80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f63a000a9a0 tx=0x7f63a0008040 comp rx=0 tx=0).stop 2024-09-12T03:37:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b01520a0 msgr2=0x7f63b014d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b01520a0 0x7f63b014d690 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c820 tx=0x7f63a400cce0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 shutdown_connections 2024-09-12T03:37:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f639c0678c0 0x7f639c069d80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63b01520a0 0x7f63b014d690 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63b015f1d0 0x7f63b00cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 --2- 172.21.15.73:0/1101044462 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63b006fe50 0x7f63b009a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 >> 172.21.15.73:0/1101044462 conn(0x7f63b00b1f90 msgr2=0x7f63b00adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 shutdown_connections 2024-09-12T03:37:57.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.389+0000 7f63b562d640 1 -- 172.21.15.73:0/1101044462 wait complete. 2024-09-12T03:37:57.406 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:37:57.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.521+0000 7efe9e702640 1 Processor -- start 2024-09-12T03:37:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.521+0000 7efe9e702640 1 -- start start 2024-09-12T03:37:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe9e702640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe9815bec0 0x7efe980ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe9e702640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815c2a0 0x7efe980aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe9e702640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe980b3290 con 0x7efe980af2a0 2024-09-12T03:37:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe9e702640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7efe980b3570 con 0x7efe9815bec0 2024-09-12T03:37:57.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe9e702640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efe980b3850 con 0x7efe9815c2a0 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe9815bec0 0x7efe980ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe9815bec0 0x7efe980ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56906/0 (socket says 172.21.15.73:56906) 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 -- 172.21.15.73:0/140204955 learned_addr learned my addr 172.21.15.73:0/140204955 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe977fe640 1 --2- 172.21.15.73:0/140204955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815c2a0 0x7efe980aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 -- 172.21.15.73:0/140204955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815c2a0 msgr2=0x7efe980aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 --2- 172.21.15.73:0/140204955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815c2a0 0x7efe980aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 -- 172.21.15.73:0/140204955 >> v1:172.21.15.150:6789/0 conn(0x7efe980af2a0 legacy=0x7efe9815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 -- 172.21.15.73:0/140204955 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe980b3b30 con 0x7efe9815bec0 2024-09-12T03:37:57.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe977fe640 1 --2- 172.21.15.73:0/140204955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815c2a0 0x7efe980aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:57.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe97fff640 1 --2- 172.21.15.73:0/140204955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815bec0 0x7efe980ad200 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009870 tx=0x7efe8c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db7e3f810d22a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe96ffd640 1 -- 172.21.15.73:0/140204955 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0a95f0 con 0x7efe9815bec0 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe96ffd640 1 -- 172.21.15.73:0/140204955 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe8c0a9790 con 0x7efe9815bec0 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.525+0000 7efe96ffd640 1 -- 172.21.15.73:0/140204955 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8c0a9b60 con 0x7efe9815bec0 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- 172.21.15.73:0/140204955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815bec0 msgr2=0x7efe980ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 --2- 172.21.15.73:0/140204955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815bec0 0x7efe980ad200 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009870 tx=0x7efe8c01c530 comp rx=0 tx=0).stop 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- 172.21.15.73:0/140204955 shutdown_connections 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 --2- 172.21.15.73:0/140204955 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815c2a0 0x7efe980aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 --2- 172.21.15.73:0/140204955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815bec0 0x7efe980ad200 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- 172.21.15.73:0/140204955 >> 172.21.15.73:0/140204955 conn(0x7efe980b1f90 msgr2=0x7efe980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- 172.21.15.73:0/140204955 shutdown_connections 2024-09-12T03:37:57.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- 172.21.15.73:0/140204955 wait complete. 2024-09-12T03:37:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 Processor -- start 2024-09-12T03:37:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- start start 2024-09-12T03:37:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe980af2a0 0x7efe9815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815bec0 0x7efe981f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815c2a0 0x7efe98154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efe980af6b0 con 0x7efe9815c2a0 2024-09-12T03:37:57.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7efe980ad740 con 0x7efe980af2a0 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7efe98169000 con 0x7efe9815bec0 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815c2a0 0x7efe98154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815c2a0 0x7efe98154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56914/0 (socket says 172.21.15.73:56914) 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 -- 172.21.15.73:0/897838269 learned_addr learned my addr 172.21.15.73:0/897838269 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe977fe640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815bec0 0x7efe981f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe97fff640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe980af2a0 0x7efe9815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 -- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815bec0 msgr2=0x7efe981f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815bec0 0x7efe981f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 -- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe980af2a0 msgr2=0x7efe9815c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe980af2a0 0x7efe9815c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 -- 172.21.15.73:0/897838269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9815cbe0 con 0x7efe9815c2a0 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe97fff640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe980af2a0 0x7efe9815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:57.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9cc9f640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815c2a0 0x7efe98154500 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c740 tx=0x7efe9000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe94ff9640 1 -- 172.21.15.73:0/897838269 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe90016020 con 0x7efe9815c2a0 2024-09-12T03:37:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe94ff9640 1 -- 172.21.15.73:0/897838269 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9000ce50 con 0x7efe9815c2a0 2024-09-12T03:37:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9815ce80 con 0x7efe9815c2a0 2024-09-12T03:37:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe94ff9640 1 -- 172.21.15.73:0/897838269 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe90003980 con 0x7efe9815c2a0 2024-09-12T03:37:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.529+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9815d440 con 0x7efe9815c2a0 2024-09-12T03:37:57.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.533+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe980ad200 con 0x7efe9815c2a0 2024-09-12T03:37:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.533+0000 7efe94ff9640 1 -- 172.21.15.73:0/897838269 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe90003b20 con 0x7efe9815c2a0 2024-09-12T03:37:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.533+0000 7efe94ff9640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe840678c0 0x7efe84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.533+0000 7efe94ff9640 1 -- 172.21.15.73:0/897838269 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7efe90085a60 con 0x7efe9815c2a0 2024-09-12T03:37:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.533+0000 7efe97fff640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe840678c0 0x7efe84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.533+0000 7efe97fff640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe840678c0 0x7efe84069d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0ae000 tx=0x7efe8c0b3040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.537+0000 7efe94ff9640 1 -- 172.21.15.73:0/897838269 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe90020020 con 0x7efe9815c2a0 2024-09-12T03:37:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.725+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe9806fcd0 con 0x7efe9815c2a0 2024-09-12T03:37:57.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.725+0000 7efe94ff9640 1 -- 172.21.15.73:0/897838269 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5222 (secure 0 0 0) 0x7efe90019310 con 0x7efe9815c2a0 2024-09-12T03:37:57.729 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:57.729 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"btime":"2024-09-12T03:37:42:437910+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/54392956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54392956},{"type":"v1","addr":"172.21.15.150:6835","nonce":54392956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6240,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/583240547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":583240547},{"type":"v1","addr":"172.21.15.73:6835","nonce":583240547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3438655973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3438655973},{"type":"v1","addr":"172.21.15.73:6837","nonce":3438655973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:39.761504+0000","modified":"2024-09-12T03:37:41.797723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6833/3979723408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3979723408},{"type":"v1","addr":"172.21.15.150:6833","nonce":3979723408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":6}]} 2024-09-12T03:37:57.729 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 48 2024-09-12T03:37:57.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe840678c0 msgr2=0x7efe84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe840678c0 0x7efe84069d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0ae000 tx=0x7efe8c0b3040 comp rx=0 tx=0).stop 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815c2a0 msgr2=0x7efe98154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815c2a0 0x7efe98154500 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7efe9000c740 tx=0x7efe9000cc00 comp rx=0 tx=0).stop 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 shutdown_connections 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7efe840678c0 0x7efe84069d80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe9815c2a0 0x7efe98154500 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7efe9815bec0 0x7efe981f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 --2- 172.21.15.73:0/897838269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efe980af2a0 0x7efe9815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 >> 172.21.15.73:0/897838269 conn(0x7efe980b1f90 msgr2=0x7efe980b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 shutdown_connections 2024-09-12T03:37:57.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.729+0000 7efe9e702640 1 -- 172.21.15.73:0/897838269 wait complete. 2024-09-12T03:37:57.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:37:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0159374640 1 Processor -- start 2024-09-12T03:37:57.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0159374640 1 -- start start 2024-09-12T03:37:57.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0159374640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f01541567e0 0x7f01540b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0159374640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0154160460 0x7f015415d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0159374640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01540b4620 con 0x7f01540b3c40 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0159374640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f01540b4900 con 0x7f0154160460 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0159374640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f01540b4be0 con 0x7f01541567e0 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f01527fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f01540b3c40 0x7f015415fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49664/0 (socket says 172.21.15.73:49664) 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f01527fc640 1 -- 172.21.15.73:0/1202252094 learned_addr learned my addr 172.21.15.73:0/1202252094 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f01537fe640 1 --2- 172.21.15.73:0/1202252094 >> v2:172.21.15.73:3300/0 conn(0x7f0154160460 0x7f015415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0152ffd640 1 --2- 172.21.15.73:0/1202252094 >> v2:172.21.15.150:3300/0 conn(0x7f01541567e0 0x7f01540b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0151ffb640 1 -- 172.21.15.73:0/1202252094 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540407150 0 0) 0x7f01540b4620 con 0x7f01540b3c40 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0151ffb640 1 -- 172.21.15.73:0/1202252094 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0138003530 con 0x7f01540b3c40 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f01537fe640 1 -- 172.21.15.73:0/1202252094 >> v2:172.21.15.150:3300/0 conn(0x7f01541567e0 msgr2=0x7f01540b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:57.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f01537fe640 1 --2- 172.21.15.73:0/1202252094 >> v2:172.21.15.150:3300/0 conn(0x7f01541567e0 0x7f01540b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f01537fe640 1 -- 172.21.15.73:0/1202252094 >> v1:172.21.15.73:6789/0 conn(0x7f01540b3c40 legacy=0x7f015415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f01537fe640 1 -- 172.21.15.73:0/1202252094 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01540b4ec0 con 0x7f0154160460 2024-09-12T03:37:57.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.853+0000 7f0152ffd640 1 --2- 172.21.15.73:0/1202252094 >> v2:172.21.15.150:3300/0 conn(0x7f01541567e0 0x7f01540b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:37:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01537fe640 1 --2- 172.21.15.73:0/1202252094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0154160460 0x7f015415d920 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f014c0097c0 tx=0x7f014c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3ab0748f454fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0151ffb640 1 -- 172.21.15.73:0/1202252094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0b1070 con 0x7f0154160460 2024-09-12T03:37:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0151ffb640 1 -- 172.21.15.73:0/1202252094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014c0ac620 con 0x7f0154160460 2024-09-12T03:37:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0151ffb640 1 -- 172.21.15.73:0/1202252094 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0ac9d0 con 0x7f0154160460 2024-09-12T03:37:57.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- 172.21.15.73:0/1202252094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0154160460 msgr2=0x7f015415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 --2- 172.21.15.73:0/1202252094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0154160460 0x7f015415d920 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f014c0097c0 tx=0x7f014c01c3a0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- 172.21.15.73:0/1202252094 shutdown_connections 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 --2- 172.21.15.73:0/1202252094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0154160460 0x7f015415d920 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 --2- 172.21.15.73:0/1202252094 >> v2:172.21.15.150:3300/0 conn(0x7f01541567e0 0x7f01540b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- 172.21.15.73:0/1202252094 >> 172.21.15.73:0/1202252094 conn(0x7f0154073580 msgr2=0x7f015406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- 172.21.15.73:0/1202252094 shutdown_connections 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- 172.21.15.73:0/1202252094 wait complete. 2024-09-12T03:37:57.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 Processor -- start 2024-09-12T03:37:57.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- start start 2024-09-12T03:37:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01540b3c40 0x7f0154161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01541567e0 0x7f01541503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0154160460 0x7f0154150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0154160b50 con 0x7f01541567e0 2024-09-12T03:37:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f01541609d0 con 0x7f0154160460 2024-09-12T03:37:57.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f015415e270 con 0x7f01540b3c40 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01541567e0 0x7f01541503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01541567e0 0x7f01541503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56946/0 (socket says 172.21.15.73:56946) 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 -- 172.21.15.73:0/3147573690 learned_addr learned my addr 172.21.15.73:0/3147573690 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 -- 172.21.15.73:0/3147573690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01540b3c40 msgr2=0x7f0154161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01540b3c40 0x7f0154161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 -- 172.21.15.73:0/3147573690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0154160460 msgr2=0x7f0154150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0154160460 0x7f0154150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 -- 172.21.15.73:0/3147573690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0154161dd0 con 0x7f01541567e0 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f01527fc640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01541567e0 0x7f01541503f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f014000cb40 tx=0x7f014000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f014b7fe640 1 -- 172.21.15.73:0/3147573690 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140017070 con 0x7f01541567e0 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f014b7fe640 1 -- 172.21.15.73:0/3147573690 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014000aca0 con 0x7f01541567e0 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0154160e80 con 0x7f01541567e0 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.857+0000 7f014b7fe640 1 -- 172.21.15.73:0/3147573690 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140012620 con 0x7f01541567e0 2024-09-12T03:37:57.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.861+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0154161440 con 0x7f01541567e0 2024-09-12T03:37:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.861+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01540b56c0 con 0x7f01541567e0 2024-09-12T03:37:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.861+0000 7f014b7fe640 1 -- 172.21.15.73:0/3147573690 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f014001a070 con 0x7f01541567e0 2024-09-12T03:37:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.861+0000 7f014b7fe640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f013c0678c0 0x7f013c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:57.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.861+0000 7f014b7fe640 1 -- 172.21.15.73:0/3147573690 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f0140085c60 con 0x7f01541567e0 2024-09-12T03:37:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.861+0000 7f0152ffd640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f013c0678c0 0x7f013c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:57.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.861+0000 7f0152ffd640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f013c0678c0 0x7f013c069d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0144006f10 tx=0x7f0144008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:57.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:57.865+0000 7f014b7fe640 1 -- 172.21.15.73:0/3147573690 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0140056610 con 0x7f01541567e0 2024-09-12T03:37:58.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.049+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0154070e20 con 0x7f01541567e0 2024-09-12T03:37:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.049+0000 7f014b7fe640 1 -- 172.21.15.73:0/3147573690 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5222 (secure 0 0 0) 0x7f0140055f10 con 0x7f01541567e0 2024-09-12T03:37:58.052 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:58.052 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"btime":"2024-09-12T03:37:42:437910+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/54392956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54392956},{"type":"v1","addr":"172.21.15.150:6835","nonce":54392956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6240,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/583240547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":583240547},{"type":"v1","addr":"172.21.15.73:6835","nonce":583240547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3438655973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3438655973},{"type":"v1","addr":"172.21.15.73:6837","nonce":3438655973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:37:39.761504+0000","modified":"2024-09-12T03:37:41.797723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6255":{"gid":6255,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6833/3979723408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3979723408},{"type":"v1","addr":"172.21.15.150:6833","nonce":3979723408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6255,"qdb_cluster":[6255]},"id":6}]} 2024-09-12T03:37:58.052 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 48 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f013c0678c0 msgr2=0x7f013c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f013c0678c0 0x7f013c069d80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0144006f10 tx=0x7f0144008040 comp rx=0 tx=0).stop 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01541567e0 msgr2=0x7f01541503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01541567e0 0x7f01541503f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f014000cb40 tx=0x7f014000a060 comp rx=0 tx=0).stop 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 shutdown_connections 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f013c0678c0 0x7f013c069d80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01541567e0 0x7f01541503f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0154160460 0x7f0154150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 --2- 172.21.15.73:0/3147573690 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01540b3c40 0x7f0154161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 >> 172.21.15.73:0/3147573690 conn(0x7f0154073580 msgr2=0x7f0154153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 shutdown_connections 2024-09-12T03:37:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.053+0000 7f0159374640 1 -- 172.21.15.73:0/3147573690 wait complete. 2024-09-12T03:37:58.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:37:58.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb544213640 1 Processor -- start 2024-09-12T03:37:58.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb544213640 1 -- start start 2024-09-12T03:37:58.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb544213640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c0cf620 0x7fb53c168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb544213640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb53c0d0300 con 0x7fb53c161a60 2024-09-12T03:37:58.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb544213640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb53c0cfab0 con 0x7fb53c0d3060 2024-09-12T03:37:58.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb544213640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb53c06e6c0 con 0x7fb53c0cf620 2024-09-12T03:37:58.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb53c161a60 0x7fb53c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49670/0 (socket says 172.21.15.73:49670) 2024-09-12T03:37:58.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 -- 172.21.15.73:0/3283143834 learned_addr learned my addr 172.21.15.73:0/3283143834 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:37:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb5427b0640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c0cf620 0x7fb53c168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862268177 0 0) 0x7fb538001120 con 0x7fb53c161a60 2024-09-12T03:37:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb528003530 con 0x7fb53c161a60 2024-09-12T03:37:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3676696487 0 0) 0x7fb528003530 con 0x7fb53c161a60 2024-09-12T03:37:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c0cf620 msgr2=0x7fb53c168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:58.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c0cf620 0x7fb53c168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 >> v1:172.21.15.150:6789/0 conn(0x7fb53c0d3060 legacy=0x7fb53c0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53c0b0f60 con 0x7fb53c161a60 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fb538001850 con 0x7fb53c161a60 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 >> v1:172.21.15.73:6789/0 conn(0x7fb53c161a60 legacy=0x7fb53c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb528003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c0cf620 0x7fb528004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb528004d50 0x7fb5280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c06e6c0 con 0x7fb5280039f0 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb52800bb00 con 0x7fb528004d50 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb52800bd00 con 0x7fb53c0cf620 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb528003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 -- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c0cf620 msgr2=0x7fb528004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c0cf620 0x7fb528004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 -- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb528004d50 msgr2=0x7fb5280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:58.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb528004d50 0x7fb5280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.181+0000 7fb541faf640 1 -- 172.21.15.73:0/3283143834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528003530 con 0x7fb5280039f0 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb528003e10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c490 tx=0x7fb53801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0a06357213895a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53800c0e0 con 0x7fb5280039f0 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5380a9020 con 0x7fb5280039f0 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb540fad640 1 -- 172.21.15.73:0/3283143834 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538005b00 con 0x7fb5280039f0 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- 172.21.15.73:0/3283143834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 msgr2=0x7fb528003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 --2- 172.21.15.73:0/3283143834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb528003e10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c490 tx=0x7fb53801cb90 comp rx=0 tx=0).stop 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb5427b0640 1 -- 172.21.15.73:0/3283143834 reap_dead start 2024-09-12T03:37:58.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- 172.21.15.73:0/3283143834 shutdown_connections 2024-09-12T03:37:58.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- 172.21.15.73:0/3283143834 >> 172.21.15.73:0/3283143834 conn(0x7fb53c08bf90 msgr2=0x7fb53c09d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:58.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- 172.21.15.73:0/3283143834 shutdown_connections 2024-09-12T03:37:58.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- 172.21.15.73:0/3283143834 wait complete. 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 Processor -- start 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- start start 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb53c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c1557a0 0x7fb53c1fb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb53c0b4aa0 0x7fb53c0b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c169720 con 0x7fb5280039f0 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c06d190 con 0x7fb53c0b4aa0 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb544213640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb53c1698a0 con 0x7fb53c1557a0 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb53c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb53c0cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56964/0 (socket says 172.21.15.73:56964) 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 -- 172.21.15.73:0/1047694614 learned_addr learned my addr 172.21.15.73:0/1047694614 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb5427b0640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb53c0b4aa0 0x7fb53c0b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb5417ae640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c1557a0 0x7fb53c1fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 -- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c1557a0 msgr2=0x7fb53c1fb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c1557a0 0x7fb53c1fb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 -- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb53c0b4aa0 msgr2=0x7fb53c0b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb53c0b4aa0 0x7fb53c0b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.185+0000 7fb541faf640 1 -- 172.21.15.73:0/1047694614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53c0cf3d0 con 0x7fb5280039f0 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb541faf640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb53c0cb440 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c490 tx=0x7fb528005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5327fc640 1 -- 172.21.15.73:0/1047694614 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380a5870 con 0x7fb5280039f0 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5327fc640 1 -- 172.21.15.73:0/1047694614 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5380b3070 con 0x7fb5280039f0 2024-09-12T03:37:58.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53c0b84c0 con 0x7fb5280039f0 2024-09-12T03:37:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5327fc640 1 -- 172.21.15.73:0/1047694614 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380a5c30 con 0x7fb5280039f0 2024-09-12T03:37:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53c1fb840 con 0x7fb5280039f0 2024-09-12T03:37:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53c0cef10 con 0x7fb5280039f0 2024-09-12T03:37:58.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5327fc640 1 -- 172.21.15.73:0/1047694614 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5380047f0 con 0x7fb5280039f0 2024-09-12T03:37:58.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5327fc640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5200678c0 0x7fb520069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5327fc640 1 -- 172.21.15.73:0/1047694614 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fb53811f940 con 0x7fb5280039f0 2024-09-12T03:37:58.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5417ae640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5200678c0 0x7fb520069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.189+0000 7fb5417ae640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5200678c0 0x7fb520069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb53c1fa850 tx=0x7fb52c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.193+0000 7fb5327fc640 1 -- 172.21.15.73:0/1047694614 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb53c1fb840 con 0x7fb5280039f0 2024-09-12T03:37:58.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.345+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb53c1606d0 con 0x7fb5280039f0 2024-09-12T03:37:58.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.345+0000 7fb5327fc640 1 -- 172.21.15.73:0/1047694614 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16957 (secure 0 0 0) 0x7fb53c0b84c0 con 0x7fb5280039f0 2024-09-12T03:37:58.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:37:58.348 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":86,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:37:41.394697+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:37:37.412919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-12T03:37:38.757412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5200678c0 msgr2=0x7fb520069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5200678c0 0x7fb520069d80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb53c1fa850 tx=0x7fb52c009040 comp rx=0 tx=0).stop 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 msgr2=0x7fb53c0cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb53c0cb440 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb53800c490 tx=0x7fb528005840 comp rx=0 tx=0).stop 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 shutdown_connections 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5200678c0 0x7fb520069d80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb53c0b4aa0 0x7fb53c0b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb53c1557a0 0x7fb53c1fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 --2- 172.21.15.73:0/1047694614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5280039f0 0x7fb53c0cb440 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 >> 172.21.15.73:0/1047694614 conn(0x7fb53c08bf90 msgr2=0x7fb53c15bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 shutdown_connections 2024-09-12T03:37:58.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.349+0000 7fb544213640 1 -- 172.21.15.73:0/1047694614 wait complete. 2024-09-12T03:37:58.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:37:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 Processor -- start 2024-09-12T03:37:58.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 -- start start 2024-09-12T03:37:58.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ef41567b0 0x7f7ef415c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7ef40730c0 0x7f7ef4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef406bcc0 0x7f7ef406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef40cfc00 con 0x7f7ef41567b0 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f7ef415cb50 con 0x7f7ef40730c0 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efc379640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef40cfe80 con 0x7f7ef406bcc0 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ef41567b0 0x7f7ef415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ef41567b0 0x7f7ef415c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56974/0 (socket says 172.21.15.73:56974) 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 -- 172.21.15.73:0/2418319184 learned_addr learned my addr 172.21.15.73:0/2418319184 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa916640 1 --2- 172.21.15.73:0/2418319184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef406bcc0 0x7f7ef406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7ef9914640 1 --2- 172.21.15.73:0/2418319184 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40730c0 0x7f7ef4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 -- 172.21.15.73:0/2418319184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef406bcc0 msgr2=0x7f7ef406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 --2- 172.21.15.73:0/2418319184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef406bcc0 0x7f7ef406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 -- 172.21.15.73:0/2418319184 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40730c0 msgr2=0x7f7ef4070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:58.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 --2- 172.21.15.73:0/2418319184 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40730c0 0x7f7ef4070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7efa115640 1 -- 172.21.15.73:0/2418319184 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef415cdf0 con 0x7f7ef41567b0 2024-09-12T03:37:58.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.473+0000 7f7ef9914640 1 --2- 172.21.15.73:0/2418319184 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40730c0 0x7f7ef4070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:58.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efa115640 1 --2- 172.21.15.73:0/2418319184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef415c610 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40b0610 tx=0x7f7ef001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f13dfe0c74f8da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7ef9113640 1 -- 172.21.15.73:0/2418319184 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00a7070 con 0x7f7ef41567b0 2024-09-12T03:37:58.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7ef9113640 1 -- 172.21.15.73:0/2418319184 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef00b0070 con 0x7f7ef41567b0 2024-09-12T03:37:58.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7ef9113640 1 -- 172.21.15.73:0/2418319184 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00ab890 con 0x7f7ef41567b0 2024-09-12T03:37:58.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- 172.21.15.73:0/2418319184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 msgr2=0x7f7ef415c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 --2- 172.21.15.73:0/2418319184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef415c610 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40b0610 tx=0x7f7ef001c490 comp rx=0 tx=0).stop 2024-09-12T03:37:58.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- 172.21.15.73:0/2418319184 shutdown_connections 2024-09-12T03:37:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 --2- 172.21.15.73:0/2418319184 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef406bcc0 0x7f7ef406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 --2- 172.21.15.73:0/2418319184 >> v2:172.21.15.150:3300/0 conn(0x7f7ef40730c0 0x7f7ef4070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 --2- 172.21.15.73:0/2418319184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef415c610 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- 172.21.15.73:0/2418319184 >> 172.21.15.73:0/2418319184 conn(0x7f7ef40b2de0 msgr2=0x7f7ef40b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- 172.21.15.73:0/2418319184 shutdown_connections 2024-09-12T03:37:58.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- 172.21.15.73:0/2418319184 wait complete. 2024-09-12T03:37:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 Processor -- start 2024-09-12T03:37:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- start start 2024-09-12T03:37:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef406bcc0 0x7f7ef4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40730c0 0x7f7ef4145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef4146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40d0d10 con 0x7f7ef41567b0 2024-09-12T03:37:58.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef40d0b90 con 0x7f7ef406bcc0 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efc379640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7ef40d0e90 con 0x7f7ef40730c0 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.477+0000 7f7efa916640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef4146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef4146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56988/0 (socket says 172.21.15.73:56988) 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 -- 172.21.15.73:0/3248839903 learned_addr learned my addr 172.21.15.73:0/3248839903 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7ef9914640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40730c0 0x7f7ef4145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa115640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef406bcc0 0x7f7ef4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 -- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40730c0 msgr2=0x7f7ef4145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40730c0 0x7f7ef4145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 -- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef406bcc0 msgr2=0x7f7ef4151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef406bcc0 0x7f7ef4151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 -- 172.21.15.73:0/3248839903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef4148730 con 0x7f7ef41567b0 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7ef9914640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40730c0 0x7f7ef4145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa916640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef4146320 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7eec007e60 tx=0x7f7eec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7eeaffd640 1 -- 172.21.15.73:0/3248839903 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec014420 con 0x7f7ef41567b0 2024-09-12T03:37:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7eeaffd640 1 -- 172.21.15.73:0/3248839903 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec019070 con 0x7f7ef41567b0 2024-09-12T03:37:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7eeaffd640 1 -- 172.21.15.73:0/3248839903 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec014820 con 0x7f7ef41567b0 2024-09-12T03:37:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef4148a10 con 0x7f7ef41567b0 2024-09-12T03:37:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef41494f0 con 0x7f7ef41567b0 2024-09-12T03:37:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef4070240 con 0x7f7ef41567b0 2024-09-12T03:37:58.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7eeaffd640 1 -- 172.21.15.73:0/3248839903 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7eec0149c0 con 0x7f7ef41567b0 2024-09-12T03:37:58.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7eeaffd640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ed80678c0 0x7f7ed8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7eeaffd640 1 -- 172.21.15.73:0/3248839903 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f7eec0865b0 con 0x7f7ef41567b0 2024-09-12T03:37:58.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa115640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ed80678c0 0x7f7ed8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.481+0000 7f7efa115640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ed80678c0 0x7f7ed8069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00af000 tx=0x7f7ef0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.485+0000 7f7eeaffd640 1 -- 172.21.15.73:0/3248839903 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7eec056ff0 con 0x7f7ef41567b0 2024-09-12T03:37:58.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.677+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7ef4073a50 con 0x7f7ef41567b0 2024-09-12T03:37:58.681 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T03:37:58.681+0000 7fe1c1027640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:37:58.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.681+0000 7f7eeaffd640 1 -- 172.21.15.73:0/3248839903 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) ==== 161+0+0 (secure 0 0 0) 0x7f7eec0568f0 con 0x7f7ef41567b0 2024-09-12T03:37:58.685 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:37:58.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ed80678c0 msgr2=0x7f7ed8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ed80678c0 0x7f7ed8069d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00af000 tx=0x7f7ef0008040 comp rx=0 tx=0).stop 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 msgr2=0x7f7ef4146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef4146320 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f7eec007e60 tx=0x7f7eec00e4b0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 shutdown_connections 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7ed80678c0 0x7f7ed8069d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41567b0 0x7f7ef4146320 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7ef40730c0 0x7f7ef4145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 --2- 172.21.15.73:0/3248839903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7ef406bcc0 0x7f7ef4151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 >> 172.21.15.73:0/3248839903 conn(0x7f7ef40b2de0 msgr2=0x7f7ef415db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:58.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 shutdown_connections 2024-09-12T03:37:58.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.685+0000 7f7efc379640 1 -- 172.21.15.73:0/3248839903 wait complete. 2024-09-12T03:37:58.695 INFO:tasks.ceph.mds.b.smithi150.stderr: -2223> 2024-09-12T03:37:42.371+0000 7fd79b393640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:37:58.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:37:58.733 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:37:58.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cf41f640 1 Processor -- start 2024-09-12T03:37:58.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cf41f640 1 -- start start 2024-09-12T03:37:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cf41f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f23c815b080 0x7f23c80b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cf41f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23c80b23e0 0x7f23c80b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cf41f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c80b5590 con 0x7f23c80b5180 2024-09-12T03:37:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cf41f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80b0eb0 con 0x7f23c80b23e0 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cf41f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80b1190 con 0x7f23c815b080 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cc9ba640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23c80b23e0 0x7f23c80b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cc9ba640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23c80b23e0 0x7f23c80b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56992/0 (socket says 172.21.15.73:56992) 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cc9ba640 1 -- 172.21.15.73:0/1080969736 learned_addr learned my addr 172.21.15.73:0/1080969736 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cc9ba640 1 -- 172.21.15.73:0/1080969736 >> v2:172.21.15.150:3300/0 conn(0x7f23c815b080 msgr2=0x7f23c80b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cd1bb640 1 --2- 172.21.15.73:0/1080969736 >> v2:172.21.15.150:3300/0 conn(0x7f23c815b080 0x7f23c80b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cc9ba640 1 --2- 172.21.15.73:0/1080969736 >> v2:172.21.15.150:3300/0 conn(0x7f23c815b080 0x7f23c80b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cc9ba640 1 -- 172.21.15.73:0/1080969736 >> v1:172.21.15.150:6789/0 conn(0x7f23c80b5180 legacy=0x7f23c815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cc9ba640 1 -- 172.21.15.73:0/1080969736 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80b1470 con 0x7f23c80b23e0 2024-09-12T03:37:58.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.813+0000 7f23cd1bb640 1 --2- 172.21.15.73:0/1080969736 >> v2:172.21.15.150:3300/0 conn(0x7f23c815b080 0x7f23c80b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cc9ba640 1 --2- 172.21.15.73:0/1080969736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c80b4c40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f23c8072720 tx=0x7f23b801c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb6e2216c985891 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23bffff640 1 -- 172.21.15.73:0/1080969736 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b80b0070 con 0x7f23c80b23e0 2024-09-12T03:37:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23bffff640 1 -- 172.21.15.73:0/1080969736 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b80ab600 con 0x7f23c80b23e0 2024-09-12T03:37:58.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23bffff640 1 -- 172.21.15.73:0/1080969736 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b80ab9d0 con 0x7f23c80b23e0 2024-09-12T03:37:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 -- 172.21.15.73:0/1080969736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 msgr2=0x7f23c80b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 --2- 172.21.15.73:0/1080969736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c80b4c40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f23c8072720 tx=0x7f23b801c1e0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 -- 172.21.15.73:0/1080969736 shutdown_connections 2024-09-12T03:37:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 --2- 172.21.15.73:0/1080969736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c80b4c40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 --2- 172.21.15.73:0/1080969736 >> v2:172.21.15.150:3300/0 conn(0x7f23c815b080 0x7f23c80b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 -- 172.21.15.73:0/1080969736 >> 172.21.15.73:0/1080969736 conn(0x7f23c809aa00 msgr2=0x7f23c80b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 -- 172.21.15.73:0/1080969736 shutdown_connections 2024-09-12T03:37:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 -- 172.21.15.73:0/1080969736 wait complete. 2024-09-12T03:37:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 Processor -- start 2024-09-12T03:37:58.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.817+0000 7f23cf41f640 1 -- start start 2024-09-12T03:37:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c8140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c80b5180 0x7f23c81414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c815b080 0x7f23c8141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23c80af840 con 0x7f23c80b23e0 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f23c80af6c0 con 0x7f23c815b080 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f23c815b460 con 0x7f23c80b5180 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c8140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c8140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57008/0 (socket says 172.21.15.73:57008) 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 -- 172.21.15.73:0/2404597740 learned_addr learned my addr 172.21.15.73:0/2404597740 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cc9ba640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c80b5180 0x7f23c81414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 -- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c80b5180 msgr2=0x7f23c81414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c80b5180 0x7f23c81414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 -- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c815b080 msgr2=0x7f23c8141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c815b080 0x7f23c8141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:58.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 -- 172.21.15.73:0/2404597740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c815a4e0 con 0x7f23c80b23e0 2024-09-12T03:37:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cc9ba640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c80b5180 0x7f23c81414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cd1bb640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c8140b90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c7f0 tx=0x7f23c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23bdffb640 1 -- 172.21.15.73:0/2404597740 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4015070 con 0x7f23c80b23e0 2024-09-12T03:37:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23bdffb640 1 -- 172.21.15.73:0/2404597740 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c4007820 con 0x7f23c80b23e0 2024-09-12T03:37:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23bdffb640 1 -- 172.21.15.73:0/2404597740 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4007c10 con 0x7f23c80b23e0 2024-09-12T03:37:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c8154ba0 con 0x7f23c80b23e0 2024-09-12T03:37:58.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c81540c0 con 0x7f23c80b23e0 2024-09-12T03:37:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c80b4c40 con 0x7f23c80b23e0 2024-09-12T03:37:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23bdffb640 1 -- 172.21.15.73:0/2404597740 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23c4018070 con 0x7f23c80b23e0 2024-09-12T03:37:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23bdffb640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f23ac0678c0 0x7f23ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23bdffb640 1 -- 172.21.15.73:0/2404597740 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7f23c4085fa0 con 0x7f23c80b23e0 2024-09-12T03:37:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cc9ba640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f23ac0678c0 0x7f23ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:58.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.821+0000 7f23cc9ba640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f23ac0678c0 0x7f23ac069d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f23b80ad000 tx=0x7f23b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:58.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:58.825+0000 7f23bdffb640 1 -- 172.21.15.73:0/2404597740 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23c815a4e0 con 0x7f23c80b23e0 2024-09-12T03:37:59.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.017+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f23c80754f0 con 0x7f23c80b23e0 2024-09-12T03:37:59.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.685+0000 7f23bdffb640 1 -- 172.21.15.73:0/2404597740 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) ==== 104+0+0 (secure 0 0 0) 0x7f23c4056900 con 0x7f23c80b23e0 2024-09-12T03:37:59.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f23ac0678c0 msgr2=0x7f23ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f23ac0678c0 0x7f23ac069d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f23b80ad000 tx=0x7f23b8008040 comp rx=0 tx=0).stop 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 msgr2=0x7f23c8140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c8140b90 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c7f0 tx=0x7f23c400ccb0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 shutdown_connections 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f23ac0678c0 0x7f23ac069d80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23c815b080 0x7f23c8141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f23c80b5180 0x7f23c81414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 --2- 172.21.15.73:0/2404597740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23c80b23e0 0x7f23c8140b90 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 >> 172.21.15.73:0/2404597740 conn(0x7f23c809aa00 msgr2=0x7f23c80b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 shutdown_connections 2024-09-12T03:37:59.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.689+0000 7f23cf41f640 1 -- 172.21.15.73:0/2404597740 wait complete. 2024-09-12T03:37:59.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:37:59.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc39e489640 1 Processor -- start 2024-09-12T03:37:59.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc39e489640 1 -- start start 2024-09-12T03:37:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc39e489640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc39815bec0 0x7fc3980ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc39e489640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc39815c2a0 0x7fc3980aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc39e489640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3980b3290 con 0x7fc3980af2a0 2024-09-12T03:37:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc39e489640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc3980b3570 con 0x7fc39815bec0 2024-09-12T03:37:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc39e489640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc3980b3850 con 0x7fc39815c2a0 2024-09-12T03:37:59.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc397fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc39815bec0 0x7fc3980ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc397fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc39815bec0 0x7fc3980ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57024/0 (socket says 172.21.15.73:57024) 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc397fff640 1 -- 172.21.15.73:0/1085445440 learned_addr learned my addr 172.21.15.73:0/1085445440 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc3977fe640 1 --2- 172.21.15.73:0/1085445440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc39815c2a0 0x7fc3980aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc397fff640 1 -- 172.21.15.73:0/1085445440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc39815c2a0 msgr2=0x7fc3980aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc397fff640 1 --2- 172.21.15.73:0/1085445440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc39815c2a0 0x7fc3980aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc397fff640 1 -- 172.21.15.73:0/1085445440 >> v1:172.21.15.150:6789/0 conn(0x7fc3980af2a0 legacy=0x7fc39815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc397fff640 1 -- 172.21.15.73:0/1085445440 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3980b3b30 con 0x7fc39815bec0 2024-09-12T03:37:59.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.837+0000 7fc3977fe640 1 --2- 172.21.15.73:0/1085445440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc39815c2a0 0x7fc3980aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:59.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc397fff640 1 --2- 172.21.15.73:0/1085445440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3980ad200 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc388009870 tx=0x7fc38801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e545f4b51277ead server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:59.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc396ffd640 1 -- 172.21.15.73:0/1085445440 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3880aa610 con 0x7fc39815bec0 2024-09-12T03:37:59.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc396ffd640 1 -- 172.21.15.73:0/1085445440 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3880af070 con 0x7fc39815bec0 2024-09-12T03:37:59.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc396ffd640 1 -- 172.21.15.73:0/1085445440 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3880aa9d0 con 0x7fc39815bec0 2024-09-12T03:37:59.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- 172.21.15.73:0/1085445440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 msgr2=0x7fc3980ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:59.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 --2- 172.21.15.73:0/1085445440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3980ad200 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc388009870 tx=0x7fc38801c4f0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- 172.21.15.73:0/1085445440 shutdown_connections 2024-09-12T03:37:59.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 --2- 172.21.15.73:0/1085445440 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc39815c2a0 0x7fc3980aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 --2- 172.21.15.73:0/1085445440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3980ad200 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- 172.21.15.73:0/1085445440 >> 172.21.15.73:0/1085445440 conn(0x7fc3980b1f90 msgr2=0x7fc3980b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:37:59.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- 172.21.15.73:0/1085445440 shutdown_connections 2024-09-12T03:37:59.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- 172.21.15.73:0/1085445440 wait complete. 2024-09-12T03:37:59.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 Processor -- start 2024-09-12T03:37:59.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- start start 2024-09-12T03:37:59.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3980af2a0 0x7fc3981479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:59.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3981574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:59.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc39815c2a0 0x7fc398157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc3980ad740 con 0x7fc39815bec0 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc3980afc90 con 0x7fc39815c2a0 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39e489640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc398169000 con 0x7fc3980af2a0 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3981574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3981574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57028/0 (socket says 172.21.15.73:57028) 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 -- 172.21.15.73:0/1799280133 learned_addr learned my addr 172.21.15.73:0/1799280133 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 -- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3980af2a0 msgr2=0x7fc3981479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39ca26640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc39815c2a0 0x7fc398157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc397fff640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3980af2a0 0x7fc3981479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3980af2a0 0x7fc3981479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 -- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc39815c2a0 msgr2=0x7fc398157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc39815c2a0 0x7fc398157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:37:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 -- 172.21.15.73:0/1799280133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc398070820 con 0x7fc39815bec0 2024-09-12T03:37:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc39ca26640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc39815c2a0 0x7fc398157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:37:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc3977fe640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3981574e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7f0 tx=0x7fc38c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.841+0000 7fc394ff9640 1 -- 172.21.15.73:0/1799280133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c015070 con 0x7fc39815bec0 2024-09-12T03:37:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc394ff9640 1 -- 172.21.15.73:0/1799280133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38c007820 con 0x7fc39815bec0 2024-09-12T03:37:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc398147f00 con 0x7fc39815bec0 2024-09-12T03:37:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc394ff9640 1 -- 172.21.15.73:0/1799280133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c007c10 con 0x7fc39815bec0 2024-09-12T03:37:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc398158980 con 0x7fc39815bec0 2024-09-12T03:37:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3980b2ce0 con 0x7fc39815bec0 2024-09-12T03:37:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc394ff9640 1 -- 172.21.15.73:0/1799280133 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc38c018070 con 0x7fc39815bec0 2024-09-12T03:37:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc394ff9640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3840678c0 0x7fc384069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:37:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc394ff9640 1 -- 172.21.15.73:0/1799280133 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6187+0+0 (secure 0 0 0) 0x7fc38c085f10 con 0x7fc39815bec0 2024-09-12T03:37:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc397fff640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3840678c0 0x7fc384069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:37:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.845+0000 7fc397fff640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3840678c0 0x7fc384069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc3880ae000 tx=0x7fc388008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:37:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:37:59.849+0000 7fc394ff9640 1 -- 172.21.15.73:0/1799280133 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc38c056900 con 0x7fc39815bec0 2024-09-12T03:38:00.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.009+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc39806fcd0 con 0x7fc39815bec0 2024-09-12T03:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.949+0000 7fc394ff9640 1 -- 172.21.15.73:0/1799280133 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7fc38c056200 con 0x7fc39815bec0 2024-09-12T03:38:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3840678c0 msgr2=0x7fc384069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3840678c0 0x7fc384069d80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc3880ae000 tx=0x7fc388008040 comp rx=0 tx=0).stop 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 msgr2=0x7fc3981574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3981574e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c7f0 tx=0x7fc38c00ccb0 comp rx=0 tx=0).stop 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 shutdown_connections 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3840678c0 0x7fc384069d80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc39815bec0 0x7fc3981574e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:00.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc39815c2a0 0x7fc398157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 --2- 172.21.15.73:0/1799280133 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3980af2a0 0x7fc3981479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 >> 172.21.15.73:0/1799280133 conn(0x7fc3980b1f90 msgr2=0x7fc398152170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 shutdown_connections 2024-09-12T03:38:00.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:00.957+0000 7fc39e489640 1 -- 172.21.15.73:0/1799280133 wait complete. 2024-09-12T03:38:00.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:38:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b9eb2640 1 Processor -- start 2024-09-12T03:38:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b9eb2640 1 -- start start 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b9eb2640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f68b41417c0 0x7f68b40d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b9eb2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68b40d2620 0x7f68b40d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b9eb2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b413f360 con 0x7f68b413ef80 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b9eb2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f68b4142570 con 0x7f68b40d2620 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b9eb2640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f68b40d2a70 con 0x7f68b41417c0 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68b40d2620 0x7f68b40d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68b40d2620 0x7f68b40d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57038/0 (socket says 172.21.15.73:57038) 2024-09-12T03:38:01.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b3fff640 1 -- 172.21.15.73:0/600315483 learned_addr learned my addr 172.21.15.73:0/600315483 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b2ffd640 1 --2- 172.21.15.73:0/600315483 >> v2:172.21.15.150:3300/0 conn(0x7f68b41417c0 0x7f68b40d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b3fff640 1 -- 172.21.15.73:0/600315483 >> v2:172.21.15.150:3300/0 conn(0x7f68b41417c0 msgr2=0x7f68b40d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b3fff640 1 --2- 172.21.15.73:0/600315483 >> v2:172.21.15.150:3300/0 conn(0x7f68b41417c0 0x7f68b40d20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b3fff640 1 -- 172.21.15.73:0/600315483 >> v1:172.21.15.150:6789/0 conn(0x7f68b413ef80 legacy=0x7f68b4141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b3fff640 1 -- 172.21.15.73:0/600315483 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b415c870 con 0x7f68b40d2620 2024-09-12T03:38:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.105+0000 7f68b2ffd640 1 --2- 172.21.15.73:0/600315483 >> v2:172.21.15.150:3300/0 conn(0x7f68b41417c0 0x7f68b40d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b3fff640 1 --2- 172.21.15.73:0/600315483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b40d2620 0x7f68b40d0c20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f68b40710a0 tx=0x7f68a401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d4bc0777b88370 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b27fc640 1 -- 172.21.15.73:0/600315483 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a40a6040 con 0x7f68b40d2620 2024-09-12T03:38:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b27fc640 1 -- 172.21.15.73:0/600315483 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a40af070 con 0x7f68b40d2620 2024-09-12T03:38:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b27fc640 1 -- 172.21.15.73:0/600315483 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a40aa860 con 0x7f68b40d2620 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- 172.21.15.73:0/600315483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b40d2620 msgr2=0x7f68b40d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/600315483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b40d2620 0x7f68b40d0c20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f68b40710a0 tx=0x7f68a401c4e0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- 172.21.15.73:0/600315483 shutdown_connections 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/600315483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b40d2620 0x7f68b40d0c20 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/600315483 >> v2:172.21.15.150:3300/0 conn(0x7f68b41417c0 0x7f68b40d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- 172.21.15.73:0/600315483 >> 172.21.15.73:0/600315483 conn(0x7f68b406c0c0 msgr2=0x7f68b406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- 172.21.15.73:0/600315483 shutdown_connections 2024-09-12T03:38:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- 172.21.15.73:0/600315483 wait complete. 2024-09-12T03:38:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 Processor -- start 2024-09-12T03:38:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- start start 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40d2620 0x7f68b415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b413ef80 0x7f68b413ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b41417c0 0x7f68b41fa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f68b40d1970 con 0x7f68b41417c0 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f68b415c4f0 con 0x7f68b40d2620 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b9eb2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f68b40d1af0 con 0x7f68b413ef80 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.109+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b41417c0 0x7f68b41fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b41417c0 0x7f68b41fa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57046/0 (socket says 172.21.15.73:57046) 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 -- 172.21.15.73:0/371204106 learned_addr learned my addr 172.21.15.73:0/371204106 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:01.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b2ffd640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b413ef80 0x7f68b413ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b37fe640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40d2620 0x7f68b415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 -- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b413ef80 msgr2=0x7f68b413ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b413ef80 0x7f68b413ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 -- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40d2620 msgr2=0x7f68b415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:01.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40d2620 0x7f68b415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 -- 172.21.15.73:0/371204106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b415b8f0 con 0x7f68b41417c0 2024-09-12T03:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b3fff640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b41417c0 0x7f68b41fa460 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f68a401a110 tx=0x7f68a401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f689bfff640 1 -- 172.21.15.73:0/371204106 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a40bd3f0 con 0x7f68b41417c0 2024-09-12T03:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f689bfff640 1 -- 172.21.15.73:0/371204106 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a40bd5b0 con 0x7f68b41417c0 2024-09-12T03:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f689bfff640 1 -- 172.21.15.73:0/371204106 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a40bd9a0 con 0x7f68b41417c0 2024-09-12T03:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b415b060 con 0x7f68b41417c0 2024-09-12T03:38:01.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b415b610 con 0x7f68b41417c0 2024-09-12T03:38:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b40d0c20 con 0x7f68b41417c0 2024-09-12T03:38:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f689bfff640 1 -- 172.21.15.73:0/371204106 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68a40c6430 con 0x7f68b41417c0 2024-09-12T03:38:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f689bfff640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68a00678c0 0x7f68a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b37fe640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68a00678c0 0x7f68a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f689bfff640 1 -- 172.21.15.73:0/371204106 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5749+0+0 (secure 0 0 0) 0x7f68a4120270 con 0x7f68b41417c0 2024-09-12T03:38:01.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.113+0000 7f68b37fe640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68a00678c0 0x7f68a0069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f68b4155260 tx=0x7f68ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:01.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.117+0000 7f689bfff640 1 -- 172.21.15.73:0/371204106 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f68a40160d0 con 0x7f68b41417c0 2024-09-12T03:38:01.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.281+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f68b4152e10 con 0x7f68b41417c0 2024-09-12T03:38:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.957+0000 7f689bfff640 1 -- 172.21.15.73:0/371204106 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7f68a40f0e90 con 0x7f68b41417c0 2024-09-12T03:38:01.961 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T03:38:01.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68a00678c0 msgr2=0x7f68a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:01.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68a00678c0 0x7f68a0069d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f68b4155260 tx=0x7f68ac009040 comp rx=0 tx=0).stop 2024-09-12T03:38:01.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b41417c0 msgr2=0x7f68b41fa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:01.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b41417c0 0x7f68b41fa460 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f68a401a110 tx=0x7f68a401ad20 comp rx=0 tx=0).stop 2024-09-12T03:38:01.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 shutdown_connections 2024-09-12T03:38:01.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f68a00678c0 0x7f68a0069d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68b41417c0 0x7f68b41fa460 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f68b413ef80 0x7f68b413ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 --2- 172.21.15.73:0/371204106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f68b40d2620 0x7f68b415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:01.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 >> 172.21.15.73:0/371204106 conn(0x7f68b406c0c0 msgr2=0x7f68b40b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 shutdown_connections 2024-09-12T03:38:01.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:01.961+0000 7f68b9eb2640 1 -- 172.21.15.73:0/371204106 wait complete. 2024-09-12T03:38:01.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T03:38:02.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.113+0000 7fce67464640 1 Processor -- start 2024-09-12T03:38:02.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.113+0000 7fce67464640 1 -- start start 2024-09-12T03:38:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.113+0000 7fce67464640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015c2a0 0x7fce600aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce67464640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fce600af2a0 0x7fce6006e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce67464640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce600b3290 con 0x7fce6015bec0 2024-09-12T03:38:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce67464640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fce600b3570 con 0x7fce600af2a0 2024-09-12T03:38:02.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce67464640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce600b3850 con 0x7fce6015c2a0 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015c2a0 0x7fce600aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015c2a0 0x7fce600aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:38624/0 (socket says 172.21.15.73:38624) 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 -- 172.21.15.73:0/387085583 learned_addr learned my addr 172.21.15.73:0/387085583 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce65a01640 1 --2- 172.21.15.73:0/387085583 >> v2:172.21.15.150:3300/0 conn(0x7fce600af2a0 0x7fce6006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 -- 172.21.15.73:0/387085583 >> v2:172.21.15.150:3300/0 conn(0x7fce600af2a0 msgr2=0x7fce6006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 --2- 172.21.15.73:0/387085583 >> v2:172.21.15.150:3300/0 conn(0x7fce600af2a0 0x7fce6006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 -- 172.21.15.73:0/387085583 >> v1:172.21.15.150:6789/0 conn(0x7fce6015bec0 legacy=0x7fce600ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 -- 172.21.15.73:0/387085583 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce600b3b30 con 0x7fce6015c2a0 2024-09-12T03:38:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce649ff640 1 --2- 172.21.15.73:0/387085583 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015c2a0 0x7fce600aed60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009870 tx=0x7fce5c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769c2a85b2e89ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce57fff640 1 -- 172.21.15.73:0/387085583 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0a95f0 con 0x7fce6015c2a0 2024-09-12T03:38:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce57fff640 1 -- 172.21.15.73:0/387085583 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5c0a9790 con 0x7fce6015c2a0 2024-09-12T03:38:02.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.117+0000 7fce57fff640 1 -- 172.21.15.73:0/387085583 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0a9b60 con 0x7fce6015c2a0 2024-09-12T03:38:02.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- 172.21.15.73:0/387085583 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015c2a0 msgr2=0x7fce600aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 --2- 172.21.15.73:0/387085583 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015c2a0 0x7fce600aed60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009870 tx=0x7fce5c01c530 comp rx=0 tx=0).stop 2024-09-12T03:38:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- 172.21.15.73:0/387085583 shutdown_connections 2024-09-12T03:38:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 --2- 172.21.15.73:0/387085583 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015c2a0 0x7fce600aed60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 --2- 172.21.15.73:0/387085583 >> v2:172.21.15.150:3300/0 conn(0x7fce600af2a0 0x7fce6006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- 172.21.15.73:0/387085583 >> 172.21.15.73:0/387085583 conn(0x7fce600b1f90 msgr2=0x7fce600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- 172.21.15.73:0/387085583 shutdown_connections 2024-09-12T03:38:02.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- 172.21.15.73:0/387085583 wait complete. 2024-09-12T03:38:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 Processor -- start 2024-09-12T03:38:02.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- start start 2024-09-12T03:38:02.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce600af2a0 0x7fce601534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015bec0 0x7fce6015a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce6015c2a0 0x7fce6015ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fce6006ed50 con 0x7fce6015c2a0 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fce600af6b0 con 0x7fce600af2a0 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce67464640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fce6006eed0 con 0x7fce6015bec0 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce6015c2a0 0x7fce6015ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce6015c2a0 0x7fce6015ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57056/0 (socket says 172.21.15.73:57056) 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 -- 172.21.15.73:0/3944708620 learned_addr learned my addr 172.21.15.73:0/3944708620 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65200640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce600af2a0 0x7fce601534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce649ff640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015bec0 0x7fce6015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 -- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015bec0 msgr2=0x7fce6015a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015bec0 0x7fce6015a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 -- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce600af2a0 msgr2=0x7fce601534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce600af2a0 0x7fce601534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 -- 172.21.15.73:0/3944708620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6015ef50 con 0x7fce6015c2a0 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65200640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce600af2a0 0x7fce601534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce65a01640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce6015c2a0 0x7fce6015ad80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fce5800efc0 tx=0x7fce5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.121+0000 7fce55ffb640 1 -- 172.21.15.73:0/3944708620 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58018020 con 0x7fce6015c2a0 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce55ffb640 1 -- 172.21.15.73:0/3944708620 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce58014480 con 0x7fce6015c2a0 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6015f230 con 0x7fce6015c2a0 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce55ffb640 1 -- 172.21.15.73:0/3944708620 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58014870 con 0x7fce6015c2a0 2024-09-12T03:38:02.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce6015f7f0 con 0x7fce6015c2a0 2024-09-12T03:38:02.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce60068e50 con 0x7fce6015c2a0 2024-09-12T03:38:02.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce55ffb640 1 -- 172.21.15.73:0/3944708620 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fce5801b020 con 0x7fce6015c2a0 2024-09-12T03:38:02.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce55ffb640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fce440678c0 0x7fce44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce55ffb640 1 -- 172.21.15.73:0/3944708620 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7fce580865c0 con 0x7fce6015c2a0 2024-09-12T03:38:02.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce65200640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fce440678c0 0x7fce44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.125+0000 7fce65200640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fce440678c0 0x7fce44069d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce600b0600 tx=0x7fce50009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:02.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.129+0000 7fce55ffb640 1 -- 172.21.15.73:0/3944708620 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fce58022070 con 0x7fce6015c2a0 2024-09-12T03:38:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.293+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fce6006f270 con 0x7fce6015c2a0 2024-09-12T03:38:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.297+0000 7fce55ffb640 1 -- 172.21.15.73:0/3944708620 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fce58010040 con 0x7fce6015c2a0 2024-09-12T03:38:02.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fce440678c0 msgr2=0x7fce44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fce440678c0 0x7fce44069d80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce600b0600 tx=0x7fce50009040 comp rx=0 tx=0).stop 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce6015c2a0 msgr2=0x7fce6015ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce6015c2a0 0x7fce6015ad80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fce5800efc0 tx=0x7fce5800c490 comp rx=0 tx=0).stop 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 shutdown_connections 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fce440678c0 0x7fce44069d80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce6015c2a0 0x7fce6015ad80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fce6015bec0 0x7fce6015a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 --2- 172.21.15.73:0/3944708620 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fce600af2a0 0x7fce601534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 >> 172.21.15.73:0/3944708620 conn(0x7fce600b1f90 msgr2=0x7fce600b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 shutdown_connections 2024-09-12T03:38:02.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.301+0000 7fce67464640 1 -- 172.21.15.73:0/3944708620 wait complete. 2024-09-12T03:38:02.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr' 2024-09-12T03:38:02.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc7919640 1 Processor -- start 2024-09-12T03:38:02.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc7919640 1 -- start start 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc7919640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fedc015bec0 0x7fedc00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc7919640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedc015c2a0 0x7fedc00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc7919640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc00b3290 con 0x7fedc00af2a0 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc7919640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fedc00b3570 con 0x7fedc015c2a0 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc7919640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fedc00b3850 con 0x7fedc015bec0 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedc015c2a0 0x7fedc00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedc015c2a0 0x7fedc00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57066/0 (socket says 172.21.15.73:57066) 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 -- 172.21.15.73:0/3075816554 learned_addr learned my addr 172.21.15.73:0/3075816554 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:02.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc56b5640 1 --2- 172.21.15.73:0/3075816554 >> v2:172.21.15.150:3300/0 conn(0x7fedc015bec0 0x7fedc00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 -- 172.21.15.73:0/3075816554 >> v2:172.21.15.150:3300/0 conn(0x7fedc015bec0 msgr2=0x7fedc00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 --2- 172.21.15.73:0/3075816554 >> v2:172.21.15.150:3300/0 conn(0x7fedc015bec0 0x7fedc00ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 -- 172.21.15.73:0/3075816554 >> v1:172.21.15.150:6789/0 conn(0x7fedc00af2a0 legacy=0x7fedc015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 -- 172.21.15.73:0/3075816554 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc00b3b30 con 0x7fedc015c2a0 2024-09-12T03:38:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc56b5640 1 --2- 172.21.15.73:0/3075816554 >> v2:172.21.15.150:3300/0 conn(0x7fedc015bec0 0x7fedc00ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.437+0000 7fedc4eb4640 1 --2- 172.21.15.73:0/3075816554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc015c2a0 0x7fedc00aed60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fedc0071710 tx=0x7fedb001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3cf1d1b95d6fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:02.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedb7fff640 1 -- 172.21.15.73:0/3075816554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb00aa610 con 0x7fedc015c2a0 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedb7fff640 1 -- 172.21.15.73:0/3075816554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb00af070 con 0x7fedc015c2a0 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedb7fff640 1 -- 172.21.15.73:0/3075816554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb00aa9d0 con 0x7fedc015c2a0 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- 172.21.15.73:0/3075816554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc015c2a0 msgr2=0x7fedc00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 --2- 172.21.15.73:0/3075816554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc015c2a0 0x7fedc00aed60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fedc0071710 tx=0x7fedb001c4b0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- 172.21.15.73:0/3075816554 shutdown_connections 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 --2- 172.21.15.73:0/3075816554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc015c2a0 0x7fedc00aed60 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 --2- 172.21.15.73:0/3075816554 >> v2:172.21.15.150:3300/0 conn(0x7fedc015bec0 0x7fedc00ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- 172.21.15.73:0/3075816554 >> 172.21.15.73:0/3075816554 conn(0x7fedc00b1f90 msgr2=0x7fedc00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- 172.21.15.73:0/3075816554 shutdown_connections 2024-09-12T03:38:02.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- 172.21.15.73:0/3075816554 wait complete. 2024-09-12T03:38:02.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 Processor -- start 2024-09-12T03:38:02.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- start start 2024-09-12T03:38:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc00af2a0 0x7fedc009a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedc015bec0 0x7fedc00cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc015c2a0 0x7fedc009d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00ad740 con 0x7fedc00af2a0 2024-09-12T03:38:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00af710 con 0x7fedc015c2a0 2024-09-12T03:38:02.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fedc0169000 con 0x7fedc015bec0 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc00af2a0 0x7fedc009a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc00af2a0 0x7fedc009a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57078/0 (socket says 172.21.15.73:57078) 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 -- 172.21.15.73:0/4217458148 learned_addr learned my addr 172.21.15.73:0/4217458148 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc4eb4640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedc015bec0 0x7fedc00cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc5eb6640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc015c2a0 0x7fedc009d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 -- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedc015bec0 msgr2=0x7fedc00cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedc015bec0 0x7fedc00cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 -- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc015c2a0 msgr2=0x7fedc009d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc015c2a0 0x7fedc009d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 -- 172.21.15.73:0/4217458148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc0155fe0 con 0x7fedc00af2a0 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc4eb4640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedc015bec0 0x7fedc00cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:02.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc56b5640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc00af2a0 0x7fedc009a280 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c7f0 tx=0x7fedbc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:02.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedb5ffb640 1 -- 172.21.15.73:0/4217458148 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc007a30 con 0x7fedc00af2a0 2024-09-12T03:38:02.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedb5ffb640 1 -- 172.21.15.73:0/4217458148 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedbc007bd0 con 0x7fedc00af2a0 2024-09-12T03:38:02.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc0156280 con 0x7fedc00af2a0 2024-09-12T03:38:02.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedb5ffb640 1 -- 172.21.15.73:0/4217458148 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0113f0 con 0x7fedc00af2a0 2024-09-12T03:38:02.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.441+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc009e260 con 0x7fedc00af2a0 2024-09-12T03:38:02.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.445+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc00ad200 con 0x7fedc00af2a0 2024-09-12T03:38:02.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.445+0000 7fedb5ffb640 1 -- 172.21.15.73:0/4217458148 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fedbc011590 con 0x7fedc00af2a0 2024-09-12T03:38:02.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.445+0000 7fedb5ffb640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feda40678f0 0x7feda4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:02.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.445+0000 7fedb5ffb640 1 -- 172.21.15.73:0/4217458148 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7fedbc085de0 con 0x7fedc00af2a0 2024-09-12T03:38:02.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.445+0000 7fedc4eb4640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feda40678f0 0x7feda4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:02.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.445+0000 7fedc4eb4640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feda40678f0 0x7feda4069db0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fedb00ae000 tx=0x7fedb00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:02.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.449+0000 7fedb5ffb640 1 -- 172.21.15.73:0/4217458148 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fedbc015020 con 0x7fedc00af2a0 2024-09-12T03:38:02.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.657+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]} v 0) -- 0x7fedc006fcd0 con 0x7fedc00af2a0 2024-09-12T03:38:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.961+0000 7fedb5ffb640 1 -- 172.21.15.73:0/4217458148 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_getfattr"]}]=0 v203) ==== 140+0+0 (secure 0 0 0) 0x7fedbc056960 con 0x7fedc00af2a0 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feda40678f0 msgr2=0x7feda4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feda40678f0 0x7feda4069db0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fedb00ae000 tx=0x7fedb00a7000 comp rx=0 tx=0).stop 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc00af2a0 msgr2=0x7fedc009a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc00af2a0 0x7fedc009a280 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00c7f0 tx=0x7fedbc00ccb0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 shutdown_connections 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7feda40678f0 0x7feda4069db0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedc015c2a0 0x7fedc009d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fedc015bec0 0x7fedc00cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 --2- 172.21.15.73:0/4217458148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedc00af2a0 0x7fedc009a280 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 >> 172.21.15.73:0/4217458148 conn(0x7fedc00b1f90 msgr2=0x7fedc0165080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:02.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 shutdown_connections 2024-09-12T03:38:02.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:02.965+0000 7fedc7919640 1 -- 172.21.15.73:0/4217458148 wait complete. 2024-09-12T03:38:02.986 INFO:tasks.cephfs_test_runner:That quota changes made from one client are visible to another ... ok 2024-09-12T03:38:02.986 INFO:tasks.cephfs_test_runner:Starting test: test_remote_update_write (tasks.cephfs.test_quota.TestQuota) That when a client modifies the quota on a directory used 2024-09-12T03:38:02.986 INFO:tasks.cephfs_test_runner:test_remote_update_write (tasks.cephfs.test_quota.TestQuota) 2024-09-12T03:38:02.987 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:38:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.101+0000 7fe2ff84e640 1 Processor -- start 2024-09-12T03:38:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.101+0000 7fe2ff84e640 1 -- start start 2024-09-12T03:38:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2ff84e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f81520a0 0x7fe2f806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2ff84e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe2f806fe50 0x7fe2f815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2ff84e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f8070250 con 0x7fe2f815f1d0 2024-09-12T03:38:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2ff84e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f8152480 con 0x7fe2f806fe50 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2ff84e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f80aede0 con 0x7fe2f81520a0 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fcde9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe2f806fe50 0x7fe2f815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fddeb640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe2f815f1d0 0x7fe2f8071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49676/0 (socket says 172.21.15.73:49676) 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fddeb640 1 -- 172.21.15.73:0/1112671290 learned_addr learned my addr 172.21.15.73:0/1112671290 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fd5ea640 1 --2- 172.21.15.73:0/1112671290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f81520a0 0x7fe2f806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fcde9640 1 -- 172.21.15.73:0/1112671290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f81520a0 msgr2=0x7fe2f806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fcde9640 1 --2- 172.21.15.73:0/1112671290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f81520a0 0x7fe2f806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fcde9640 1 -- 172.21.15.73:0/1112671290 >> v1:172.21.15.73:6789/0 conn(0x7fe2f815f1d0 legacy=0x7fe2f8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fcde9640 1 -- 172.21.15.73:0/1112671290 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f815fa10 con 0x7fe2f806fe50 2024-09-12T03:38:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2f7fff640 1 -- 172.21.15.73:0/1112671290 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948448182 0 0) 0x7fe2f8070250 con 0x7fe2f815f1d0 2024-09-12T03:38:03.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2fcde9640 1 --2- 172.21.15.73:0/1112671290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f815ec90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00ba60 tx=0x7fe2ec01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec375fad1dfaf371 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2f7fff640 1 -- 172.21.15.73:0/1112671290 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0b4070 con 0x7fe2f806fe50 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2f7fff640 1 -- 172.21.15.73:0/1112671290 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0a7b40 con 0x7fe2f806fe50 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.105+0000 7fe2f7fff640 1 -- 172.21.15.73:0/1112671290 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0af440 con 0x7fe2f806fe50 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- 172.21.15.73:0/1112671290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 msgr2=0x7fe2f815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/1112671290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f815ec90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00ba60 tx=0x7fe2ec01eb50 comp rx=0 tx=0).stop 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- 172.21.15.73:0/1112671290 shutdown_connections 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/1112671290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f815ec90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/1112671290 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f81520a0 0x7fe2f806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- 172.21.15.73:0/1112671290 >> 172.21.15.73:0/1112671290 conn(0x7fe2f80b1f90 msgr2=0x7fe2f80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- 172.21.15.73:0/1112671290 shutdown_connections 2024-09-12T03:38:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- 172.21.15.73:0/1112671290 wait complete. 2024-09-12T03:38:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 Processor -- start 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- start start 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2f81520a0 0x7fe2f809b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f815f1d0 0x7fe2f81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8073d30 con 0x7fe2f806fe50 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8073a50 con 0x7fe2f81520a0 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f815f640 con 0x7fe2f815f1d0 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f814b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57098/0 (socket says 172.21.15.73:57098) 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 -- 172.21.15.73:0/3277552801 learned_addr learned my addr 172.21.15.73:0/3277552801 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fcde9640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2f81520a0 0x7fe2f809b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fddeb640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f815f1d0 0x7fe2f81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 -- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f815f1d0 msgr2=0x7fe2f81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f815f1d0 0x7fe2f81512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 -- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2f81520a0 msgr2=0x7fe2f809b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2f81520a0 0x7fe2f809b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 -- 172.21.15.73:0/3277552801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f814e8a0 con 0x7fe2f806fe50 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fddeb640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f815f1d0 0x7fe2f81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2fd5ea640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f814b970 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0007f20 tx=0x7fe2f000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2f5ffb640 1 -- 172.21.15.73:0/3277552801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0014620 con 0x7fe2f806fe50 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2f5ffb640 1 -- 172.21.15.73:0/3277552801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f0019070 con 0x7fe2f806fe50 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f809d390 con 0x7fe2f806fe50 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2f5ffb640 1 -- 172.21.15.73:0/3277552801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0014a00 con 0x7fe2f806fe50 2024-09-12T03:38:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.109+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f809d950 con 0x7fe2f806fe50 2024-09-12T03:38:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.113+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f815ec90 con 0x7fe2f806fe50 2024-09-12T03:38:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.113+0000 7fe2f5ffb640 1 -- 172.21.15.73:0/3277552801 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe2f0014ba0 con 0x7fe2f806fe50 2024-09-12T03:38:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.113+0000 7fe2f5ffb640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2e40678c0 0x7fe2e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.113+0000 7fe2fcde9640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2e40678c0 0x7fe2e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.113+0000 7fe2f5ffb640 1 -- 172.21.15.73:0/3277552801 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7fe2f0086550 con 0x7fe2f806fe50 2024-09-12T03:38:03.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.113+0000 7fe2fcde9640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2e40678c0 0x7fe2e4069d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0b1000 tx=0x7fe2ec0a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.117+0000 7fe2f5ffb640 1 -- 172.21.15.73:0/3277552801 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe2f0057160 con 0x7fe2f806fe50 2024-09-12T03:38:03.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.293+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2f806e540 con 0x7fe2f806fe50 2024-09-12T03:38:03.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.293+0000 7fe2f5ffb640 1 -- 172.21.15.73:0/3277552801 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+13320 (secure 0 0 0) 0x7fe2f0056a60 con 0x7fe2f806fe50 2024-09-12T03:38:03.296 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:03.297 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":89,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:38:01.955187+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6833/3979723408":"2024-09-13T03:37:58.683546+0000","172.21.15.150:6832/3979723408":"2024-09-13T03:37:58.683546+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:38:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2e40678c0 msgr2=0x7fe2e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2e40678c0 0x7fe2e4069d80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0b1000 tx=0x7fe2ec0a9070 comp rx=0 tx=0).stop 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 msgr2=0x7fe2f814b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f814b970 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0007f20 tx=0x7fe2f000e570 comp rx=0 tx=0).stop 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 shutdown_connections 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe2e40678c0 0x7fe2e4069d80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe2f815f1d0 0x7fe2f81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2f81520a0 0x7fe2f809b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 --2- 172.21.15.73:0/3277552801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2f806fe50 0x7fe2f814b970 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 >> 172.21.15.73:0/3277552801 conn(0x7fe2f80b1f90 msgr2=0x7fe2f806ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 shutdown_connections 2024-09-12T03:38:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.297+0000 7fe2ff84e640 1 -- 172.21.15.73:0/3277552801 wait complete. 2024-09-12T03:38:03.315 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T03:34:25.956292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T03:38:03.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T03:38:03.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2b79e640 1 Processor -- start 2024-09-12T03:38:03.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2b79e640 1 -- start start 2024-09-12T03:38:03.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2b79e640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcb2415bec0 0x7fcb240ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2b79e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb240af470 0x7fcb2406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2b79e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb240b3290 con 0x7fcb2415c2a0 2024-09-12T03:38:03.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2b79e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcb240b3570 con 0x7fcb240af470 2024-09-12T03:38:03.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2b79e640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fcb240b3850 con 0x7fcb2415bec0 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb29d3b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb240af470 0x7fcb2406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb29d3b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb240af470 0x7fcb2406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57104/0 (socket says 172.21.15.73:57104) 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb29d3b640 1 -- 172.21.15.73:0/200224047 learned_addr learned my addr 172.21.15.73:0/200224047 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb2953a640 1 --2- 172.21.15.73:0/200224047 >> v2:172.21.15.150:3300/0 conn(0x7fcb2415bec0 0x7fcb240ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb29d3b640 1 -- 172.21.15.73:0/200224047 >> v2:172.21.15.150:3300/0 conn(0x7fcb2415bec0 msgr2=0x7fcb240ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb29d3b640 1 --2- 172.21.15.73:0/200224047 >> v2:172.21.15.150:3300/0 conn(0x7fcb2415bec0 0x7fcb240ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb29d3b640 1 -- 172.21.15.73:0/200224047 >> v1:172.21.15.150:6789/0 conn(0x7fcb2415c2a0 legacy=0x7fcb240aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:03.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.433+0000 7fcb29d3b640 1 -- 172.21.15.73:0/200224047 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb240b3b30 con 0x7fcb240af470 2024-09-12T03:38:03.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb29d3b640 1 --2- 172.21.15.73:0/200224047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb2406e000 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fcb24071710 tx=0x7fcb1c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a312b201b73fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb1bfff640 1 -- 172.21.15.73:0/200224047 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0a5840 con 0x7fcb240af470 2024-09-12T03:38:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb1bfff640 1 -- 172.21.15.73:0/200224047 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0a59e0 con 0x7fcb240af470 2024-09-12T03:38:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb1bfff640 1 -- 172.21.15.73:0/200224047 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0a5db0 con 0x7fcb240af470 2024-09-12T03:38:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- 172.21.15.73:0/200224047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 msgr2=0x7fcb2406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/200224047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb2406e000 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fcb24071710 tx=0x7fcb1c01c980 comp rx=0 tx=0).stop 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- 172.21.15.73:0/200224047 shutdown_connections 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/200224047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb2406e000 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/200224047 >> v2:172.21.15.150:3300/0 conn(0x7fcb2415bec0 0x7fcb240ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- 172.21.15.73:0/200224047 >> 172.21.15.73:0/200224047 conn(0x7fcb240b1f90 msgr2=0x7fcb240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- 172.21.15.73:0/200224047 shutdown_connections 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- 172.21.15.73:0/200224047 wait complete. 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 Processor -- start 2024-09-12T03:38:03.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- start start 2024-09-12T03:38:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb241554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb2415bec0 0x7fcb2415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2415c2a0 0x7fcb2414a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2406ed50 con 0x7fcb240af470 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240ad740 con 0x7fcb2415c2a0 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2b79e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2406eed0 con 0x7fcb2415bec0 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb241554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb241554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57114/0 (socket says 172.21.15.73:57114) 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 -- 172.21.15.73:0/1598115625 learned_addr learned my addr 172.21.15.73:0/1598115625 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb29d3b640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2415c2a0 0x7fcb2414a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb28d39640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb2415bec0 0x7fcb2415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 -- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb2415bec0 msgr2=0x7fcb2415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb2415bec0 0x7fcb2415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 -- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2415c2a0 msgr2=0x7fcb2414a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2415c2a0 0x7fcb2414a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.437+0000 7fcb2953a640 1 -- 172.21.15.73:0/1598115625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb24155bd0 con 0x7fcb240af470 2024-09-12T03:38:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb2953a640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb241554c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c7f0 tx=0x7fcb2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb19ffb640 1 -- 172.21.15.73:0/1598115625 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20015070 con 0x7fcb240af470 2024-09-12T03:38:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb19ffb640 1 -- 172.21.15.73:0/1598115625 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb20004240 con 0x7fcb240af470 2024-09-12T03:38:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2415ef00 con 0x7fcb240af470 2024-09-12T03:38:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb19ffb640 1 -- 172.21.15.73:0/1598115625 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20003620 con 0x7fcb240af470 2024-09-12T03:38:03.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2415f4c0 con 0x7fcb240af470 2024-09-12T03:38:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2406f260 con 0x7fcb240af470 2024-09-12T03:38:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb19ffb640 1 -- 172.21.15.73:0/1598115625 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb200037c0 con 0x7fcb240af470 2024-09-12T03:38:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb19ffb640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcb080678c0 0x7fcb08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb19ffb640 1 -- 172.21.15.73:0/1598115625 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7fcb200859f0 con 0x7fcb240af470 2024-09-12T03:38:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb28d39640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcb080678c0 0x7fcb08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.441+0000 7fcb28d39640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcb080678c0 0x7fcb08069d80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcb241f84d0 tx=0x7fcb14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.445+0000 7fcb19ffb640 1 -- 172.21.15.73:0/1598115625 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcb2008c080 con 0x7fcb240af470 2024-09-12T03:38:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.605+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb2406fcd0 con 0x7fcb240af470 2024-09-12T03:38:03.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.605+0000 7fcb19ffb640 1 -- 172.21.15.73:0/1598115625 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fcb200566a0 con 0x7fcb240af470 2024-09-12T03:38:03.608 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-09-12T03:38:03.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcb080678c0 msgr2=0x7fcb08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcb080678c0 0x7fcb08069d80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcb241f84d0 tx=0x7fcb14008040 comp rx=0 tx=0).stop 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 msgr2=0x7fcb241554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb241554c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c7f0 tx=0x7fcb2000ccb0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 shutdown_connections 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcb080678c0 0x7fcb08069d80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcb2415c2a0 0x7fcb2414a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcb2415bec0 0x7fcb2415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 --2- 172.21.15.73:0/1598115625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb240af470 0x7fcb241554c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 >> 172.21.15.73:0/1598115625 conn(0x7fcb240b1f90 msgr2=0x7fcb24159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 shutdown_connections 2024-09-12T03:38:03.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.609+0000 7fcb2b79e640 1 -- 172.21.15.73:0/1598115625 wait complete. 2024-09-12T03:38:03.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2024-09-12T03:38:03.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930fc8c640 1 Processor -- start 2024-09-12T03:38:03.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930fc8c640 1 -- start start 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930fc8c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f93080cf800 0x7f93080b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930fc8c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93080b4340 0x7f93080d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930fc8c640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93080d27a0 con 0x7f93081457a0 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930fc8c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f93080b4790 con 0x7f93080b4340 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930fc8c640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f93080d2a80 con 0x7f93080cf800 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930e229640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93080b4340 0x7f93080d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930e229640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93080b4340 0x7f93080d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57116/0 (socket says 172.21.15.73:57116) 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930e229640 1 -- 172.21.15.73:0/3344466168 learned_addr learned my addr 172.21.15.73:0/3344466168 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930d227640 1 --2- 172.21.15.73:0/3344466168 >> v2:172.21.15.150:3300/0 conn(0x7f93080cf800 0x7f93080b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930e229640 1 -- 172.21.15.73:0/3344466168 >> v2:172.21.15.150:3300/0 conn(0x7f93080cf800 msgr2=0x7f93080b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930e229640 1 --2- 172.21.15.73:0/3344466168 >> v2:172.21.15.150:3300/0 conn(0x7f93080cf800 0x7f93080b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930e229640 1 -- 172.21.15.73:0/3344466168 >> v1:172.21.15.150:6789/0 conn(0x7f93081457a0 legacy=0x7f93080d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:03.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.745+0000 7f930e229640 1 -- 172.21.15.73:0/3344466168 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93080d2d60 con 0x7f93080b4340 2024-09-12T03:38:03.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930e229640 1 --2- 172.21.15.73:0/3344466168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080b4340 0x7f93080d0710 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f93080cfc70 tx=0x7f930001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce52b59df716b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930ca26640 1 -- 172.21.15.73:0/3344466168 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000b0070 con 0x7f93080b4340 2024-09-12T03:38:03.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930ca26640 1 -- 172.21.15.73:0/3344466168 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93000ab600 con 0x7f93080b4340 2024-09-12T03:38:03.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930ca26640 1 -- 172.21.15.73:0/3344466168 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000ab9d0 con 0x7f93080b4340 2024-09-12T03:38:03.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 -- 172.21.15.73:0/3344466168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080b4340 msgr2=0x7f93080d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 --2- 172.21.15.73:0/3344466168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080b4340 0x7f93080d0710 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f93080cfc70 tx=0x7f930001c450 comp rx=0 tx=0).stop 2024-09-12T03:38:03.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 -- 172.21.15.73:0/3344466168 shutdown_connections 2024-09-12T03:38:03.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 --2- 172.21.15.73:0/3344466168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93080b4340 0x7f93080d0710 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 --2- 172.21.15.73:0/3344466168 >> v2:172.21.15.150:3300/0 conn(0x7f93080cf800 0x7f93080b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 -- 172.21.15.73:0/3344466168 >> 172.21.15.73:0/3344466168 conn(0x7f930806bcc0 msgr2=0x7f930806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:03.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 -- 172.21.15.73:0/3344466168 shutdown_connections 2024-09-12T03:38:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.749+0000 7f930fc8c640 1 -- 172.21.15.73:0/3344466168 wait complete. 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 Processor -- start 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 -- start start 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93080b4340 0x7f930812f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93080cf800 0x7f93080c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93081457a0 0x7f93080ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f93081690b0 con 0x7f93081457a0 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f93080d1670 con 0x7f93080b4340 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9308169230 con 0x7f93080cf800 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93081457a0 0x7f93080ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93081457a0 0x7f93080ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57118/0 (socket says 172.21.15.73:57118) 2024-09-12T03:38:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 -- 172.21.15.73:0/2952283770 learned_addr learned my addr 172.21.15.73:0/2952283770 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930da28640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93080b4340 0x7f930812f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930d227640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93080cf800 0x7f93080c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 -- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93080cf800 msgr2=0x7f93080c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93080cf800 0x7f93080c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 -- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93080b4340 msgr2=0x7f930812f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93080b4340 0x7f930812f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 -- 172.21.15.73:0/2952283770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081641f0 con 0x7f93081457a0 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930da28640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93080b4340 0x7f930812f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930e229640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93081457a0 0x7f93080ca420 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f93000ae040 tx=0x7f93000191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f93067fc640 1 -- 172.21.15.73:0/2952283770 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000b0040 con 0x7f93081457a0 2024-09-12T03:38:03.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f93067fc640 1 -- 172.21.15.73:0/2952283770 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93000b9070 con 0x7f93081457a0 2024-09-12T03:38:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93081644d0 con 0x7f93081457a0 2024-09-12T03:38:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f93067fc640 1 -- 172.21.15.73:0/2952283770 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000b4640 con 0x7f93081457a0 2024-09-12T03:38:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9308164a90 con 0x7f93081457a0 2024-09-12T03:38:03.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93080d0710 con 0x7f93081457a0 2024-09-12T03:38:03.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f93067fc640 1 -- 172.21.15.73:0/2952283770 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f93000b47e0 con 0x7f93081457a0 2024-09-12T03:38:03.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f93067fc640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92f40678c0 0x7f92f4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:03.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f93067fc640 1 -- 172.21.15.73:0/2952283770 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f930011f6a0 con 0x7f93081457a0 2024-09-12T03:38:03.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.753+0000 7f930da28640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92f40678c0 0x7f92f4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:03.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.757+0000 7f930da28640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92f40678c0 0x7f92f4069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93080b5e90 tx=0x7f92f80073c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:03.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.757+0000 7f93067fc640 1 -- 172.21.15.73:0/2952283770 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f93000160d0 con 0x7f93081457a0 2024-09-12T03:38:03.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:03.965+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) -- 0x7f930815ced0 con 0x7f93081457a0 2024-09-12T03:38:04.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.969+0000 7f93067fc640 1 -- 172.21.15.73:0/2952283770 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v205) ==== 140+0+0 (secure 0 0 0) 0x7f93000f0470 con 0x7f93081457a0 2024-09-12T03:38:04.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92f40678c0 msgr2=0x7f92f4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:04.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92f40678c0 0x7f92f4069d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93080b5e90 tx=0x7f92f80073c0 comp rx=0 tx=0).stop 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93081457a0 msgr2=0x7f93080ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93081457a0 0x7f93080ca420 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f93000ae040 tx=0x7f93000191f0 comp rx=0 tx=0).stop 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 shutdown_connections 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f92f40678c0 0x7f92f4069d80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93081457a0 0x7f93080ca420 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f93080cf800 0x7f93080c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 --2- 172.21.15.73:0/2952283770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93080b4340 0x7f930812f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 >> 172.21.15.73:0/2952283770 conn(0x7f930806bcc0 msgr2=0x7f930815feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 shutdown_connections 2024-09-12T03:38:04.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:04.973+0000 7f930fc8c640 1 -- 172.21.15.73:0/2952283770 wait complete. 2024-09-12T03:38:04.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T03:38:05.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.117+0000 7f3d52c59640 1 Processor -- start 2024-09-12T03:38:05.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.117+0000 7f3d52c59640 1 -- start start 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d52c59640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c15c2a0 0x7f3d4c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d52c59640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c0b3290 con 0x7f3d4c0af2a0 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d52c59640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c0b3570 con 0x7f3d4c15bec0 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d52c59640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4c0b3850 con 0x7f3d4c15c2a0 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d511f6640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3d4c0af2a0 0x7f3d4c06e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53616/0 (socket says 172.21.15.73:53616) 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d511f6640 1 -- 172.21.15.73:0/2259919282 learned_addr learned my addr 172.21.15.73:0/2259919282 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c15c2a0 0x7f3d4c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871196961 0 0) 0x7f3d4c0b3290 con 0x7f3d4c0af2a0 2024-09-12T03:38:05.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d34003530 con 0x7f3d4c0af2a0 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2507188092 0 0) 0x7f3d34003530 con 0x7f3d4c0af2a0 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c15c2a0 msgr2=0x7f3d4c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c15c2a0 0x7f3d4c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 >> v1:172.21.15.150:6789/0 conn(0x7f3d4c15bec0 legacy=0x7f3d4c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c0b3b30 con 0x7f3d4c0af2a0 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f3d44001a00 con 0x7f3d4c0af2a0 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 >> v1:172.21.15.73:6789/0 conn(0x7f3d4c0af2a0 legacy=0x7f3d4c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340039f0 0x7f3d34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d34004350 0x7f3d34004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34005030 0x7f3d3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0b3850 con 0x7f3d34004350 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3400bf40 con 0x7f3d34005030 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d3400c140 con 0x7f3d340039f0 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c15c2a0 0x7f3d4c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d34004350 0x7f3d34004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d511f6640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34005030 0x7f3d3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d509f5640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340039f0 0x7f3d34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 -- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340039f0 msgr2=0x7f3d34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340039f0 0x7f3d34003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 -- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34005030 msgr2=0x7f3d3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34005030 0x7f3d3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d4bfff640 1 -- 172.21.15.73:0/2259919282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d34003530 con 0x7f3d34004350 2024-09-12T03:38:05.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.121+0000 7f3d509f5640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d340039f0 0x7f3d34003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d34004350 0x7f3d34004830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c06da50 tx=0x7f3d4001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8887a3b55ffd8a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400097f0 con 0x7f3d34004350 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40004030 con 0x7f3d34004350 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4b7fe640 1 -- 172.21.15.73:0/2259919282 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40004400 con 0x7f3d34004350 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- 172.21.15.73:0/2259919282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d34004350 msgr2=0x7f3d34004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 --2- 172.21.15.73:0/2259919282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d34004350 0x7f3d34004830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c06da50 tx=0x7f3d4001cab0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d511f6640 1 -- 172.21.15.73:0/2259919282 reap_dead start 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- 172.21.15.73:0/2259919282 shutdown_connections 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- 172.21.15.73:0/2259919282 >> 172.21.15.73:0/2259919282 conn(0x7f3d4c0b1f90 msgr2=0x7f3d4c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- 172.21.15.73:0/2259919282 shutdown_connections 2024-09-12T03:38:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- 172.21.15.73:0/2259919282 wait complete. 2024-09-12T03:38:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 Processor -- start 2024-09-12T03:38:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- start start 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34004350 0x7f3d4c1f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d4c1f74f0 0x7f3d4c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c156990 0x7f3d4c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0af730 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0b40f0 con 0x7f3d34004350 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d52c59640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4c0afc90 con 0x7f3d4c156990 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d4c1f74f0 0x7f3d4c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d4c1f74f0 0x7f3d4c153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52408/0 (socket says 172.21.15.73:52408) 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 -- 172.21.15.73:0/2026284371 learned_addr learned my addr 172.21.15.73:0/2026284371 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d511f6640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c156990 0x7f3d4c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d509f5640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34004350 0x7f3d4c1f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 -- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c156990 msgr2=0x7f3d4c156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c156990 0x7f3d4c156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 -- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34004350 msgr2=0x7f3d4c1f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34004350 0x7f3d4c1f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d4bfff640 1 -- 172.21.15.73:0/2026284371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c1f79d0 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d511f6640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c156990 0x7f3d4c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.125+0000 7f3d509f5640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34004350 0x7f3d4c1f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d4bfff640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d4c1f74f0 0x7f3d4c153ab0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3d4001caf0 tx=0x7f3d34005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d497fa640 1 -- 172.21.15.73:0/2026284371 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a5a70 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d497fa640 1 -- 172.21.15.73:0/2026284371 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d400bc070 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4c1f7cb0 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d497fa640 1 -- 172.21.15.73:0/2026284371 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a5e10 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4c1f8270 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4c0aed60 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d497fa640 1 -- 172.21.15.73:0/2026284371 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3d40003620 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d497fa640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d380678f0 0x7f3d38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d497fa640 1 -- 172.21.15.73:0/2026284371 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f3d4011f9b0 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d509f5640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d380678f0 0x7f3d38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.129+0000 7f3d509f5640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d380678f0 0x7f3d38069db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00aca0 tx=0x7f3d3c00a1f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:05.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.133+0000 7f3d497fa640 1 -- 172.21.15.73:0/2026284371 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3d400c5020 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.297+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3d4c157eb0 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d497fa640 1 -- 172.21.15.73:0/2026284371 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f3d400167c0 con 0x7f3d4c1f74f0 2024-09-12T03:38:05.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d380678f0 msgr2=0x7f3d38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d380678f0 0x7f3d38069db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00aca0 tx=0x7f3d3c00a1f0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d4c1f74f0 msgr2=0x7f3d4c153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d4c1f74f0 0x7f3d4c153ab0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3d4001caf0 tx=0x7f3d34005840 comp rx=0 tx=0).stop 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 shutdown_connections 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3d380678f0 0x7f3d38069db0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d4c1f74f0 0x7f3d4c153ab0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3d4c156990 0x7f3d4c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 --2- 172.21.15.73:0/2026284371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d34004350 0x7f3d4c1f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 >> 172.21.15.73:0/2026284371 conn(0x7f3d4c0b1f90 msgr2=0x7f3d4c0d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 shutdown_connections 2024-09-12T03:38:05.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.301+0000 7f3d52c59640 1 -- 172.21.15.73:0/2026284371 wait complete. 2024-09-12T03:38:05.321 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:38:05.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:38:05.363 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:38:05.421 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:38:05.421 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:38:05.421 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:05.427 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:38:05.427 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:05.427 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:05.433 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:38:05.433 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:38:05.433 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:05.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:38:05.474 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:05.474 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:05.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:38:05.480 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T03:38:05.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:38:05.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2541a2f640 1 Processor -- start 2024-09-12T03:38:05.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2541a2f640 1 -- start start 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2541a2f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f253c15bec0 0x7f253c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2541a2f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c15c2a0 0x7f253c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2541a2f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0b3290 con 0x7f253c0af2a0 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2541a2f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f253c0b3570 con 0x7f253c15bec0 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2541a2f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f253c0b3850 con 0x7f253c15c2a0 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f253c15bec0 0x7f253c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f253c0af2a0 0x7f253c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53626/0 (socket says 172.21.15.73:53626) 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253b7fe640 1 -- 172.21.15.73:0/3075235596 learned_addr learned my addr 172.21.15.73:0/3075235596 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253a7fc640 1 --2- 172.21.15.73:0/3075235596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c15c2a0 0x7f253c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253affd640 1 -- 172.21.15.73:0/3075235596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c15c2a0 msgr2=0x7f253c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253affd640 1 --2- 172.21.15.73:0/3075235596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c15c2a0 0x7f253c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253affd640 1 -- 172.21.15.73:0/3075235596 >> v1:172.21.15.73:6789/0 conn(0x7f253c0af2a0 legacy=0x7f253c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253affd640 1 -- 172.21.15.73:0/3075235596 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c0b3b30 con 0x7f253c15bec0 2024-09-12T03:38:05.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f2539ffb640 1 -- 172.21.15.73:0/3075235596 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729703051 0 0) 0x7f253c0b3290 con 0x7f253c0af2a0 2024-09-12T03:38:05.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.641+0000 7f253a7fc640 1 --2- 172.21.15.73:0/3075235596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c15c2a0 0x7f253c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:05.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253affd640 1 --2- 172.21.15.73:0/3075235596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15bec0 0x7f253c0ad200 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f252c0097c0 tx=0x7f252c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6ab07985279a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:05.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2539ffb640 1 -- 172.21.15.73:0/3075235596 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c0a7070 con 0x7f253c15bec0 2024-09-12T03:38:05.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2539ffb640 1 -- 172.21.15.73:0/3075235596 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252c0b0070 con 0x7f253c15bec0 2024-09-12T03:38:05.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2539ffb640 1 -- 172.21.15.73:0/3075235596 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c0ab890 con 0x7f253c15bec0 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- 172.21.15.73:0/3075235596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15bec0 msgr2=0x7f253c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 --2- 172.21.15.73:0/3075235596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15bec0 0x7f253c0ad200 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f252c0097c0 tx=0x7f252c01c470 comp rx=0 tx=0).stop 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- 172.21.15.73:0/3075235596 shutdown_connections 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 --2- 172.21.15.73:0/3075235596 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c15c2a0 0x7f253c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 --2- 172.21.15.73:0/3075235596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15bec0 0x7f253c0ad200 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- 172.21.15.73:0/3075235596 >> 172.21.15.73:0/3075235596 conn(0x7f253c0b1f90 msgr2=0x7f253c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- 172.21.15.73:0/3075235596 shutdown_connections 2024-09-12T03:38:05.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- 172.21.15.73:0/3075235596 wait complete. 2024-09-12T03:38:05.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 Processor -- start 2024-09-12T03:38:05.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- start start 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c0af2a0 0x7f253c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f253c15bec0 0x7f253c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15c2a0 0x7f253c09a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f253c0af6f0 con 0x7f253c15c2a0 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f253c0ad740 con 0x7f253c15bec0 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f253c169000 con 0x7f253c0af2a0 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15c2a0 0x7f253c09a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15c2a0 0x7f253c09a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52432/0 (socket says 172.21.15.73:52432) 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 -- 172.21.15.73:0/2454820889 learned_addr learned my addr 172.21.15.73:0/2454820889 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253affd640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c0af2a0 0x7f253c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253a7fc640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f253c15bec0 0x7f253c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 -- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c0af2a0 msgr2=0x7f253c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c0af2a0 0x7f253c15c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 -- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f253c15bec0 msgr2=0x7f253c151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f253c15bec0 0x7f253c151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 -- 172.21.15.73:0/2454820889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c09aad0 con 0x7f253c15c2a0 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253affd640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c0af2a0 0x7f253c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253a7fc640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f253c15bec0 0x7f253c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f253b7fe640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15c2a0 0x7f253c09a280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f253400c7a0 tx=0x7f253400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2523fff640 1 -- 172.21.15.73:0/2454820889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534018070 con 0x7f253c15c2a0 2024-09-12T03:38:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2523fff640 1 -- 172.21.15.73:0/2454820889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253400a640 con 0x7f253c15c2a0 2024-09-12T03:38:05.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c09adb0 con 0x7f253c15c2a0 2024-09-12T03:38:05.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2523fff640 1 -- 172.21.15.73:0/2454820889 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253400aab0 con 0x7f253c15c2a0 2024-09-12T03:38:05.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.645+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c152780 con 0x7f253c15c2a0 2024-09-12T03:38:05.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.649+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c152980 con 0x7f253c15c2a0 2024-09-12T03:38:05.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.649+0000 7f2523fff640 1 -- 172.21.15.73:0/2454820889 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f253401b070 con 0x7f253c15c2a0 2024-09-12T03:38:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.649+0000 7f2523fff640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25280678c0 0x7f2528069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.649+0000 7f2523fff640 1 -- 172.21.15.73:0/2454820889 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f2534085110 con 0x7f253c15c2a0 2024-09-12T03:38:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.649+0000 7f253affd640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25280678c0 0x7f2528069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.649+0000 7f253affd640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25280678c0 0x7f2528069d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f252c0af000 tx=0x7f252c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:05.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.653+0000 7f2523fff640 1 -- 172.21.15.73:0/2454820889 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2534055e50 con 0x7f253c15c2a0 2024-09-12T03:38:05.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f253c0ad200 con 0x7f253c15c2a0 2024-09-12T03:38:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2523fff640 1 -- 172.21.15.73:0/2454820889 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+3908 (secure 0 0 0) 0x7f2534055750 con 0x7f253c15c2a0 2024-09-12T03:38:05.854 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:05.854 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":50,"btime":"2024-09-12T03:37:59:686413+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/54392956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":54392956},{"type":"v1","addr":"172.21.15.150:6835","nonce":54392956}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":5476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/1533437664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":1533437664},{"type":"v1","addr":"172.21.15.150:6833","nonce":1533437664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6240,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/583240547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":583240547},{"type":"v1","addr":"172.21.15.73:6835","nonce":583240547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3438655973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3438655973},{"type":"v1","addr":"172.21.15.73:6837","nonce":3438655973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[]} 2024-09-12T03:38:05.854 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 50 2024-09-12T03:38:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25280678c0 msgr2=0x7f2528069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25280678c0 0x7f2528069d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f252c0af000 tx=0x7f252c008040 comp rx=0 tx=0).stop 2024-09-12T03:38:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15c2a0 msgr2=0x7f253c09a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:05.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15c2a0 0x7f253c09a280 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f253400c7a0 tx=0x7f253400cc60 comp rx=0 tx=0).stop 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 shutdown_connections 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f25280678c0 0x7f2528069d80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f253c15c2a0 0x7f253c09a280 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f253c15bec0 0x7f253c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 --2- 172.21.15.73:0/2454820889 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f253c0af2a0 0x7f253c15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 >> 172.21.15.73:0/2454820889 conn(0x7f253c0b1f90 msgr2=0x7f253c15a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 shutdown_connections 2024-09-12T03:38:05.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:05.853+0000 7f2541a2f640 1 -- 172.21.15.73:0/2454820889 wait complete. 2024-09-12T03:38:05.873 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T03:38:05.873 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T03:38:05.873 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:38:05.873 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:38:05.873 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T03:38:05.873 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T03:38:05.874 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:38:05.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:38:05.874 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T03:38:05.874 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T03:38:05.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:38:05.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:38:05.874 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T03:38:05.875 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T03:38:05.875 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:38:05.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:38:05.883 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:38:05.883 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T03:38:05.884 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:38:05.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T03:38:05.889 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:38:05.889 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T03:38:05.891 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:38:05.891 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T03:38:05.926 INFO:tasks.ceph.mds.a:Started 2024-09-12T03:38:05.926 DEBUG:teuthology.parallel:result is None 2024-09-12T03:38:05.927 INFO:tasks.ceph.mds.c:Started 2024-09-12T03:38:05.927 DEBUG:teuthology.parallel:result is None 2024-09-12T03:38:05.936 INFO:tasks.ceph.mds.d:Started 2024-09-12T03:38:05.936 DEBUG:teuthology.parallel:result is None 2024-09-12T03:38:05.937 INFO:tasks.ceph.mds.b:Started 2024-09-12T03:38:05.938 DEBUG:teuthology.parallel:result is None 2024-09-12T03:38:05.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T03:38:05.984 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-09-12T03:38:05.991 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:38:06.004 INFO:tasks.ceph.mds.d.smithi150.stdout:starting mds.d at 2024-09-12T03:38:06.013 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2024-09-12T03:38:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 Processor -- start 2024-09-12T03:38:06.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 -- start start 2024-09-12T03:38:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1588156720 0x7f15880b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:06.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f15880b5b50 0x7f1588140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1588141110 0x7f15880b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1588141560 con 0x7f1588156720 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f1588140740 con 0x7f15880b5b50 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158d245640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f158813fb30 con 0x7f1588141110 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1588156720 0x7f15880b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1588156720 0x7f15880b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52470/0 (socket says 172.21.15.73:52470) 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 -- 172.21.15.73:0/2328848544 learned_addr learned my addr 172.21.15.73:0/2328848544 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158659c640 1 --2- 172.21.15.73:0/2328848544 >> v2:172.21.15.150:3300/0 conn(0x7f15880b5b50 0x7f1588140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 -- 172.21.15.73:0/2328848544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1588141110 msgr2=0x7f15880b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158759e640 1 --2- 172.21.15.73:0/2328848544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1588141110 0x7f15880b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 --2- 172.21.15.73:0/2328848544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1588141110 0x7f15880b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:06.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 -- 172.21.15.73:0/2328848544 >> v2:172.21.15.150:3300/0 conn(0x7f15880b5b50 msgr2=0x7f1588140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 --2- 172.21.15.73:0/2328848544 >> v2:172.21.15.150:3300/0 conn(0x7f15880b5b50 0x7f1588140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 -- 172.21.15.73:0/2328848544 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158813fe10 con 0x7f1588156720 2024-09-12T03:38:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f158659c640 1 --2- 172.21.15.73:0/2328848544 >> v2:172.21.15.150:3300/0 conn(0x7f15880b5b50 0x7f1588140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:06.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1586d9d640 1 --2- 172.21.15.73:0/2328848544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5610 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1588145d30 tx=0x7f157801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8649ea18a42a89df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1585d9b640 1 -- 172.21.15.73:0/2328848544 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15780b0070 con 0x7f1588156720 2024-09-12T03:38:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1585d9b640 1 -- 172.21.15.73:0/2328848544 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15780ab600 con 0x7f1588156720 2024-09-12T03:38:06.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.049+0000 7f1585d9b640 1 -- 172.21.15.73:0/2328848544 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15780ab9d0 con 0x7f1588156720 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- 172.21.15.73:0/2328848544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 msgr2=0x7f15880b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 --2- 172.21.15.73:0/2328848544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5610 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1588145d30 tx=0x7f157801c520 comp rx=0 tx=0).stop 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- 172.21.15.73:0/2328848544 shutdown_connections 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 --2- 172.21.15.73:0/2328848544 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1588141110 0x7f15880b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 --2- 172.21.15.73:0/2328848544 >> v2:172.21.15.150:3300/0 conn(0x7f15880b5b50 0x7f1588140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 --2- 172.21.15.73:0/2328848544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5610 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- 172.21.15.73:0/2328848544 >> 172.21.15.73:0/2328848544 conn(0x7f158806c0c0 msgr2=0x7f158806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- 172.21.15.73:0/2328848544 shutdown_connections 2024-09-12T03:38:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- 172.21.15.73:0/2328848544 wait complete. 2024-09-12T03:38:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 Processor -- start 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- start start 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15880b5b50 0x7f1588154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1588141110 0x7f158815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f158813f860 con 0x7f1588156720 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f158813f6e0 con 0x7f1588141110 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1588141f80 con 0x7f15880b5b50 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52480/0 (socket says 172.21.15.73:52480) 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 -- 172.21.15.73:0/259621053 learned_addr learned my addr 172.21.15.73:0/259621053 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158659c640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1588141110 0x7f158815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f1586d9d640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15880b5b50 0x7f1588154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 -- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15880b5b50 msgr2=0x7f1588154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15880b5b50 0x7f1588154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 -- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1588141110 msgr2=0x7f158815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1588141110 0x7f158815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 -- 172.21.15.73:0/259621053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158815dd30 con 0x7f1588156720 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158759e640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5f80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f158000cda0 tx=0x7f158000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f156f7fe640 1 -- 172.21.15.73:0/259621053 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580003ba0 con 0x7f1588156720 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f156f7fe640 1 -- 172.21.15.73:0/259621053 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1580003d40 con 0x7f1588156720 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158815e010 con 0x7f1588156720 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f156f7fe640 1 -- 172.21.15.73:0/259621053 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580004240 con 0x7f1588156720 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.053+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15880b6b40 con 0x7f1588156720 2024-09-12T03:38:06.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.057+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1588142390 con 0x7f1588156720 2024-09-12T03:38:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.057+0000 7f156f7fe640 1 -- 172.21.15.73:0/259621053 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f15800043e0 con 0x7f1588156720 2024-09-12T03:38:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.057+0000 7f156f7fe640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f15740678c0 0x7f1574069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.057+0000 7f156f7fe640 1 -- 172.21.15.73:0/259621053 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5335+0+0 (secure 0 0 0) 0x7f15800864c0 con 0x7f1588156720 2024-09-12T03:38:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.057+0000 7f1586d9d640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f15740678c0 0x7f1574069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.057+0000 7f1586d9d640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f15740678c0 0x7f1574069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f15780ad000 tx=0x7f1578008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:06.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.061+0000 7f156f7fe640 1 -- 172.21.15.73:0/259621053 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1580056b20 con 0x7f1588156720 2024-09-12T03:38:06.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:06.229+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f1588069170 con 0x7f1588156720 2024-09-12T03:38:07.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.325+0000 7f156f7fe640 1 -- 172.21.15.73:0/259621053 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) ==== 97+0+0 (secure 0 0 0) 0x7f158005ae20 con 0x7f1588156720 2024-09-12T03:38:07.326 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-09-12T03:38:07.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f15740678c0 msgr2=0x7f1574069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f15740678c0 0x7f1574069d80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f15780ad000 tx=0x7f1578008040 comp rx=0 tx=0).stop 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 msgr2=0x7f15880b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5f80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f158000cda0 tx=0x7f158000a660 comp rx=0 tx=0).stop 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 shutdown_connections 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f15740678c0 0x7f1574069d80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1588156720 0x7f15880b5f80 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1588141110 0x7f158815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 --2- 172.21.15.73:0/259621053 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f15880b5b50 0x7f1588154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 >> 172.21.15.73:0/259621053 conn(0x7f158806c0c0 msgr2=0x7f15881579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 shutdown_connections 2024-09-12T03:38:07.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.329+0000 7f158d245640 1 -- 172.21.15.73:0/259621053 wait complete. 2024-09-12T03:38:07.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T03:38:07.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff8e9e640 1 Processor -- start 2024-09-12T03:38:07.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff8e9e640 1 -- start start 2024-09-12T03:38:07.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff8e9e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff40d3060 0x7fdff40cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff8e9e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdff40cf450 0x7fdff406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff8e9e640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff40d0300 con 0x7fdff4161a60 2024-09-12T03:38:07.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff8e9e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fdff40b0f60 con 0x7fdff40cf450 2024-09-12T03:38:07.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff8e9e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdff40cfd40 con 0x7fdff40d3060 2024-09-12T03:38:07.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff2d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdff40cf450 0x7fdff406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff2d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdff40cf450 0x7fdff406d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52496/0 (socket says 172.21.15.73:52496) 2024-09-12T03:38:07.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff2d9d640 1 -- 172.21.15.73:0/1757435953 learned_addr learned my addr 172.21.15.73:0/1757435953 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:07.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff1d9b640 1 --2- 172.21.15.73:0/1757435953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff40d3060 0x7fdff40cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff2d9d640 1 -- 172.21.15.73:0/1757435953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff40d3060 msgr2=0x7fdff40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:07.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff2d9d640 1 --2- 172.21.15.73:0/1757435953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff40d3060 0x7fdff40cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff2d9d640 1 -- 172.21.15.73:0/1757435953 >> v1:172.21.15.150:6789/0 conn(0x7fdff4161a60 legacy=0x7fdff40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:07.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.517+0000 7fdff2d9d640 1 -- 172.21.15.73:0/1757435953 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff40d0020 con 0x7fdff40cf450 2024-09-12T03:38:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff2d9d640 1 --2- 172.21.15.73:0/1757435953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40cf450 0x7fdff406d6b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009e50 tx=0x7fdfec01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f233d68309c4d571 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff159a640 1 -- 172.21.15.73:0/1757435953 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0a5830 con 0x7fdff40cf450 2024-09-12T03:38:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff159a640 1 -- 172.21.15.73:0/1757435953 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec0a59d0 con 0x7fdff40cf450 2024-09-12T03:38:07.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff159a640 1 -- 172.21.15.73:0/1757435953 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0a5da0 con 0x7fdff40cf450 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 -- 172.21.15.73:0/1757435953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40cf450 msgr2=0x7fdff406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/1757435953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40cf450 0x7fdff406d6b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009e50 tx=0x7fdfec01c970 comp rx=0 tx=0).stop 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 -- 172.21.15.73:0/1757435953 shutdown_connections 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/1757435953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40cf450 0x7fdff406d6b0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/1757435953 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff40d3060 0x7fdff40cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 -- 172.21.15.73:0/1757435953 >> 172.21.15.73:0/1757435953 conn(0x7fdff408bf90 msgr2=0x7fdff409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 -- 172.21.15.73:0/1757435953 shutdown_connections 2024-09-12T03:38:07.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 -- 172.21.15.73:0/1757435953 wait complete. 2024-09-12T03:38:07.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 Processor -- start 2024-09-12T03:38:07.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.521+0000 7fdff8e9e640 1 -- start start 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff40cf450 0x7fdff40b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40d3060 0x7fdff40cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff4161a60 0x7fdff4158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdff406e400 con 0x7fdff40d3060 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fdff40cfaf0 con 0x7fdff40cf450 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fdff406e580 con 0x7fdff4161a60 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40d3060 0x7fdff40cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40d3060 0x7fdff40cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52502/0 (socket says 172.21.15.73:52502) 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 -- 172.21.15.73:0/884826493 learned_addr learned my addr 172.21.15.73:0/884826493 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 -- 172.21.15.73:0/884826493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff4161a60 msgr2=0x7fdff4158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff4161a60 0x7fdff4158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 -- 172.21.15.73:0/884826493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff40cf450 msgr2=0x7fdff40b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff40cf450 0x7fdff40b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 -- 172.21.15.73:0/884826493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff40cc870 con 0x7fdff40d3060 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff1d9b640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40d3060 0x7fdff40cbe90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d5f0 tx=0x7fdfe800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdfe2ffd640 1 -- 172.21.15.73:0/884826493 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80125f0 con 0x7fdff40d3060 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdfe2ffd640 1 -- 172.21.15.73:0/884826493 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe8019070 con 0x7fdff40d3060 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdfe2ffd640 1 -- 172.21.15.73:0/884826493 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe80129d0 con 0x7fdff40d3060 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff40ccb50 con 0x7fdff40d3060 2024-09-12T03:38:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff40cce30 con 0x7fdff40d3060 2024-09-12T03:38:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff406d6b0 con 0x7fdff40d3060 2024-09-12T03:38:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdfe2ffd640 1 -- 172.21.15.73:0/884826493 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdfe8012b70 con 0x7fdff40d3060 2024-09-12T03:38:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdfe2ffd640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfd40678f0 0x7fdfd4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdfe2ffd640 1 -- 172.21.15.73:0/884826493 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7fdfe8085e90 con 0x7fdff40d3060 2024-09-12T03:38:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff259c640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfd40678f0 0x7fdfd4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.525+0000 7fdff259c640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfd40678f0 0x7fdfd4069db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4000f70 tx=0x7fdfe40079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:07.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.529+0000 7fdfe2ffd640 1 -- 172.21.15.73:0/884826493 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdfe8056c00 con 0x7fdff40d3060 2024-09-12T03:38:07.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.733+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdff40b4f20 con 0x7fdff40d3060 2024-09-12T03:38:07.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.733+0000 7fdfe2ffd640 1 -- 172.21.15.73:0/884826493 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fdfe8056500 con 0x7fdff40d3060 2024-09-12T03:38:07.735 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmaEUUERAALsPB1LZgDjpQy6Mc2+7KYQ==", 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.736 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLjk1IBAASwpjilbzXQSdlRmtrWkIgw==", 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.737 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmTTCtGRAAP9yJozOWrEnBBnrAD5bwCA==", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLFWXKBAAcW3jvmxeLQaIxXVjj0TMuQ==", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.738 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAWYeJmJiDOORAAiDSeou2vMYC0katUnlw6vg==", 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.739 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAaYeJmPuuwDBAARCvmbwbWoKcEhEIYBZ9Fxw==", 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAdYeJmGX4sHBAAfIFgK+oD0KGfJj1r23gcig==", 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.740 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAgYeJmWRXWLRAA6TvzDblsVKPG/tamqAmTTQ==", 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAmYeJm6fWWOhAAVd8ILZhQUARqQRQWgUOA8A==", 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-09-12T03:38:07.742 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAqYeJmeyB+DhAAMG5HZDlSRADXOAWGHPW/Xg==", 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAtYeJmXaotHhAArAHHghQdBuERNfwHSGSaOQ==", 2024-09-12T03:38:07.743 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQAwYeJmn9tnKhAAApLy5nLlD1j21tvwDM6Z9g==", 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-09-12T03:38:07.744 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg==", 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-09-12T03:38:07.745 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm5VfQNRAAGf2hnydokIG+odC7tYwWmA==", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmLGXkMhAAAdcwGqJEbb70Nj7zyM+Rjw==", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:38:07.746 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmJVADOxAAgfVRqw3J8L9oClushRFJgQ==", 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.747 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQASYeJmw4+ENRAAkTAy3UFY3keAJJFJvyQaAA==", 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJmITbDDRAATeaIKFJq+RkCdlkxcKrTaw==", 2024-09-12T03:38:07.748 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQATYeJm2FbOChAAEFXtXZ5fcQxn3CaZdENbtA==", 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-09-12T03:38:07.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:07.750 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-12T03:38:07.750 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:07.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:38:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfd40678f0 msgr2=0x7fdfd4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfd40678f0 0x7fdfd4069db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4000f70 tx=0x7fdfe40079e0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40d3060 msgr2=0x7fdff40cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40d3060 0x7fdff40cbe90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800d5f0 tx=0x7fdfe800dab0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 shutdown_connections 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fdfd40678f0 0x7fdfd4069db0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdff40d3060 0x7fdff40cbe90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fdff4161a60 0x7fdff4158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 --2- 172.21.15.73:0/884826493 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdff40cf450 0x7fdff40b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 >> 172.21.15.73:0/884826493 conn(0x7fdff408bf90 msgr2=0x7fdff40b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 shutdown_connections 2024-09-12T03:38:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.737+0000 7fdff8e9e640 1 -- 172.21.15.73:0/884826493 wait complete. 2024-09-12T03:38:07.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T03:38:07.754 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:38:07.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.901+0000 7fec64236640 1 Processor -- start 2024-09-12T03:38:07.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.901+0000 7fec64236640 1 -- start start 2024-09-12T03:38:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec64236640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c1520a0 0x7fec5c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec64236640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fec5c06fe50 0x7fec5c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec64236640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec5c15f1d0 0x7fec5c071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec64236640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fec5c152480 con 0x7fec5c15f1d0 2024-09-12T03:38:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec64236640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fec5c070250 con 0x7fec5c06fe50 2024-09-12T03:38:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec64236640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c0aede0 con 0x7fec5c1520a0 2024-09-12T03:38:07.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec5c15f1d0 0x7fec5c071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec5c15f1d0 0x7fec5c071f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52510/0 (socket says 172.21.15.73:52510) 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 -- 172.21.15.73:0/4210154252 learned_addr learned my addr 172.21.15.73:0/4210154252 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 -- 172.21.15.73:0/4210154252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c1520a0 msgr2=0x7fec5c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec61fd2640 1 --2- 172.21.15.73:0/4210154252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c1520a0 0x7fec5c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec617d1640 1 --2- 172.21.15.73:0/4210154252 >> v2:172.21.15.150:3300/0 conn(0x7fec5c06fe50 0x7fec5c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 --2- 172.21.15.73:0/4210154252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c1520a0 0x7fec5c06f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 -- 172.21.15.73:0/4210154252 >> v2:172.21.15.150:3300/0 conn(0x7fec5c06fe50 msgr2=0x7fec5c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 --2- 172.21.15.73:0/4210154252 >> v2:172.21.15.150:3300/0 conn(0x7fec5c06fe50 0x7fec5c15ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 -- 172.21.15.73:0/4210154252 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c15fa10 con 0x7fec5c15f1d0 2024-09-12T03:38:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec627d3640 1 --2- 172.21.15.73:0/4210154252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c15f1d0 0x7fec5c071f10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fec5c06de20 tx=0x7fec5401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbc95cb252df19f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec60fd0640 1 -- 172.21.15.73:0/4210154252 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540a5590 con 0x7fec5c15f1d0 2024-09-12T03:38:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec60fd0640 1 -- 172.21.15.73:0/4210154252 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540a5730 con 0x7fec5c15f1d0 2024-09-12T03:38:07.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.905+0000 7fec60fd0640 1 -- 172.21.15.73:0/4210154252 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540a5b00 con 0x7fec5c15f1d0 2024-09-12T03:38:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- 172.21.15.73:0/4210154252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c15f1d0 msgr2=0x7fec5c071f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 --2- 172.21.15.73:0/4210154252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c15f1d0 0x7fec5c071f10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fec5c06de20 tx=0x7fec5401c710 comp rx=0 tx=0).stop 2024-09-12T03:38:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- 172.21.15.73:0/4210154252 shutdown_connections 2024-09-12T03:38:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 --2- 172.21.15.73:0/4210154252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c15f1d0 0x7fec5c071f10 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 --2- 172.21.15.73:0/4210154252 >> v2:172.21.15.150:3300/0 conn(0x7fec5c06fe50 0x7fec5c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 --2- 172.21.15.73:0/4210154252 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c1520a0 0x7fec5c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- 172.21.15.73:0/4210154252 >> 172.21.15.73:0/4210154252 conn(0x7fec5c0b1f90 msgr2=0x7fec5c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- 172.21.15.73:0/4210154252 shutdown_connections 2024-09-12T03:38:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- 172.21.15.73:0/4210154252 wait complete. 2024-09-12T03:38:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 Processor -- start 2024-09-12T03:38:07.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- start start 2024-09-12T03:38:07.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c06fe50 0x7fec5c0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c1520a0 0x7fec5c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c15f1d0 0x7fec5c1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c073d30 con 0x7fec5c1520a0 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c073a50 con 0x7fec5c06fe50 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fec5c15f680 con 0x7fec5c15f1d0 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c1520a0 0x7fec5c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec61fd2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c06fe50 0x7fec5c0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c1520a0 0x7fec5c15fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52522/0 (socket says 172.21.15.73:52522) 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 -- 172.21.15.73:0/1731802013 learned_addr learned my addr 172.21.15.73:0/1731802013 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec627d3640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c15f1d0 0x7fec5c1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 -- 172.21.15.73:0/1731802013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c15f1d0 msgr2=0x7fec5c1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c15f1d0 0x7fec5c1410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 -- 172.21.15.73:0/1731802013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c06fe50 msgr2=0x7fec5c0b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:07.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c06fe50 0x7fec5c0b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 -- 172.21.15.73:0/1731802013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c09c3e0 con 0x7fec5c1520a0 2024-09-12T03:38:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec617d1640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c1520a0 0x7fec5c15fcc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c570 tx=0x7fec5000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec5a7fc640 1 -- 172.21.15.73:0/1731802013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50015070 con 0x7fec5c1520a0 2024-09-12T03:38:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec5a7fc640 1 -- 172.21.15.73:0/1731802013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec50004220 con 0x7fec5c1520a0 2024-09-12T03:38:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c09c6c0 con 0x7fec5c1520a0 2024-09-12T03:38:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec5a7fc640 1 -- 172.21.15.73:0/1731802013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50003620 con 0x7fec5c1520a0 2024-09-12T03:38:07.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.909+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c09cc80 con 0x7fec5c1520a0 2024-09-12T03:38:07.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.913+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c06e540 con 0x7fec5c1520a0 2024-09-12T03:38:07.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.913+0000 7fec5a7fc640 1 -- 172.21.15.73:0/1731802013 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fec500037c0 con 0x7fec5c1520a0 2024-09-12T03:38:07.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.913+0000 7fec5a7fc640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec480678c0 0x7fec48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:07.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.913+0000 7fec5a7fc640 1 -- 172.21.15.73:0/1731802013 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7fec50085770 con 0x7fec5c1520a0 2024-09-12T03:38:07.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.913+0000 7fec61fd2640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec480678c0 0x7fec48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:07.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.913+0000 7fec61fd2640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec480678c0 0x7fec48069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006fd0 tx=0x7fec4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:07.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:07.917+0000 7fec5a7fc640 1 -- 172.21.15.73:0/1731802013 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec50055e20 con 0x7fec5c1520a0 2024-09-12T03:38:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fec5c0b5350 con 0x7fec5c1520a0 2024-09-12T03:38:08.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec5a7fc640 1 -- 172.21.15.73:0/1731802013 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) ==== 84+0+65 (secure 0 0 0) 0x7fec5005a120 con 0x7fec5c1520a0 2024-09-12T03:38:08.082 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:08.083 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-09-12T03:38:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-09-12T03:38:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-09-12T03:38:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-09-12T03:38:08.083 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:08.083 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-09-12T03:38:08.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec480678c0 msgr2=0x7fec48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec480678c0 0x7fec48069d80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006fd0 tx=0x7fec4c008040 comp rx=0 tx=0).stop 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c1520a0 msgr2=0x7fec5c15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c1520a0 0x7fec5c15fcc0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fec5000c570 tx=0x7fec5000ca30 comp rx=0 tx=0).stop 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 shutdown_connections 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fec480678c0 0x7fec48069d80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec5c1520a0 0x7fec5c15fcc0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fec5c15f1d0 0x7fec5c1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 --2- 172.21.15.73:0/1731802013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec5c06fe50 0x7fec5c0b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 >> 172.21.15.73:0/1731802013 conn(0x7fec5c0b1f90 msgr2=0x7fec5c151180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 shutdown_connections 2024-09-12T03:38:08.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.081+0000 7fec64236640 1 -- 172.21.15.73:0/1731802013 wait complete. 2024-09-12T03:38:08.100 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T03:38:08.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T03:38:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b2a323640 1 Processor -- start 2024-09-12T03:38:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b2a323640 1 -- start start 2024-09-12T03:38:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b2a323640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b24070020 0x7f5b2415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b2a323640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b2415f1d0 0x7f5b240adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:08.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b2a323640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240aede0 con 0x7f5b241520a0 2024-09-12T03:38:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b2a323640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5b24152480 con 0x7f5b24070020 2024-09-12T03:38:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b2a323640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2415fa10 con 0x7f5b2415f1d0 2024-09-12T03:38:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b1b7fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b24070020 0x7f5b2415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b288c0640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b2415f1d0 0x7f5b240adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b1b7fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5b24070020 0x7f5b2415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:38548/0 (socket says 172.21.15.73:38548) 2024-09-12T03:38:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b1b7fe640 1 -- 172.21.15.73:0/2335801735 learned_addr learned my addr 172.21.15.73:0/2335801735 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:08.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b288c0640 1 -- 172.21.15.73:0/2335801735 >> v2:172.21.15.150:3300/0 conn(0x7f5b24070020 msgr2=0x7f5b2415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b288c0640 1 --2- 172.21.15.73:0/2335801735 >> v2:172.21.15.150:3300/0 conn(0x7f5b24070020 0x7f5b2415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b288c0640 1 -- 172.21.15.73:0/2335801735 >> v1:172.21.15.150:6789/0 conn(0x7f5b241520a0 legacy=0x7f5b2406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b288c0640 1 -- 172.21.15.73:0/2335801735 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b24074250 con 0x7f5b2415f1d0 2024-09-12T03:38:08.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.213+0000 7f5b1b7fe640 1 --2- 172.21.15.73:0/2335801735 >> v2:172.21.15.150:3300/0 conn(0x7f5b24070020 0x7f5b2415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:38:08.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b288c0640 1 --2- 172.21.15.73:0/2335801735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b2415f1d0 0x7f5b240adc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009d90 tx=0x7f5b1c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3bc5979d675b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:08.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b237fe640 1 -- 172.21.15.73:0/2335801735 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0b2070 con 0x7f5b2415f1d0 2024-09-12T03:38:08.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b237fe640 1 -- 172.21.15.73:0/2335801735 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0a5a00 con 0x7f5b2415f1d0 2024-09-12T03:38:08.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b237fe640 1 -- 172.21.15.73:0/2335801735 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0a5dd0 con 0x7f5b2415f1d0 2024-09-12T03:38:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 -- 172.21.15.73:0/2335801735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b2415f1d0 msgr2=0x7f5b240adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 --2- 172.21.15.73:0/2335801735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b2415f1d0 0x7f5b240adc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009d90 tx=0x7f5b1c01c940 comp rx=0 tx=0).stop 2024-09-12T03:38:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 -- 172.21.15.73:0/2335801735 shutdown_connections 2024-09-12T03:38:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 --2- 172.21.15.73:0/2335801735 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b2415f1d0 0x7f5b240adc80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 --2- 172.21.15.73:0/2335801735 >> v2:172.21.15.150:3300/0 conn(0x7f5b24070020 0x7f5b2415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 -- 172.21.15.73:0/2335801735 >> 172.21.15.73:0/2335801735 conn(0x7f5b240b1f90 msgr2=0x7f5b240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:08.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 -- 172.21.15.73:0/2335801735 shutdown_connections 2024-09-12T03:38:08.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.217+0000 7f5b2a323640 1 -- 172.21.15.73:0/2335801735 wait complete. 2024-09-12T03:38:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 Processor -- start 2024-09-12T03:38:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 -- start start 2024-09-12T03:38:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24070020 0x7f5b2414ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b241520a0 0x7f5b240afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b2415f1d0 0x7f5b2414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:08.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2415f680 con 0x7f5b24070020 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5b24073d30 con 0x7f5b2415f1d0 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5b24167f10 con 0x7f5b241520a0 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24070020 0x7f5b2414ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24070020 0x7f5b2414ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52538/0 (socket says 172.21.15.73:52538) 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 -- 172.21.15.73:0/53173177 learned_addr learned my addr 172.21.15.73:0/53173177 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b1b7fe640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b241520a0 0x7f5b240afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b288c0640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b2415f1d0 0x7f5b2414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 -- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b241520a0 msgr2=0x7f5b240afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b241520a0 0x7f5b240afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 -- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b2415f1d0 msgr2=0x7f5b2414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b2415f1d0 0x7f5b2414f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 -- 172.21.15.73:0/53173177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b24165000 con 0x7f5b24070020 2024-09-12T03:38:08.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b23fff640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24070020 0x7f5b2414ce20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c420 tx=0x7f5b1400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:08.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b217fa640 1 -- 172.21.15.73:0/53173177 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b140052d0 con 0x7f5b24070020 2024-09-12T03:38:08.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b217fa640 1 -- 172.21.15.73:0/53173177 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b14005470 con 0x7f5b24070020 2024-09-12T03:38:08.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b241652e0 con 0x7f5b24070020 2024-09-12T03:38:08.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b217fa640 1 -- 172.21.15.73:0/53173177 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14007260 con 0x7f5b24070020 2024-09-12T03:38:08.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2414d980 con 0x7f5b24070020 2024-09-12T03:38:08.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2414db80 con 0x7f5b24070020 2024-09-12T03:38:08.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b217fa640 1 -- 172.21.15.73:0/53173177 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5b14007400 con 0x7f5b24070020 2024-09-12T03:38:08.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b217fa640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b040678c0 0x7f5b04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:08.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b217fa640 1 -- 172.21.15.73:0/53173177 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5249+0+0 (secure 0 0 0) 0x7f5b14084f90 con 0x7f5b24070020 2024-09-12T03:38:08.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.221+0000 7f5b1b7fe640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b040678c0 0x7f5b04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:08.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.225+0000 7f5b1b7fe640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b040678c0 0x7f5b04069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5b24069010 tx=0x7f5b0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:08.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.225+0000 7f5b217fa640 1 -- 172.21.15.73:0/53173177 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5b2414db80 con 0x7f5b24070020 2024-09-12T03:38:08.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:08.377+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5b240d0f50 con 0x7f5b24070020 2024-09-12T03:38:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.329+0000 7f5b217fa640 1 -- 172.21.15.73:0/53173177 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) ==== 138+0+0 (secure 0 0 0) 0x7f5b14055c90 con 0x7f5b24070020 2024-09-12T03:38:09.332 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-09-12T03:38:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.333+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b040678c0 msgr2=0x7f5b04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.333+0000 7f5b2a323640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b040678c0 0x7f5b04069d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5b24069010 tx=0x7f5b0c008040 comp rx=0 tx=0).stop 2024-09-12T03:38:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.333+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24070020 msgr2=0x7f5b2414ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:09.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.333+0000 7f5b2a323640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24070020 0x7f5b2414ce20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400c420 tx=0x7f5b1400c8e0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 shutdown_connections 2024-09-12T03:38:09.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5b040678c0 0x7f5b04069d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5b2415f1d0 0x7f5b2414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5b241520a0 0x7f5b240afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 --2- 172.21.15.73:0/53173177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b24070020 0x7f5b2414ce20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 >> 172.21.15.73:0/53173177 conn(0x7f5b240b1f90 msgr2=0x7f5b24151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:09.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 shutdown_connections 2024-09-12T03:38:09.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.337+0000 7f5b2a323640 1 -- 172.21.15.73:0/53173177 wait complete. 2024-09-12T03:38:09.361 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T03:38:09.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f8278370640 1 Processor -- start 2024-09-12T03:38:09.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f8278370640 1 -- start start 2024-09-12T03:38:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f8278370640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8270073100 0x7f82700cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f8278370640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f82700cdfd0 0x7f827006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:09.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f8278370640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82700ce8d0 con 0x7f82700cc870 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f8278370640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f82700cebb0 con 0x7f82700cdfd0 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f8278370640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f82700cee90 con 0x7f8270073100 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f827610c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f82700cc870 0x7f82700ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53650/0 (socket says 172.21.15.73:53650) 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f827610c640 1 -- 172.21.15.73:0/68883077 learned_addr learned my addr 172.21.15.73:0/68883077 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.489+0000 7f827690d640 1 --2- 172.21.15.73:0/68883077 >> v2:172.21.15.73:3300/0 conn(0x7f82700cdfd0 0x7f827006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827510a640 1 -- 172.21.15.73:0/68883077 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003281052 0 0) 0x7f82700ce8d0 con 0x7f82700cc870 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827510a640 1 -- 172.21.15.73:0/68883077 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f825c003530 con 0x7f82700cc870 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827590b640 1 --2- 172.21.15.73:0/68883077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8270073100 0x7f82700cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827690d640 1 -- 172.21.15.73:0/68883077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8270073100 msgr2=0x7f82700cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827690d640 1 --2- 172.21.15.73:0/68883077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8270073100 0x7f82700cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827690d640 1 -- 172.21.15.73:0/68883077 >> v1:172.21.15.73:6789/0 conn(0x7f82700cc870 legacy=0x7f82700ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:09.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827690d640 1 -- 172.21.15.73:0/68883077 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82700cf170 con 0x7f82700cdfd0 2024-09-12T03:38:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827690d640 1 --2- 172.21.15.73:0/68883077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82700cdfd0 0x7f827006de00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8268009d90 tx=0x7f826801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3aaf37aea3d411 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827510a640 1 -- 172.21.15.73:0/68883077 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680b2070 con 0x7f82700cdfd0 2024-09-12T03:38:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827510a640 1 -- 172.21.15.73:0/68883077 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82680a5a20 con 0x7f82700cdfd0 2024-09-12T03:38:09.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f827510a640 1 -- 172.21.15.73:0/68883077 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680a5dd0 con 0x7f82700cdfd0 2024-09-12T03:38:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 -- 172.21.15.73:0/68883077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82700cdfd0 msgr2=0x7f827006de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 --2- 172.21.15.73:0/68883077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82700cdfd0 0x7f827006de00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8268009d90 tx=0x7f826801c940 comp rx=0 tx=0).stop 2024-09-12T03:38:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 -- 172.21.15.73:0/68883077 shutdown_connections 2024-09-12T03:38:09.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 --2- 172.21.15.73:0/68883077 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8270073100 0x7f82700cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 --2- 172.21.15.73:0/68883077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82700cdfd0 0x7f827006de00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 -- 172.21.15.73:0/68883077 >> 172.21.15.73:0/68883077 conn(0x7f82700b1c80 msgr2=0x7f82700b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 -- 172.21.15.73:0/68883077 shutdown_connections 2024-09-12T03:38:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.493+0000 7f8278370640 1 -- 172.21.15.73:0/68883077 wait complete. 2024-09-12T03:38:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 Processor -- start 2024-09-12T03:38:09.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 -- start start 2024-09-12T03:38:09.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8270073100 0x7f827013fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:09.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82700cc870 0x7f82701429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82700cdfd0 0x7f827013b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8270169310 con 0x7f8270073100 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8270169190 con 0x7f82700cdfd0 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8270169490 con 0x7f82700cc870 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8270073100 0x7f827013fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8270073100 0x7f827013fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52542/0 (socket says 172.21.15.73:52542) 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 -- 172.21.15.73:0/3843829055 learned_addr learned my addr 172.21.15.73:0/3843829055 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 -- 172.21.15.73:0/3843829055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82700cc870 msgr2=0x7f82701429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82700cc870 0x7f82701429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 -- 172.21.15.73:0/3843829055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82700cdfd0 msgr2=0x7f827013b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:09.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82700cdfd0 0x7f827013b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 -- 172.21.15.73:0/3843829055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8270142210 con 0x7f8270073100 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f827610c640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8270073100 0x7f827013fdb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c450 tx=0x7f826c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8266ffd640 1 -- 172.21.15.73:0/3843829055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c017070 con 0x7f8270073100 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8266ffd640 1 -- 172.21.15.73:0/3843829055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c005cf0 con 0x7f8270073100 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8270142ee0 con 0x7f8270073100 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8266ffd640 1 -- 172.21.15.73:0/3843829055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826c007290 con 0x7f8270073100 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82701397e0 con 0x7f8270073100 2024-09-12T03:38:09.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82700cf970 con 0x7f8270073100 2024-09-12T03:38:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.497+0000 7f8266ffd640 1 -- 172.21.15.73:0/3843829055 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f826c01a070 con 0x7f8270073100 2024-09-12T03:38:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.501+0000 7f8266ffd640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f82540678f0 0x7f8254069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.501+0000 7f8266ffd640 1 -- 172.21.15.73:0/3843829055 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5619+0+0 (secure 0 0 0) 0x7f826c085310 con 0x7f8270073100 2024-09-12T03:38:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.501+0000 7f827590b640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f82540678f0 0x7f8254069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:09.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.501+0000 7f827590b640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f82540678f0 0x7f8254069db0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f827009e280 tx=0x7f8260008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:09.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.505+0000 7f8266ffd640 1 -- 172.21.15.73:0/3843829055 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f826c021080 con 0x7f8270073100 2024-09-12T03:38:09.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:09.665+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f82700af8d0 con 0x7f8270073100 2024-09-12T03:38:10.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.345+0000 7f8266ffd640 1 -- 172.21.15.73:0/3843829055 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) ==== 170+0+0 (secure 0 0 0) 0x7f8270142ee0 con 0x7f8270073100 2024-09-12T03:38:10.348 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-09-12T03:38:10.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f82540678f0 msgr2=0x7f8254069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:10.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f82540678f0 0x7f8254069db0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f827009e280 tx=0x7f8260008040 comp rx=0 tx=0).stop 2024-09-12T03:38:10.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8270073100 msgr2=0x7f827013fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:10.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8270073100 0x7f827013fdb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f826c00c450 tx=0x7f826c00c910 comp rx=0 tx=0).stop 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 shutdown_connections 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f82540678f0 0x7f8254069db0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82700cdfd0 0x7f827013b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f82700cc870 0x7f82701429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 --2- 172.21.15.73:0/3843829055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8270073100 0x7f827013fdb0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 >> 172.21.15.73:0/3843829055 conn(0x7f82700b1c80 msgr2=0x7f82700afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 shutdown_connections 2024-09-12T03:38:10.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.353+0000 7f8278370640 1 -- 172.21.15.73:0/3843829055 wait complete. 2024-09-12T03:38:10.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T03:38:10.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 Processor -- start 2024-09-12T03:38:10.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 -- start start 2024-09-12T03:38:10.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6741587a0 0x7ff6740b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:10.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6740b37d0 0x7ff67406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:10.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff67406e4b0 0x7ff674161e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:10.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff67406f870 con 0x7ff6740b37d0 2024-09-12T03:38:10.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7ff6740b3c10 con 0x7ff67406e4b0 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67b7df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff67406ec60 con 0x7ff6741587a0 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6740b37d0 0x7ff67406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6740b37d0 0x7ff67406df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52554/0 (socket says 172.21.15.73:52554) 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 -- 172.21.15.73:0/2318627389 learned_addr learned my addr 172.21.15.73:0/2318627389 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff679d7c640 1 --2- 172.21.15.73:0/2318627389 >> v2:172.21.15.150:3300/0 conn(0x7ff67406e4b0 0x7ff674161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff67957b640 1 --2- 172.21.15.73:0/2318627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6741587a0 0x7ff6740b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 -- 172.21.15.73:0/2318627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6741587a0 msgr2=0x7ff6740b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 --2- 172.21.15.73:0/2318627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6741587a0 0x7ff6740b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 -- 172.21.15.73:0/2318627389 >> v2:172.21.15.150:3300/0 conn(0x7ff67406e4b0 msgr2=0x7ff674161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 --2- 172.21.15.73:0/2318627389 >> v2:172.21.15.150:3300/0 conn(0x7ff67406e4b0 0x7ff674161e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.505+0000 7ff678d7a640 1 -- 172.21.15.73:0/2318627389 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67406ef40 con 0x7ff6740b37d0 2024-09-12T03:38:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff678d7a640 1 --2- 172.21.15.73:0/2318627389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6740b37d0 0x7ff67406df70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff67406da30 tx=0x7ff66401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46da75abc55e1559 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff673fff640 1 -- 172.21.15.73:0/2318627389 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640b0070 con 0x7ff6740b37d0 2024-09-12T03:38:10.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff673fff640 1 -- 172.21.15.73:0/2318627389 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6640ab600 con 0x7ff6740b37d0 2024-09-12T03:38:10.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff673fff640 1 -- 172.21.15.73:0/2318627389 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640ab9d0 con 0x7ff6740b37d0 2024-09-12T03:38:10.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 -- 172.21.15.73:0/2318627389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6740b37d0 msgr2=0x7ff67406df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 --2- 172.21.15.73:0/2318627389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6740b37d0 0x7ff67406df70 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff67406da30 tx=0x7ff66401c230 comp rx=0 tx=0).stop 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 -- 172.21.15.73:0/2318627389 shutdown_connections 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 --2- 172.21.15.73:0/2318627389 >> v2:172.21.15.150:3300/0 conn(0x7ff67406e4b0 0x7ff674161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 --2- 172.21.15.73:0/2318627389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6740b37d0 0x7ff67406df70 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 --2- 172.21.15.73:0/2318627389 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6741587a0 0x7ff6740b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 -- 172.21.15.73:0/2318627389 >> 172.21.15.73:0/2318627389 conn(0x7ff6740b1f90 msgr2=0x7ff6740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 -- 172.21.15.73:0/2318627389 shutdown_connections 2024-09-12T03:38:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 -- 172.21.15.73:0/2318627389 wait complete. 2024-09-12T03:38:10.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 Processor -- start 2024-09-12T03:38:10.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.509+0000 7ff67b7df640 1 -- start start 2024-09-12T03:38:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff67406e4b0 0x7ff67414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6740b37d0 0x7ff674150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6741587a0 0x7ff674155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff674158b80 con 0x7ff67406e4b0 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7ff674072160 con 0x7ff6741587a0 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7ff6741507c0 con 0x7ff6740b37d0 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff67406e4b0 0x7ff67414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff67406e4b0 0x7ff67414f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52568/0 (socket says 172.21.15.73:52568) 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 -- 172.21.15.73:0/3778541340 learned_addr learned my addr 172.21.15.73:0/3778541340 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff679d7c640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6741587a0 0x7ff674155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 -- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6740b37d0 msgr2=0x7ff674150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff678d7a640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6740b37d0 0x7ff674150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6740b37d0 0x7ff674150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 -- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6741587a0 msgr2=0x7ff674155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6741587a0 0x7ff674155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 -- 172.21.15.73:0/3778541340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6741509f0 con 0x7ff67406e4b0 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67957b640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff67406e4b0 0x7ff67414f2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00cd00 tx=0x7ff65c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff671ffb640 1 -- 172.21.15.73:0/3778541340 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0039a0 con 0x7ff67406e4b0 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff671ffb640 1 -- 172.21.15.73:0/3778541340 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c003b40 con 0x7ff67406e4b0 2024-09-12T03:38:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff674150cd0 con 0x7ff67406e4b0 2024-09-12T03:38:10.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff671ffb640 1 -- 172.21.15.73:0/3778541340 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c004020 con 0x7ff67406e4b0 2024-09-12T03:38:10.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff674156580 con 0x7ff67406e4b0 2024-09-12T03:38:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff674156370 con 0x7ff67406e4b0 2024-09-12T03:38:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff671ffb640 1 -- 172.21.15.73:0/3778541340 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff65c0041c0 con 0x7ff67406e4b0 2024-09-12T03:38:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff671ffb640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff6540678c0 0x7ff654069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff671ffb640 1 -- 172.21.15.73:0/3778541340 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 6001+0+0 (secure 0 0 0) 0x7ff65c0862f0 con 0x7ff67406e4b0 2024-09-12T03:38:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff678d7a640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff6540678c0 0x7ff654069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.513+0000 7ff678d7a640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff6540678c0 0x7ff654069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff6640ad000 tx=0x7ff664008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:10.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.521+0000 7ff671ffb640 1 -- 172.21.15.73:0/3778541340 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff65c014030 con 0x7ff67406e4b0 2024-09-12T03:38:10.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:10.705+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff674070080 con 0x7ff67406e4b0 2024-09-12T03:38:11.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.361+0000 7ff671ffb640 1 -- 172.21.15.73:0/3778541340 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v52) ==== 174+0+0 (secure 0 0 0) 0x7ff65c056d00 con 0x7ff67406e4b0 2024-09-12T03:38:11.385 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 15 and data pool 16 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.385+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff6540678c0 msgr2=0x7ff654069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.385+0000 7ff67b7df640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff6540678c0 0x7ff654069d80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff6640ad000 tx=0x7ff664008040 comp rx=0 tx=0).stop 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.385+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff67406e4b0 msgr2=0x7ff67414f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.385+0000 7ff67b7df640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff67406e4b0 0x7ff67414f2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00cd00 tx=0x7ff65c00a5c0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 shutdown_connections 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7ff6540678c0 0x7ff654069d80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6741587a0 0x7ff674155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7ff6740b37d0 0x7ff674150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 --2- 172.21.15.73:0/3778541340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff67406e4b0 0x7ff67414f2f0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 >> 172.21.15.73:0/3778541340 conn(0x7ff6740b1f90 msgr2=0x7ff6741470e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 shutdown_connections 2024-09-12T03:38:11.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.389+0000 7ff67b7df640 1 -- 172.21.15.73:0/3778541340 wait complete. 2024-09-12T03:38:11.411 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:38:11.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec2eb2640 1 Processor -- start 2024-09-12T03:38:11.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec2eb2640 1 -- start start 2024-09-12T03:38:11.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec2eb2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 0x7f9ebc15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec2eb2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ebc0aede0 con 0x7f9ebc15f1d0 2024-09-12T03:38:11.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec2eb2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ebc15fa10 con 0x7f9ebc1520a0 2024-09-12T03:38:11.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec2eb2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ebc152480 con 0x7f9ebc070020 2024-09-12T03:38:11.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec144f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9ebc15f1d0 0x7f9ebc0adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53662/0 (socket says 172.21.15.73:53662) 2024-09-12T03:38:11.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec144f640 1 -- 172.21.15.73:0/3214044312 learned_addr learned my addr 172.21.15.73:0/3214044312 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:11.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 0x7f9ebc15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752258046 0 0) 0x7f9ebc0aede0 con 0x7f9ebc15f1d0 2024-09-12T03:38:11.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ea4003530 con 0x7f9ebc15f1d0 2024-09-12T03:38:11.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4114599025 0 0) 0x7f9ea4003530 con 0x7f9ebc15f1d0 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 msgr2=0x7f9ebc15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 0x7f9ebc15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 >> v1:172.21.15.150:6789/0 conn(0x7f9ebc1520a0 legacy=0x7f9ebc06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ebc074250 con 0x7f9ebc15f1d0 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f9eb4001a00 con 0x7f9ebc15f1d0 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 >> v1:172.21.15.73:6789/0 conn(0x7f9ebc15f1d0 legacy=0x7f9ebc0adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 0x7f9ea40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea4003f70 0x7f9ea4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4004d50 0x7f9ea40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea400ba80 con 0x7f9ea4003f70 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea400bc30 con 0x7f9ea4004d50 2024-09-12T03:38:11.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea400be30 con 0x7f9ebc070020 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea4003f70 0x7f9ea4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec0c4e640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 0x7f9ea40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec144f640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4004d50 0x7f9ea40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb3fff640 1 -- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 msgr2=0x7f9ea40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 0x7f9ea40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb3fff640 1 -- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4004d50 msgr2=0x7f9ea40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4004d50 0x7f9ea40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9eb3fff640 1 -- 172.21.15.73:0/3214044312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea4003530 con 0x7f9ea4003f70 2024-09-12T03:38:11.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.525+0000 7f9ec0c4e640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc070020 0x7f9ea40039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:11.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea4003f70 0x7f9ea4004810 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009ab0 tx=0x7f9eac01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41428cbbeb41ea3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:11.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0b2070 con 0x7f9ea4003f70 2024-09-12T03:38:11.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eac0a5530 con 0x7f9ea4003f70 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9eb37fe640 1 -- 172.21.15.73:0/3214044312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0096b0 con 0x7f9ea4003f70 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/3214044312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea4003f70 msgr2=0x7f9ea4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 --2- 172.21.15.73:0/3214044312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ea4003f70 0x7f9ea4004810 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009ab0 tx=0x7f9eac01ca50 comp rx=0 tx=0).stop 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec144f640 1 -- 172.21.15.73:0/3214044312 reap_dead start 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/3214044312 shutdown_connections 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/3214044312 >> 172.21.15.73:0/3214044312 conn(0x7f9ebc0b1f90 msgr2=0x7f9ebc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/3214044312 shutdown_connections 2024-09-12T03:38:11.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/3214044312 wait complete. 2024-09-12T03:38:11.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 Processor -- start 2024-09-12T03:38:11.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.529+0000 7f9ec2eb2640 1 -- start start 2024-09-12T03:38:11.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4003f70 0x7f9ebc14a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ebc15d590 0x7f9ebc15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc0b0e50 0x7f9ebc0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc073a50 con 0x7f9ebc15d590 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ebc073770 con 0x7f9ea4003f70 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ebc073d30 con 0x7f9ebc0b0e50 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ebc15d590 0x7f9ebc15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ebc15d590 0x7f9ebc15d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52586/0 (socket says 172.21.15.73:52586) 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 -- 172.21.15.73:0/777003991 learned_addr learned my addr 172.21.15.73:0/777003991 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec0c4e640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4003f70 0x7f9ebc14a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec144f640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc0b0e50 0x7f9ebc0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 -- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc0b0e50 msgr2=0x7f9ebc0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc0b0e50 0x7f9ebc0b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 -- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4003f70 msgr2=0x7f9ebc14a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4003f70 0x7f9ebc14a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 -- 172.21.15.73:0/777003991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ebc14aa70 con 0x7f9ebc15d590 2024-09-12T03:38:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb3fff640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ebc15d590 0x7f9ebc15d9f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009ab0 tx=0x7f9ea4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb17fa640 1 -- 172.21.15.73:0/777003991 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0b2040 con 0x7f9ebc15d590 2024-09-12T03:38:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb17fa640 1 -- 172.21.15.73:0/777003991 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eac0ad440 con 0x7f9ebc15d590 2024-09-12T03:38:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ebc14e960 con 0x7f9ebc15d590 2024-09-12T03:38:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb17fa640 1 -- 172.21.15.73:0/777003991 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0096b0 con 0x7f9ebc15d590 2024-09-12T03:38:11.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ebc14ef20 con 0x7f9ebc15d590 2024-09-12T03:38:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ebc06e540 con 0x7f9ebc15d590 2024-09-12T03:38:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb17fa640 1 -- 172.21.15.73:0/777003991 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9eac0ad7f0 con 0x7f9ebc15d590 2024-09-12T03:38:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb17fa640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ea80678c0 0x7f9ea8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9eb17fa640 1 -- 172.21.15.73:0/777003991 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f9eac1207f0 con 0x7f9ebc15d590 2024-09-12T03:38:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec0c4e640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ea80678c0 0x7f9ea8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.533+0000 7f9ec0c4e640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ea80678c0 0x7f9ea8069d80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8000c10 tx=0x7f9eb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:11.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.537+0000 7f9eb17fa640 1 -- 172.21.15.73:0/777003991 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ebc14aa70 con 0x7f9ebc15d590 2024-09-12T03:38:11.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.705+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ebc15a160 con 0x7f9ebc15d590 2024-09-12T03:38:11.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.705+0000 7f9eb17fa640 1 -- 172.21.15.73:0/777003991 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16958 (secure 0 0 0) 0x7f9eac016760 con 0x7f9ebc15d590 2024-09-12T03:38:11.707 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:11.707 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":97,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:38:10.711542+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:38:08.420270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T03:38:09.709269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:38:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ea80678c0 msgr2=0x7f9ea8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ea80678c0 0x7f9ea8069d80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8000c10 tx=0x7f9eb8009040 comp rx=0 tx=0).stop 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ebc15d590 msgr2=0x7f9ebc15d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ebc15d590 0x7f9ebc15d9f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009ab0 tx=0x7f9ea4005840 comp rx=0 tx=0).stop 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 shutdown_connections 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ea80678c0 0x7f9ea8069d80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ebc15d590 0x7f9ebc15d9f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9ebc0b0e50 0x7f9ebc0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 --2- 172.21.15.73:0/777003991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ea4003f70 0x7f9ebc14a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 >> 172.21.15.73:0/777003991 conn(0x7f9ebc0b1f90 msgr2=0x7f9ebc15a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 shutdown_connections 2024-09-12T03:38:11.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.709+0000 7f9ec2eb2640 1 -- 172.21.15.73:0/777003991 wait complete. 2024-09-12T03:38:11.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:38:11.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.841+0000 7fc4f8abe640 1 Processor -- start 2024-09-12T03:38:11.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.841+0000 7fc4f8abe640 1 -- start start 2024-09-12T03:38:11.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f8abe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc4f415c1c0 0x7fc4f415c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f8abe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4f406d3e0 0x7fc4f40ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f8abe640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4f40cd5b0 con 0x7fc4f415cae0 2024-09-12T03:38:11.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f8abe640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f40cd890 con 0x7fc4f406d3e0 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f8abe640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc4f40cdb70 con 0x7fc4f415c1c0 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4f406d3e0 0x7fc4f40ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4f406d3e0 0x7fc4f40ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52600/0 (socket says 172.21.15.73:52600) 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 -- 172.21.15.73:0/289551024 learned_addr learned my addr 172.21.15.73:0/289551024 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f259c640 1 --2- 172.21.15.73:0/289551024 >> v2:172.21.15.150:3300/0 conn(0x7fc4f415c1c0 0x7fc4f415c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 -- 172.21.15.73:0/289551024 >> v2:172.21.15.150:3300/0 conn(0x7fc4f415c1c0 msgr2=0x7fc4f415c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 --2- 172.21.15.73:0/289551024 >> v2:172.21.15.150:3300/0 conn(0x7fc4f415c1c0 0x7fc4f415c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 -- 172.21.15.73:0/289551024 >> v1:172.21.15.150:6789/0 conn(0x7fc4f415cae0 legacy=0x7fc4f406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 -- 172.21.15.73:0/289551024 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f40cde50 con 0x7fc4f406d3e0 2024-09-12T03:38:11.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f259c640 1 --2- 172.21.15.73:0/289551024 >> v2:172.21.15.150:3300/0 conn(0x7fc4f415c1c0 0x7fc4f415c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:11.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f2d9d640 1 --2- 172.21.15.73:0/289551024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f406d3e0 0x7fc4f40ce650 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4073a40 tx=0x7fc4ec01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f532a7ffccb20f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:11.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f159a640 1 -- 172.21.15.73:0/289551024 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0b0070 con 0x7fc4f406d3e0 2024-09-12T03:38:11.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f159a640 1 -- 172.21.15.73:0/289551024 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ec0ab600 con 0x7fc4f406d3e0 2024-09-12T03:38:11.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.845+0000 7fc4f159a640 1 -- 172.21.15.73:0/289551024 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0ab9d0 con 0x7fc4f406d3e0 2024-09-12T03:38:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- 172.21.15.73:0/289551024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f406d3e0 msgr2=0x7fc4f40ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/289551024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f406d3e0 0x7fc4f40ce650 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4073a40 tx=0x7fc4ec01c420 comp rx=0 tx=0).stop 2024-09-12T03:38:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- 172.21.15.73:0/289551024 shutdown_connections 2024-09-12T03:38:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/289551024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f406d3e0 0x7fc4f40ce650 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/289551024 >> v2:172.21.15.150:3300/0 conn(0x7fc4f415c1c0 0x7fc4f415c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- 172.21.15.73:0/289551024 >> 172.21.15.73:0/289551024 conn(0x7fc4f4072670 msgr2=0x7fc4f4072a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- 172.21.15.73:0/289551024 shutdown_connections 2024-09-12T03:38:11.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- 172.21.15.73:0/289551024 wait complete. 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 Processor -- start 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- start start 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f406d3e0 0x7fc4f4151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f415c1c0 0x7fc4f415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4151880 0x7fc4f4152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f40cef20 con 0x7fc4f415c1c0 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f40ceda0 con 0x7fc4f4151880 2024-09-12T03:38:11.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc4f40cf0a0 con 0x7fc4f406d3e0 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f415c1c0 0x7fc4f415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f415c1c0 0x7fc4f415d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52602/0 (socket says 172.21.15.73:52602) 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 -- 172.21.15.73:0/2631458982 learned_addr learned my addr 172.21.15.73:0/2631458982 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f259c640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f406d3e0 0x7fc4f4151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f2d9d640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4151880 0x7fc4f4152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 -- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f406d3e0 msgr2=0x7fc4f4151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f406d3e0 0x7fc4f4151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 -- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4151880 msgr2=0x7fc4f4152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4151880 0x7fc4f4152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 -- 172.21.15.73:0/2631458982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f4152940 con 0x7fc4f415c1c0 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f2d9d640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4151880 0x7fc4f4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:11.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f1d9b640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f415c1c0 0x7fc4f415d8e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c490 tx=0x7fc4dc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4eaffd640 1 -- 172.21.15.73:0/2631458982 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc017070 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4eaffd640 1 -- 172.21.15.73:0/2631458982 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4dc003600 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f415e390 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4eaffd640 1 -- 172.21.15.73:0/2631458982 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc003a30 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.849+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f41562d0 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.853+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f40ce650 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.853+0000 7fc4eaffd640 1 -- 172.21.15.73:0/2631458982 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4dc01a070 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.853+0000 7fc4eaffd640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4d40678f0 0x7fc4d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.853+0000 7fc4eaffd640 1 -- 172.21.15.73:0/2631458982 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7fc4dc0851a0 con 0x7fc4f415c1c0 2024-09-12T03:38:11.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.853+0000 7fc4f259c640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4d40678f0 0x7fc4d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:11.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.853+0000 7fc4f259c640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4d40678f0 0x7fc4d4069db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4008ee0 tx=0x7fc4e4008430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:11.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:11.857+0000 7fc4eaffd640 1 -- 172.21.15.73:0/2631458982 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4f415e390 con 0x7fc4f415c1c0 2024-09-12T03:38:12.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.017+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4f4072e60 con 0x7fc4f415c1c0 2024-09-12T03:38:12.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4eaffd640 1 -- 172.21.15.73:0/2631458982 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16958 (secure 0 0 0) 0x7fc4dc055be0 con 0x7fc4f415c1c0 2024-09-12T03:38:12.022 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:12.022 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":97,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:38:10.711542+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:38:08.420270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T03:38:09.709269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:38:12.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4d40678f0 msgr2=0x7fc4d4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4d40678f0 0x7fc4d4069db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4008ee0 tx=0x7fc4e4008430 comp rx=0 tx=0).stop 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f415c1c0 msgr2=0x7fc4f415d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f415c1c0 0x7fc4f415d8e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c490 tx=0x7fc4dc001e80 comp rx=0 tx=0).stop 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 shutdown_connections 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc4d40678f0 0x7fc4d4069db0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4f415c1c0 0x7fc4f415d8e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4f4151880 0x7fc4f4152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 --2- 172.21.15.73:0/2631458982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc4f406d3e0 0x7fc4f4151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 >> 172.21.15.73:0/2631458982 conn(0x7fc4f4072670 msgr2=0x7fc4f406e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 shutdown_connections 2024-09-12T03:38:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.021+0000 7fc4f8abe640 1 -- 172.21.15.73:0/2631458982 wait complete. 2024-09-12T03:38:12.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T03:38:12.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d036bc640 1 Processor -- start 2024-09-12T03:38:12.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d036bc640 1 -- start start 2024-09-12T03:38:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d036bc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 0x7f9cfc0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d036bc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cfc13fb30 con 0x7f9cfc1412e0 2024-09-12T03:38:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d036bc640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cfc13fe10 con 0x7f9cfc0b5b50 2024-09-12T03:38:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d036bc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9cfc140740 con 0x7f9cfc156720 2024-09-12T03:38:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d01c59640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9cfc1412e0 0x7f9cfc0b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53674/0 (socket says 172.21.15.73:53674) 2024-09-12T03:38:12.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d01c59640 1 -- 172.21.15.73:0/2099915657 learned_addr learned my addr 172.21.15.73:0/2099915657 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278164786 0 0) 0x7f9cfc13fb30 con 0x7f9cfc1412e0 2024-09-12T03:38:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ce8003530 con 0x7f9cfc1412e0 2024-09-12T03:38:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9d01458640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 0x7f9cfc0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1394786804 0 0) 0x7f9ce8003530 con 0x7f9cfc1412e0 2024-09-12T03:38:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 msgr2=0x7f9cfc0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 0x7f9cfc0b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 >> v1:172.21.15.150:6789/0 conn(0x7f9cfc0b5b50 legacy=0x7f9cfc140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc1400f0 con 0x7f9cfc1412e0 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.161+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f9cf4001680 con 0x7f9cfc1412e0 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 >> v1:172.21.15.73:6789/0 conn(0x7f9cfc1412e0 legacy=0x7f9cfc0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ce80039f0 0x7f9ce8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9ce8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 0x7f9ce8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc140740 con 0x7f9ce8004810 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce800bb00 con 0x7f9ce80039f0 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce800bd00 con 0x7f9cfc156720 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9ce8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d01458640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ce80039f0 0x7f9ce8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d01c59640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 0x7f9ce8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d00c57640 1 -- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 msgr2=0x7f9ce8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc156720 0x7f9ce8005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d00c57640 1 -- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ce80039f0 msgr2=0x7f9ce8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ce80039f0 0x7f9ce8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d00c57640 1 -- 172.21.15.73:0/2099915657 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce8003530 con 0x7f9ce8004810 2024-09-12T03:38:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d01458640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9ce80039f0 0x7f9ce8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9ce8004c90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc13f5b0 tx=0x7f9cec01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc53a631be74149 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0013a0 con 0x7f9ce8004810 2024-09-12T03:38:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cec0052f0 con 0x7f9ce8004810 2024-09-12T03:38:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9cf3fff640 1 -- 172.21.15.73:0/2099915657 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec003840 con 0x7f9ce8004810 2024-09-12T03:38:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d036bc640 1 -- 172.21.15.73:0/2099915657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 msgr2=0x7f9ce8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d036bc640 1 --2- 172.21.15.73:0/2099915657 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9ce8004c90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc13f5b0 tx=0x7f9cec01c380 comp rx=0 tx=0).stop 2024-09-12T03:38:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d01c59640 1 -- 172.21.15.73:0/2099915657 reap_dead start 2024-09-12T03:38:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d036bc640 1 -- 172.21.15.73:0/2099915657 shutdown_connections 2024-09-12T03:38:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d036bc640 1 -- 172.21.15.73:0/2099915657 >> 172.21.15.73:0/2099915657 conn(0x7f9cfc06c0c0 msgr2=0x7f9cfc06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d036bc640 1 -- 172.21.15.73:0/2099915657 shutdown_connections 2024-09-12T03:38:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.165+0000 7f9d036bc640 1 -- 172.21.15.73:0/2099915657 wait complete. 2024-09-12T03:38:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 Processor -- start 2024-09-12T03:38:12.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 -- start start 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9cfc1334f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cfc15eeb0 0x7f9cfc15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc144aa0 0x7f9cfc1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc13f6e0 con 0x7f9ce8004810 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc0728d0 con 0x7f9cfc15eeb0 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9cfc13f860 con 0x7f9cfc144aa0 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9cfc1334f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9cfc1334f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52612/0 (socket says 172.21.15.73:52612) 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 -- 172.21.15.73:0/2744959429 learned_addr learned my addr 172.21.15.73:0/2744959429 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cfc15eeb0 0x7f9cfc15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01c59640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc144aa0 0x7f9cfc1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 -- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc144aa0 msgr2=0x7f9cfc1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc144aa0 0x7f9cfc1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 -- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cfc15eeb0 msgr2=0x7f9cfc15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cfc15eeb0 0x7f9cfc15bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 -- 172.21.15.73:0/2744959429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc15c490 con 0x7f9ce8004810 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cfc15eeb0 0x7f9cfc15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d01458640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9cfc1334f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009fd0 tx=0x7f9cf800f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9cf1ffb640 1 -- 172.21.15.73:0/2744959429 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8018020 con 0x7f9ce8004810 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9cf1ffb640 1 -- 172.21.15.73:0/2744959429 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf8014610 con 0x7f9ce8004810 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9cf1ffb640 1 -- 172.21.15.73:0/2744959429 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8014a00 con 0x7f9ce8004810 2024-09-12T03:38:12.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cfc15c770 con 0x7f9ce8004810 2024-09-12T03:38:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cfc15cd30 con 0x7f9ce8004810 2024-09-12T03:38:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.169+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cfc0b5610 con 0x7f9ce8004810 2024-09-12T03:38:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.173+0000 7f9cf1ffb640 1 -- 172.21.15.73:0/2744959429 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cf801b020 con 0x7f9ce8004810 2024-09-12T03:38:12.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.173+0000 7f9cf1ffb640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ce00678c0 0x7f9ce0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.173+0000 7f9cf1ffb640 1 -- 172.21.15.73:0/2744959429 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 6101+0+0 (secure 0 0 0) 0x7f9cf8086810 con 0x7f9ce8004810 2024-09-12T03:38:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.173+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ce00678c0 0x7f9ce0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:12.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.173+0000 7f9d00c57640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ce00678c0 0x7f9ce0069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0b5f50 tx=0x7f9cec0011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:12.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.177+0000 7f9cf1ffb640 1 -- 172.21.15.73:0/2744959429 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9cf8022030 con 0x7f9ce8004810 2024-09-12T03:38:12.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:12.373+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9cfc0d15e0 con 0x7f9ce8004810 2024-09-12T03:38:13.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9cf1ffb640 1 -- 172.21.15.73:0/2744959429 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) ==== 118+0+0 (secure 0 0 0) 0x7f9cf8057130 con 0x7f9ce8004810 2024-09-12T03:38:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ce00678c0 msgr2=0x7f9ce0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ce00678c0 0x7f9ce0069d80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc0b5f50 tx=0x7f9cec0011a0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 msgr2=0x7f9cfc1334f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9cfc1334f0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009fd0 tx=0x7f9cf800f5e0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 shutdown_connections 2024-09-12T03:38:13.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f9ce00678c0 0x7f9ce0069d80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9cfc144aa0 0x7f9cfc1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9cfc15eeb0 0x7f9cfc15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 --2- 172.21.15.73:0/2744959429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9ce8004810 0x7f9cfc1334f0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 >> 172.21.15.73:0/2744959429 conn(0x7f9cfc06c0c0 msgr2=0x7f9cfc1598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 shutdown_connections 2024-09-12T03:38:13.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.377+0000 7f9d036bc640 1 -- 172.21.15.73:0/2744959429 wait complete. 2024-09-12T03:38:13.400 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T03:38:13.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T03:38:13.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96b5dd2640 1 Processor -- start 2024-09-12T03:38:13.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96b5dd2640 1 -- start start 2024-09-12T03:38:13.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96b5dd2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:13.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96b5dd2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96b0160480 0x7f96b006da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:13.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96b5dd2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b006e060 con 0x7f96b0072050 2024-09-12T03:38:13.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96b5dd2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f96b015efe0 con 0x7f96b0160480 2024-09-12T03:38:13.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96b5dd2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f96b006e340 con 0x7f96b0071730 2024-09-12T03:38:13.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96affff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96b0160480 0x7f96b006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:13.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96affff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96b0160480 0x7f96b006da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52618/0 (socket says 172.21.15.73:52618) 2024-09-12T03:38:13.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96affff640 1 -- 172.21.15.73:0/2575381259 learned_addr learned my addr 172.21.15.73:0/2575381259 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:13.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96affff640 1 -- 172.21.15.73:0/2575381259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 msgr2=0x7f96b0071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:13.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96af7fe640 1 --2- 172.21.15.73:0/2575381259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:13.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96affff640 1 --2- 172.21.15.73:0/2575381259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b0071b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96affff640 1 -- 172.21.15.73:0/2575381259 >> v1:172.21.15.150:6789/0 conn(0x7f96b0072050 legacy=0x7f96b006d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:13.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.525+0000 7f96affff640 1 -- 172.21.15.73:0/2575381259 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b015e990 con 0x7f96b0160480 2024-09-12T03:38:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96affff640 1 --2- 172.21.15.73:0/2575381259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b006da00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009e50 tx=0x7f96a801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65523c01de7bcd1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96ae7fc640 1 -- 172.21.15.73:0/2575381259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80a5860 con 0x7f96b0160480 2024-09-12T03:38:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96ae7fc640 1 -- 172.21.15.73:0/2575381259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a80a5a00 con 0x7f96b0160480 2024-09-12T03:38:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96ae7fc640 1 -- 172.21.15.73:0/2575381259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80a5dd0 con 0x7f96b0160480 2024-09-12T03:38:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 -- 172.21.15.73:0/2575381259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 msgr2=0x7f96b006da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/2575381259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b006da00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009e50 tx=0x7f96a801c9c0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 -- 172.21.15.73:0/2575381259 shutdown_connections 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/2575381259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b006da00 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/2575381259 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b0071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 -- 172.21.15.73:0/2575381259 >> 172.21.15.73:0/2575381259 conn(0x7f96b00b3e70 msgr2=0x7f96b00b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 -- 172.21.15.73:0/2575381259 shutdown_connections 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 -- 172.21.15.73:0/2575381259 wait complete. 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 Processor -- start 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.529+0000 7f96b5dd2640 1 -- start start 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b013a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b0072050 0x7f96b013c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b013ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f96b016a7c0 con 0x7f96b0160480 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f96b016a640 con 0x7f96b0072050 2024-09-12T03:38:13.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f96b016a940 con 0x7f96b0071730 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b013ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b013ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52626/0 (socket says 172.21.15.73:52626) 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 -- 172.21.15.73:0/3682782745 learned_addr learned my addr 172.21.15.73:0/3682782745 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96aeffd640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b0072050 0x7f96b013c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96af7fe640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b013a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 -- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 msgr2=0x7f96b013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b013a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 -- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b0072050 msgr2=0x7f96b013c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b0072050 0x7f96b013c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 -- 172.21.15.73:0/3682782745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b00d2640 con 0x7f96b0160480 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96af7fe640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b013a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96affff640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b013ce20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f96a80af040 tx=0x7f96a8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:13.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f9697fff640 1 -- 172.21.15.73:0/3682782745 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80b8880 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f9697fff640 1 -- 172.21.15.73:0/3682782745 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a80be070 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f9697fff640 1 -- 172.21.15.73:0/3682782745 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80b8c80 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b013a7d0 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b013ad90 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b0071b10 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f9697fff640 1 -- 172.21.15.73:0/3682782745 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96a80c3460 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f9697fff640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f969c0678c0 0x7f969c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f9697fff640 1 -- 172.21.15.73:0/3682782745 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f96a8121210 con 0x7f96b0160480 2024-09-12T03:38:13.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96af7fe640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f969c0678c0 0x7f969c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.533+0000 7f96af7fe640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f969c0678c0 0x7f969c069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006fd0 tx=0x7f96a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:13.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.537+0000 7f9697fff640 1 -- 172.21.15.73:0/3682782745 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96a80165e0 con 0x7f96b0160480 2024-09-12T03:38:13.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:13.737+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f96b006efe0 con 0x7f96b0160480 2024-09-12T03:38:14.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f9697fff640 1 -- 172.21.15.73:0/3682782745 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f96a80f1c50 con 0x7f96b0160480 2024-09-12T03:38:14.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f969c0678c0 msgr2=0x7f969c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f969c0678c0 0x7f969c069d80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f96a0006fd0 tx=0x7f96a0008040 comp rx=0 tx=0).stop 2024-09-12T03:38:14.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 msgr2=0x7f96b013ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b013ce20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f96a80af040 tx=0x7f96a8019760 comp rx=0 tx=0).stop 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 shutdown_connections 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f969c0678c0 0x7f969c069d80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96b0160480 0x7f96b013ce20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f96b0072050 0x7f96b013c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 --2- 172.21.15.73:0/3682782745 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f96b0071730 0x7f96b013a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 >> 172.21.15.73:0/3682782745 conn(0x7f96b00b3e70 msgr2=0x7f96b013dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 shutdown_connections 2024-09-12T03:38:14.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.385+0000 7f96b5dd2640 1 -- 172.21.15.73:0/3682782745 wait complete. 2024-09-12T03:38:14.410 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T03:38:14.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:38:14.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.533+0000 7f61b4b23640 1 Processor -- start 2024-09-12T03:38:14.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.533+0000 7f61b4b23640 1 -- start start 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61b4b23640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61b015c2a0 0x7f61b00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61b4b23640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b00b3290 con 0x7f61b00af2a0 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61b4b23640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b00b3570 con 0x7f61b015bec0 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61b4b23640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f61b00b3850 con 0x7f61b015c2a0 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61add9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61b015c2a0 0x7f61b00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61add9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61b015c2a0 0x7f61b00aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52638/0 (socket says 172.21.15.73:52638) 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61add9b640 1 -- 172.21.15.73:0/3284495314 learned_addr learned my addr 172.21.15.73:0/3284495314 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61add9b640 1 -- 172.21.15.73:0/3284495314 >> v1:172.21.15.150:6789/0 conn(0x7f61b015bec0 legacy=0x7f61b00ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61add9b640 1 -- 172.21.15.73:0/3284495314 >> v1:172.21.15.73:6789/0 conn(0x7f61b00af2a0 legacy=0x7f61b006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61add9b640 1 -- 172.21.15.73:0/3284495314 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b00b3b30 con 0x7f61b015c2a0 2024-09-12T03:38:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61add9b640 1 --2- 172.21.15.73:0/3284495314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b015c2a0 0x7f61b00aed60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b634ddadbbfcd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61ad59a640 1 -- 172.21.15.73:0/3284495314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a40aa650 con 0x7f61b015c2a0 2024-09-12T03:38:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61ad59a640 1 -- 172.21.15.73:0/3284495314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a40af070 con 0x7f61b015c2a0 2024-09-12T03:38:14.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.537+0000 7f61ad59a640 1 -- 172.21.15.73:0/3284495314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a40aaa10 con 0x7f61b015c2a0 2024-09-12T03:38:14.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- 172.21.15.73:0/3284495314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b015c2a0 msgr2=0x7f61b00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 --2- 172.21.15.73:0/3284495314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b015c2a0 0x7f61b00aed60 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a401c4f0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- 172.21.15.73:0/3284495314 shutdown_connections 2024-09-12T03:38:14.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 --2- 172.21.15.73:0/3284495314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b015c2a0 0x7f61b00aed60 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- 172.21.15.73:0/3284495314 >> 172.21.15.73:0/3284495314 conn(0x7f61b00b1f90 msgr2=0x7f61b00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:14.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- 172.21.15.73:0/3284495314 shutdown_connections 2024-09-12T03:38:14.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- 172.21.15.73:0/3284495314 wait complete. 2024-09-12T03:38:14.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 Processor -- start 2024-09-12T03:38:14.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- start start 2024-09-12T03:38:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b00af2a0 0x7f61b0099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b015bec0 0x7f61b014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61b015c2a0 0x7f61b014b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f61b006ef20 con 0x7f61b00af2a0 2024-09-12T03:38:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00af6b0 con 0x7f61b015bec0 2024-09-12T03:38:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f61b006f0a0 con 0x7f61b015c2a0 2024-09-12T03:38:14.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b00af2a0 0x7f61b0099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b00af2a0 0x7f61b0099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52652/0 (socket says 172.21.15.73:52652) 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 -- 172.21.15.73:0/4162261946 learned_addr learned my addr 172.21.15.73:0/4162261946 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61add9b640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b015bec0 0x7f61b014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61aed9d640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61b015c2a0 0x7f61b014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 -- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61b015c2a0 msgr2=0x7f61b014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61b015c2a0 0x7f61b014b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 -- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b015bec0 msgr2=0x7f61b014b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b015bec0 0x7f61b014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 -- 172.21.15.73:0/4162261946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b0157080 con 0x7f61b00af2a0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61ae59c640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b00af2a0 0x7f61b0099a40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c450 tx=0x7f61a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f619effd640 1 -- 172.21.15.73:0/4162261946 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0012830 con 0x7f61b00af2a0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f619effd640 1 -- 172.21.15.73:0/4162261946 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0017070 con 0x7f61b00af2a0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f619effd640 1 -- 172.21.15.73:0/4162261946 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0012c30 con 0x7f61b00af2a0 2024-09-12T03:38:14.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b0157360 con 0x7f61b00af2a0 2024-09-12T03:38:14.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.541+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b0157920 con 0x7f61b00af2a0 2024-09-12T03:38:14.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.545+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b00aed60 con 0x7f61b00af2a0 2024-09-12T03:38:14.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.545+0000 7f619effd640 1 -- 172.21.15.73:0/4162261946 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f61a001c460 con 0x7f61b00af2a0 2024-09-12T03:38:14.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.545+0000 7f619effd640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61900678c0 0x7f6190069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.545+0000 7f619effd640 1 -- 172.21.15.73:0/4162261946 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f61a0085bd0 con 0x7f61b00af2a0 2024-09-12T03:38:14.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.545+0000 7f61add9b640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61900678c0 0x7f6190069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.545+0000 7f61add9b640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61900678c0 0x7f6190069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61a40ae000 tx=0x7f61a40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:14.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.549+0000 7f619effd640 1 -- 172.21.15.73:0/4162261946 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f61a0056580 con 0x7f61b00af2a0 2024-09-12T03:38:14.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61b006fcd0 con 0x7f61b00af2a0 2024-09-12T03:38:14.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f619effd640 1 -- 172.21.15.73:0/4162261946 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f61a0055e80 con 0x7f61b00af2a0 2024-09-12T03:38:14.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:14.750 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"btime":"2024-09-12T03:38:14:379931+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5521,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2804939638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2804939638},{"type":"v1","addr":"172.21.15.150:6833","nonce":2804939638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2609449242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2609449242},{"type":"v1","addr":"172.21.15.150:6835","nonce":2609449242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3463752136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3463752136},{"type":"v1","addr":"172.21.15.73:6835","nonce":3463752136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:38:10.712259+0000","modified":"2024-09-12T03:38:13.741150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3586054053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3586054053},{"type":"v1","addr":"172.21.15.73:6837","nonce":3586054053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6579,"qdb_cluster":[6579]},"id":7}]} 2024-09-12T03:38:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 56 2024-09-12T03:38:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61900678c0 msgr2=0x7f6190069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61900678c0 0x7f6190069d80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61a40ae000 tx=0x7f61a40a7000 comp rx=0 tx=0).stop 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b00af2a0 msgr2=0x7f61b0099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b00af2a0 0x7f61b0099a40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c450 tx=0x7f61a000c910 comp rx=0 tx=0).stop 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 shutdown_connections 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f61900678c0 0x7f6190069d80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f61b015c2a0 0x7f61b014b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61b015bec0 0x7f61b014b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 --2- 172.21.15.73:0/4162261946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61b00af2a0 0x7f61b0099a40 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 >> 172.21.15.73:0/4162261946 conn(0x7f61b00b1f90 msgr2=0x7f61b0151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 shutdown_connections 2024-09-12T03:38:14.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.749+0000 7f61b4b23640 1 -- 172.21.15.73:0/4162261946 wait complete. 2024-09-12T03:38:14.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:38:14.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.885+0000 7f3bb0a5b640 1 Processor -- start 2024-09-12T03:38:14.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.885+0000 7f3bb0a5b640 1 -- start start 2024-09-12T03:38:14.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.885+0000 7f3bb0a5b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac06e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.885+0000 7f3bb0a5b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3bac06fef0 0x7f3bac15b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.885+0000 7f3bb0a5b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bac15bda0 con 0x7f3bac0b3d50 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3bac06ee50 con 0x7f3bac06fef0 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3bac06f130 con 0x7f3bac073e60 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3bac06fef0 0x7f3bac15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3bac06fef0 0x7f3bac15b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52654/0 (socket says 172.21.15.73:52654) 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 -- 172.21.15.73:0/2260613042 learned_addr learned my addr 172.21.15.73:0/2260613042 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:14.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3baa59c640 1 --2- 172.21.15.73:0/2260613042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac06e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 -- 172.21.15.73:0/2260613042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 msgr2=0x7f3bac06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:14.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 --2- 172.21.15.73:0/2260613042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac06e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 -- 172.21.15.73:0/2260613042 >> v1:172.21.15.150:6789/0 conn(0x7f3bac0b3d50 legacy=0x7f3bac0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:14.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 -- 172.21.15.73:0/2260613042 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac06f410 con 0x7f3bac06fef0 2024-09-12T03:38:14.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba9d9b640 1 --2- 172.21.15.73:0/2260613042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15b860 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009870 tx=0x7f3ba001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf148b18bf33cb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:14.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba959a640 1 -- 172.21.15.73:0/2260613042 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba00b0070 con 0x7f3bac06fef0 2024-09-12T03:38:14.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba959a640 1 -- 172.21.15.73:0/2260613042 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ba00ab600 con 0x7f3bac06fef0 2024-09-12T03:38:14.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3ba959a640 1 -- 172.21.15.73:0/2260613042 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba00ab9d0 con 0x7f3bac06fef0 2024-09-12T03:38:14.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/2260613042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 msgr2=0x7f3bac15b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/2260613042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15b860 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009870 tx=0x7f3ba001c490 comp rx=0 tx=0).stop 2024-09-12T03:38:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/2260613042 shutdown_connections 2024-09-12T03:38:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/2260613042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15b860 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/2260613042 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac06e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/2260613042 >> 172.21.15.73:0/2260613042 conn(0x7f3bac0b1f90 msgr2=0x7f3bac0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/2260613042 shutdown_connections 2024-09-12T03:38:14.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.889+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/2260613042 wait complete. 2024-09-12T03:38:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 Processor -- start 2024-09-12T03:38:14.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 -- start start 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac14deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bac0b3d50 0x7f3bac14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3bac0731f0 con 0x7f3bac06fef0 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3bac073070 con 0x7f3bac0b3d50 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3bac073370 con 0x7f3bac073e60 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52664/0 (socket says 172.21.15.73:52664) 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 -- 172.21.15.73:0/1105716598 learned_addr learned my addr 172.21.15.73:0/1105716598 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:14.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3ba9d9b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac14deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baad9d640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bac0b3d50 0x7f3bac14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 -- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 msgr2=0x7f3bac14deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac14deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 -- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bac0b3d50 msgr2=0x7f3bac14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bac0b3d50 0x7f3bac14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 -- 172.21.15.73:0/1105716598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac1581f0 con 0x7f3bac06fef0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3baa59c640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15d260 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00c7f0 tx=0x7f3b9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3b9affd640 1 -- 172.21.15.73:0/1105716598 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c015070 con 0x7f3bac06fef0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3b9affd640 1 -- 172.21.15.73:0/1105716598 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b9c007820 con 0x7f3bac06fef0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3b9affd640 1 -- 172.21.15.73:0/1105716598 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c007c10 con 0x7f3bac06fef0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bac151e20 con 0x7f3bac06fef0 2024-09-12T03:38:14.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bac1523e0 con 0x7f3bac06fef0 2024-09-12T03:38:14.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.893+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bac15b860 con 0x7f3bac06fef0 2024-09-12T03:38:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.897+0000 7f3b9affd640 1 -- 172.21.15.73:0/1105716598 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3b9c018070 con 0x7f3bac06fef0 2024-09-12T03:38:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.897+0000 7f3b9affd640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b8c0678c0 0x7f3b8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.897+0000 7f3b9affd640 1 -- 172.21.15.73:0/1105716598 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f3b9c085eb0 con 0x7f3bac06fef0 2024-09-12T03:38:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.897+0000 7f3ba9d9b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b8c0678c0 0x7f3b8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:14.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.897+0000 7f3ba9d9b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b8c0678c0 0x7f3b8c069d80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00ad000 tx=0x7f3ba0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:14.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:14.901+0000 7f3b9affd640 1 -- 172.21.15.73:0/1105716598 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3b9c056860 con 0x7f3bac06fef0 2024-09-12T03:38:15.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.049+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bac0723f0 con 0x7f3bac06fef0 2024-09-12T03:38:15.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.053+0000 7f3b9affd640 1 -- 172.21.15.73:0/1105716598 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16945 (secure 0 0 0) 0x7f3b9c056160 con 0x7f3bac06fef0 2024-09-12T03:38:15.055 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:15.056 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":98,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:38:12.341061+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:38:08.420270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T03:38:09.709269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:38:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.053+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b8c0678c0 msgr2=0x7f3b8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.053+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b8c0678c0 0x7f3b8c069d80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00ad000 tx=0x7f3ba0008040 comp rx=0 tx=0).stop 2024-09-12T03:38:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.053+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 msgr2=0x7f3bac15d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.053+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15d260 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00c7f0 tx=0x7f3b9c00ccb0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 shutdown_connections 2024-09-12T03:38:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3b8c0678c0 0x7f3b8c069d80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3bac0b3d50 0x7f3bac14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3bac073e60 0x7f3bac14deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 --2- 172.21.15.73:0/1105716598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bac06fef0 0x7f3bac15d260 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 >> 172.21.15.73:0/1105716598 conn(0x7f3bac0b1f90 msgr2=0x7f3bac159110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 shutdown_connections 2024-09-12T03:38:15.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.057+0000 7f3bb0a5b640 1 -- 172.21.15.73:0/1105716598 wait complete. 2024-09-12T03:38:15.072 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:38:15.073 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:15.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.185+0000 7f265ca0b640 1 Processor -- start 2024-09-12T03:38:15.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.185+0000 7f265ca0b640 1 -- start start 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265ca0b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f265815c2a0 0x7f26580aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265ca0b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f265806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265ca0b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26580b3290 con 0x7f265815bec0 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265ca0b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f26580b3570 con 0x7f265815c2a0 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265ca0b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f26580b3850 con 0x7f26580af2a0 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f265815bec0 0x7f26580ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50780/0 (socket says 172.21.15.73:50780) 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 -- 172.21.15.73:0/2393966647 learned_addr learned my addr 172.21.15.73:0/2393966647 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637800761 0 0) 0x7f26580b3290 con 0x7f265815bec0 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f2655d9b640 1 --2- 172.21.15.73:0/2393966647 >> v2:172.21.15.150:3300/0 conn(0x7f265815c2a0 0x7f26580aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f2656d9d640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f265806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2644003530 con 0x7f265815bec0 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1369786134 0 0) 0x7f2644003530 con 0x7f265815bec0 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 msgr2=0x7f265806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f265806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 >> v2:172.21.15.150:3300/0 conn(0x7f265815c2a0 msgr2=0x7f26580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 --2- 172.21.15.73:0/2393966647 >> v2:172.21.15.150:3300/0 conn(0x7f265815c2a0 0x7f26580aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26580b3b30 con 0x7f265815bec0 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f2650001a00 con 0x7f265815bec0 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f2656d9d640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f265806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 >> v1:172.21.15.73:6789/0 conn(0x7f265815bec0 legacy=0x7f26580ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26440039c0 0x7f2644003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2644004810 0x7f2644004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f26440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f26580b3570 con 0x7f26440039c0 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26580b3850 con 0x7f2644004810 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f264400ba50 con 0x7f26580af2a0 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26440039c0 0x7f2644003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f2655d9b640 1 --2- 172.21.15.73:0/2393966647 >> v2:172.21.15.150:3300/0 conn(0x7f265815c2a0 0x7f26580aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f2656d9d640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f26440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 -- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 msgr2=0x7f26440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f26440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 -- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2644004810 msgr2=0x7f2644004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2644004810 0x7f2644004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 -- 172.21.15.73:0/2393966647 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2644003530 con 0x7f26440039c0 2024-09-12T03:38:15.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f2656d9d640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26580af2a0 0x7f26440051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.189+0000 7f265659c640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26440039c0 0x7f2644003de0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f265000a880 tx=0x7f265001d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed3a4f4f698d828 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265000a4a0 con 0x7f26440039c0 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26500ad650 con 0x7f26440039c0 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265559a640 1 -- 172.21.15.73:0/2393966647 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26500ada40 con 0x7f26440039c0 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- 172.21.15.73:0/2393966647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26440039c0 msgr2=0x7f2644003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 --2- 172.21.15.73:0/2393966647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26440039c0 0x7f2644003de0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f265000a880 tx=0x7f265001d370 comp rx=0 tx=0).stop 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 -- 172.21.15.73:0/2393966647 reap_dead start 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- 172.21.15.73:0/2393966647 shutdown_connections 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- 172.21.15.73:0/2393966647 >> 172.21.15.73:0/2393966647 conn(0x7f26580b1f90 msgr2=0x7f26580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- 172.21.15.73:0/2393966647 shutdown_connections 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- 172.21.15.73:0/2393966647 wait complete. 2024-09-12T03:38:15.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 Processor -- start 2024-09-12T03:38:15.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- start start 2024-09-12T03:38:15.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26440039c0 0x7f265814c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f265814d300 0x7f2658151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f265815e210 0x7f26580b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f265806e810 con 0x7f265815e210 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f26580af6b0 con 0x7f265814d300 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f265806e990 con 0x7f26440039c0 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f265815e210 0x7f26580b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f265815e210 0x7f26580b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39508/0 (socket says 172.21.15.73:39508) 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 -- 172.21.15.73:0/256383201 learned_addr learned my addr 172.21.15.73:0/256383201 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265659c640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26440039c0 0x7f265814c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2655d9b640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f265814d300 0x7f2658151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 -- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26440039c0 msgr2=0x7f265814c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26440039c0 0x7f265814c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 -- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f265814d300 msgr2=0x7f2658151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f265814d300 0x7f2658151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 -- 172.21.15.73:0/256383201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265815eb80 con 0x7f265815e210 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f2656d9d640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f265815e210 0x7f26580b0910 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f265815c680 tx=0x7f264800f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f264effd640 1 -- 172.21.15.73:0/256383201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648004230 con 0x7f265815e210 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f264effd640 1 -- 172.21.15.73:0/256383201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264801a070 con 0x7f265815e210 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265815ee60 con 0x7f265815e210 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f264effd640 1 -- 172.21.15.73:0/256383201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648003620 con 0x7f265815e210 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.193+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2658151a70 con 0x7f265815e210 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.197+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26581515a0 con 0x7f265815e210 2024-09-12T03:38:15.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.197+0000 7f264effd640 1 -- 172.21.15.73:0/256383201 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2648012070 con 0x7f265815e210 2024-09-12T03:38:15.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.197+0000 7f264effd640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f26380678f0 0x7f2638069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.197+0000 7f265659c640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f26380678f0 0x7f2638069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.197+0000 7f264effd640 1 -- 172.21.15.73:0/256383201 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f2648085820 con 0x7f265815e210 2024-09-12T03:38:15.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.197+0000 7f265659c640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f26380678f0 0x7f2638069db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f265000a880 tx=0x7f26580b3460 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.201+0000 7f264effd640 1 -- 172.21.15.73:0/256383201 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f26480561d0 con 0x7f265815e210 2024-09-12T03:38:15.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.361+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26580aed60 con 0x7f26380678f0 2024-09-12T03:38:15.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.377+0000 7f264effd640 1 -- 172.21.15.73:0/256383201 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250241 (secure 0 0 0) 0x7f26580aed60 con 0x7f26380678f0 2024-09-12T03:38:15.382 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:15.383 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:15.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f26380678f0 msgr2=0x7f2638069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f26380678f0 0x7f2638069db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f265000a880 tx=0x7f26580b3460 comp rx=0 tx=0).stop 2024-09-12T03:38:15.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f265815e210 msgr2=0x7f26580b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f265815e210 0x7f26580b0910 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f265815c680 tx=0x7f264800f5b0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 shutdown_connections 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f26380678f0 0x7f2638069db0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f265815e210 0x7f26580b0910 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f265814d300 0x7f2658151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 --2- 172.21.15.73:0/256383201 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f26440039c0 0x7f265814c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 >> 172.21.15.73:0/256383201 conn(0x7f26580b1f90 msgr2=0x7f26580b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 shutdown_connections 2024-09-12T03:38:15.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.381+0000 7f265ca0b640 1 -- 172.21.15.73:0/256383201 wait complete. 2024-09-12T03:38:15.400 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-12T03:38:13.852436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260032,"kb_used_data":10496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714688,"statfs":{"total":773094113280,"available":772827840512,"internally_reserved":0,"allocated":10747904,"data_stored":5539093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.517217"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365795+0000","last_change":"2024-09-12T03:38:10.365795+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365795+0000","last_undegraded":"2024-09-12T03:38:10.365795+0000","last_fullsized":"2024-09-12T03:38:10.365795+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.380880+0000","last_change":"2024-09-12T03:38:10.380880+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.380880+0000","last_undegraded":"2024-09-12T03:38:10.380880+0000","last_fullsized":"2024-09-12T03:38:10.380880+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365790+0000","last_change":"2024-09-12T03:38:10.365790+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365790+0000","last_undegraded":"2024-09-12T03:38:10.365790+0000","last_fullsized":"2024-09-12T03:38:10.365790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355538+0000","last_change":"2024-09-12T03:38:11.413014+0000","last_active":"2024-09-12T03:38:12.355538+0000","last_peered":"2024-09-12T03:38:12.355538+0000","last_clean":"2024-09-12T03:38:12.355538+0000","last_became_active":"2024-09-12T03:38:11.412596+0000","last_became_peered":"2024-09-12T03:38:11.412596+0000","last_unstale":"2024-09-12T03:38:12.355538+0000","last_undegraded":"2024-09-12T03:38:12.355538+0000","last_fullsized":"2024-09-12T03:38:12.355538+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413879+0000","last_change":"2024-09-12T03:38:11.412827+0000","last_active":"2024-09-12T03:38:11.413879+0000","last_peered":"2024-09-12T03:38:11.413879+0000","last_clean":"2024-09-12T03:38:11.413879+0000","last_became_active":"2024-09-12T03:38:11.412492+0000","last_became_peered":"2024-09-12T03:38:11.412492+0000","last_unstale":"2024-09-12T03:38:11.413879+0000","last_undegraded":"2024-09-12T03:38:11.413879+0000","last_fullsized":"2024-09-12T03:38:11.413879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.367553+0000","last_change":"2024-09-12T03:38:10.367553+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.367553+0000","last_undegraded":"2024-09-12T03:38:10.367553+0000","last_fullsized":"2024-09-12T03:38:10.367553+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.382689+0000","last_change":"2024-09-12T03:38:10.382689+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.382689+0000","last_undegraded":"2024-09-12T03:38:10.382689+0000","last_fullsized":"2024-09-12T03:38:10.382689+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388655+0000","last_change":"2024-09-12T03:38:11.375885+0000","last_active":"2024-09-12T03:38:11.388655+0000","last_peered":"2024-09-12T03:38:11.388655+0000","last_clean":"2024-09-12T03:38:11.388655+0000","last_became_active":"2024-09-12T03:38:11.375504+0000","last_became_peered":"2024-09-12T03:38:11.375504+0000","last_unstale":"2024-09-12T03:38:11.388655+0000","last_undegraded":"2024-09-12T03:38:11.388655+0000","last_fullsized":"2024-09-12T03:38:11.388655+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:35.575296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.370582+0000","last_change":"2024-09-12T03:38:10.370582+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.370582+0000","last_undegraded":"2024-09-12T03:38:10.370582+0000","last_fullsized":"2024-09-12T03:38:10.370582+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.383201+0000","last_change":"2024-09-12T03:38:11.378703+0000","last_active":"2024-09-12T03:38:11.383201+0000","last_peered":"2024-09-12T03:38:11.383201+0000","last_clean":"2024-09-12T03:38:11.383201+0000","last_became_active":"2024-09-12T03:38:11.378398+0000","last_became_peered":"2024-09-12T03:38:11.378398+0000","last_unstale":"2024-09-12T03:38:11.383201+0000","last_undegraded":"2024-09-12T03:38:11.383201+0000","last_fullsized":"2024-09-12T03:38:11.383201+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355575+0000","last_change":"2024-09-12T03:38:11.390773+0000","last_active":"2024-09-12T03:38:12.355575+0000","last_peered":"2024-09-12T03:38:12.355575+0000","last_clean":"2024-09-12T03:38:12.355575+0000","last_became_active":"2024-09-12T03:38:11.390033+0000","last_became_peered":"2024-09-12T03:38:11.390033+0000","last_unstale":"2024-09-12T03:38:12.355575+0000","last_undegraded":"2024-09-12T03:38:12.355575+0000","last_fullsized":"2024-09-12T03:38:12.355575+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414317+0000","last_change":"2024-09-12T03:38:11.389551+0000","last_active":"2024-09-12T03:38:11.414317+0000","last_peered":"2024-09-12T03:38:11.414317+0000","last_clean":"2024-09-12T03:38:11.414317+0000","last_became_active":"2024-09-12T03:38:11.382597+0000","last_became_peered":"2024-09-12T03:38:11.382597+0000","last_unstale":"2024-09-12T03:38:11.414317+0000","last_undegraded":"2024-09-12T03:38:11.414317+0000","last_fullsized":"2024-09-12T03:38:11.414317+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354540+0000","last_change":"2024-09-12T03:38:11.400083+0000","last_active":"2024-09-12T03:38:12.354540+0000","last_peered":"2024-09-12T03:38:12.354540+0000","last_clean":"2024-09-12T03:38:12.354540+0000","last_became_active":"2024-09-12T03:38:11.399735+0000","last_became_peered":"2024-09-12T03:38:11.399735+0000","last_unstale":"2024-09-12T03:38:12.354540+0000","last_undegraded":"2024-09-12T03:38:12.354540+0000","last_fullsized":"2024-09-12T03:38:12.354540+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.391723+0000","last_change":"2024-09-12T03:38:11.382202+0000","last_active":"2024-09-12T03:38:11.391723+0000","last_peered":"2024-09-12T03:38:11.391723+0000","last_clean":"2024-09-12T03:38:11.391723+0000","last_became_active":"2024-09-12T03:38:11.379979+0000","last_became_peered":"2024-09-12T03:38:11.379979+0000","last_unstale":"2024-09-12T03:38:11.391723+0000","last_undegraded":"2024-09-12T03:38:11.391723+0000","last_fullsized":"2024-09-12T03:38:11.391723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404588+0000","last_change":"2024-09-12T03:38:11.400513+0000","last_active":"2024-09-12T03:38:11.404588+0000","last_peered":"2024-09-12T03:38:11.404588+0000","last_clean":"2024-09-12T03:38:11.404588+0000","last_became_active":"2024-09-12T03:38:11.399612+0000","last_became_peered":"2024-09-12T03:38:11.399612+0000","last_unstale":"2024-09-12T03:38:11.404588+0000","last_undegraded":"2024-09-12T03:38:11.404588+0000","last_fullsized":"2024-09-12T03:38:11.404588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.349400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400905+0000","last_change":"2024-09-12T03:38:11.393997+0000","last_active":"2024-09-12T03:38:11.400905+0000","last_peered":"2024-09-12T03:38:11.400905+0000","last_clean":"2024-09-12T03:38:11.400905+0000","last_became_active":"2024-09-12T03:38:11.393283+0000","last_became_peered":"2024-09-12T03:38:11.393283+0000","last_unstale":"2024-09-12T03:38:11.400905+0000","last_undegraded":"2024-09-12T03:38:11.400905+0000","last_fullsized":"2024-09-12T03:38:11.400905+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365224+0000","last_change":"2024-09-12T03:38:10.365224+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365224+0000","last_undegraded":"2024-09-12T03:38:10.365224+0000","last_fullsized":"2024-09-12T03:38:10.365224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.367188+0000","last_change":"2024-09-12T03:38:10.367188+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.367188+0000","last_undegraded":"2024-09-12T03:38:10.367188+0000","last_fullsized":"2024-09-12T03:38:10.367188+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365342+0000","last_change":"2024-09-12T03:38:10.365342+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365342+0000","last_undegraded":"2024-09-12T03:38:10.365342+0000","last_fullsized":"2024-09-12T03:38:10.365342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.411880+0000","last_change":"2024-09-12T03:38:11.375988+0000","last_active":"2024-09-12T03:38:11.411880+0000","last_peered":"2024-09-12T03:38:11.411880+0000","last_clean":"2024-09-12T03:38:11.411880+0000","last_became_active":"2024-09-12T03:38:11.375260+0000","last_became_peered":"2024-09-12T03:38:11.375260+0000","last_unstale":"2024-09-12T03:38:11.411880+0000","last_undegraded":"2024-09-12T03:38:11.411880+0000","last_fullsized":"2024-09-12T03:38:11.411880+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390309+0000","last_change":"2024-09-12T03:38:11.388685+0000","last_active":"2024-09-12T03:38:11.390309+0000","last_peered":"2024-09-12T03:38:11.390309+0000","last_clean":"2024-09-12T03:38:11.390309+0000","last_became_active":"2024-09-12T03:38:11.388328+0000","last_became_peered":"2024-09-12T03:38:11.388328+0000","last_unstale":"2024-09-12T03:38:11.390309+0000","last_undegraded":"2024-09-12T03:38:11.390309+0000","last_fullsized":"2024-09-12T03:38:11.390309+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:44.776547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400494+0000","last_change":"2024-09-12T03:38:11.399867+0000","last_active":"2024-09-12T03:38:11.400494+0000","last_peered":"2024-09-12T03:38:11.400494+0000","last_clean":"2024-09-12T03:38:11.400494+0000","last_became_active":"2024-09-12T03:38:11.399587+0000","last_became_peered":"2024-09-12T03:38:11.399587+0000","last_unstale":"2024-09-12T03:38:11.400494+0000","last_undegraded":"2024-09-12T03:38:11.400494+0000","last_fullsized":"2024-09-12T03:38:11.400494+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.360596+0000","last_change":"2024-09-12T03:38:10.360596+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.360596+0000","last_undegraded":"2024-09-12T03:38:10.360596+0000","last_fullsized":"2024-09-12T03:38:10.360596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.378686+0000","last_change":"2024-09-12T03:38:11.368565+0000","last_active":"2024-09-12T03:38:11.378686+0000","last_peered":"2024-09-12T03:38:11.378686+0000","last_clean":"2024-09-12T03:38:11.378686+0000","last_became_active":"2024-09-12T03:38:11.367075+0000","last_became_peered":"2024-09-12T03:38:11.367075+0000","last_unstale":"2024-09-12T03:38:11.378686+0000","last_undegraded":"2024-09-12T03:38:11.378686+0000","last_fullsized":"2024-09-12T03:38:11.378686+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412038+0000","last_change":"2024-09-12T03:38:11.373854+0000","last_active":"2024-09-12T03:38:11.412038+0000","last_peered":"2024-09-12T03:38:11.412038+0000","last_clean":"2024-09-12T03:38:11.412038+0000","last_became_active":"2024-09-12T03:38:11.372933+0000","last_became_peered":"2024-09-12T03:38:11.372933+0000","last_unstale":"2024-09-12T03:38:11.412038+0000","last_undegraded":"2024-09-12T03:38:11.412038+0000","last_fullsized":"2024-09-12T03:38:11.412038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412130+0000","last_change":"2024-09-12T03:38:11.378651+0000","last_active":"2024-09-12T03:38:11.412130+0000","last_peered":"2024-09-12T03:38:11.412130+0000","last_clean":"2024-09-12T03:38:11.412130+0000","last_became_active":"2024-09-12T03:38:11.377912+0000","last_became_peered":"2024-09-12T03:38:11.377912+0000","last_unstale":"2024-09-12T03:38:11.412130+0000","last_undegraded":"2024-09-12T03:38:11.412130+0000","last_fullsized":"2024-09-12T03:38:11.412130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355613+0000","last_change":"2024-09-12T03:38:11.403022+0000","last_active":"2024-09-12T03:38:12.355613+0000","last_peered":"2024-09-12T03:38:12.355613+0000","last_clean":"2024-09-12T03:38:12.355613+0000","last_became_active":"2024-09-12T03:38:11.402440+0000","last_became_peered":"2024-09-12T03:38:11.402440+0000","last_unstale":"2024-09-12T03:38:12.355613+0000","last_undegraded":"2024-09-12T03:38:12.355613+0000","last_fullsized":"2024-09-12T03:38:12.355613+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.372322+0000","last_change":"2024-09-12T03:38:10.372322+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.372322+0000","last_undegraded":"2024-09-12T03:38:10.372322+0000","last_fullsized":"2024-09-12T03:38:10.372322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389356+0000","last_change":"2024-09-12T03:38:11.386723+0000","last_active":"2024-09-12T03:38:11.389356+0000","last_peered":"2024-09-12T03:38:11.389356+0000","last_clean":"2024-09-12T03:38:11.389356+0000","last_became_active":"2024-09-12T03:38:11.386276+0000","last_became_peered":"2024-09-12T03:38:11.386276+0000","last_unstale":"2024-09-12T03:38:11.389356+0000","last_undegraded":"2024-09-12T03:38:11.389356+0000","last_fullsized":"2024-09-12T03:38:11.389356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:55.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412229+0000","last_change":"2024-09-12T03:38:11.373029+0000","last_active":"2024-09-12T03:38:11.412229+0000","last_peered":"2024-09-12T03:38:11.412229+0000","last_clean":"2024-09-12T03:38:11.412229+0000","last_became_active":"2024-09-12T03:38:11.372027+0000","last_became_peered":"2024-09-12T03:38:11.372027+0000","last_unstale":"2024-09-12T03:38:11.412229+0000","last_undegraded":"2024-09-12T03:38:11.412229+0000","last_fullsized":"2024-09-12T03:38:11.412229+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.367944+0000","last_change":"2024-09-12T03:38:10.367944+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.367944+0000","last_undegraded":"2024-09-12T03:38:10.367944+0000","last_fullsized":"2024-09-12T03:38:10.367944+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414159+0000","last_change":"2024-09-12T03:38:11.412866+0000","last_active":"2024-09-12T03:38:11.414159+0000","last_peered":"2024-09-12T03:38:11.414159+0000","last_clean":"2024-09-12T03:38:11.414159+0000","last_became_active":"2024-09-12T03:38:11.412507+0000","last_became_peered":"2024-09-12T03:38:11.412507+0000","last_unstale":"2024-09-12T03:38:11.414159+0000","last_undegraded":"2024-09-12T03:38:11.414159+0000","last_fullsized":"2024-09-12T03:38:11.414159+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.093665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.360487+0000","last_change":"2024-09-12T03:38:10.360487+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.360487+0000","last_undegraded":"2024-09-12T03:38:10.360487+0000","last_fullsized":"2024-09-12T03:38:10.360487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356288+0000","last_change":"2024-09-12T03:38:10.386396+0000","last_active":"2024-09-12T03:38:12.356288+0000","last_peered":"2024-09-12T03:38:12.356288+0000","last_clean":"2024-09-12T03:38:12.356288+0000","last_became_active":"2024-09-12T03:38:10.386049+0000","last_became_peered":"2024-09-12T03:38:10.386049+0000","last_unstale":"2024-09-12T03:38:12.356288+0000","last_undegraded":"2024-09-12T03:38:12.356288+0000","last_fullsized":"2024-09-12T03:38:12.356288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.120769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388945+0000","last_change":"2024-09-12T03:38:11.382219+0000","last_active":"2024-09-12T03:38:11.388945+0000","last_peered":"2024-09-12T03:38:11.388945+0000","last_clean":"2024-09-12T03:38:11.388945+0000","last_became_active":"2024-09-12T03:38:11.381850+0000","last_became_peered":"2024-09-12T03:38:11.381850+0000","last_unstale":"2024-09-12T03:38:11.388945+0000","last_undegraded":"2024-09-12T03:38:11.388945+0000","last_fullsized":"2024-09-12T03:38:11.388945+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:42.795485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.393105+0000","last_change":"2024-09-12T03:38:10.372155+0000","last_active":"2024-09-12T03:38:11.393105+0000","last_peered":"2024-09-12T03:38:11.393105+0000","last_clean":"2024-09-12T03:38:11.393105+0000","last_became_active":"2024-09-12T03:38:10.371286+0000","last_became_peered":"2024-09-12T03:38:10.371286+0000","last_unstale":"2024-09-12T03:38:11.393105+0000","last_undegraded":"2024-09-12T03:38:11.393105+0000","last_fullsized":"2024-09-12T03:38:11.393105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:24.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412287+0000","last_change":"2024-09-12T03:38:11.379955+0000","last_active":"2024-09-12T03:38:11.412287+0000","last_peered":"2024-09-12T03:38:11.412287+0000","last_clean":"2024-09-12T03:38:11.412287+0000","last_became_active":"2024-09-12T03:38:11.379266+0000","last_became_peered":"2024-09-12T03:38:11.379266+0000","last_unstale":"2024-09-12T03:38:11.412287+0000","last_undegraded":"2024-09-12T03:38:11.412287+0000","last_fullsized":"2024-09-12T03:38:11.412287+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414531+0000","last_change":"2024-09-12T03:38:10.396126+0000","last_active":"2024-09-12T03:38:11.414531+0000","last_peered":"2024-09-12T03:38:11.414531+0000","last_clean":"2024-09-12T03:38:11.414531+0000","last_became_active":"2024-09-12T03:38:10.391204+0000","last_became_peered":"2024-09-12T03:38:10.391204+0000","last_unstale":"2024-09-12T03:38:11.414531+0000","last_undegraded":"2024-09-12T03:38:11.414531+0000","last_fullsized":"2024-09-12T03:38:11.414531+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354859+0000","last_change":"2024-09-12T03:38:11.390529+0000","last_active":"2024-09-12T03:38:12.354859+0000","last_peered":"2024-09-12T03:38:12.354859+0000","last_clean":"2024-09-12T03:38:12.354859+0000","last_became_active":"2024-09-12T03:38:11.389787+0000","last_became_peered":"2024-09-12T03:38:11.389787+0000","last_unstale":"2024-09-12T03:38:12.354859+0000","last_undegraded":"2024-09-12T03:38:12.354859+0000","last_fullsized":"2024-09-12T03:38:12.354859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413407+0000","last_change":"2024-09-12T03:38:10.393267+0000","last_active":"2024-09-12T03:38:11.413407+0000","last_peered":"2024-09-12T03:38:11.413407+0000","last_clean":"2024-09-12T03:38:11.413407+0000","last_became_active":"2024-09-12T03:38:10.392994+0000","last_became_peered":"2024-09-12T03:38:10.392994+0000","last_unstale":"2024-09-12T03:38:11.413407+0000","last_undegraded":"2024-09-12T03:38:11.413407+0000","last_fullsized":"2024-09-12T03:38:11.413407+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355465+0000","last_change":"2024-09-12T03:38:11.377861+0000","last_active":"2024-09-12T03:38:12.355465+0000","last_peered":"2024-09-12T03:38:12.355465+0000","last_clean":"2024-09-12T03:38:12.355465+0000","last_became_active":"2024-09-12T03:38:11.377511+0000","last_became_peered":"2024-09-12T03:38:11.377511+0000","last_unstale":"2024-09-12T03:38:12.355465+0000","last_undegraded":"2024-09-12T03:38:12.355465+0000","last_fullsized":"2024-09-12T03:38:12.355465+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.403041+0000","last_change":"2024-09-12T03:38:10.386519+0000","last_active":"2024-09-12T03:38:11.403041+0000","last_peered":"2024-09-12T03:38:11.403041+0000","last_clean":"2024-09-12T03:38:11.403041+0000","last_became_active":"2024-09-12T03:38:10.385746+0000","last_became_peered":"2024-09-12T03:38:10.385746+0000","last_unstale":"2024-09-12T03:38:11.403041+0000","last_undegraded":"2024-09-12T03:38:11.403041+0000","last_fullsized":"2024-09-12T03:38:11.403041+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:47.841147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364324+0000","last_change":"2024-09-12T03:38:10.364324+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364324+0000","last_undegraded":"2024-09-12T03:38:10.364324+0000","last_fullsized":"2024-09-12T03:38:10.364324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354371+0000","last_change":"2024-09-12T03:38:10.394181+0000","last_active":"2024-09-12T03:38:12.354371+0000","last_peered":"2024-09-12T03:38:12.354371+0000","last_clean":"2024-09-12T03:38:12.354371+0000","last_became_active":"2024-09-12T03:38:10.393438+0000","last_became_peered":"2024-09-12T03:38:10.393438+0000","last_unstale":"2024-09-12T03:38:12.354371+0000","last_undegraded":"2024-09-12T03:38:12.354371+0000","last_fullsized":"2024-09-12T03:38:12.354371+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:59.138777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.366128+0000","last_change":"2024-09-12T03:38:10.366128+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.366128+0000","last_undegraded":"2024-09-12T03:38:10.366128+0000","last_fullsized":"2024-09-12T03:38:10.366128+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355550+0000","last_change":"2024-09-12T03:38:10.386837+0000","last_active":"2024-09-12T03:38:11.355550+0000","last_peered":"2024-09-12T03:38:11.355550+0000","last_clean":"2024-09-12T03:38:11.355550+0000","last_became_active":"2024-09-12T03:38:10.382683+0000","last_became_peered":"2024-09-12T03:38:10.382683+0000","last_unstale":"2024-09-12T03:38:11.355550+0000","last_undegraded":"2024-09-12T03:38:11.355550+0000","last_fullsized":"2024-09-12T03:38:11.355550+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356272+0000","last_change":"2024-09-12T03:38:11.387150+0000","last_active":"2024-09-12T03:38:12.356272+0000","last_peered":"2024-09-12T03:38:12.356272+0000","last_clean":"2024-09-12T03:38:12.356272+0000","last_became_active":"2024-09-12T03:38:11.386913+0000","last_became_peered":"2024-09-12T03:38:11.386913+0000","last_unstale":"2024-09-12T03:38:12.356272+0000","last_undegraded":"2024-09-12T03:38:12.356272+0000","last_fullsized":"2024-09-12T03:38:12.356272+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353698+0000","last_change":"2024-09-12T03:38:10.380693+0000","last_active":"2024-09-12T03:38:12.353698+0000","last_peered":"2024-09-12T03:38:12.353698+0000","last_clean":"2024-09-12T03:38:12.353698+0000","last_became_active":"2024-09-12T03:38:10.380423+0000","last_became_peered":"2024-09-12T03:38:10.380423+0000","last_unstale":"2024-09-12T03:38:12.353698+0000","last_undegraded":"2024-09-12T03:38:12.353698+0000","last_fullsized":"2024-09-12T03:38:12.353698+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.361410+0000","last_change":"2024-09-12T03:38:10.361410+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.361410+0000","last_undegraded":"2024-09-12T03:38:10.361410+0000","last_fullsized":"2024-09-12T03:38:10.361410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356264+0000","last_change":"2024-09-12T03:38:10.386626+0000","last_active":"2024-09-12T03:38:11.356264+0000","last_peered":"2024-09-12T03:38:11.356264+0000","last_clean":"2024-09-12T03:38:11.356264+0000","last_became_active":"2024-09-12T03:38:10.382526+0000","last_became_peered":"2024-09-12T03:38:10.382526+0000","last_unstale":"2024-09-12T03:38:11.356264+0000","last_undegraded":"2024-09-12T03:38:11.356264+0000","last_fullsized":"2024-09-12T03:38:11.356264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377375+0000","last_change":"2024-09-12T03:38:11.374433+0000","last_active":"2024-09-12T03:38:11.377375+0000","last_peered":"2024-09-12T03:38:11.377375+0000","last_clean":"2024-09-12T03:38:11.377375+0000","last_became_active":"2024-09-12T03:38:11.374104+0000","last_became_peered":"2024-09-12T03:38:11.374104+0000","last_unstale":"2024-09-12T03:38:11.377375+0000","last_undegraded":"2024-09-12T03:38:11.377375+0000","last_fullsized":"2024-09-12T03:38:11.377375+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.396095+0000","last_change":"2024-09-12T03:38:10.393712+0000","last_active":"2024-09-12T03:38:10.396095+0000","last_peered":"2024-09-12T03:38:10.396095+0000","last_clean":"2024-09-12T03:38:10.396095+0000","last_became_active":"2024-09-12T03:38:10.393273+0000","last_became_peered":"2024-09-12T03:38:10.393273+0000","last_unstale":"2024-09-12T03:38:10.396095+0000","last_undegraded":"2024-09-12T03:38:10.396095+0000","last_fullsized":"2024-09-12T03:38:10.396095+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:14.732430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389013+0000","last_change":"2024-09-12T03:38:11.376141+0000","last_active":"2024-09-12T03:38:11.389013+0000","last_peered":"2024-09-12T03:38:11.389013+0000","last_clean":"2024-09-12T03:38:11.389013+0000","last_became_active":"2024-09-12T03:38:11.375589+0000","last_became_peered":"2024-09-12T03:38:11.375589+0000","last_unstale":"2024-09-12T03:38:11.389013+0000","last_undegraded":"2024-09-12T03:38:11.389013+0000","last_fullsized":"2024-09-12T03:38:11.389013+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:48.925960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.392975+0000","last_change":"2024-09-12T03:38:10.377052+0000","last_active":"2024-09-12T03:38:11.392975+0000","last_peered":"2024-09-12T03:38:11.392975+0000","last_clean":"2024-09-12T03:38:11.392975+0000","last_became_active":"2024-09-12T03:38:10.376406+0000","last_became_peered":"2024-09-12T03:38:10.376406+0000","last_unstale":"2024-09-12T03:38:11.392975+0000","last_undegraded":"2024-09-12T03:38:11.392975+0000","last_fullsized":"2024-09-12T03:38:11.392975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:06.325275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377171+0000","last_change":"2024-09-12T03:38:11.373470+0000","last_active":"2024-09-12T03:38:11.377171+0000","last_peered":"2024-09-12T03:38:11.377171+0000","last_clean":"2024-09-12T03:38:11.377171+0000","last_became_active":"2024-09-12T03:38:11.369749+0000","last_became_peered":"2024-09-12T03:38:11.369749+0000","last_unstale":"2024-09-12T03:38:11.377171+0000","last_undegraded":"2024-09-12T03:38:11.377171+0000","last_fullsized":"2024-09-12T03:38:11.377171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.400212+0000","last_change":"2024-09-12T03:38:10.390735+0000","last_active":"2024-09-12T03:38:10.400212+0000","last_peered":"2024-09-12T03:38:10.400212+0000","last_clean":"2024-09-12T03:38:10.400212+0000","last_became_active":"2024-09-12T03:38:10.389748+0000","last_became_peered":"2024-09-12T03:38:10.389748+0000","last_unstale":"2024-09-12T03:38:10.400212+0000","last_undegraded":"2024-09-12T03:38:10.400212+0000","last_fullsized":"2024-09-12T03:38:10.400212+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:52.599813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354800+0000","last_change":"2024-09-12T03:38:11.389078+0000","last_active":"2024-09-12T03:38:12.354800+0000","last_peered":"2024-09-12T03:38:12.354800+0000","last_clean":"2024-09-12T03:38:12.354800+0000","last_became_active":"2024-09-12T03:38:11.388369+0000","last_became_peered":"2024-09-12T03:38:11.388369+0000","last_unstale":"2024-09-12T03:38:12.354800+0000","last_undegraded":"2024-09-12T03:38:12.354800+0000","last_fullsized":"2024-09-12T03:38:12.354800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:50.506813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389574+0000","last_change":"2024-09-12T03:38:10.378214+0000","last_active":"2024-09-12T03:38:11.389574+0000","last_peered":"2024-09-12T03:38:11.389574+0000","last_clean":"2024-09-12T03:38:11.389574+0000","last_became_active":"2024-09-12T03:38:10.377904+0000","last_became_peered":"2024-09-12T03:38:10.377904+0000","last_unstale":"2024-09-12T03:38:11.389574+0000","last_undegraded":"2024-09-12T03:38:11.389574+0000","last_fullsized":"2024-09-12T03:38:11.389574+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.371181+0000","last_change":"2024-09-12T03:38:10.371181+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.371181+0000","last_undegraded":"2024-09-12T03:38:10.371181+0000","last_fullsized":"2024-09-12T03:38:10.371181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354576+0000","last_change":"2024-09-12T03:38:10.374595+0000","last_active":"2024-09-12T03:38:12.354576+0000","last_peered":"2024-09-12T03:38:12.354576+0000","last_clean":"2024-09-12T03:38:12.354576+0000","last_became_active":"2024-09-12T03:38:10.374184+0000","last_became_peered":"2024-09-12T03:38:10.374184+0000","last_unstale":"2024-09-12T03:38:12.354576+0000","last_undegraded":"2024-09-12T03:38:12.354576+0000","last_fullsized":"2024-09-12T03:38:12.354576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:09.966450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414410+0000","last_change":"2024-09-12T03:38:11.413754+0000","last_active":"2024-09-12T03:38:11.414410+0000","last_peered":"2024-09-12T03:38:11.414410+0000","last_clean":"2024-09-12T03:38:11.414410+0000","last_became_active":"2024-09-12T03:38:11.413457+0000","last_became_peered":"2024-09-12T03:38:11.413457+0000","last_unstale":"2024-09-12T03:38:11.414410+0000","last_undegraded":"2024-09-12T03:38:11.414410+0000","last_fullsized":"2024-09-12T03:38:11.414410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:39.890043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.357062+0000","last_change":"2024-09-12T03:38:10.397284+0000","last_active":"2024-09-12T03:38:11.357062+0000","last_peered":"2024-09-12T03:38:11.357062+0000","last_clean":"2024-09-12T03:38:11.357062+0000","last_became_active":"2024-09-12T03:38:10.397035+0000","last_became_peered":"2024-09-12T03:38:10.397035+0000","last_unstale":"2024-09-12T03:38:11.357062+0000","last_undegraded":"2024-09-12T03:38:11.357062+0000","last_fullsized":"2024-09-12T03:38:11.357062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:01.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364681+0000","last_change":"2024-09-12T03:38:10.364681+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364681+0000","last_undegraded":"2024-09-12T03:38:10.364681+0000","last_fullsized":"2024-09-12T03:38:10.364681+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415226+0000","last_change":"2024-09-12T03:38:10.396181+0000","last_active":"2024-09-12T03:38:11.415226+0000","last_peered":"2024-09-12T03:38:11.415226+0000","last_clean":"2024-09-12T03:38:11.415226+0000","last_became_active":"2024-09-12T03:38:10.391810+0000","last_became_peered":"2024-09-12T03:38:10.391810+0000","last_unstale":"2024-09-12T03:38:11.415226+0000","last_undegraded":"2024-09-12T03:38:11.415226+0000","last_fullsized":"2024-09-12T03:38:11.415226+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389320+0000","last_change":"2024-09-12T03:38:11.386951+0000","last_active":"2024-09-12T03:38:11.389320+0000","last_peered":"2024-09-12T03:38:11.389320+0000","last_clean":"2024-09-12T03:38:11.389320+0000","last_became_active":"2024-09-12T03:38:11.386626+0000","last_became_peered":"2024-09-12T03:38:11.386626+0000","last_unstale":"2024-09-12T03:38:11.389320+0000","last_undegraded":"2024-09-12T03:38:11.389320+0000","last_fullsized":"2024-09-12T03:38:11.389320+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.218703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.402973+0000","last_change":"2024-09-12T03:38:10.399566+0000","last_active":"2024-09-12T03:38:10.402973+0000","last_peered":"2024-09-12T03:38:10.402973+0000","last_clean":"2024-09-12T03:38:10.402973+0000","last_became_active":"2024-09-12T03:38:10.398778+0000","last_became_peered":"2024-09-12T03:38:10.398778+0000","last_unstale":"2024-09-12T03:38:10.402973+0000","last_undegraded":"2024-09-12T03:38:10.402973+0000","last_fullsized":"2024-09-12T03:38:10.402973+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:21.970046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.366670+0000","last_change":"2024-09-12T03:38:10.366670+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.366670+0000","last_undegraded":"2024-09-12T03:38:10.366670+0000","last_fullsized":"2024-09-12T03:38:10.366670+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415097+0000","last_change":"2024-09-12T03:38:10.394211+0000","last_active":"2024-09-12T03:38:11.415097+0000","last_peered":"2024-09-12T03:38:11.415097+0000","last_clean":"2024-09-12T03:38:11.415097+0000","last_became_active":"2024-09-12T03:38:10.393408+0000","last_became_peered":"2024-09-12T03:38:10.393408+0000","last_unstale":"2024-09-12T03:38:11.415097+0000","last_undegraded":"2024-09-12T03:38:11.415097+0000","last_fullsized":"2024-09-12T03:38:11.415097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:21.318043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377196+0000","last_change":"2024-09-12T03:38:11.375483+0000","last_active":"2024-09-12T03:38:11.377196+0000","last_peered":"2024-09-12T03:38:11.377196+0000","last_clean":"2024-09-12T03:38:11.377196+0000","last_became_active":"2024-09-12T03:38:11.375033+0000","last_became_peered":"2024-09-12T03:38:11.375033+0000","last_unstale":"2024-09-12T03:38:11.377196+0000","last_undegraded":"2024-09-12T03:38:11.377196+0000","last_fullsized":"2024-09-12T03:38:11.377196+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355071+0000","last_change":"2024-09-12T03:38:10.387509+0000","last_active":"2024-09-12T03:38:12.355071+0000","last_peered":"2024-09-12T03:38:12.355071+0000","last_clean":"2024-09-12T03:38:12.355071+0000","last_became_active":"2024-09-12T03:38:10.386787+0000","last_became_peered":"2024-09-12T03:38:10.386787+0000","last_unstale":"2024-09-12T03:38:12.355071+0000","last_undegraded":"2024-09-12T03:38:12.355071+0000","last_fullsized":"2024-09-12T03:38:12.355071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364932+0000","last_change":"2024-09-12T03:38:10.364932+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364932+0000","last_undegraded":"2024-09-12T03:38:10.364932+0000","last_fullsized":"2024-09-12T03:38:10.364932+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390601+0000","last_change":"2024-09-12T03:38:10.371802+0000","last_active":"2024-09-12T03:38:11.390601+0000","last_peered":"2024-09-12T03:38:11.390601+0000","last_clean":"2024-09-12T03:38:11.390601+0000","last_became_active":"2024-09-12T03:38:10.371392+0000","last_became_peered":"2024-09-12T03:38:10.371392+0000","last_unstale":"2024-09-12T03:38:11.390601+0000","last_undegraded":"2024-09-12T03:38:11.390601+0000","last_fullsized":"2024-09-12T03:38:11.390601+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:45.146362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364861+0000","last_change":"2024-09-12T03:38:10.364861+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364861+0000","last_undegraded":"2024-09-12T03:38:10.364861+0000","last_fullsized":"2024-09-12T03:38:10.364861+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356974+0000","last_change":"2024-09-12T03:38:10.371718+0000","last_active":"2024-09-12T03:38:11.356974+0000","last_peered":"2024-09-12T03:38:11.356974+0000","last_clean":"2024-09-12T03:38:11.356974+0000","last_became_active":"2024-09-12T03:38:10.371419+0000","last_became_peered":"2024-09-12T03:38:10.371419+0000","last_unstale":"2024-09-12T03:38:11.356974+0000","last_undegraded":"2024-09-12T03:38:11.356974+0000","last_fullsized":"2024-09-12T03:38:11.356974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.819443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355100+0000","last_change":"2024-09-12T03:38:11.401115+0000","last_active":"2024-09-12T03:38:12.355100+0000","last_peered":"2024-09-12T03:38:12.355100+0000","last_clean":"2024-09-12T03:38:12.355100+0000","last_became_active":"2024-09-12T03:38:11.400866+0000","last_became_peered":"2024-09-12T03:38:11.400866+0000","last_unstale":"2024-09-12T03:38:12.355100+0000","last_undegraded":"2024-09-12T03:38:12.355100+0000","last_fullsized":"2024-09-12T03:38:12.355100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.405517+0000","last_change":"2024-09-12T03:38:10.400711+0000","last_active":"2024-09-12T03:38:10.405517+0000","last_peered":"2024-09-12T03:38:10.405517+0000","last_clean":"2024-09-12T03:38:10.405517+0000","last_became_active":"2024-09-12T03:38:10.399905+0000","last_became_peered":"2024-09-12T03:38:10.399905+0000","last_unstale":"2024-09-12T03:38:10.405517+0000","last_undegraded":"2024-09-12T03:38:10.405517+0000","last_fullsized":"2024-09-12T03:38:10.405517+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.198067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388770+0000","last_change":"2024-09-12T03:38:11.381737+0000","last_active":"2024-09-12T03:38:11.388770+0000","last_peered":"2024-09-12T03:38:11.388770+0000","last_clean":"2024-09-12T03:38:11.388770+0000","last_became_active":"2024-09-12T03:38:11.381350+0000","last_became_peered":"2024-09-12T03:38:11.381350+0000","last_unstale":"2024-09-12T03:38:11.388770+0000","last_undegraded":"2024-09-12T03:38:11.388770+0000","last_fullsized":"2024-09-12T03:38:11.388770+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:55.796930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360809+0000","last_change":"2024-09-12T03:38:10.372995+0000","last_active":"2024-09-12T03:38:11.360809+0000","last_peered":"2024-09-12T03:38:11.360809+0000","last_clean":"2024-09-12T03:38:11.360809+0000","last_became_active":"2024-09-12T03:38:10.372390+0000","last_became_peered":"2024-09-12T03:38:10.372390+0000","last_unstale":"2024-09-12T03:38:11.360809+0000","last_undegraded":"2024-09-12T03:38:11.360809+0000","last_fullsized":"2024-09-12T03:38:11.360809+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:37.755261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.361836+0000","last_change":"2024-09-12T03:38:10.361836+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.361836+0000","last_undegraded":"2024-09-12T03:38:10.361836+0000","last_fullsized":"2024-09-12T03:38:10.361836+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389875+0000","last_change":"2024-09-12T03:38:10.378023+0000","last_active":"2024-09-12T03:38:11.389875+0000","last_peered":"2024-09-12T03:38:11.389875+0000","last_clean":"2024-09-12T03:38:11.389875+0000","last_became_active":"2024-09-12T03:38:10.377276+0000","last_became_peered":"2024-09-12T03:38:10.377276+0000","last_unstale":"2024-09-12T03:38:11.389875+0000","last_undegraded":"2024-09-12T03:38:11.389875+0000","last_fullsized":"2024-09-12T03:38:11.389875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412023+0000","last_change":"2024-09-12T03:38:11.381329+0000","last_active":"2024-09-12T03:38:11.412023+0000","last_peered":"2024-09-12T03:38:11.412023+0000","last_clean":"2024-09-12T03:38:11.412023+0000","last_became_active":"2024-09-12T03:38:11.380636+0000","last_became_peered":"2024-09-12T03:38:11.380636+0000","last_unstale":"2024-09-12T03:38:11.412023+0000","last_undegraded":"2024-09-12T03:38:11.412023+0000","last_fullsized":"2024-09-12T03:38:11.412023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.382788+0000","last_change":"2024-09-12T03:38:10.381935+0000","last_active":"2024-09-12T03:38:10.382788+0000","last_peered":"2024-09-12T03:38:10.382788+0000","last_clean":"2024-09-12T03:38:10.382788+0000","last_became_active":"2024-09-12T03:38:10.381501+0000","last_became_peered":"2024-09-12T03:38:10.381501+0000","last_unstale":"2024-09-12T03:38:10.382788+0000","last_undegraded":"2024-09-12T03:38:10.382788+0000","last_fullsized":"2024-09-12T03:38:10.382788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:54.693400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354781+0000","last_change":"2024-09-12T03:38:11.380067+0000","last_active":"2024-09-12T03:38:12.354781+0000","last_peered":"2024-09-12T03:38:12.354781+0000","last_clean":"2024-09-12T03:38:12.354781+0000","last_became_active":"2024-09-12T03:38:11.379715+0000","last_became_peered":"2024-09-12T03:38:11.379715+0000","last_unstale":"2024-09-12T03:38:12.354781+0000","last_undegraded":"2024-09-12T03:38:12.354781+0000","last_fullsized":"2024-09-12T03:38:12.354781+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.400389+0000","last_change":"2024-09-12T03:38:10.398220+0000","last_active":"2024-09-12T03:38:10.400389+0000","last_peered":"2024-09-12T03:38:10.400389+0000","last_clean":"2024-09-12T03:38:10.400389+0000","last_became_active":"2024-09-12T03:38:10.390272+0000","last_became_peered":"2024-09-12T03:38:10.390272+0000","last_unstale":"2024-09-12T03:38:10.400389+0000","last_undegraded":"2024-09-12T03:38:10.400389+0000","last_fullsized":"2024-09-12T03:38:10.400389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:59.373658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354667+0000","last_change":"2024-09-12T03:38:11.373341+0000","last_active":"2024-09-12T03:38:12.354667+0000","last_peered":"2024-09-12T03:38:12.354667+0000","last_clean":"2024-09-12T03:38:12.354667+0000","last_became_active":"2024-09-12T03:38:11.371198+0000","last_became_peered":"2024-09-12T03:38:11.371198+0000","last_unstale":"2024-09-12T03:38:12.354667+0000","last_undegraded":"2024-09-12T03:38:12.354667+0000","last_fullsized":"2024-09-12T03:38:12.354667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:48.990741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.352280+0000","last_change":"2024-09-12T03:38:10.391548+0000","last_active":"2024-09-12T03:38:11.352280+0000","last_peered":"2024-09-12T03:38:11.352280+0000","last_clean":"2024-09-12T03:38:11.352280+0000","last_became_active":"2024-09-12T03:38:10.391192+0000","last_became_peered":"2024-09-12T03:38:10.391192+0000","last_unstale":"2024-09-12T03:38:11.352280+0000","last_undegraded":"2024-09-12T03:38:11.352280+0000","last_fullsized":"2024-09-12T03:38:11.352280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388970+0000","last_change":"2024-09-12T03:38:11.376125+0000","last_active":"2024-09-12T03:38:11.388970+0000","last_peered":"2024-09-12T03:38:11.388970+0000","last_clean":"2024-09-12T03:38:11.388970+0000","last_became_active":"2024-09-12T03:38:11.375578+0000","last_became_peered":"2024-09-12T03:38:11.375578+0000","last_unstale":"2024-09-12T03:38:11.388970+0000","last_undegraded":"2024-09-12T03:38:11.388970+0000","last_fullsized":"2024-09-12T03:38:11.388970+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:37.856069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355446+0000","last_change":"2024-09-12T03:38:10.392155+0000","last_active":"2024-09-12T03:38:11.355446+0000","last_peered":"2024-09-12T03:38:11.355446+0000","last_clean":"2024-09-12T03:38:11.355446+0000","last_became_active":"2024-09-12T03:38:10.391414+0000","last_became_peered":"2024-09-12T03:38:10.391414+0000","last_unstale":"2024-09-12T03:38:11.355446+0000","last_undegraded":"2024-09-12T03:38:11.355446+0000","last_fullsized":"2024-09-12T03:38:11.355446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388839+0000","last_change":"2024-09-12T03:38:11.381890+0000","last_active":"2024-09-12T03:38:11.388839+0000","last_peered":"2024-09-12T03:38:11.388839+0000","last_clean":"2024-09-12T03:38:11.388839+0000","last_became_active":"2024-09-12T03:38:11.380922+0000","last_became_peered":"2024-09-12T03:38:11.380922+0000","last_unstale":"2024-09-12T03:38:11.388839+0000","last_undegraded":"2024-09-12T03:38:11.388839+0000","last_fullsized":"2024-09-12T03:38:11.388839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:49.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.358028+0000","last_change":"2024-09-12T03:38:10.393564+0000","last_active":"2024-09-12T03:38:11.358028+0000","last_peered":"2024-09-12T03:38:11.358028+0000","last_clean":"2024-09-12T03:38:11.358028+0000","last_became_active":"2024-09-12T03:38:10.393172+0000","last_became_peered":"2024-09-12T03:38:10.393172+0000","last_unstale":"2024-09-12T03:38:11.358028+0000","last_undegraded":"2024-09-12T03:38:11.358028+0000","last_fullsized":"2024-09-12T03:38:11.358028+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:33.801197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404380+0000","last_change":"2024-09-12T03:38:11.400545+0000","last_active":"2024-09-12T03:38:11.404380+0000","last_peered":"2024-09-12T03:38:11.404380+0000","last_clean":"2024-09-12T03:38:11.404380+0000","last_became_active":"2024-09-12T03:38:11.399766+0000","last_became_peered":"2024-09-12T03:38:11.399766+0000","last_unstale":"2024-09-12T03:38:11.404380+0000","last_undegraded":"2024-09-12T03:38:11.404380+0000","last_fullsized":"2024-09-12T03:38:11.404380+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.401060+0000","last_change":"2024-09-12T03:38:10.396815+0000","last_active":"2024-09-12T03:38:10.401060+0000","last_peered":"2024-09-12T03:38:10.401060+0000","last_clean":"2024-09-12T03:38:10.401060+0000","last_became_active":"2024-09-12T03:38:10.389620+0000","last_became_peered":"2024-09-12T03:38:10.389620+0000","last_unstale":"2024-09-12T03:38:10.401060+0000","last_undegraded":"2024-09-12T03:38:10.401060+0000","last_fullsized":"2024-09-12T03:38:10.401060+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.376643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355855+0000","last_change":"2024-09-12T03:38:11.372417+0000","last_active":"2024-09-12T03:38:12.355855+0000","last_peered":"2024-09-12T03:38:12.355855+0000","last_clean":"2024-09-12T03:38:12.355855+0000","last_became_active":"2024-09-12T03:38:11.371689+0000","last_became_peered":"2024-09-12T03:38:11.371689+0000","last_unstale":"2024-09-12T03:38:12.355855+0000","last_undegraded":"2024-09-12T03:38:12.355855+0000","last_fullsized":"2024-09-12T03:38:12.355855+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360600+0000","last_change":"2024-09-12T03:38:10.393789+0000","last_active":"2024-09-12T03:38:11.360600+0000","last_peered":"2024-09-12T03:38:11.360600+0000","last_clean":"2024-09-12T03:38:11.360600+0000","last_became_active":"2024-09-12T03:38:10.393378+0000","last_became_peered":"2024-09-12T03:38:10.393378+0000","last_unstale":"2024-09-12T03:38:11.360600+0000","last_undegraded":"2024-09-12T03:38:11.360600+0000","last_fullsized":"2024-09-12T03:38:11.360600+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:50.751585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354326+0000","last_change":"2024-09-12T03:38:11.362250+0000","last_active":"2024-09-12T03:38:12.354326+0000","last_peered":"2024-09-12T03:38:12.354326+0000","last_clean":"2024-09-12T03:38:12.354326+0000","last_became_active":"2024-09-12T03:38:11.361375+0000","last_became_peered":"2024-09-12T03:38:11.361375+0000","last_unstale":"2024-09-12T03:38:12.354326+0000","last_undegraded":"2024-09-12T03:38:12.354326+0000","last_fullsized":"2024-09-12T03:38:12.354326+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:22.065181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389098+0000","last_change":"2024-09-12T03:38:10.372217+0000","last_active":"2024-09-12T03:38:11.389098+0000","last_peered":"2024-09-12T03:38:11.389098+0000","last_clean":"2024-09-12T03:38:11.389098+0000","last_became_active":"2024-09-12T03:38:10.371938+0000","last_became_peered":"2024-09-12T03:38:10.371938+0000","last_unstale":"2024-09-12T03:38:11.389098+0000","last_undegraded":"2024-09-12T03:38:11.389098+0000","last_fullsized":"2024-09-12T03:38:11.389098+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.905520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":304,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.366864+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:11.366864+0000","last_peered":"2024-09-12T03:38:11.366864+0000","last_clean":"2024-09-12T03:38:11.366864+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:11.366864+0000","last_undegraded":"2024-09-12T03:38:11.366864+0000","last_fullsized":"2024-09-12T03:38:11.366864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":1137835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1196032,"data_stored":547307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":547399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1171456,"data_stored":533473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":1130508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:15.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:15.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 Processor -- start 2024-09-12T03:38:15.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 -- start start 2024-09-12T03:38:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01d81520a0 0x7f01d806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f01d815f1d0 0x7f01d8071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f01d8152480 con 0x7f01d81520a0 2024-09-12T03:38:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f01d8070250 con 0x7f01d815f1d0 2024-09-12T03:38:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01deba8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f01d80aede0 con 0x7f01d806fe50 2024-09-12T03:38:15.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01d81520a0 0x7f01d806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01d81520a0 0x7f01d806f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39524/0 (socket says 172.21.15.73:39524) 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 -- 172.21.15.73:0/1237441799 learned_addr learned my addr 172.21.15.73:0/1237441799 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dd145640 1 --2- 172.21.15.73:0/1237441799 >> v2:172.21.15.150:3300/0 conn(0x7f01d815f1d0 0x7f01d8071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01d7fff640 1 --2- 172.21.15.73:0/1237441799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 -- 172.21.15.73:0/1237441799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 msgr2=0x7f01d815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 --2- 172.21.15.73:0/1237441799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 -- 172.21.15.73:0/1237441799 >> v2:172.21.15.150:3300/0 conn(0x7f01d815f1d0 msgr2=0x7f01d8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 --2- 172.21.15.73:0/1237441799 >> v2:172.21.15.150:3300/0 conn(0x7f01d815f1d0 0x7f01d8071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dc944640 1 -- 172.21.15.73:0/1237441799 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d815fa10 con 0x7f01d81520a0 2024-09-12T03:38:15.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.565+0000 7f01dd145640 1 --2- 172.21.15.73:0/1237441799 >> v2:172.21.15.150:3300/0 conn(0x7f01d815f1d0 0x7f01d8071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:15.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01dc944640 1 --2- 172.21.15.73:0/1237441799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d806f910 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f01d806e250 tx=0x7f01cc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b797622189e87a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01d77fe640 1 -- 172.21.15.73:0/1237441799 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0b0070 con 0x7f01d81520a0 2024-09-12T03:38:15.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01d77fe640 1 -- 172.21.15.73:0/1237441799 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01cc0ab600 con 0x7f01d81520a0 2024-09-12T03:38:15.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01d77fe640 1 -- 172.21.15.73:0/1237441799 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc0ab9d0 con 0x7f01d81520a0 2024-09-12T03:38:15.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 -- 172.21.15.73:0/1237441799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 msgr2=0x7f01d806f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 --2- 172.21.15.73:0/1237441799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d806f910 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f01d806e250 tx=0x7f01cc01c240 comp rx=0 tx=0).stop 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 -- 172.21.15.73:0/1237441799 shutdown_connections 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 --2- 172.21.15.73:0/1237441799 >> v2:172.21.15.150:3300/0 conn(0x7f01d815f1d0 0x7f01d8071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 --2- 172.21.15.73:0/1237441799 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 --2- 172.21.15.73:0/1237441799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d806f910 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 -- 172.21.15.73:0/1237441799 >> 172.21.15.73:0/1237441799 conn(0x7f01d80b1f90 msgr2=0x7f01d80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 -- 172.21.15.73:0/1237441799 shutdown_connections 2024-09-12T03:38:15.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.569+0000 7f01deba8640 1 -- 172.21.15.73:0/1237441799 wait complete. 2024-09-12T03:38:15.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 Processor -- start 2024-09-12T03:38:15.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 -- start start 2024-09-12T03:38:15.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d815f1d0 0x7f01d80b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f01d8073d30 con 0x7f01d81520a0 2024-09-12T03:38:15.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f01d8073a50 con 0x7f01d815f1d0 2024-09-12T03:38:15.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f01d815f5e0 con 0x7f01d806fe50 2024-09-12T03:38:15.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d814a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39526/0 (socket says 172.21.15.73:39526) 2024-09-12T03:38:15.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 -- 172.21.15.73:0/2971907811 learned_addr learned my addr 172.21.15.73:0/2971907811 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01dd145640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d815f1d0 0x7f01d80b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01dc944640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 -- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 msgr2=0x7f01d814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d814b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 -- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d815f1d0 msgr2=0x7f01d80b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d815f1d0 0x7f01d80b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 -- 172.21.15.73:0/2971907811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d814b770 con 0x7f01d81520a0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d7fff640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d814a9f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f01c400d5c0 tx=0x7f01c400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d57fa640 1 -- 172.21.15.73:0/2971907811 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4018020 con 0x7f01d81520a0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d57fa640 1 -- 172.21.15.73:0/2971907811 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c4014620 con 0x7f01d81520a0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d814ba50 con 0x7f01d81520a0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01d57fa640 1 -- 172.21.15.73:0/2971907811 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4014a10 con 0x7f01d81520a0 2024-09-12T03:38:15.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d814c010 con 0x7f01d81520a0 2024-09-12T03:38:15.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.573+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d806f910 con 0x7f01d81520a0 2024-09-12T03:38:15.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.577+0000 7f01d57fa640 1 -- 172.21.15.73:0/2971907811 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f01c401b020 con 0x7f01d81520a0 2024-09-12T03:38:15.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.577+0000 7f01d57fa640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01bc0678c0 0x7f01bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.577+0000 7f01d57fa640 1 -- 172.21.15.73:0/2971907811 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f01c4086090 con 0x7f01d81520a0 2024-09-12T03:38:15.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.577+0000 7f01dc944640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01bc0678c0 0x7f01bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.577+0000 7f01dc944640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01bc0678c0 0x7f01bc069d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0ad000 tx=0x7f01cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.581+0000 7f01d57fa640 1 -- 172.21.15.73:0/2971907811 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f01c4022030 con 0x7f01d81520a0 2024-09-12T03:38:15.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.741+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01d814af30 con 0x7f01bc0678c0 2024-09-12T03:38:15.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.749+0000 7f01d57fa640 1 -- 172.21.15.73:0/2971907811 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250241 (secure 0 0 0) 0x7f01d814af30 con 0x7f01bc0678c0 2024-09-12T03:38:15.753 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:15.754 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:15.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01bc0678c0 msgr2=0x7f01bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01bc0678c0 0x7f01bc069d80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f01cc0ad000 tx=0x7f01cc008040 comp rx=0 tx=0).stop 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 msgr2=0x7f01d814a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d814a9f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f01c400d5c0 tx=0x7f01c400da80 comp rx=0 tx=0).stop 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 shutdown_connections 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f01bc0678c0 0x7f01bc069d80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81520a0 0x7f01d814a9f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01d815f1d0 0x7f01d80b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 --2- 172.21.15.73:0/2971907811 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f01d806fe50 0x7f01d814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 >> 172.21.15.73:0/2971907811 conn(0x7f01d80b1f90 msgr2=0x7f01d815c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 shutdown_connections 2024-09-12T03:38:15.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.753+0000 7f01deba8640 1 -- 172.21.15.73:0/2971907811 wait complete. 2024-09-12T03:38:15.772 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-12T03:38:13.852436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260032,"kb_used_data":10496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714688,"statfs":{"total":773094113280,"available":772827840512,"internally_reserved":0,"allocated":10747904,"data_stored":5539093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":55,"apply_latency_ms":55,"commit_latency_ns":55000000,"apply_latency_ns":55000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.517217"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365795+0000","last_change":"2024-09-12T03:38:10.365795+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365795+0000","last_undegraded":"2024-09-12T03:38:10.365795+0000","last_fullsized":"2024-09-12T03:38:10.365795+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.380880+0000","last_change":"2024-09-12T03:38:10.380880+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.380880+0000","last_undegraded":"2024-09-12T03:38:10.380880+0000","last_fullsized":"2024-09-12T03:38:10.380880+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365790+0000","last_change":"2024-09-12T03:38:10.365790+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365790+0000","last_undegraded":"2024-09-12T03:38:10.365790+0000","last_fullsized":"2024-09-12T03:38:10.365790+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355538+0000","last_change":"2024-09-12T03:38:11.413014+0000","last_active":"2024-09-12T03:38:12.355538+0000","last_peered":"2024-09-12T03:38:12.355538+0000","last_clean":"2024-09-12T03:38:12.355538+0000","last_became_active":"2024-09-12T03:38:11.412596+0000","last_became_peered":"2024-09-12T03:38:11.412596+0000","last_unstale":"2024-09-12T03:38:12.355538+0000","last_undegraded":"2024-09-12T03:38:12.355538+0000","last_fullsized":"2024-09-12T03:38:12.355538+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413879+0000","last_change":"2024-09-12T03:38:11.412827+0000","last_active":"2024-09-12T03:38:11.413879+0000","last_peered":"2024-09-12T03:38:11.413879+0000","last_clean":"2024-09-12T03:38:11.413879+0000","last_became_active":"2024-09-12T03:38:11.412492+0000","last_became_peered":"2024-09-12T03:38:11.412492+0000","last_unstale":"2024-09-12T03:38:11.413879+0000","last_undegraded":"2024-09-12T03:38:11.413879+0000","last_fullsized":"2024-09-12T03:38:11.413879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.367553+0000","last_change":"2024-09-12T03:38:10.367553+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.367553+0000","last_undegraded":"2024-09-12T03:38:10.367553+0000","last_fullsized":"2024-09-12T03:38:10.367553+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.382689+0000","last_change":"2024-09-12T03:38:10.382689+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.382689+0000","last_undegraded":"2024-09-12T03:38:10.382689+0000","last_fullsized":"2024-09-12T03:38:10.382689+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388655+0000","last_change":"2024-09-12T03:38:11.375885+0000","last_active":"2024-09-12T03:38:11.388655+0000","last_peered":"2024-09-12T03:38:11.388655+0000","last_clean":"2024-09-12T03:38:11.388655+0000","last_became_active":"2024-09-12T03:38:11.375504+0000","last_became_peered":"2024-09-12T03:38:11.375504+0000","last_unstale":"2024-09-12T03:38:11.388655+0000","last_undegraded":"2024-09-12T03:38:11.388655+0000","last_fullsized":"2024-09-12T03:38:11.388655+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:35.575296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.370582+0000","last_change":"2024-09-12T03:38:10.370582+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.370582+0000","last_undegraded":"2024-09-12T03:38:10.370582+0000","last_fullsized":"2024-09-12T03:38:10.370582+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.383201+0000","last_change":"2024-09-12T03:38:11.378703+0000","last_active":"2024-09-12T03:38:11.383201+0000","last_peered":"2024-09-12T03:38:11.383201+0000","last_clean":"2024-09-12T03:38:11.383201+0000","last_became_active":"2024-09-12T03:38:11.378398+0000","last_became_peered":"2024-09-12T03:38:11.378398+0000","last_unstale":"2024-09-12T03:38:11.383201+0000","last_undegraded":"2024-09-12T03:38:11.383201+0000","last_fullsized":"2024-09-12T03:38:11.383201+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355575+0000","last_change":"2024-09-12T03:38:11.390773+0000","last_active":"2024-09-12T03:38:12.355575+0000","last_peered":"2024-09-12T03:38:12.355575+0000","last_clean":"2024-09-12T03:38:12.355575+0000","last_became_active":"2024-09-12T03:38:11.390033+0000","last_became_peered":"2024-09-12T03:38:11.390033+0000","last_unstale":"2024-09-12T03:38:12.355575+0000","last_undegraded":"2024-09-12T03:38:12.355575+0000","last_fullsized":"2024-09-12T03:38:12.355575+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414317+0000","last_change":"2024-09-12T03:38:11.389551+0000","last_active":"2024-09-12T03:38:11.414317+0000","last_peered":"2024-09-12T03:38:11.414317+0000","last_clean":"2024-09-12T03:38:11.414317+0000","last_became_active":"2024-09-12T03:38:11.382597+0000","last_became_peered":"2024-09-12T03:38:11.382597+0000","last_unstale":"2024-09-12T03:38:11.414317+0000","last_undegraded":"2024-09-12T03:38:11.414317+0000","last_fullsized":"2024-09-12T03:38:11.414317+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354540+0000","last_change":"2024-09-12T03:38:11.400083+0000","last_active":"2024-09-12T03:38:12.354540+0000","last_peered":"2024-09-12T03:38:12.354540+0000","last_clean":"2024-09-12T03:38:12.354540+0000","last_became_active":"2024-09-12T03:38:11.399735+0000","last_became_peered":"2024-09-12T03:38:11.399735+0000","last_unstale":"2024-09-12T03:38:12.354540+0000","last_undegraded":"2024-09-12T03:38:12.354540+0000","last_fullsized":"2024-09-12T03:38:12.354540+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.391723+0000","last_change":"2024-09-12T03:38:11.382202+0000","last_active":"2024-09-12T03:38:11.391723+0000","last_peered":"2024-09-12T03:38:11.391723+0000","last_clean":"2024-09-12T03:38:11.391723+0000","last_became_active":"2024-09-12T03:38:11.379979+0000","last_became_peered":"2024-09-12T03:38:11.379979+0000","last_unstale":"2024-09-12T03:38:11.391723+0000","last_undegraded":"2024-09-12T03:38:11.391723+0000","last_fullsized":"2024-09-12T03:38:11.391723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404588+0000","last_change":"2024-09-12T03:38:11.400513+0000","last_active":"2024-09-12T03:38:11.404588+0000","last_peered":"2024-09-12T03:38:11.404588+0000","last_clean":"2024-09-12T03:38:11.404588+0000","last_became_active":"2024-09-12T03:38:11.399612+0000","last_became_peered":"2024-09-12T03:38:11.399612+0000","last_unstale":"2024-09-12T03:38:11.404588+0000","last_undegraded":"2024-09-12T03:38:11.404588+0000","last_fullsized":"2024-09-12T03:38:11.404588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.349400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400905+0000","last_change":"2024-09-12T03:38:11.393997+0000","last_active":"2024-09-12T03:38:11.400905+0000","last_peered":"2024-09-12T03:38:11.400905+0000","last_clean":"2024-09-12T03:38:11.400905+0000","last_became_active":"2024-09-12T03:38:11.393283+0000","last_became_peered":"2024-09-12T03:38:11.393283+0000","last_unstale":"2024-09-12T03:38:11.400905+0000","last_undegraded":"2024-09-12T03:38:11.400905+0000","last_fullsized":"2024-09-12T03:38:11.400905+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365224+0000","last_change":"2024-09-12T03:38:10.365224+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365224+0000","last_undegraded":"2024-09-12T03:38:10.365224+0000","last_fullsized":"2024-09-12T03:38:10.365224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.367188+0000","last_change":"2024-09-12T03:38:10.367188+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.367188+0000","last_undegraded":"2024-09-12T03:38:10.367188+0000","last_fullsized":"2024-09-12T03:38:10.367188+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.365342+0000","last_change":"2024-09-12T03:38:10.365342+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.365342+0000","last_undegraded":"2024-09-12T03:38:10.365342+0000","last_fullsized":"2024-09-12T03:38:10.365342+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.411880+0000","last_change":"2024-09-12T03:38:11.375988+0000","last_active":"2024-09-12T03:38:11.411880+0000","last_peered":"2024-09-12T03:38:11.411880+0000","last_clean":"2024-09-12T03:38:11.411880+0000","last_became_active":"2024-09-12T03:38:11.375260+0000","last_became_peered":"2024-09-12T03:38:11.375260+0000","last_unstale":"2024-09-12T03:38:11.411880+0000","last_undegraded":"2024-09-12T03:38:11.411880+0000","last_fullsized":"2024-09-12T03:38:11.411880+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390309+0000","last_change":"2024-09-12T03:38:11.388685+0000","last_active":"2024-09-12T03:38:11.390309+0000","last_peered":"2024-09-12T03:38:11.390309+0000","last_clean":"2024-09-12T03:38:11.390309+0000","last_became_active":"2024-09-12T03:38:11.388328+0000","last_became_peered":"2024-09-12T03:38:11.388328+0000","last_unstale":"2024-09-12T03:38:11.390309+0000","last_undegraded":"2024-09-12T03:38:11.390309+0000","last_fullsized":"2024-09-12T03:38:11.390309+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:44.776547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400494+0000","last_change":"2024-09-12T03:38:11.399867+0000","last_active":"2024-09-12T03:38:11.400494+0000","last_peered":"2024-09-12T03:38:11.400494+0000","last_clean":"2024-09-12T03:38:11.400494+0000","last_became_active":"2024-09-12T03:38:11.399587+0000","last_became_peered":"2024-09-12T03:38:11.399587+0000","last_unstale":"2024-09-12T03:38:11.400494+0000","last_undegraded":"2024-09-12T03:38:11.400494+0000","last_fullsized":"2024-09-12T03:38:11.400494+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.360596+0000","last_change":"2024-09-12T03:38:10.360596+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.360596+0000","last_undegraded":"2024-09-12T03:38:10.360596+0000","last_fullsized":"2024-09-12T03:38:10.360596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.378686+0000","last_change":"2024-09-12T03:38:11.368565+0000","last_active":"2024-09-12T03:38:11.378686+0000","last_peered":"2024-09-12T03:38:11.378686+0000","last_clean":"2024-09-12T03:38:11.378686+0000","last_became_active":"2024-09-12T03:38:11.367075+0000","last_became_peered":"2024-09-12T03:38:11.367075+0000","last_unstale":"2024-09-12T03:38:11.378686+0000","last_undegraded":"2024-09-12T03:38:11.378686+0000","last_fullsized":"2024-09-12T03:38:11.378686+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412038+0000","last_change":"2024-09-12T03:38:11.373854+0000","last_active":"2024-09-12T03:38:11.412038+0000","last_peered":"2024-09-12T03:38:11.412038+0000","last_clean":"2024-09-12T03:38:11.412038+0000","last_became_active":"2024-09-12T03:38:11.372933+0000","last_became_peered":"2024-09-12T03:38:11.372933+0000","last_unstale":"2024-09-12T03:38:11.412038+0000","last_undegraded":"2024-09-12T03:38:11.412038+0000","last_fullsized":"2024-09-12T03:38:11.412038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412130+0000","last_change":"2024-09-12T03:38:11.378651+0000","last_active":"2024-09-12T03:38:11.412130+0000","last_peered":"2024-09-12T03:38:11.412130+0000","last_clean":"2024-09-12T03:38:11.412130+0000","last_became_active":"2024-09-12T03:38:11.377912+0000","last_became_peered":"2024-09-12T03:38:11.377912+0000","last_unstale":"2024-09-12T03:38:11.412130+0000","last_undegraded":"2024-09-12T03:38:11.412130+0000","last_fullsized":"2024-09-12T03:38:11.412130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355613+0000","last_change":"2024-09-12T03:38:11.403022+0000","last_active":"2024-09-12T03:38:12.355613+0000","last_peered":"2024-09-12T03:38:12.355613+0000","last_clean":"2024-09-12T03:38:12.355613+0000","last_became_active":"2024-09-12T03:38:11.402440+0000","last_became_peered":"2024-09-12T03:38:11.402440+0000","last_unstale":"2024-09-12T03:38:12.355613+0000","last_undegraded":"2024-09-12T03:38:12.355613+0000","last_fullsized":"2024-09-12T03:38:12.355613+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.372322+0000","last_change":"2024-09-12T03:38:10.372322+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.372322+0000","last_undegraded":"2024-09-12T03:38:10.372322+0000","last_fullsized":"2024-09-12T03:38:10.372322+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389356+0000","last_change":"2024-09-12T03:38:11.386723+0000","last_active":"2024-09-12T03:38:11.389356+0000","last_peered":"2024-09-12T03:38:11.389356+0000","last_clean":"2024-09-12T03:38:11.389356+0000","last_became_active":"2024-09-12T03:38:11.386276+0000","last_became_peered":"2024-09-12T03:38:11.386276+0000","last_unstale":"2024-09-12T03:38:11.389356+0000","last_undegraded":"2024-09-12T03:38:11.389356+0000","last_fullsized":"2024-09-12T03:38:11.389356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:55.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412229+0000","last_change":"2024-09-12T03:38:11.373029+0000","last_active":"2024-09-12T03:38:11.412229+0000","last_peered":"2024-09-12T03:38:11.412229+0000","last_clean":"2024-09-12T03:38:11.412229+0000","last_became_active":"2024-09-12T03:38:11.372027+0000","last_became_peered":"2024-09-12T03:38:11.372027+0000","last_unstale":"2024-09-12T03:38:11.412229+0000","last_undegraded":"2024-09-12T03:38:11.412229+0000","last_fullsized":"2024-09-12T03:38:11.412229+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.367944+0000","last_change":"2024-09-12T03:38:10.367944+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.367944+0000","last_undegraded":"2024-09-12T03:38:10.367944+0000","last_fullsized":"2024-09-12T03:38:10.367944+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414159+0000","last_change":"2024-09-12T03:38:11.412866+0000","last_active":"2024-09-12T03:38:11.414159+0000","last_peered":"2024-09-12T03:38:11.414159+0000","last_clean":"2024-09-12T03:38:11.414159+0000","last_became_active":"2024-09-12T03:38:11.412507+0000","last_became_peered":"2024-09-12T03:38:11.412507+0000","last_unstale":"2024-09-12T03:38:11.414159+0000","last_undegraded":"2024-09-12T03:38:11.414159+0000","last_fullsized":"2024-09-12T03:38:11.414159+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.093665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.360487+0000","last_change":"2024-09-12T03:38:10.360487+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.360487+0000","last_undegraded":"2024-09-12T03:38:10.360487+0000","last_fullsized":"2024-09-12T03:38:10.360487+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356288+0000","last_change":"2024-09-12T03:38:10.386396+0000","last_active":"2024-09-12T03:38:12.356288+0000","last_peered":"2024-09-12T03:38:12.356288+0000","last_clean":"2024-09-12T03:38:12.356288+0000","last_became_active":"2024-09-12T03:38:10.386049+0000","last_became_peered":"2024-09-12T03:38:10.386049+0000","last_unstale":"2024-09-12T03:38:12.356288+0000","last_undegraded":"2024-09-12T03:38:12.356288+0000","last_fullsized":"2024-09-12T03:38:12.356288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.120769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388945+0000","last_change":"2024-09-12T03:38:11.382219+0000","last_active":"2024-09-12T03:38:11.388945+0000","last_peered":"2024-09-12T03:38:11.388945+0000","last_clean":"2024-09-12T03:38:11.388945+0000","last_became_active":"2024-09-12T03:38:11.381850+0000","last_became_peered":"2024-09-12T03:38:11.381850+0000","last_unstale":"2024-09-12T03:38:11.388945+0000","last_undegraded":"2024-09-12T03:38:11.388945+0000","last_fullsized":"2024-09-12T03:38:11.388945+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:42.795485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.393105+0000","last_change":"2024-09-12T03:38:10.372155+0000","last_active":"2024-09-12T03:38:11.393105+0000","last_peered":"2024-09-12T03:38:11.393105+0000","last_clean":"2024-09-12T03:38:11.393105+0000","last_became_active":"2024-09-12T03:38:10.371286+0000","last_became_peered":"2024-09-12T03:38:10.371286+0000","last_unstale":"2024-09-12T03:38:11.393105+0000","last_undegraded":"2024-09-12T03:38:11.393105+0000","last_fullsized":"2024-09-12T03:38:11.393105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:24.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412287+0000","last_change":"2024-09-12T03:38:11.379955+0000","last_active":"2024-09-12T03:38:11.412287+0000","last_peered":"2024-09-12T03:38:11.412287+0000","last_clean":"2024-09-12T03:38:11.412287+0000","last_became_active":"2024-09-12T03:38:11.379266+0000","last_became_peered":"2024-09-12T03:38:11.379266+0000","last_unstale":"2024-09-12T03:38:11.412287+0000","last_undegraded":"2024-09-12T03:38:11.412287+0000","last_fullsized":"2024-09-12T03:38:11.412287+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414531+0000","last_change":"2024-09-12T03:38:10.396126+0000","last_active":"2024-09-12T03:38:11.414531+0000","last_peered":"2024-09-12T03:38:11.414531+0000","last_clean":"2024-09-12T03:38:11.414531+0000","last_became_active":"2024-09-12T03:38:10.391204+0000","last_became_peered":"2024-09-12T03:38:10.391204+0000","last_unstale":"2024-09-12T03:38:11.414531+0000","last_undegraded":"2024-09-12T03:38:11.414531+0000","last_fullsized":"2024-09-12T03:38:11.414531+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354859+0000","last_change":"2024-09-12T03:38:11.390529+0000","last_active":"2024-09-12T03:38:12.354859+0000","last_peered":"2024-09-12T03:38:12.354859+0000","last_clean":"2024-09-12T03:38:12.354859+0000","last_became_active":"2024-09-12T03:38:11.389787+0000","last_became_peered":"2024-09-12T03:38:11.389787+0000","last_unstale":"2024-09-12T03:38:12.354859+0000","last_undegraded":"2024-09-12T03:38:12.354859+0000","last_fullsized":"2024-09-12T03:38:12.354859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413407+0000","last_change":"2024-09-12T03:38:10.393267+0000","last_active":"2024-09-12T03:38:11.413407+0000","last_peered":"2024-09-12T03:38:11.413407+0000","last_clean":"2024-09-12T03:38:11.413407+0000","last_became_active":"2024-09-12T03:38:10.392994+0000","last_became_peered":"2024-09-12T03:38:10.392994+0000","last_unstale":"2024-09-12T03:38:11.413407+0000","last_undegraded":"2024-09-12T03:38:11.413407+0000","last_fullsized":"2024-09-12T03:38:11.413407+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355465+0000","last_change":"2024-09-12T03:38:11.377861+0000","last_active":"2024-09-12T03:38:12.355465+0000","last_peered":"2024-09-12T03:38:12.355465+0000","last_clean":"2024-09-12T03:38:12.355465+0000","last_became_active":"2024-09-12T03:38:11.377511+0000","last_became_peered":"2024-09-12T03:38:11.377511+0000","last_unstale":"2024-09-12T03:38:12.355465+0000","last_undegraded":"2024-09-12T03:38:12.355465+0000","last_fullsized":"2024-09-12T03:38:12.355465+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.403041+0000","last_change":"2024-09-12T03:38:10.386519+0000","last_active":"2024-09-12T03:38:11.403041+0000","last_peered":"2024-09-12T03:38:11.403041+0000","last_clean":"2024-09-12T03:38:11.403041+0000","last_became_active":"2024-09-12T03:38:10.385746+0000","last_became_peered":"2024-09-12T03:38:10.385746+0000","last_unstale":"2024-09-12T03:38:11.403041+0000","last_undegraded":"2024-09-12T03:38:11.403041+0000","last_fullsized":"2024-09-12T03:38:11.403041+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:47.841147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364324+0000","last_change":"2024-09-12T03:38:10.364324+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364324+0000","last_undegraded":"2024-09-12T03:38:10.364324+0000","last_fullsized":"2024-09-12T03:38:10.364324+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354371+0000","last_change":"2024-09-12T03:38:10.394181+0000","last_active":"2024-09-12T03:38:12.354371+0000","last_peered":"2024-09-12T03:38:12.354371+0000","last_clean":"2024-09-12T03:38:12.354371+0000","last_became_active":"2024-09-12T03:38:10.393438+0000","last_became_peered":"2024-09-12T03:38:10.393438+0000","last_unstale":"2024-09-12T03:38:12.354371+0000","last_undegraded":"2024-09-12T03:38:12.354371+0000","last_fullsized":"2024-09-12T03:38:12.354371+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:59.138777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.366128+0000","last_change":"2024-09-12T03:38:10.366128+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.366128+0000","last_undegraded":"2024-09-12T03:38:10.366128+0000","last_fullsized":"2024-09-12T03:38:10.366128+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355550+0000","last_change":"2024-09-12T03:38:10.386837+0000","last_active":"2024-09-12T03:38:11.355550+0000","last_peered":"2024-09-12T03:38:11.355550+0000","last_clean":"2024-09-12T03:38:11.355550+0000","last_became_active":"2024-09-12T03:38:10.382683+0000","last_became_peered":"2024-09-12T03:38:10.382683+0000","last_unstale":"2024-09-12T03:38:11.355550+0000","last_undegraded":"2024-09-12T03:38:11.355550+0000","last_fullsized":"2024-09-12T03:38:11.355550+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356272+0000","last_change":"2024-09-12T03:38:11.387150+0000","last_active":"2024-09-12T03:38:12.356272+0000","last_peered":"2024-09-12T03:38:12.356272+0000","last_clean":"2024-09-12T03:38:12.356272+0000","last_became_active":"2024-09-12T03:38:11.386913+0000","last_became_peered":"2024-09-12T03:38:11.386913+0000","last_unstale":"2024-09-12T03:38:12.356272+0000","last_undegraded":"2024-09-12T03:38:12.356272+0000","last_fullsized":"2024-09-12T03:38:12.356272+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353698+0000","last_change":"2024-09-12T03:38:10.380693+0000","last_active":"2024-09-12T03:38:12.353698+0000","last_peered":"2024-09-12T03:38:12.353698+0000","last_clean":"2024-09-12T03:38:12.353698+0000","last_became_active":"2024-09-12T03:38:10.380423+0000","last_became_peered":"2024-09-12T03:38:10.380423+0000","last_unstale":"2024-09-12T03:38:12.353698+0000","last_undegraded":"2024-09-12T03:38:12.353698+0000","last_fullsized":"2024-09-12T03:38:12.353698+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.361410+0000","last_change":"2024-09-12T03:38:10.361410+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.361410+0000","last_undegraded":"2024-09-12T03:38:10.361410+0000","last_fullsized":"2024-09-12T03:38:10.361410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356264+0000","last_change":"2024-09-12T03:38:10.386626+0000","last_active":"2024-09-12T03:38:11.356264+0000","last_peered":"2024-09-12T03:38:11.356264+0000","last_clean":"2024-09-12T03:38:11.356264+0000","last_became_active":"2024-09-12T03:38:10.382526+0000","last_became_peered":"2024-09-12T03:38:10.382526+0000","last_unstale":"2024-09-12T03:38:11.356264+0000","last_undegraded":"2024-09-12T03:38:11.356264+0000","last_fullsized":"2024-09-12T03:38:11.356264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377375+0000","last_change":"2024-09-12T03:38:11.374433+0000","last_active":"2024-09-12T03:38:11.377375+0000","last_peered":"2024-09-12T03:38:11.377375+0000","last_clean":"2024-09-12T03:38:11.377375+0000","last_became_active":"2024-09-12T03:38:11.374104+0000","last_became_peered":"2024-09-12T03:38:11.374104+0000","last_unstale":"2024-09-12T03:38:11.377375+0000","last_undegraded":"2024-09-12T03:38:11.377375+0000","last_fullsized":"2024-09-12T03:38:11.377375+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.396095+0000","last_change":"2024-09-12T03:38:10.393712+0000","last_active":"2024-09-12T03:38:10.396095+0000","last_peered":"2024-09-12T03:38:10.396095+0000","last_clean":"2024-09-12T03:38:10.396095+0000","last_became_active":"2024-09-12T03:38:10.393273+0000","last_became_peered":"2024-09-12T03:38:10.393273+0000","last_unstale":"2024-09-12T03:38:10.396095+0000","last_undegraded":"2024-09-12T03:38:10.396095+0000","last_fullsized":"2024-09-12T03:38:10.396095+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:14.732430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389013+0000","last_change":"2024-09-12T03:38:11.376141+0000","last_active":"2024-09-12T03:38:11.389013+0000","last_peered":"2024-09-12T03:38:11.389013+0000","last_clean":"2024-09-12T03:38:11.389013+0000","last_became_active":"2024-09-12T03:38:11.375589+0000","last_became_peered":"2024-09-12T03:38:11.375589+0000","last_unstale":"2024-09-12T03:38:11.389013+0000","last_undegraded":"2024-09-12T03:38:11.389013+0000","last_fullsized":"2024-09-12T03:38:11.389013+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:48.925960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.392975+0000","last_change":"2024-09-12T03:38:10.377052+0000","last_active":"2024-09-12T03:38:11.392975+0000","last_peered":"2024-09-12T03:38:11.392975+0000","last_clean":"2024-09-12T03:38:11.392975+0000","last_became_active":"2024-09-12T03:38:10.376406+0000","last_became_peered":"2024-09-12T03:38:10.376406+0000","last_unstale":"2024-09-12T03:38:11.392975+0000","last_undegraded":"2024-09-12T03:38:11.392975+0000","last_fullsized":"2024-09-12T03:38:11.392975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:06.325275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377171+0000","last_change":"2024-09-12T03:38:11.373470+0000","last_active":"2024-09-12T03:38:11.377171+0000","last_peered":"2024-09-12T03:38:11.377171+0000","last_clean":"2024-09-12T03:38:11.377171+0000","last_became_active":"2024-09-12T03:38:11.369749+0000","last_became_peered":"2024-09-12T03:38:11.369749+0000","last_unstale":"2024-09-12T03:38:11.377171+0000","last_undegraded":"2024-09-12T03:38:11.377171+0000","last_fullsized":"2024-09-12T03:38:11.377171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.400212+0000","last_change":"2024-09-12T03:38:10.390735+0000","last_active":"2024-09-12T03:38:10.400212+0000","last_peered":"2024-09-12T03:38:10.400212+0000","last_clean":"2024-09-12T03:38:10.400212+0000","last_became_active":"2024-09-12T03:38:10.389748+0000","last_became_peered":"2024-09-12T03:38:10.389748+0000","last_unstale":"2024-09-12T03:38:10.400212+0000","last_undegraded":"2024-09-12T03:38:10.400212+0000","last_fullsized":"2024-09-12T03:38:10.400212+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:52.599813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354800+0000","last_change":"2024-09-12T03:38:11.389078+0000","last_active":"2024-09-12T03:38:12.354800+0000","last_peered":"2024-09-12T03:38:12.354800+0000","last_clean":"2024-09-12T03:38:12.354800+0000","last_became_active":"2024-09-12T03:38:11.388369+0000","last_became_peered":"2024-09-12T03:38:11.388369+0000","last_unstale":"2024-09-12T03:38:12.354800+0000","last_undegraded":"2024-09-12T03:38:12.354800+0000","last_fullsized":"2024-09-12T03:38:12.354800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:50.506813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389574+0000","last_change":"2024-09-12T03:38:10.378214+0000","last_active":"2024-09-12T03:38:11.389574+0000","last_peered":"2024-09-12T03:38:11.389574+0000","last_clean":"2024-09-12T03:38:11.389574+0000","last_became_active":"2024-09-12T03:38:10.377904+0000","last_became_peered":"2024-09-12T03:38:10.377904+0000","last_unstale":"2024-09-12T03:38:11.389574+0000","last_undegraded":"2024-09-12T03:38:11.389574+0000","last_fullsized":"2024-09-12T03:38:11.389574+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.371181+0000","last_change":"2024-09-12T03:38:10.371181+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.371181+0000","last_undegraded":"2024-09-12T03:38:10.371181+0000","last_fullsized":"2024-09-12T03:38:10.371181+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354576+0000","last_change":"2024-09-12T03:38:10.374595+0000","last_active":"2024-09-12T03:38:12.354576+0000","last_peered":"2024-09-12T03:38:12.354576+0000","last_clean":"2024-09-12T03:38:12.354576+0000","last_became_active":"2024-09-12T03:38:10.374184+0000","last_became_peered":"2024-09-12T03:38:10.374184+0000","last_unstale":"2024-09-12T03:38:12.354576+0000","last_undegraded":"2024-09-12T03:38:12.354576+0000","last_fullsized":"2024-09-12T03:38:12.354576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:09.966450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414410+0000","last_change":"2024-09-12T03:38:11.413754+0000","last_active":"2024-09-12T03:38:11.414410+0000","last_peered":"2024-09-12T03:38:11.414410+0000","last_clean":"2024-09-12T03:38:11.414410+0000","last_became_active":"2024-09-12T03:38:11.413457+0000","last_became_peered":"2024-09-12T03:38:11.413457+0000","last_unstale":"2024-09-12T03:38:11.414410+0000","last_undegraded":"2024-09-12T03:38:11.414410+0000","last_fullsized":"2024-09-12T03:38:11.414410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:39.890043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.357062+0000","last_change":"2024-09-12T03:38:10.397284+0000","last_active":"2024-09-12T03:38:11.357062+0000","last_peered":"2024-09-12T03:38:11.357062+0000","last_clean":"2024-09-12T03:38:11.357062+0000","last_became_active":"2024-09-12T03:38:10.397035+0000","last_became_peered":"2024-09-12T03:38:10.397035+0000","last_unstale":"2024-09-12T03:38:11.357062+0000","last_undegraded":"2024-09-12T03:38:11.357062+0000","last_fullsized":"2024-09-12T03:38:11.357062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:01.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364681+0000","last_change":"2024-09-12T03:38:10.364681+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364681+0000","last_undegraded":"2024-09-12T03:38:10.364681+0000","last_fullsized":"2024-09-12T03:38:10.364681+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415226+0000","last_change":"2024-09-12T03:38:10.396181+0000","last_active":"2024-09-12T03:38:11.415226+0000","last_peered":"2024-09-12T03:38:11.415226+0000","last_clean":"2024-09-12T03:38:11.415226+0000","last_became_active":"2024-09-12T03:38:10.391810+0000","last_became_peered":"2024-09-12T03:38:10.391810+0000","last_unstale":"2024-09-12T03:38:11.415226+0000","last_undegraded":"2024-09-12T03:38:11.415226+0000","last_fullsized":"2024-09-12T03:38:11.415226+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389320+0000","last_change":"2024-09-12T03:38:11.386951+0000","last_active":"2024-09-12T03:38:11.389320+0000","last_peered":"2024-09-12T03:38:11.389320+0000","last_clean":"2024-09-12T03:38:11.389320+0000","last_became_active":"2024-09-12T03:38:11.386626+0000","last_became_peered":"2024-09-12T03:38:11.386626+0000","last_unstale":"2024-09-12T03:38:11.389320+0000","last_undegraded":"2024-09-12T03:38:11.389320+0000","last_fullsized":"2024-09-12T03:38:11.389320+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.218703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.402973+0000","last_change":"2024-09-12T03:38:10.399566+0000","last_active":"2024-09-12T03:38:10.402973+0000","last_peered":"2024-09-12T03:38:10.402973+0000","last_clean":"2024-09-12T03:38:10.402973+0000","last_became_active":"2024-09-12T03:38:10.398778+0000","last_became_peered":"2024-09-12T03:38:10.398778+0000","last_unstale":"2024-09-12T03:38:10.402973+0000","last_undegraded":"2024-09-12T03:38:10.402973+0000","last_fullsized":"2024-09-12T03:38:10.402973+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:21.970046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.366670+0000","last_change":"2024-09-12T03:38:10.366670+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.366670+0000","last_undegraded":"2024-09-12T03:38:10.366670+0000","last_fullsized":"2024-09-12T03:38:10.366670+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415097+0000","last_change":"2024-09-12T03:38:10.394211+0000","last_active":"2024-09-12T03:38:11.415097+0000","last_peered":"2024-09-12T03:38:11.415097+0000","last_clean":"2024-09-12T03:38:11.415097+0000","last_became_active":"2024-09-12T03:38:10.393408+0000","last_became_peered":"2024-09-12T03:38:10.393408+0000","last_unstale":"2024-09-12T03:38:11.415097+0000","last_undegraded":"2024-09-12T03:38:11.415097+0000","last_fullsized":"2024-09-12T03:38:11.415097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:21.318043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377196+0000","last_change":"2024-09-12T03:38:11.375483+0000","last_active":"2024-09-12T03:38:11.377196+0000","last_peered":"2024-09-12T03:38:11.377196+0000","last_clean":"2024-09-12T03:38:11.377196+0000","last_became_active":"2024-09-12T03:38:11.375033+0000","last_became_peered":"2024-09-12T03:38:11.375033+0000","last_unstale":"2024-09-12T03:38:11.377196+0000","last_undegraded":"2024-09-12T03:38:11.377196+0000","last_fullsized":"2024-09-12T03:38:11.377196+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355071+0000","last_change":"2024-09-12T03:38:10.387509+0000","last_active":"2024-09-12T03:38:12.355071+0000","last_peered":"2024-09-12T03:38:12.355071+0000","last_clean":"2024-09-12T03:38:12.355071+0000","last_became_active":"2024-09-12T03:38:10.386787+0000","last_became_peered":"2024-09-12T03:38:10.386787+0000","last_unstale":"2024-09-12T03:38:12.355071+0000","last_undegraded":"2024-09-12T03:38:12.355071+0000","last_fullsized":"2024-09-12T03:38:12.355071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364932+0000","last_change":"2024-09-12T03:38:10.364932+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364932+0000","last_undegraded":"2024-09-12T03:38:10.364932+0000","last_fullsized":"2024-09-12T03:38:10.364932+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390601+0000","last_change":"2024-09-12T03:38:10.371802+0000","last_active":"2024-09-12T03:38:11.390601+0000","last_peered":"2024-09-12T03:38:11.390601+0000","last_clean":"2024-09-12T03:38:11.390601+0000","last_became_active":"2024-09-12T03:38:10.371392+0000","last_became_peered":"2024-09-12T03:38:10.371392+0000","last_unstale":"2024-09-12T03:38:11.390601+0000","last_undegraded":"2024-09-12T03:38:11.390601+0000","last_fullsized":"2024-09-12T03:38:11.390601+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:45.146362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.364861+0000","last_change":"2024-09-12T03:38:10.364861+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.364861+0000","last_undegraded":"2024-09-12T03:38:10.364861+0000","last_fullsized":"2024-09-12T03:38:10.364861+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356974+0000","last_change":"2024-09-12T03:38:10.371718+0000","last_active":"2024-09-12T03:38:11.356974+0000","last_peered":"2024-09-12T03:38:11.356974+0000","last_clean":"2024-09-12T03:38:11.356974+0000","last_became_active":"2024-09-12T03:38:10.371419+0000","last_became_peered":"2024-09-12T03:38:10.371419+0000","last_unstale":"2024-09-12T03:38:11.356974+0000","last_undegraded":"2024-09-12T03:38:11.356974+0000","last_fullsized":"2024-09-12T03:38:11.356974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.819443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355100+0000","last_change":"2024-09-12T03:38:11.401115+0000","last_active":"2024-09-12T03:38:12.355100+0000","last_peered":"2024-09-12T03:38:12.355100+0000","last_clean":"2024-09-12T03:38:12.355100+0000","last_became_active":"2024-09-12T03:38:11.400866+0000","last_became_peered":"2024-09-12T03:38:11.400866+0000","last_unstale":"2024-09-12T03:38:12.355100+0000","last_undegraded":"2024-09-12T03:38:12.355100+0000","last_fullsized":"2024-09-12T03:38:12.355100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.405517+0000","last_change":"2024-09-12T03:38:10.400711+0000","last_active":"2024-09-12T03:38:10.405517+0000","last_peered":"2024-09-12T03:38:10.405517+0000","last_clean":"2024-09-12T03:38:10.405517+0000","last_became_active":"2024-09-12T03:38:10.399905+0000","last_became_peered":"2024-09-12T03:38:10.399905+0000","last_unstale":"2024-09-12T03:38:10.405517+0000","last_undegraded":"2024-09-12T03:38:10.405517+0000","last_fullsized":"2024-09-12T03:38:10.405517+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:43.198067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388770+0000","last_change":"2024-09-12T03:38:11.381737+0000","last_active":"2024-09-12T03:38:11.388770+0000","last_peered":"2024-09-12T03:38:11.388770+0000","last_clean":"2024-09-12T03:38:11.388770+0000","last_became_active":"2024-09-12T03:38:11.381350+0000","last_became_peered":"2024-09-12T03:38:11.381350+0000","last_unstale":"2024-09-12T03:38:11.388770+0000","last_undegraded":"2024-09-12T03:38:11.388770+0000","last_fullsized":"2024-09-12T03:38:11.388770+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:55.796930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360809+0000","last_change":"2024-09-12T03:38:10.372995+0000","last_active":"2024-09-12T03:38:11.360809+0000","last_peered":"2024-09-12T03:38:11.360809+0000","last_clean":"2024-09-12T03:38:11.360809+0000","last_became_active":"2024-09-12T03:38:10.372390+0000","last_became_peered":"2024-09-12T03:38:10.372390+0000","last_unstale":"2024-09-12T03:38:11.360809+0000","last_undegraded":"2024-09-12T03:38:11.360809+0000","last_fullsized":"2024-09-12T03:38:11.360809+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:37.755261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2024-09-12T03:38:10.361836+0000","last_change":"2024-09-12T03:38:10.361836+0000","last_active":"2024-09-12T03:38:10.334912+0000","last_peered":"2024-09-12T03:38:10.334912+0000","last_clean":"2024-09-12T03:38:10.334912+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T03:38:10.361836+0000","last_undegraded":"2024-09-12T03:38:10.361836+0000","last_fullsized":"2024-09-12T03:38:10.361836+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389875+0000","last_change":"2024-09-12T03:38:10.378023+0000","last_active":"2024-09-12T03:38:11.389875+0000","last_peered":"2024-09-12T03:38:11.389875+0000","last_clean":"2024-09-12T03:38:11.389875+0000","last_became_active":"2024-09-12T03:38:10.377276+0000","last_became_peered":"2024-09-12T03:38:10.377276+0000","last_unstale":"2024-09-12T03:38:11.389875+0000","last_undegraded":"2024-09-12T03:38:11.389875+0000","last_fullsized":"2024-09-12T03:38:11.389875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412023+0000","last_change":"2024-09-12T03:38:11.381329+0000","last_active":"2024-09-12T03:38:11.412023+0000","last_peered":"2024-09-12T03:38:11.412023+0000","last_clean":"2024-09-12T03:38:11.412023+0000","last_became_active":"2024-09-12T03:38:11.380636+0000","last_became_peered":"2024-09-12T03:38:11.380636+0000","last_unstale":"2024-09-12T03:38:11.412023+0000","last_undegraded":"2024-09-12T03:38:11.412023+0000","last_fullsized":"2024-09-12T03:38:11.412023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.382788+0000","last_change":"2024-09-12T03:38:10.381935+0000","last_active":"2024-09-12T03:38:10.382788+0000","last_peered":"2024-09-12T03:38:10.382788+0000","last_clean":"2024-09-12T03:38:10.382788+0000","last_became_active":"2024-09-12T03:38:10.381501+0000","last_became_peered":"2024-09-12T03:38:10.381501+0000","last_unstale":"2024-09-12T03:38:10.382788+0000","last_undegraded":"2024-09-12T03:38:10.382788+0000","last_fullsized":"2024-09-12T03:38:10.382788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:54.693400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354781+0000","last_change":"2024-09-12T03:38:11.380067+0000","last_active":"2024-09-12T03:38:12.354781+0000","last_peered":"2024-09-12T03:38:12.354781+0000","last_clean":"2024-09-12T03:38:12.354781+0000","last_became_active":"2024-09-12T03:38:11.379715+0000","last_became_peered":"2024-09-12T03:38:11.379715+0000","last_unstale":"2024-09-12T03:38:12.354781+0000","last_undegraded":"2024-09-12T03:38:12.354781+0000","last_fullsized":"2024-09-12T03:38:12.354781+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.400389+0000","last_change":"2024-09-12T03:38:10.398220+0000","last_active":"2024-09-12T03:38:10.400389+0000","last_peered":"2024-09-12T03:38:10.400389+0000","last_clean":"2024-09-12T03:38:10.400389+0000","last_became_active":"2024-09-12T03:38:10.390272+0000","last_became_peered":"2024-09-12T03:38:10.390272+0000","last_unstale":"2024-09-12T03:38:10.400389+0000","last_undegraded":"2024-09-12T03:38:10.400389+0000","last_fullsized":"2024-09-12T03:38:10.400389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:59.373658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354667+0000","last_change":"2024-09-12T03:38:11.373341+0000","last_active":"2024-09-12T03:38:12.354667+0000","last_peered":"2024-09-12T03:38:12.354667+0000","last_clean":"2024-09-12T03:38:12.354667+0000","last_became_active":"2024-09-12T03:38:11.371198+0000","last_became_peered":"2024-09-12T03:38:11.371198+0000","last_unstale":"2024-09-12T03:38:12.354667+0000","last_undegraded":"2024-09-12T03:38:12.354667+0000","last_fullsized":"2024-09-12T03:38:12.354667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:48.990741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.352280+0000","last_change":"2024-09-12T03:38:10.391548+0000","last_active":"2024-09-12T03:38:11.352280+0000","last_peered":"2024-09-12T03:38:11.352280+0000","last_clean":"2024-09-12T03:38:11.352280+0000","last_became_active":"2024-09-12T03:38:10.391192+0000","last_became_peered":"2024-09-12T03:38:10.391192+0000","last_unstale":"2024-09-12T03:38:11.352280+0000","last_undegraded":"2024-09-12T03:38:11.352280+0000","last_fullsized":"2024-09-12T03:38:11.352280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388970+0000","last_change":"2024-09-12T03:38:11.376125+0000","last_active":"2024-09-12T03:38:11.388970+0000","last_peered":"2024-09-12T03:38:11.388970+0000","last_clean":"2024-09-12T03:38:11.388970+0000","last_became_active":"2024-09-12T03:38:11.375578+0000","last_became_peered":"2024-09-12T03:38:11.375578+0000","last_unstale":"2024-09-12T03:38:11.388970+0000","last_undegraded":"2024-09-12T03:38:11.388970+0000","last_fullsized":"2024-09-12T03:38:11.388970+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:37.856069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355446+0000","last_change":"2024-09-12T03:38:10.392155+0000","last_active":"2024-09-12T03:38:11.355446+0000","last_peered":"2024-09-12T03:38:11.355446+0000","last_clean":"2024-09-12T03:38:11.355446+0000","last_became_active":"2024-09-12T03:38:10.391414+0000","last_became_peered":"2024-09-12T03:38:10.391414+0000","last_unstale":"2024-09-12T03:38:11.355446+0000","last_undegraded":"2024-09-12T03:38:11.355446+0000","last_fullsized":"2024-09-12T03:38:11.355446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388839+0000","last_change":"2024-09-12T03:38:11.381890+0000","last_active":"2024-09-12T03:38:11.388839+0000","last_peered":"2024-09-12T03:38:11.388839+0000","last_clean":"2024-09-12T03:38:11.388839+0000","last_became_active":"2024-09-12T03:38:11.380922+0000","last_became_peered":"2024-09-12T03:38:11.380922+0000","last_unstale":"2024-09-12T03:38:11.388839+0000","last_undegraded":"2024-09-12T03:38:11.388839+0000","last_fullsized":"2024-09-12T03:38:11.388839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:49.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.358028+0000","last_change":"2024-09-12T03:38:10.393564+0000","last_active":"2024-09-12T03:38:11.358028+0000","last_peered":"2024-09-12T03:38:11.358028+0000","last_clean":"2024-09-12T03:38:11.358028+0000","last_became_active":"2024-09-12T03:38:10.393172+0000","last_became_peered":"2024-09-12T03:38:10.393172+0000","last_unstale":"2024-09-12T03:38:11.358028+0000","last_undegraded":"2024-09-12T03:38:11.358028+0000","last_fullsized":"2024-09-12T03:38:11.358028+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:33.801197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404380+0000","last_change":"2024-09-12T03:38:11.400545+0000","last_active":"2024-09-12T03:38:11.404380+0000","last_peered":"2024-09-12T03:38:11.404380+0000","last_clean":"2024-09-12T03:38:11.404380+0000","last_became_active":"2024-09-12T03:38:11.399766+0000","last_became_peered":"2024-09-12T03:38:11.399766+0000","last_unstale":"2024-09-12T03:38:11.404380+0000","last_undegraded":"2024-09-12T03:38:11.404380+0000","last_fullsized":"2024-09-12T03:38:11.404380+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-12T03:38:10.401060+0000","last_change":"2024-09-12T03:38:10.396815+0000","last_active":"2024-09-12T03:38:10.401060+0000","last_peered":"2024-09-12T03:38:10.401060+0000","last_clean":"2024-09-12T03:38:10.401060+0000","last_became_active":"2024-09-12T03:38:10.389620+0000","last_became_peered":"2024-09-12T03:38:10.389620+0000","last_unstale":"2024-09-12T03:38:10.401060+0000","last_undegraded":"2024-09-12T03:38:10.401060+0000","last_fullsized":"2024-09-12T03:38:10.401060+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:26.376643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355855+0000","last_change":"2024-09-12T03:38:11.372417+0000","last_active":"2024-09-12T03:38:12.355855+0000","last_peered":"2024-09-12T03:38:12.355855+0000","last_clean":"2024-09-12T03:38:12.355855+0000","last_became_active":"2024-09-12T03:38:11.371689+0000","last_became_peered":"2024-09-12T03:38:11.371689+0000","last_unstale":"2024-09-12T03:38:12.355855+0000","last_undegraded":"2024-09-12T03:38:12.355855+0000","last_fullsized":"2024-09-12T03:38:12.355855+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360600+0000","last_change":"2024-09-12T03:38:10.393789+0000","last_active":"2024-09-12T03:38:11.360600+0000","last_peered":"2024-09-12T03:38:11.360600+0000","last_clean":"2024-09-12T03:38:11.360600+0000","last_became_active":"2024-09-12T03:38:10.393378+0000","last_became_peered":"2024-09-12T03:38:10.393378+0000","last_unstale":"2024-09-12T03:38:11.360600+0000","last_undegraded":"2024-09-12T03:38:11.360600+0000","last_fullsized":"2024-09-12T03:38:11.360600+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:50.751585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354326+0000","last_change":"2024-09-12T03:38:11.362250+0000","last_active":"2024-09-12T03:38:12.354326+0000","last_peered":"2024-09-12T03:38:12.354326+0000","last_clean":"2024-09-12T03:38:12.354326+0000","last_became_active":"2024-09-12T03:38:11.361375+0000","last_became_peered":"2024-09-12T03:38:11.361375+0000","last_unstale":"2024-09-12T03:38:12.354326+0000","last_undegraded":"2024-09-12T03:38:12.354326+0000","last_fullsized":"2024-09-12T03:38:12.354326+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:22.065181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389098+0000","last_change":"2024-09-12T03:38:10.372217+0000","last_active":"2024-09-12T03:38:11.389098+0000","last_peered":"2024-09-12T03:38:11.389098+0000","last_clean":"2024-09-12T03:38:11.389098+0000","last_became_active":"2024-09-12T03:38:10.371938+0000","last_became_peered":"2024-09-12T03:38:10.371938+0000","last_unstale":"2024-09-12T03:38:11.389098+0000","last_undegraded":"2024-09-12T03:38:11.389098+0000","last_fullsized":"2024-09-12T03:38:11.389098+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.905520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":304,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.366864+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:11.366864+0000","last_peered":"2024-09-12T03:38:11.366864+0000","last_clean":"2024-09-12T03:38:11.366864+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:11.366864+0000","last_undegraded":"2024-09-12T03:38:11.366864+0000","last_fullsized":"2024-09-12T03:38:11.366864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":1137835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1196032,"data_stored":547307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":547399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1171456,"data_stored":533473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1777664,"data_stored":1130508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:15.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:15.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.925+0000 7f2988933640 1 Processor -- start 2024-09-12T03:38:15.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.925+0000 7f2988933640 1 -- start start 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2988933640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29841520a0 0x7f298406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2988933640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 0x7f298415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2988933640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2984070250 con 0x7f298415f1d0 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2988933640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f2984152480 con 0x7f29841520a0 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2988933640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f29840aede0 con 0x7f298406fe50 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f298415f1d0 0x7f2984071f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50792/0 (socket says 172.21.15.73:50792) 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 -- 172.21.15.73:0/3009798945 learned_addr learned my addr 172.21.15.73:0/3009798945 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2979d9b640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 0x7f298415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f298259c640 1 --2- 172.21.15.73:0/3009798945 >> v2:172.21.15.150:3300/0 conn(0x7f29841520a0 0x7f298406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529585075 0 0) 0x7f2984070250 con 0x7f298415f1d0 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2970003530 con 0x7f298415f1d0 2024-09-12T03:38:15.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1280483789 0 0) 0x7f2970003530 con 0x7f298415f1d0 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 msgr2=0x7f298415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 0x7f298415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 >> v2:172.21.15.150:3300/0 conn(0x7f29841520a0 msgr2=0x7f298406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 --2- 172.21.15.73:0/3009798945 >> v2:172.21.15.150:3300/0 conn(0x7f29841520a0 0x7f298406f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298415fa10 con 0x7f298415f1d0 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f297c001a00 con 0x7f298415f1d0 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2979d9b640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 0x7f298415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 >> v1:172.21.15.73:6789/0 conn(0x7f298415f1d0 legacy=0x7f2984071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 0x7f29700039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970003f00 0x7f2970004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2970004d50 0x7f29700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f29840aede0 con 0x7f2970004d50 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f297000b9d0 con 0x7f2970003f00 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f297000bb80 con 0x7f298406fe50 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2970004d50 0x7f29700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f298259c640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 0x7f29700039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 -- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 msgr2=0x7f29700039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298406fe50 0x7f29700039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 -- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970003f00 msgr2=0x7f2970004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2979d9b640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970003f00 0x7f2970004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970003f00 0x7f2970004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 -- 172.21.15.73:0/3009798945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2970003530 con 0x7f2970004d50 2024-09-12T03:38:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2982d9d640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2970004d50 0x7f29700051d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f297c00a880 tx=0x7f297c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a644ab71339ecae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c00a4a0 con 0x7f2970004d50 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297c0ad630 con 0x7f2970004d50 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.929+0000 7f2981d9b640 1 -- 172.21.15.73:0/3009798945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297c0adaa0 con 0x7f2970004d50 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/3009798945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2970004d50 msgr2=0x7f29700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 --2- 172.21.15.73:0/3009798945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2970004d50 0x7f29700051d0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f297c00a880 tx=0x7f297c01d3a0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2982d9d640 1 -- 172.21.15.73:0/3009798945 reap_dead start 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/3009798945 shutdown_connections 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/3009798945 >> 172.21.15.73:0/3009798945 conn(0x7f29840b1f90 msgr2=0x7f29840b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/3009798945 shutdown_connections 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/3009798945 wait complete. 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 Processor -- start 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- start start 2024-09-12T03:38:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29841f3f80 0x7f298414d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298414bb30 0x7f29841e4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298414dd00 0x7f29841e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2984073770 con 0x7f29841f3f80 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2984073490 con 0x7f298414bb30 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2984073a50 con 0x7f298414dd00 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29841f3f80 0x7f298414d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29841f3f80 0x7f298414d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39542/0 (socket says 172.21.15.73:39542) 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 -- 172.21.15.73:0/574103013 learned_addr learned my addr 172.21.15.73:0/574103013 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2982d9d640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298414dd00 0x7f29841e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 -- 172.21.15.73:0/574103013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298414dd00 msgr2=0x7f29841e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298414dd00 0x7f29841e4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 -- 172.21.15.73:0/574103013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298414bb30 msgr2=0x7f29841e4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298414bb30 0x7f29841e4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:15.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 -- 172.21.15.73:0/574103013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29841f4360 con 0x7f29841f3f80 2024-09-12T03:38:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f298259c640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29841f3f80 0x7f298414d7c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2974010930 tx=0x7f2974010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f297b7fe640 1 -- 172.21.15.73:0/574103013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297400f040 con 0x7f29841f3f80 2024-09-12T03:38:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f297b7fe640 1 -- 172.21.15.73:0/574103013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f297400ec20 con 0x7f29841f3f80 2024-09-12T03:38:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298414bfc0 con 0x7f29841f3f80 2024-09-12T03:38:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f297b7fe640 1 -- 172.21.15.73:0/574103013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297401c400 con 0x7f29841f3f80 2024-09-12T03:38:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f298414c580 con 0x7f29841f3f80 2024-09-12T03:38:15.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.933+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2984073d30 con 0x7f29841f3f80 2024-09-12T03:38:15.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.937+0000 7f297b7fe640 1 -- 172.21.15.73:0/574103013 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f297401c5a0 con 0x7f29841f3f80 2024-09-12T03:38:15.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.937+0000 7f297b7fe640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29640678f0 0x7f2964069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:15.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.937+0000 7f2979d9b640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29640678f0 0x7f2964069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:15.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.937+0000 7f297b7fe640 1 -- 172.21.15.73:0/574103013 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f2974086470 con 0x7f29841f3f80 2024-09-12T03:38:15.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.937+0000 7f2979d9b640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29640678f0 0x7f2964069db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f29841517d0 tx=0x7f296c006e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:15.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:15.941+0000 7f297b7fe640 1 -- 172.21.15.73:0/574103013 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2974018030 con 0x7f29841f3f80 2024-09-12T03:38:16.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.085+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f298406e540 con 0x7f29640678f0 2024-09-12T03:38:16.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.105+0000 7f297b7fe640 1 -- 172.21.15.73:0/574103013 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252061 (secure 0 0 0) 0x7f298406e540 con 0x7f29640678f0 2024-09-12T03:38:16.108 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:16.110 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29640678f0 msgr2=0x7f2964069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29640678f0 0x7f2964069db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f29841517d0 tx=0x7f296c006e00 comp rx=0 tx=0).stop 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29841f3f80 msgr2=0x7f298414d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29841f3f80 0x7f298414d7c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2974010930 tx=0x7f2974010df0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 shutdown_connections 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29640678f0 0x7f2964069db0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f298414dd00 0x7f29841e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f298414bb30 0x7f29841e4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 --2- 172.21.15.73:0/574103013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29841f3f80 0x7f298414d7c0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 >> 172.21.15.73:0/574103013 conn(0x7f29840b1f90 msgr2=0x7f29840d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:16.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 shutdown_connections 2024-09-12T03:38:16.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.109+0000 7f2988933640 1 -- 172.21.15.73:0/574103013 wait complete. 2024-09-12T03:38:16.126 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-12T03:38:15.853152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260136,"kb_used_data":10592,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714584,"statfs":{"total":773094113280,"available":772827734016,"internally_reserved":0,"allocated":10846208,"data_stored":5577396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001795"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353913+0000","last_change":"2024-09-12T03:38:11.384627+0000","last_active":"2024-09-12T03:38:12.353913+0000","last_peered":"2024-09-12T03:38:12.353913+0000","last_clean":"2024-09-12T03:38:12.353913+0000","last_became_active":"2024-09-12T03:38:11.376938+0000","last_became_peered":"2024-09-12T03:38:11.376938+0000","last_unstale":"2024-09-12T03:38:12.353913+0000","last_undegraded":"2024-09-12T03:38:12.353913+0000","last_fullsized":"2024-09-12T03:38:12.353913+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:30.105284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049780+0000","last_change":"2024-09-12T03:38:11.375766+0000","last_active":"2024-09-12T03:38:13.049780+0000","last_peered":"2024-09-12T03:38:13.049780+0000","last_clean":"2024-09-12T03:38:13.049780+0000","last_became_active":"2024-09-12T03:38:11.372614+0000","last_became_peered":"2024-09-12T03:38:11.372614+0000","last_unstale":"2024-09-12T03:38:13.049780+0000","last_undegraded":"2024-09-12T03:38:13.049780+0000","last_fullsized":"2024-09-12T03:38:13.049780+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.749756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353285+0000","last_change":"2024-09-12T03:38:11.371359+0000","last_active":"2024-09-12T03:38:12.353285+0000","last_peered":"2024-09-12T03:38:12.353285+0000","last_clean":"2024-09-12T03:38:12.353285+0000","last_became_active":"2024-09-12T03:38:11.370665+0000","last_became_peered":"2024-09-12T03:38:11.370665+0000","last_unstale":"2024-09-12T03:38:12.353285+0000","last_undegraded":"2024-09-12T03:38:12.353285+0000","last_fullsized":"2024-09-12T03:38:12.353285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:27.196459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355538+0000","last_change":"2024-09-12T03:38:11.413014+0000","last_active":"2024-09-12T03:38:12.355538+0000","last_peered":"2024-09-12T03:38:12.355538+0000","last_clean":"2024-09-12T03:38:12.355538+0000","last_became_active":"2024-09-12T03:38:11.412596+0000","last_became_peered":"2024-09-12T03:38:11.412596+0000","last_unstale":"2024-09-12T03:38:12.355538+0000","last_undegraded":"2024-09-12T03:38:12.355538+0000","last_fullsized":"2024-09-12T03:38:12.355538+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413879+0000","last_change":"2024-09-12T03:38:11.412827+0000","last_active":"2024-09-12T03:38:11.413879+0000","last_peered":"2024-09-12T03:38:11.413879+0000","last_clean":"2024-09-12T03:38:11.413879+0000","last_became_active":"2024-09-12T03:38:11.412492+0000","last_became_peered":"2024-09-12T03:38:11.412492+0000","last_unstale":"2024-09-12T03:38:11.413879+0000","last_undegraded":"2024-09-12T03:38:11.413879+0000","last_fullsized":"2024-09-12T03:38:11.413879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049133+0000","last_change":"2024-09-12T03:38:11.379618+0000","last_active":"2024-09-12T03:38:13.049133+0000","last_peered":"2024-09-12T03:38:13.049133+0000","last_clean":"2024-09-12T03:38:13.049133+0000","last_became_active":"2024-09-12T03:38:11.378841+0000","last_became_peered":"2024-09-12T03:38:11.378841+0000","last_unstale":"2024-09-12T03:38:13.049133+0000","last_undegraded":"2024-09-12T03:38:13.049133+0000","last_fullsized":"2024-09-12T03:38:13.049133+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:21.300082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048866+0000","last_change":"2024-09-12T03:38:11.379887+0000","last_active":"2024-09-12T03:38:13.048866+0000","last_peered":"2024-09-12T03:38:13.048866+0000","last_clean":"2024-09-12T03:38:13.048866+0000","last_became_active":"2024-09-12T03:38:11.379102+0000","last_became_peered":"2024-09-12T03:38:11.379102+0000","last_unstale":"2024-09-12T03:38:13.048866+0000","last_undegraded":"2024-09-12T03:38:13.048866+0000","last_fullsized":"2024-09-12T03:38:13.048866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:28.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388655+0000","last_change":"2024-09-12T03:38:11.375885+0000","last_active":"2024-09-12T03:38:11.388655+0000","last_peered":"2024-09-12T03:38:11.388655+0000","last_clean":"2024-09-12T03:38:11.388655+0000","last_became_active":"2024-09-12T03:38:11.375504+0000","last_became_peered":"2024-09-12T03:38:11.375504+0000","last_unstale":"2024-09-12T03:38:11.388655+0000","last_undegraded":"2024-09-12T03:38:11.388655+0000","last_fullsized":"2024-09-12T03:38:11.388655+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:35.575296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049739+0000","last_change":"2024-09-12T03:38:11.392573+0000","last_active":"2024-09-12T03:38:13.049739+0000","last_peered":"2024-09-12T03:38:13.049739+0000","last_clean":"2024-09-12T03:38:13.049739+0000","last_became_active":"2024-09-12T03:38:11.387470+0000","last_became_peered":"2024-09-12T03:38:11.387470+0000","last_unstale":"2024-09-12T03:38:13.049739+0000","last_undegraded":"2024-09-12T03:38:13.049739+0000","last_fullsized":"2024-09-12T03:38:13.049739+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:40.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.383201+0000","last_change":"2024-09-12T03:38:11.378703+0000","last_active":"2024-09-12T03:38:11.383201+0000","last_peered":"2024-09-12T03:38:11.383201+0000","last_clean":"2024-09-12T03:38:11.383201+0000","last_became_active":"2024-09-12T03:38:11.378398+0000","last_became_peered":"2024-09-12T03:38:11.378398+0000","last_unstale":"2024-09-12T03:38:11.383201+0000","last_undegraded":"2024-09-12T03:38:11.383201+0000","last_fullsized":"2024-09-12T03:38:11.383201+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355575+0000","last_change":"2024-09-12T03:38:11.390773+0000","last_active":"2024-09-12T03:38:12.355575+0000","last_peered":"2024-09-12T03:38:12.355575+0000","last_clean":"2024-09-12T03:38:12.355575+0000","last_became_active":"2024-09-12T03:38:11.390033+0000","last_became_peered":"2024-09-12T03:38:11.390033+0000","last_unstale":"2024-09-12T03:38:12.355575+0000","last_undegraded":"2024-09-12T03:38:12.355575+0000","last_fullsized":"2024-09-12T03:38:12.355575+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414317+0000","last_change":"2024-09-12T03:38:11.389551+0000","last_active":"2024-09-12T03:38:11.414317+0000","last_peered":"2024-09-12T03:38:11.414317+0000","last_clean":"2024-09-12T03:38:11.414317+0000","last_became_active":"2024-09-12T03:38:11.382597+0000","last_became_peered":"2024-09-12T03:38:11.382597+0000","last_unstale":"2024-09-12T03:38:11.414317+0000","last_undegraded":"2024-09-12T03:38:11.414317+0000","last_fullsized":"2024-09-12T03:38:11.414317+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354540+0000","last_change":"2024-09-12T03:38:11.400083+0000","last_active":"2024-09-12T03:38:12.354540+0000","last_peered":"2024-09-12T03:38:12.354540+0000","last_clean":"2024-09-12T03:38:12.354540+0000","last_became_active":"2024-09-12T03:38:11.399735+0000","last_became_peered":"2024-09-12T03:38:11.399735+0000","last_unstale":"2024-09-12T03:38:12.354540+0000","last_undegraded":"2024-09-12T03:38:12.354540+0000","last_fullsized":"2024-09-12T03:38:12.354540+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.391723+0000","last_change":"2024-09-12T03:38:11.382202+0000","last_active":"2024-09-12T03:38:11.391723+0000","last_peered":"2024-09-12T03:38:11.391723+0000","last_clean":"2024-09-12T03:38:11.391723+0000","last_became_active":"2024-09-12T03:38:11.379979+0000","last_became_peered":"2024-09-12T03:38:11.379979+0000","last_unstale":"2024-09-12T03:38:11.391723+0000","last_undegraded":"2024-09-12T03:38:11.391723+0000","last_fullsized":"2024-09-12T03:38:11.391723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404588+0000","last_change":"2024-09-12T03:38:11.400513+0000","last_active":"2024-09-12T03:38:11.404588+0000","last_peered":"2024-09-12T03:38:11.404588+0000","last_clean":"2024-09-12T03:38:11.404588+0000","last_became_active":"2024-09-12T03:38:11.399612+0000","last_became_peered":"2024-09-12T03:38:11.399612+0000","last_unstale":"2024-09-12T03:38:11.404588+0000","last_undegraded":"2024-09-12T03:38:11.404588+0000","last_fullsized":"2024-09-12T03:38:11.404588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.349400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400905+0000","last_change":"2024-09-12T03:38:11.393997+0000","last_active":"2024-09-12T03:38:11.400905+0000","last_peered":"2024-09-12T03:38:11.400905+0000","last_clean":"2024-09-12T03:38:11.400905+0000","last_became_active":"2024-09-12T03:38:11.393283+0000","last_became_peered":"2024-09-12T03:38:11.393283+0000","last_unstale":"2024-09-12T03:38:11.400905+0000","last_undegraded":"2024-09-12T03:38:11.400905+0000","last_fullsized":"2024-09-12T03:38:11.400905+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354048+0000","last_change":"2024-09-12T03:38:11.376308+0000","last_active":"2024-09-12T03:38:12.354048+0000","last_peered":"2024-09-12T03:38:12.354048+0000","last_clean":"2024-09-12T03:38:12.354048+0000","last_became_active":"2024-09-12T03:38:11.372517+0000","last_became_peered":"2024-09-12T03:38:11.372517+0000","last_unstale":"2024-09-12T03:38:12.354048+0000","last_undegraded":"2024-09-12T03:38:12.354048+0000","last_fullsized":"2024-09-12T03:38:12.354048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:19.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050171+0000","last_change":"2024-09-12T03:38:11.384169+0000","last_active":"2024-09-12T03:38:13.050171+0000","last_peered":"2024-09-12T03:38:13.050171+0000","last_clean":"2024-09-12T03:38:13.050171+0000","last_became_active":"2024-09-12T03:38:11.379257+0000","last_became_peered":"2024-09-12T03:38:11.379257+0000","last_unstale":"2024-09-12T03:38:13.050171+0000","last_undegraded":"2024-09-12T03:38:13.050171+0000","last_fullsized":"2024-09-12T03:38:13.050171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:55.149939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353419+0000","last_change":"2024-09-12T03:38:11.378852+0000","last_active":"2024-09-12T03:38:12.353419+0000","last_peered":"2024-09-12T03:38:12.353419+0000","last_clean":"2024-09-12T03:38:12.353419+0000","last_became_active":"2024-09-12T03:38:11.378546+0000","last_became_peered":"2024-09-12T03:38:11.378546+0000","last_unstale":"2024-09-12T03:38:12.353419+0000","last_undegraded":"2024-09-12T03:38:12.353419+0000","last_fullsized":"2024-09-12T03:38:12.353419+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:25.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.411880+0000","last_change":"2024-09-12T03:38:11.375988+0000","last_active":"2024-09-12T03:38:11.411880+0000","last_peered":"2024-09-12T03:38:11.411880+0000","last_clean":"2024-09-12T03:38:11.411880+0000","last_became_active":"2024-09-12T03:38:11.375260+0000","last_became_peered":"2024-09-12T03:38:11.375260+0000","last_unstale":"2024-09-12T03:38:11.411880+0000","last_undegraded":"2024-09-12T03:38:11.411880+0000","last_fullsized":"2024-09-12T03:38:11.411880+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390309+0000","last_change":"2024-09-12T03:38:11.388685+0000","last_active":"2024-09-12T03:38:11.390309+0000","last_peered":"2024-09-12T03:38:11.390309+0000","last_clean":"2024-09-12T03:38:11.390309+0000","last_became_active":"2024-09-12T03:38:11.388328+0000","last_became_peered":"2024-09-12T03:38:11.388328+0000","last_unstale":"2024-09-12T03:38:11.390309+0000","last_undegraded":"2024-09-12T03:38:11.390309+0000","last_fullsized":"2024-09-12T03:38:11.390309+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:44.776547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400494+0000","last_change":"2024-09-12T03:38:11.399867+0000","last_active":"2024-09-12T03:38:11.400494+0000","last_peered":"2024-09-12T03:38:11.400494+0000","last_clean":"2024-09-12T03:38:11.400494+0000","last_became_active":"2024-09-12T03:38:11.399587+0000","last_became_peered":"2024-09-12T03:38:11.399587+0000","last_unstale":"2024-09-12T03:38:11.400494+0000","last_undegraded":"2024-09-12T03:38:11.400494+0000","last_fullsized":"2024-09-12T03:38:11.400494+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354177+0000","last_change":"2024-09-12T03:38:11.361911+0000","last_active":"2024-09-12T03:38:12.354177+0000","last_peered":"2024-09-12T03:38:12.354177+0000","last_clean":"2024-09-12T03:38:12.354177+0000","last_became_active":"2024-09-12T03:38:11.361119+0000","last_became_peered":"2024-09-12T03:38:11.361119+0000","last_unstale":"2024-09-12T03:38:12.354177+0000","last_undegraded":"2024-09-12T03:38:12.354177+0000","last_fullsized":"2024-09-12T03:38:12.354177+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:57.066228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.378686+0000","last_change":"2024-09-12T03:38:11.368565+0000","last_active":"2024-09-12T03:38:11.378686+0000","last_peered":"2024-09-12T03:38:11.378686+0000","last_clean":"2024-09-12T03:38:11.378686+0000","last_became_active":"2024-09-12T03:38:11.367075+0000","last_became_peered":"2024-09-12T03:38:11.367075+0000","last_unstale":"2024-09-12T03:38:11.378686+0000","last_undegraded":"2024-09-12T03:38:11.378686+0000","last_fullsized":"2024-09-12T03:38:11.378686+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412038+0000","last_change":"2024-09-12T03:38:11.373854+0000","last_active":"2024-09-12T03:38:11.412038+0000","last_peered":"2024-09-12T03:38:11.412038+0000","last_clean":"2024-09-12T03:38:11.412038+0000","last_became_active":"2024-09-12T03:38:11.372933+0000","last_became_peered":"2024-09-12T03:38:11.372933+0000","last_unstale":"2024-09-12T03:38:11.412038+0000","last_undegraded":"2024-09-12T03:38:11.412038+0000","last_fullsized":"2024-09-12T03:38:11.412038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412130+0000","last_change":"2024-09-12T03:38:11.378651+0000","last_active":"2024-09-12T03:38:11.412130+0000","last_peered":"2024-09-12T03:38:11.412130+0000","last_clean":"2024-09-12T03:38:11.412130+0000","last_became_active":"2024-09-12T03:38:11.377912+0000","last_became_peered":"2024-09-12T03:38:11.377912+0000","last_unstale":"2024-09-12T03:38:11.412130+0000","last_undegraded":"2024-09-12T03:38:11.412130+0000","last_fullsized":"2024-09-12T03:38:11.412130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355613+0000","last_change":"2024-09-12T03:38:11.403022+0000","last_active":"2024-09-12T03:38:12.355613+0000","last_peered":"2024-09-12T03:38:12.355613+0000","last_clean":"2024-09-12T03:38:12.355613+0000","last_became_active":"2024-09-12T03:38:11.402440+0000","last_became_peered":"2024-09-12T03:38:11.402440+0000","last_unstale":"2024-09-12T03:38:12.355613+0000","last_undegraded":"2024-09-12T03:38:12.355613+0000","last_fullsized":"2024-09-12T03:38:12.355613+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050416+0000","last_change":"2024-09-12T03:38:11.396719+0000","last_active":"2024-09-12T03:38:13.050416+0000","last_peered":"2024-09-12T03:38:13.050416+0000","last_clean":"2024-09-12T03:38:13.050416+0000","last_became_active":"2024-09-12T03:38:11.396036+0000","last_became_peered":"2024-09-12T03:38:11.396036+0000","last_unstale":"2024-09-12T03:38:13.050416+0000","last_undegraded":"2024-09-12T03:38:13.050416+0000","last_fullsized":"2024-09-12T03:38:13.050416+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:42.754775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389356+0000","last_change":"2024-09-12T03:38:11.386723+0000","last_active":"2024-09-12T03:38:11.389356+0000","last_peered":"2024-09-12T03:38:11.389356+0000","last_clean":"2024-09-12T03:38:11.389356+0000","last_became_active":"2024-09-12T03:38:11.386276+0000","last_became_peered":"2024-09-12T03:38:11.386276+0000","last_unstale":"2024-09-12T03:38:11.389356+0000","last_undegraded":"2024-09-12T03:38:11.389356+0000","last_fullsized":"2024-09-12T03:38:11.389356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:55.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412229+0000","last_change":"2024-09-12T03:38:11.373029+0000","last_active":"2024-09-12T03:38:11.412229+0000","last_peered":"2024-09-12T03:38:11.412229+0000","last_clean":"2024-09-12T03:38:11.412229+0000","last_became_active":"2024-09-12T03:38:11.372027+0000","last_became_peered":"2024-09-12T03:38:11.372027+0000","last_unstale":"2024-09-12T03:38:11.412229+0000","last_undegraded":"2024-09-12T03:38:11.412229+0000","last_fullsized":"2024-09-12T03:38:11.412229+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049267+0000","last_change":"2024-09-12T03:38:11.396412+0000","last_active":"2024-09-12T03:38:13.049267+0000","last_peered":"2024-09-12T03:38:13.049267+0000","last_clean":"2024-09-12T03:38:13.049267+0000","last_became_active":"2024-09-12T03:38:11.395717+0000","last_became_peered":"2024-09-12T03:38:11.395717+0000","last_unstale":"2024-09-12T03:38:13.049267+0000","last_undegraded":"2024-09-12T03:38:13.049267+0000","last_fullsized":"2024-09-12T03:38:13.049267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:03.504514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414159+0000","last_change":"2024-09-12T03:38:11.412866+0000","last_active":"2024-09-12T03:38:11.414159+0000","last_peered":"2024-09-12T03:38:11.414159+0000","last_clean":"2024-09-12T03:38:11.414159+0000","last_became_active":"2024-09-12T03:38:11.412507+0000","last_became_peered":"2024-09-12T03:38:11.412507+0000","last_unstale":"2024-09-12T03:38:11.414159+0000","last_undegraded":"2024-09-12T03:38:11.414159+0000","last_fullsized":"2024-09-12T03:38:11.414159+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.093665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353830+0000","last_change":"2024-09-12T03:38:11.383601+0000","last_active":"2024-09-12T03:38:12.353830+0000","last_peered":"2024-09-12T03:38:12.353830+0000","last_clean":"2024-09-12T03:38:12.353830+0000","last_became_active":"2024-09-12T03:38:11.381975+0000","last_became_peered":"2024-09-12T03:38:11.381975+0000","last_unstale":"2024-09-12T03:38:12.353830+0000","last_undegraded":"2024-09-12T03:38:12.353830+0000","last_fullsized":"2024-09-12T03:38:12.353830+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:14.464665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356288+0000","last_change":"2024-09-12T03:38:10.386396+0000","last_active":"2024-09-12T03:38:12.356288+0000","last_peered":"2024-09-12T03:38:12.356288+0000","last_clean":"2024-09-12T03:38:12.356288+0000","last_became_active":"2024-09-12T03:38:10.386049+0000","last_became_peered":"2024-09-12T03:38:10.386049+0000","last_unstale":"2024-09-12T03:38:12.356288+0000","last_undegraded":"2024-09-12T03:38:12.356288+0000","last_fullsized":"2024-09-12T03:38:12.356288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.120769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388945+0000","last_change":"2024-09-12T03:38:11.382219+0000","last_active":"2024-09-12T03:38:11.388945+0000","last_peered":"2024-09-12T03:38:11.388945+0000","last_clean":"2024-09-12T03:38:11.388945+0000","last_became_active":"2024-09-12T03:38:11.381850+0000","last_became_peered":"2024-09-12T03:38:11.381850+0000","last_unstale":"2024-09-12T03:38:11.388945+0000","last_undegraded":"2024-09-12T03:38:11.388945+0000","last_fullsized":"2024-09-12T03:38:11.388945+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:42.795485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.393105+0000","last_change":"2024-09-12T03:38:10.372155+0000","last_active":"2024-09-12T03:38:11.393105+0000","last_peered":"2024-09-12T03:38:11.393105+0000","last_clean":"2024-09-12T03:38:11.393105+0000","last_became_active":"2024-09-12T03:38:10.371286+0000","last_became_peered":"2024-09-12T03:38:10.371286+0000","last_unstale":"2024-09-12T03:38:11.393105+0000","last_undegraded":"2024-09-12T03:38:11.393105+0000","last_fullsized":"2024-09-12T03:38:11.393105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:24.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412287+0000","last_change":"2024-09-12T03:38:11.379955+0000","last_active":"2024-09-12T03:38:11.412287+0000","last_peered":"2024-09-12T03:38:11.412287+0000","last_clean":"2024-09-12T03:38:11.412287+0000","last_became_active":"2024-09-12T03:38:11.379266+0000","last_became_peered":"2024-09-12T03:38:11.379266+0000","last_unstale":"2024-09-12T03:38:11.412287+0000","last_undegraded":"2024-09-12T03:38:11.412287+0000","last_fullsized":"2024-09-12T03:38:11.412287+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414531+0000","last_change":"2024-09-12T03:38:10.396126+0000","last_active":"2024-09-12T03:38:11.414531+0000","last_peered":"2024-09-12T03:38:11.414531+0000","last_clean":"2024-09-12T03:38:11.414531+0000","last_became_active":"2024-09-12T03:38:10.391204+0000","last_became_peered":"2024-09-12T03:38:10.391204+0000","last_unstale":"2024-09-12T03:38:11.414531+0000","last_undegraded":"2024-09-12T03:38:11.414531+0000","last_fullsized":"2024-09-12T03:38:11.414531+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354859+0000","last_change":"2024-09-12T03:38:11.390529+0000","last_active":"2024-09-12T03:38:12.354859+0000","last_peered":"2024-09-12T03:38:12.354859+0000","last_clean":"2024-09-12T03:38:12.354859+0000","last_became_active":"2024-09-12T03:38:11.389787+0000","last_became_peered":"2024-09-12T03:38:11.389787+0000","last_unstale":"2024-09-12T03:38:12.354859+0000","last_undegraded":"2024-09-12T03:38:12.354859+0000","last_fullsized":"2024-09-12T03:38:12.354859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413407+0000","last_change":"2024-09-12T03:38:10.393267+0000","last_active":"2024-09-12T03:38:11.413407+0000","last_peered":"2024-09-12T03:38:11.413407+0000","last_clean":"2024-09-12T03:38:11.413407+0000","last_became_active":"2024-09-12T03:38:10.392994+0000","last_became_peered":"2024-09-12T03:38:10.392994+0000","last_unstale":"2024-09-12T03:38:11.413407+0000","last_undegraded":"2024-09-12T03:38:11.413407+0000","last_fullsized":"2024-09-12T03:38:11.413407+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355465+0000","last_change":"2024-09-12T03:38:11.377861+0000","last_active":"2024-09-12T03:38:12.355465+0000","last_peered":"2024-09-12T03:38:12.355465+0000","last_clean":"2024-09-12T03:38:12.355465+0000","last_became_active":"2024-09-12T03:38:11.377511+0000","last_became_peered":"2024-09-12T03:38:11.377511+0000","last_unstale":"2024-09-12T03:38:12.355465+0000","last_undegraded":"2024-09-12T03:38:12.355465+0000","last_fullsized":"2024-09-12T03:38:12.355465+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.403041+0000","last_change":"2024-09-12T03:38:10.386519+0000","last_active":"2024-09-12T03:38:11.403041+0000","last_peered":"2024-09-12T03:38:11.403041+0000","last_clean":"2024-09-12T03:38:11.403041+0000","last_became_active":"2024-09-12T03:38:10.385746+0000","last_became_peered":"2024-09-12T03:38:10.385746+0000","last_unstale":"2024-09-12T03:38:11.403041+0000","last_undegraded":"2024-09-12T03:38:11.403041+0000","last_fullsized":"2024-09-12T03:38:11.403041+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:47.841147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353683+0000","last_change":"2024-09-12T03:38:11.378856+0000","last_active":"2024-09-12T03:38:12.353683+0000","last_peered":"2024-09-12T03:38:12.353683+0000","last_clean":"2024-09-12T03:38:12.353683+0000","last_became_active":"2024-09-12T03:38:11.378491+0000","last_became_peered":"2024-09-12T03:38:11.378491+0000","last_unstale":"2024-09-12T03:38:12.353683+0000","last_undegraded":"2024-09-12T03:38:12.353683+0000","last_fullsized":"2024-09-12T03:38:12.353683+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.501014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354371+0000","last_change":"2024-09-12T03:38:10.394181+0000","last_active":"2024-09-12T03:38:12.354371+0000","last_peered":"2024-09-12T03:38:12.354371+0000","last_clean":"2024-09-12T03:38:12.354371+0000","last_became_active":"2024-09-12T03:38:10.393438+0000","last_became_peered":"2024-09-12T03:38:10.393438+0000","last_unstale":"2024-09-12T03:38:12.354371+0000","last_undegraded":"2024-09-12T03:38:12.354371+0000","last_fullsized":"2024-09-12T03:38:12.354371+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:59.138777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050611+0000","last_change":"2024-09-12T03:38:11.394463+0000","last_active":"2024-09-12T03:38:13.050611+0000","last_peered":"2024-09-12T03:38:13.050611+0000","last_clean":"2024-09-12T03:38:13.050611+0000","last_became_active":"2024-09-12T03:38:11.393809+0000","last_became_peered":"2024-09-12T03:38:11.393809+0000","last_unstale":"2024-09-12T03:38:13.050611+0000","last_undegraded":"2024-09-12T03:38:13.050611+0000","last_fullsized":"2024-09-12T03:38:13.050611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:21.531978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355550+0000","last_change":"2024-09-12T03:38:10.386837+0000","last_active":"2024-09-12T03:38:11.355550+0000","last_peered":"2024-09-12T03:38:11.355550+0000","last_clean":"2024-09-12T03:38:11.355550+0000","last_became_active":"2024-09-12T03:38:10.382683+0000","last_became_peered":"2024-09-12T03:38:10.382683+0000","last_unstale":"2024-09-12T03:38:11.355550+0000","last_undegraded":"2024-09-12T03:38:11.355550+0000","last_fullsized":"2024-09-12T03:38:11.355550+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356272+0000","last_change":"2024-09-12T03:38:11.387150+0000","last_active":"2024-09-12T03:38:12.356272+0000","last_peered":"2024-09-12T03:38:12.356272+0000","last_clean":"2024-09-12T03:38:12.356272+0000","last_became_active":"2024-09-12T03:38:11.386913+0000","last_became_peered":"2024-09-12T03:38:11.386913+0000","last_unstale":"2024-09-12T03:38:12.356272+0000","last_undegraded":"2024-09-12T03:38:12.356272+0000","last_fullsized":"2024-09-12T03:38:12.356272+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353698+0000","last_change":"2024-09-12T03:38:10.380693+0000","last_active":"2024-09-12T03:38:12.353698+0000","last_peered":"2024-09-12T03:38:12.353698+0000","last_clean":"2024-09-12T03:38:12.353698+0000","last_became_active":"2024-09-12T03:38:10.380423+0000","last_became_peered":"2024-09-12T03:38:10.380423+0000","last_unstale":"2024-09-12T03:38:12.353698+0000","last_undegraded":"2024-09-12T03:38:12.353698+0000","last_fullsized":"2024-09-12T03:38:12.353698+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353471+0000","last_change":"2024-09-12T03:38:11.383029+0000","last_active":"2024-09-12T03:38:12.353471+0000","last_peered":"2024-09-12T03:38:12.353471+0000","last_clean":"2024-09-12T03:38:12.353471+0000","last_became_active":"2024-09-12T03:38:11.382716+0000","last_became_peered":"2024-09-12T03:38:11.382716+0000","last_unstale":"2024-09-12T03:38:12.353471+0000","last_undegraded":"2024-09-12T03:38:12.353471+0000","last_fullsized":"2024-09-12T03:38:12.353471+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:12.353649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356264+0000","last_change":"2024-09-12T03:38:10.386626+0000","last_active":"2024-09-12T03:38:11.356264+0000","last_peered":"2024-09-12T03:38:11.356264+0000","last_clean":"2024-09-12T03:38:11.356264+0000","last_became_active":"2024-09-12T03:38:10.382526+0000","last_became_peered":"2024-09-12T03:38:10.382526+0000","last_unstale":"2024-09-12T03:38:11.356264+0000","last_undegraded":"2024-09-12T03:38:11.356264+0000","last_fullsized":"2024-09-12T03:38:11.356264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377375+0000","last_change":"2024-09-12T03:38:11.374433+0000","last_active":"2024-09-12T03:38:11.377375+0000","last_peered":"2024-09-12T03:38:11.377375+0000","last_clean":"2024-09-12T03:38:11.377375+0000","last_became_active":"2024-09-12T03:38:11.374104+0000","last_became_peered":"2024-09-12T03:38:11.374104+0000","last_unstale":"2024-09-12T03:38:11.377375+0000","last_undegraded":"2024-09-12T03:38:11.377375+0000","last_fullsized":"2024-09-12T03:38:11.377375+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.352779+0000","last_change":"2024-09-12T03:38:10.393712+0000","last_active":"2024-09-12T03:38:12.352779+0000","last_peered":"2024-09-12T03:38:12.352779+0000","last_clean":"2024-09-12T03:38:12.352779+0000","last_became_active":"2024-09-12T03:38:10.393273+0000","last_became_peered":"2024-09-12T03:38:10.393273+0000","last_unstale":"2024-09-12T03:38:12.352779+0000","last_undegraded":"2024-09-12T03:38:12.352779+0000","last_fullsized":"2024-09-12T03:38:12.352779+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:05.983923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389013+0000","last_change":"2024-09-12T03:38:11.376141+0000","last_active":"2024-09-12T03:38:11.389013+0000","last_peered":"2024-09-12T03:38:11.389013+0000","last_clean":"2024-09-12T03:38:11.389013+0000","last_became_active":"2024-09-12T03:38:11.375589+0000","last_became_peered":"2024-09-12T03:38:11.375589+0000","last_unstale":"2024-09-12T03:38:11.389013+0000","last_undegraded":"2024-09-12T03:38:11.389013+0000","last_fullsized":"2024-09-12T03:38:11.389013+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:48.925960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.392975+0000","last_change":"2024-09-12T03:38:10.377052+0000","last_active":"2024-09-12T03:38:11.392975+0000","last_peered":"2024-09-12T03:38:11.392975+0000","last_clean":"2024-09-12T03:38:11.392975+0000","last_became_active":"2024-09-12T03:38:10.376406+0000","last_became_peered":"2024-09-12T03:38:10.376406+0000","last_unstale":"2024-09-12T03:38:11.392975+0000","last_undegraded":"2024-09-12T03:38:11.392975+0000","last_fullsized":"2024-09-12T03:38:11.392975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:06.325275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377171+0000","last_change":"2024-09-12T03:38:11.373470+0000","last_active":"2024-09-12T03:38:11.377171+0000","last_peered":"2024-09-12T03:38:11.377171+0000","last_clean":"2024-09-12T03:38:11.377171+0000","last_became_active":"2024-09-12T03:38:11.369749+0000","last_became_peered":"2024-09-12T03:38:11.369749+0000","last_unstale":"2024-09-12T03:38:11.377171+0000","last_undegraded":"2024-09-12T03:38:11.377171+0000","last_fullsized":"2024-09-12T03:38:11.377171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050805+0000","last_change":"2024-09-12T03:38:10.390735+0000","last_active":"2024-09-12T03:38:13.050805+0000","last_peered":"2024-09-12T03:38:13.050805+0000","last_clean":"2024-09-12T03:38:13.050805+0000","last_became_active":"2024-09-12T03:38:10.389748+0000","last_became_peered":"2024-09-12T03:38:10.389748+0000","last_unstale":"2024-09-12T03:38:13.050805+0000","last_undegraded":"2024-09-12T03:38:13.050805+0000","last_fullsized":"2024-09-12T03:38:13.050805+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:13.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354800+0000","last_change":"2024-09-12T03:38:11.389078+0000","last_active":"2024-09-12T03:38:12.354800+0000","last_peered":"2024-09-12T03:38:12.354800+0000","last_clean":"2024-09-12T03:38:12.354800+0000","last_became_active":"2024-09-12T03:38:11.388369+0000","last_became_peered":"2024-09-12T03:38:11.388369+0000","last_unstale":"2024-09-12T03:38:12.354800+0000","last_undegraded":"2024-09-12T03:38:12.354800+0000","last_fullsized":"2024-09-12T03:38:12.354800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:50.506813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389574+0000","last_change":"2024-09-12T03:38:10.378214+0000","last_active":"2024-09-12T03:38:11.389574+0000","last_peered":"2024-09-12T03:38:11.389574+0000","last_clean":"2024-09-12T03:38:11.389574+0000","last_became_active":"2024-09-12T03:38:10.377904+0000","last_became_peered":"2024-09-12T03:38:10.377904+0000","last_unstale":"2024-09-12T03:38:11.389574+0000","last_undegraded":"2024-09-12T03:38:11.389574+0000","last_fullsized":"2024-09-12T03:38:11.389574+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050168+0000","last_change":"2024-09-12T03:38:11.377868+0000","last_active":"2024-09-12T03:38:13.050168+0000","last_peered":"2024-09-12T03:38:13.050168+0000","last_clean":"2024-09-12T03:38:13.050168+0000","last_became_active":"2024-09-12T03:38:11.377082+0000","last_became_peered":"2024-09-12T03:38:11.377082+0000","last_unstale":"2024-09-12T03:38:13.050168+0000","last_undegraded":"2024-09-12T03:38:13.050168+0000","last_fullsized":"2024-09-12T03:38:13.050168+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:19.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354576+0000","last_change":"2024-09-12T03:38:10.374595+0000","last_active":"2024-09-12T03:38:12.354576+0000","last_peered":"2024-09-12T03:38:12.354576+0000","last_clean":"2024-09-12T03:38:12.354576+0000","last_became_active":"2024-09-12T03:38:10.374184+0000","last_became_peered":"2024-09-12T03:38:10.374184+0000","last_unstale":"2024-09-12T03:38:12.354576+0000","last_undegraded":"2024-09-12T03:38:12.354576+0000","last_fullsized":"2024-09-12T03:38:12.354576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:09.966450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414410+0000","last_change":"2024-09-12T03:38:11.413754+0000","last_active":"2024-09-12T03:38:11.414410+0000","last_peered":"2024-09-12T03:38:11.414410+0000","last_clean":"2024-09-12T03:38:11.414410+0000","last_became_active":"2024-09-12T03:38:11.413457+0000","last_became_peered":"2024-09-12T03:38:11.413457+0000","last_unstale":"2024-09-12T03:38:11.414410+0000","last_undegraded":"2024-09-12T03:38:11.414410+0000","last_fullsized":"2024-09-12T03:38:11.414410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:39.890043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.357062+0000","last_change":"2024-09-12T03:38:10.397284+0000","last_active":"2024-09-12T03:38:11.357062+0000","last_peered":"2024-09-12T03:38:11.357062+0000","last_clean":"2024-09-12T03:38:11.357062+0000","last_became_active":"2024-09-12T03:38:10.397035+0000","last_became_peered":"2024-09-12T03:38:10.397035+0000","last_unstale":"2024-09-12T03:38:11.357062+0000","last_undegraded":"2024-09-12T03:38:11.357062+0000","last_fullsized":"2024-09-12T03:38:11.357062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:01.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354188+0000","last_change":"2024-09-12T03:38:11.377239+0000","last_active":"2024-09-12T03:38:12.354188+0000","last_peered":"2024-09-12T03:38:12.354188+0000","last_clean":"2024-09-12T03:38:12.354188+0000","last_became_active":"2024-09-12T03:38:11.373504+0000","last_became_peered":"2024-09-12T03:38:11.373504+0000","last_unstale":"2024-09-12T03:38:12.354188+0000","last_undegraded":"2024-09-12T03:38:12.354188+0000","last_fullsized":"2024-09-12T03:38:12.354188+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:42.442682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415226+0000","last_change":"2024-09-12T03:38:10.396181+0000","last_active":"2024-09-12T03:38:11.415226+0000","last_peered":"2024-09-12T03:38:11.415226+0000","last_clean":"2024-09-12T03:38:11.415226+0000","last_became_active":"2024-09-12T03:38:10.391810+0000","last_became_peered":"2024-09-12T03:38:10.391810+0000","last_unstale":"2024-09-12T03:38:11.415226+0000","last_undegraded":"2024-09-12T03:38:11.415226+0000","last_fullsized":"2024-09-12T03:38:11.415226+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389320+0000","last_change":"2024-09-12T03:38:11.386951+0000","last_active":"2024-09-12T03:38:11.389320+0000","last_peered":"2024-09-12T03:38:11.389320+0000","last_clean":"2024-09-12T03:38:11.389320+0000","last_became_active":"2024-09-12T03:38:11.386626+0000","last_became_peered":"2024-09-12T03:38:11.386626+0000","last_unstale":"2024-09-12T03:38:11.389320+0000","last_undegraded":"2024-09-12T03:38:11.389320+0000","last_fullsized":"2024-09-12T03:38:11.389320+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.218703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049995+0000","last_change":"2024-09-12T03:38:10.399566+0000","last_active":"2024-09-12T03:38:13.049995+0000","last_peered":"2024-09-12T03:38:13.049995+0000","last_clean":"2024-09-12T03:38:13.049995+0000","last_became_active":"2024-09-12T03:38:10.398778+0000","last_became_peered":"2024-09-12T03:38:10.398778+0000","last_unstale":"2024-09-12T03:38:13.049995+0000","last_undegraded":"2024-09-12T03:38:13.049995+0000","last_fullsized":"2024-09-12T03:38:13.049995+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.197401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050668+0000","last_change":"2024-09-12T03:38:11.393699+0000","last_active":"2024-09-12T03:38:13.050668+0000","last_peered":"2024-09-12T03:38:13.050668+0000","last_clean":"2024-09-12T03:38:13.050668+0000","last_became_active":"2024-09-12T03:38:11.387420+0000","last_became_peered":"2024-09-12T03:38:11.387420+0000","last_unstale":"2024-09-12T03:38:13.050668+0000","last_undegraded":"2024-09-12T03:38:13.050668+0000","last_fullsized":"2024-09-12T03:38:13.050668+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:19.710836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415097+0000","last_change":"2024-09-12T03:38:10.394211+0000","last_active":"2024-09-12T03:38:11.415097+0000","last_peered":"2024-09-12T03:38:11.415097+0000","last_clean":"2024-09-12T03:38:11.415097+0000","last_became_active":"2024-09-12T03:38:10.393408+0000","last_became_peered":"2024-09-12T03:38:10.393408+0000","last_unstale":"2024-09-12T03:38:11.415097+0000","last_undegraded":"2024-09-12T03:38:11.415097+0000","last_fullsized":"2024-09-12T03:38:11.415097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:21.318043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377196+0000","last_change":"2024-09-12T03:38:11.375483+0000","last_active":"2024-09-12T03:38:11.377196+0000","last_peered":"2024-09-12T03:38:11.377196+0000","last_clean":"2024-09-12T03:38:11.377196+0000","last_became_active":"2024-09-12T03:38:11.375033+0000","last_became_peered":"2024-09-12T03:38:11.375033+0000","last_unstale":"2024-09-12T03:38:11.377196+0000","last_undegraded":"2024-09-12T03:38:11.377196+0000","last_fullsized":"2024-09-12T03:38:11.377196+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355071+0000","last_change":"2024-09-12T03:38:10.387509+0000","last_active":"2024-09-12T03:38:12.355071+0000","last_peered":"2024-09-12T03:38:12.355071+0000","last_clean":"2024-09-12T03:38:12.355071+0000","last_became_active":"2024-09-12T03:38:10.386787+0000","last_became_peered":"2024-09-12T03:38:10.386787+0000","last_unstale":"2024-09-12T03:38:12.355071+0000","last_undegraded":"2024-09-12T03:38:12.355071+0000","last_fullsized":"2024-09-12T03:38:12.355071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353059+0000","last_change":"2024-09-12T03:38:11.377338+0000","last_active":"2024-09-12T03:38:12.353059+0000","last_peered":"2024-09-12T03:38:12.353059+0000","last_clean":"2024-09-12T03:38:12.353059+0000","last_became_active":"2024-09-12T03:38:11.376959+0000","last_became_peered":"2024-09-12T03:38:11.376959+0000","last_unstale":"2024-09-12T03:38:12.353059+0000","last_undegraded":"2024-09-12T03:38:12.353059+0000","last_fullsized":"2024-09-12T03:38:12.353059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:09.482818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390601+0000","last_change":"2024-09-12T03:38:10.371802+0000","last_active":"2024-09-12T03:38:11.390601+0000","last_peered":"2024-09-12T03:38:11.390601+0000","last_clean":"2024-09-12T03:38:11.390601+0000","last_became_active":"2024-09-12T03:38:10.371392+0000","last_became_peered":"2024-09-12T03:38:10.371392+0000","last_unstale":"2024-09-12T03:38:11.390601+0000","last_undegraded":"2024-09-12T03:38:11.390601+0000","last_fullsized":"2024-09-12T03:38:11.390601+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:45.146362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353550+0000","last_change":"2024-09-12T03:38:11.369326+0000","last_active":"2024-09-12T03:38:12.353550+0000","last_peered":"2024-09-12T03:38:12.353550+0000","last_clean":"2024-09-12T03:38:12.353550+0000","last_became_active":"2024-09-12T03:38:11.368764+0000","last_became_peered":"2024-09-12T03:38:11.368764+0000","last_unstale":"2024-09-12T03:38:12.353550+0000","last_undegraded":"2024-09-12T03:38:12.353550+0000","last_fullsized":"2024-09-12T03:38:12.353550+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:26.615641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356974+0000","last_change":"2024-09-12T03:38:10.371718+0000","last_active":"2024-09-12T03:38:11.356974+0000","last_peered":"2024-09-12T03:38:11.356974+0000","last_clean":"2024-09-12T03:38:11.356974+0000","last_became_active":"2024-09-12T03:38:10.371419+0000","last_became_peered":"2024-09-12T03:38:10.371419+0000","last_unstale":"2024-09-12T03:38:11.356974+0000","last_undegraded":"2024-09-12T03:38:11.356974+0000","last_fullsized":"2024-09-12T03:38:11.356974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.819443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355100+0000","last_change":"2024-09-12T03:38:11.401115+0000","last_active":"2024-09-12T03:38:12.355100+0000","last_peered":"2024-09-12T03:38:12.355100+0000","last_clean":"2024-09-12T03:38:12.355100+0000","last_became_active":"2024-09-12T03:38:11.400866+0000","last_became_peered":"2024-09-12T03:38:11.400866+0000","last_unstale":"2024-09-12T03:38:12.355100+0000","last_undegraded":"2024-09-12T03:38:12.355100+0000","last_fullsized":"2024-09-12T03:38:12.355100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051124+0000","last_change":"2024-09-12T03:38:10.400711+0000","last_active":"2024-09-12T03:38:13.051124+0000","last_peered":"2024-09-12T03:38:13.051124+0000","last_clean":"2024-09-12T03:38:13.051124+0000","last_became_active":"2024-09-12T03:38:10.399905+0000","last_became_peered":"2024-09-12T03:38:10.399905+0000","last_unstale":"2024-09-12T03:38:13.051124+0000","last_undegraded":"2024-09-12T03:38:13.051124+0000","last_fullsized":"2024-09-12T03:38:13.051124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:32.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388770+0000","last_change":"2024-09-12T03:38:11.381737+0000","last_active":"2024-09-12T03:38:11.388770+0000","last_peered":"2024-09-12T03:38:11.388770+0000","last_clean":"2024-09-12T03:38:11.388770+0000","last_became_active":"2024-09-12T03:38:11.381350+0000","last_became_peered":"2024-09-12T03:38:11.381350+0000","last_unstale":"2024-09-12T03:38:11.388770+0000","last_undegraded":"2024-09-12T03:38:11.388770+0000","last_fullsized":"2024-09-12T03:38:11.388770+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:55.796930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360809+0000","last_change":"2024-09-12T03:38:10.372995+0000","last_active":"2024-09-12T03:38:11.360809+0000","last_peered":"2024-09-12T03:38:11.360809+0000","last_clean":"2024-09-12T03:38:11.360809+0000","last_became_active":"2024-09-12T03:38:10.372390+0000","last_became_peered":"2024-09-12T03:38:10.372390+0000","last_unstale":"2024-09-12T03:38:11.360809+0000","last_undegraded":"2024-09-12T03:38:11.360809+0000","last_fullsized":"2024-09-12T03:38:11.360809+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:37.755261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353104+0000","last_change":"2024-09-12T03:38:11.382260+0000","last_active":"2024-09-12T03:38:12.353104+0000","last_peered":"2024-09-12T03:38:12.353104+0000","last_clean":"2024-09-12T03:38:12.353104+0000","last_became_active":"2024-09-12T03:38:11.375057+0000","last_became_peered":"2024-09-12T03:38:11.375057+0000","last_unstale":"2024-09-12T03:38:12.353104+0000","last_undegraded":"2024-09-12T03:38:12.353104+0000","last_fullsized":"2024-09-12T03:38:12.353104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389875+0000","last_change":"2024-09-12T03:38:10.378023+0000","last_active":"2024-09-12T03:38:11.389875+0000","last_peered":"2024-09-12T03:38:11.389875+0000","last_clean":"2024-09-12T03:38:11.389875+0000","last_became_active":"2024-09-12T03:38:10.377276+0000","last_became_peered":"2024-09-12T03:38:10.377276+0000","last_unstale":"2024-09-12T03:38:11.389875+0000","last_undegraded":"2024-09-12T03:38:11.389875+0000","last_fullsized":"2024-09-12T03:38:11.389875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412023+0000","last_change":"2024-09-12T03:38:11.381329+0000","last_active":"2024-09-12T03:38:11.412023+0000","last_peered":"2024-09-12T03:38:11.412023+0000","last_clean":"2024-09-12T03:38:11.412023+0000","last_became_active":"2024-09-12T03:38:11.380636+0000","last_became_peered":"2024-09-12T03:38:11.380636+0000","last_unstale":"2024-09-12T03:38:11.412023+0000","last_undegraded":"2024-09-12T03:38:11.412023+0000","last_fullsized":"2024-09-12T03:38:11.412023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"98'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353169+0000","last_change":"2024-09-12T03:38:10.381935+0000","last_active":"2024-09-12T03:38:12.353169+0000","last_peered":"2024-09-12T03:38:12.353169+0000","last_clean":"2024-09-12T03:38:12.353169+0000","last_became_active":"2024-09-12T03:38:10.381501+0000","last_became_peered":"2024-09-12T03:38:10.381501+0000","last_unstale":"2024-09-12T03:38:12.353169+0000","last_undegraded":"2024-09-12T03:38:12.353169+0000","last_fullsized":"2024-09-12T03:38:12.353169+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.397926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354781+0000","last_change":"2024-09-12T03:38:11.380067+0000","last_active":"2024-09-12T03:38:12.354781+0000","last_peered":"2024-09-12T03:38:12.354781+0000","last_clean":"2024-09-12T03:38:12.354781+0000","last_became_active":"2024-09-12T03:38:11.379715+0000","last_became_peered":"2024-09-12T03:38:11.379715+0000","last_unstale":"2024-09-12T03:38:12.354781+0000","last_undegraded":"2024-09-12T03:38:12.354781+0000","last_fullsized":"2024-09-12T03:38:12.354781+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050422+0000","last_change":"2024-09-12T03:38:10.398220+0000","last_active":"2024-09-12T03:38:13.050422+0000","last_peered":"2024-09-12T03:38:13.050422+0000","last_clean":"2024-09-12T03:38:13.050422+0000","last_became_active":"2024-09-12T03:38:10.390272+0000","last_became_peered":"2024-09-12T03:38:10.390272+0000","last_unstale":"2024-09-12T03:38:13.050422+0000","last_undegraded":"2024-09-12T03:38:13.050422+0000","last_fullsized":"2024-09-12T03:38:13.050422+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:07.384819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354667+0000","last_change":"2024-09-12T03:38:11.373341+0000","last_active":"2024-09-12T03:38:12.354667+0000","last_peered":"2024-09-12T03:38:12.354667+0000","last_clean":"2024-09-12T03:38:12.354667+0000","last_became_active":"2024-09-12T03:38:11.371198+0000","last_became_peered":"2024-09-12T03:38:11.371198+0000","last_unstale":"2024-09-12T03:38:12.354667+0000","last_undegraded":"2024-09-12T03:38:12.354667+0000","last_fullsized":"2024-09-12T03:38:12.354667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:48.990741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.352280+0000","last_change":"2024-09-12T03:38:10.391548+0000","last_active":"2024-09-12T03:38:11.352280+0000","last_peered":"2024-09-12T03:38:11.352280+0000","last_clean":"2024-09-12T03:38:11.352280+0000","last_became_active":"2024-09-12T03:38:10.391192+0000","last_became_peered":"2024-09-12T03:38:10.391192+0000","last_unstale":"2024-09-12T03:38:11.352280+0000","last_undegraded":"2024-09-12T03:38:11.352280+0000","last_fullsized":"2024-09-12T03:38:11.352280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388970+0000","last_change":"2024-09-12T03:38:11.376125+0000","last_active":"2024-09-12T03:38:11.388970+0000","last_peered":"2024-09-12T03:38:11.388970+0000","last_clean":"2024-09-12T03:38:11.388970+0000","last_became_active":"2024-09-12T03:38:11.375578+0000","last_became_peered":"2024-09-12T03:38:11.375578+0000","last_unstale":"2024-09-12T03:38:11.388970+0000","last_undegraded":"2024-09-12T03:38:11.388970+0000","last_fullsized":"2024-09-12T03:38:11.388970+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:37.856069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355446+0000","last_change":"2024-09-12T03:38:10.392155+0000","last_active":"2024-09-12T03:38:11.355446+0000","last_peered":"2024-09-12T03:38:11.355446+0000","last_clean":"2024-09-12T03:38:11.355446+0000","last_became_active":"2024-09-12T03:38:10.391414+0000","last_became_peered":"2024-09-12T03:38:10.391414+0000","last_unstale":"2024-09-12T03:38:11.355446+0000","last_undegraded":"2024-09-12T03:38:11.355446+0000","last_fullsized":"2024-09-12T03:38:11.355446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388839+0000","last_change":"2024-09-12T03:38:11.381890+0000","last_active":"2024-09-12T03:38:11.388839+0000","last_peered":"2024-09-12T03:38:11.388839+0000","last_clean":"2024-09-12T03:38:11.388839+0000","last_became_active":"2024-09-12T03:38:11.380922+0000","last_became_peered":"2024-09-12T03:38:11.380922+0000","last_unstale":"2024-09-12T03:38:11.388839+0000","last_undegraded":"2024-09-12T03:38:11.388839+0000","last_fullsized":"2024-09-12T03:38:11.388839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:49.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.358028+0000","last_change":"2024-09-12T03:38:10.393564+0000","last_active":"2024-09-12T03:38:11.358028+0000","last_peered":"2024-09-12T03:38:11.358028+0000","last_clean":"2024-09-12T03:38:11.358028+0000","last_became_active":"2024-09-12T03:38:10.393172+0000","last_became_peered":"2024-09-12T03:38:10.393172+0000","last_unstale":"2024-09-12T03:38:11.358028+0000","last_undegraded":"2024-09-12T03:38:11.358028+0000","last_fullsized":"2024-09-12T03:38:11.358028+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:33.801197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404380+0000","last_change":"2024-09-12T03:38:11.400545+0000","last_active":"2024-09-12T03:38:11.404380+0000","last_peered":"2024-09-12T03:38:11.404380+0000","last_clean":"2024-09-12T03:38:11.404380+0000","last_became_active":"2024-09-12T03:38:11.399766+0000","last_became_peered":"2024-09-12T03:38:11.399766+0000","last_unstale":"2024-09-12T03:38:11.404380+0000","last_undegraded":"2024-09-12T03:38:11.404380+0000","last_fullsized":"2024-09-12T03:38:11.404380+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049529+0000","last_change":"2024-09-12T03:38:10.396815+0000","last_active":"2024-09-12T03:38:13.049529+0000","last_peered":"2024-09-12T03:38:13.049529+0000","last_clean":"2024-09-12T03:38:13.049529+0000","last_became_active":"2024-09-12T03:38:10.389620+0000","last_became_peered":"2024-09-12T03:38:10.389620+0000","last_unstale":"2024-09-12T03:38:13.049529+0000","last_undegraded":"2024-09-12T03:38:13.049529+0000","last_fullsized":"2024-09-12T03:38:13.049529+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:50.642124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355855+0000","last_change":"2024-09-12T03:38:11.372417+0000","last_active":"2024-09-12T03:38:12.355855+0000","last_peered":"2024-09-12T03:38:12.355855+0000","last_clean":"2024-09-12T03:38:12.355855+0000","last_became_active":"2024-09-12T03:38:11.371689+0000","last_became_peered":"2024-09-12T03:38:11.371689+0000","last_unstale":"2024-09-12T03:38:12.355855+0000","last_undegraded":"2024-09-12T03:38:12.355855+0000","last_fullsized":"2024-09-12T03:38:12.355855+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360600+0000","last_change":"2024-09-12T03:38:10.393789+0000","last_active":"2024-09-12T03:38:11.360600+0000","last_peered":"2024-09-12T03:38:11.360600+0000","last_clean":"2024-09-12T03:38:11.360600+0000","last_became_active":"2024-09-12T03:38:10.393378+0000","last_became_peered":"2024-09-12T03:38:10.393378+0000","last_unstale":"2024-09-12T03:38:11.360600+0000","last_undegraded":"2024-09-12T03:38:11.360600+0000","last_fullsized":"2024-09-12T03:38:11.360600+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:50.751585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354326+0000","last_change":"2024-09-12T03:38:11.362250+0000","last_active":"2024-09-12T03:38:12.354326+0000","last_peered":"2024-09-12T03:38:12.354326+0000","last_clean":"2024-09-12T03:38:12.354326+0000","last_became_active":"2024-09-12T03:38:11.361375+0000","last_became_peered":"2024-09-12T03:38:11.361375+0000","last_unstale":"2024-09-12T03:38:12.354326+0000","last_undegraded":"2024-09-12T03:38:12.354326+0000","last_fullsized":"2024-09-12T03:38:12.354326+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:22.065181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389098+0000","last_change":"2024-09-12T03:38:10.372217+0000","last_active":"2024-09-12T03:38:11.389098+0000","last_peered":"2024-09-12T03:38:11.389098+0000","last_clean":"2024-09-12T03:38:11.389098+0000","last_became_active":"2024-09-12T03:38:10.371938+0000","last_became_peered":"2024-09-12T03:38:10.371938+0000","last_unstale":"2024-09-12T03:38:11.389098+0000","last_undegraded":"2024-09-12T03:38:11.389098+0000","last_fullsized":"2024-09-12T03:38:11.389098+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.905520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":304,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.366864+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:11.366864+0000","last_peered":"2024-09-12T03:38:11.366864+0000","last_clean":"2024-09-12T03:38:11.366864+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:11.366864+0000","last_undegraded":"2024-09-12T03:38:11.366864+0000","last_fullsized":"2024-09-12T03:38:11.366864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":1137835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1196032,"data_stored":547307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":547399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1228800,"data_stored":556215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1818624,"data_stored":1146069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:16.131 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T03:38:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.285+0000 7f6382755640 1 Processor -- start 2024-09-12T03:38:16.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.285+0000 7f6382755640 1 -- start start 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6382755640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f637c1457a0 0x7f637c0d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6382755640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0b4510 0x7f637c0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6382755640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c0d27a0 con 0x7f637c0cf800 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6382755640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f637c0d2a80 con 0x7f637c1457a0 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6382755640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f637c0d2d60 con 0x7f637c0b4510 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f637c1457a0 0x7f637c0d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f63737fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f637c0cf800 0x7f637c0b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50808/0 (socket says 172.21.15.73:50808) 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f63737fe640 1 -- 172.21.15.73:0/2835301244 learned_addr learned my addr 172.21.15.73:0/2835301244 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6380cf2640 1 --2- 172.21.15.73:0/2835301244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0b4510 0x7f637c0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637bfff640 1 -- 172.21.15.73:0/2835301244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0b4510 msgr2=0x7f637c0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:16.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637bfff640 1 --2- 172.21.15.73:0/2835301244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0b4510 0x7f637c0d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637bfff640 1 -- 172.21.15.73:0/2835301244 >> v1:172.21.15.73:6789/0 conn(0x7f637c0cf800 legacy=0x7f637c0b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637bfff640 1 -- 172.21.15.73:0/2835301244 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c0d01f0 con 0x7f637c1457a0 2024-09-12T03:38:16.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637b7fe640 1 -- 172.21.15.73:0/2835301244 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788345596 0 0) 0x7f637c0d27a0 con 0x7f637c0cf800 2024-09-12T03:38:16.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6380cf2640 1 --2- 172.21.15.73:0/2835301244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0b4510 0x7f637c0d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637bfff640 1 --2- 172.21.15.73:0/2835301244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c1457a0 0x7f637c0d1ea0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097c0 tx=0x7f636c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbae89cf10fc9722 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637b7fe640 1 -- 172.21.15.73:0/2835301244 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c0b0070 con 0x7f637c1457a0 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637b7fe640 1 -- 172.21.15.73:0/2835301244 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c0ab600 con 0x7f637c1457a0 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f637b7fe640 1 -- 172.21.15.73:0/2835301244 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c0ab9d0 con 0x7f637c1457a0 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6382755640 1 -- 172.21.15.73:0/2835301244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c1457a0 msgr2=0x7f637c0d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.289+0000 7f6382755640 1 --2- 172.21.15.73:0/2835301244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c1457a0 0x7f637c0d1ea0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f636c0097c0 tx=0x7f636c01c410 comp rx=0 tx=0).stop 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- 172.21.15.73:0/2835301244 shutdown_connections 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 --2- 172.21.15.73:0/2835301244 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c0b4510 0x7f637c0d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 --2- 172.21.15.73:0/2835301244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c1457a0 0x7f637c0d1ea0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- 172.21.15.73:0/2835301244 >> 172.21.15.73:0/2835301244 conn(0x7f637c06bcc0 msgr2=0x7f637c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:16.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- 172.21.15.73:0/2835301244 shutdown_connections 2024-09-12T03:38:16.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- 172.21.15.73:0/2835301244 wait complete. 2024-09-12T03:38:16.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 Processor -- start 2024-09-12T03:38:16.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- start start 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0b4510 0x7f637c166a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0cf800 0x7f637c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c1457a0 0x7f637c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f637c1690b0 con 0x7f637c0b4510 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f637c0d1670 con 0x7f637c0cf800 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f637c169230 con 0x7f637c1457a0 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0b4510 0x7f637c166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0b4510 0x7f637c166a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39570/0 (socket says 172.21.15.73:39570) 2024-09-12T03:38:16.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 -- 172.21.15.73:0/1719196618 learned_addr learned my addr 172.21.15.73:0/1719196618 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 -- 172.21.15.73:0/1719196618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c1457a0 msgr2=0x7f637c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c1457a0 0x7f637c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 -- 172.21.15.73:0/1719196618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0cf800 msgr2=0x7f637c159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0cf800 0x7f637c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 -- 172.21.15.73:0/1719196618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c13faa0 con 0x7f637c0b4510 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f637bfff640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0b4510 0x7f637c166a50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f636c0ae040 tx=0x7f636c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f63797fa640 1 -- 172.21.15.73:0/1719196618 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c0b0050 con 0x7f637c0b4510 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f63797fa640 1 -- 172.21.15.73:0/1719196618 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636c0bc070 con 0x7f637c0b4510 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637c13fd80 con 0x7f637c0b4510 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f63797fa640 1 -- 172.21.15.73:0/1719196618 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636c0b5a70 con 0x7f637c0b4510 2024-09-12T03:38:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f637c15e070 con 0x7f637c0b4510 2024-09-12T03:38:16.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.293+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f637c0d0710 con 0x7f637c0b4510 2024-09-12T03:38:16.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.297+0000 7f63797fa640 1 -- 172.21.15.73:0/1719196618 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f636c0ab4c0 con 0x7f637c0b4510 2024-09-12T03:38:16.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.297+0000 7f63797fa640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f635c0678c0 0x7f635c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.297+0000 7f63797fa640 1 -- 172.21.15.73:0/1719196618 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f636c1207b0 con 0x7f637c0b4510 2024-09-12T03:38:16.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.297+0000 7f63737fe640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f635c0678c0 0x7f635c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.297+0000 7f63737fe640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f635c0678c0 0x7f635c069d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f63640011f0 tx=0x7f6364007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:16.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.301+0000 7f63797fa640 1 -- 172.21.15.73:0/1719196618 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f636c016090 con 0x7f637c0b4510 2024-09-12T03:38:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.505+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f637c1402a0 con 0x7f637c0b4510 2024-09-12T03:38:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.505+0000 7f63797fa640 1 -- 172.21.15.73:0/1719196618 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1474 (secure 0 0 0) 0x7f636c0f1150 con 0x7f637c0b4510 2024-09-12T03:38:16.509 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:16.509 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":241,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":98,"num_osds":8,"num_up_osds":8,"osd_up_since":1726112066,"num_in_osds":8,"osd_in_since":1726112057,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":266379264,"bytes_avail":772827734016,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":56,"btime":"2024-09-12T03:38:14:379931+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":6579}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-12T03:37:29.840591+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f635c0678c0 msgr2=0x7f635c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f635c0678c0 0x7f635c069d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f63640011f0 tx=0x7f6364007930 comp rx=0 tx=0).stop 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0b4510 msgr2=0x7f637c166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0b4510 0x7f637c166a50 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f636c0ae040 tx=0x7f636c01ac50 comp rx=0 tx=0).stop 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 shutdown_connections 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f635c0678c0 0x7f635c069d80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f637c1457a0 0x7f637c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f637c0cf800 0x7f637c159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 --2- 172.21.15.73:0/1719196618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0b4510 0x7f637c166a50 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 >> 172.21.15.73:0/1719196618 conn(0x7f637c06bcc0 msgr2=0x7f637c1605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:16.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 shutdown_connections 2024-09-12T03:38:16.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.509+0000 7f6382755640 1 -- 172.21.15.73:0/1719196618 wait complete. 2024-09-12T03:38:16.526 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T03:38:16.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.641+0000 7f1bbcb88640 1 Processor -- start 2024-09-12T03:38:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bbcb88640 1 -- start start 2024-09-12T03:38:16.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bbcb88640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bb815bec0 0x7f1bb80ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bbcb88640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb80af470 0x7f1bb806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bbcb88640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb80b3290 con 0x7f1bb815c2a0 2024-09-12T03:38:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bbcb88640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb80b3570 con 0x7f1bb815bec0 2024-09-12T03:38:16.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bbcb88640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80b3850 con 0x7f1bb80af470 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb6d9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb80af470 0x7f1bb806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb659c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1bb815bec0 0x7f1bb80ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb6d9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb80af470 0x7f1bb806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:35194/0 (socket says 172.21.15.73:35194) 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/1680204857 learned_addr learned my addr 172.21.15.73:0/1680204857 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/1680204857 >> v2:172.21.15.150:3300/0 conn(0x7f1bb815bec0 msgr2=0x7f1bb80ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb6d9d640 1 --2- 172.21.15.73:0/1680204857 >> v2:172.21.15.150:3300/0 conn(0x7f1bb815bec0 0x7f1bb80ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/1680204857 >> v1:172.21.15.150:6789/0 conn(0x7f1bb815c2a0 legacy=0x7f1bb80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/1680204857 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb80b3b30 con 0x7f1bb80af470 2024-09-12T03:38:16.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.645+0000 7f1bb659c640 1 --2- 172.21.15.73:0/1680204857 >> v2:172.21.15.150:3300/0 conn(0x7f1bb815bec0 0x7f1bb80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:38:16.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 --2- 172.21.15.73:0/1680204857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb80af470 0x7f1bb806e000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009e50 tx=0x7f1bb001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323bfb4bb6eefd26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:16.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb559a640 1 -- 172.21.15.73:0/1680204857 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb00a5830 con 0x7f1bb80af470 2024-09-12T03:38:16.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb559a640 1 -- 172.21.15.73:0/1680204857 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb00a59d0 con 0x7f1bb80af470 2024-09-12T03:38:16.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb559a640 1 -- 172.21.15.73:0/1680204857 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb00a5da0 con 0x7f1bb80af470 2024-09-12T03:38:16.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- 172.21.15.73:0/1680204857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb80af470 msgr2=0x7f1bb806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/1680204857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb80af470 0x7f1bb806e000 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009e50 tx=0x7f1bb001c970 comp rx=0 tx=0).stop 2024-09-12T03:38:16.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- 172.21.15.73:0/1680204857 shutdown_connections 2024-09-12T03:38:16.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/1680204857 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb80af470 0x7f1bb806e000 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/1680204857 >> v2:172.21.15.150:3300/0 conn(0x7f1bb815bec0 0x7f1bb80ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- 172.21.15.73:0/1680204857 >> 172.21.15.73:0/1680204857 conn(0x7f1bb80b1f90 msgr2=0x7f1bb80b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- 172.21.15.73:0/1680204857 shutdown_connections 2024-09-12T03:38:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- 172.21.15.73:0/1680204857 wait complete. 2024-09-12T03:38:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 Processor -- start 2024-09-12T03:38:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- start start 2024-09-12T03:38:16.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb80af470 0x7f1bb814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb815bec0 0x7f1bb814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb815c2a0 0x7f1bb814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb806ed50 con 0x7f1bb815c2a0 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb80ad740 con 0x7f1bb80af470 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bbcb88640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb806eed0 con 0x7f1bb815bec0 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb815c2a0 0x7f1bb814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb815c2a0 0x7f1bb814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39574/0 (socket says 172.21.15.73:39574) 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/129555038 learned_addr learned my addr 172.21.15.73:0/129555038 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb659c640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb80af470 0x7f1bb814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb5d9b640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb815bec0 0x7f1bb814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb815bec0 msgr2=0x7f1bb814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb815bec0 0x7f1bb814a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb80af470 msgr2=0x7f1bb814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb80af470 0x7f1bb814a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.649+0000 7f1bb6d9d640 1 -- 172.21.15.73:0/129555038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8163fe0 con 0x7f1bb815c2a0 2024-09-12T03:38:16.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1bb6d9d640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb815c2a0 0x7f1bb814d0b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1bb001a5a0 tx=0x7f1bb0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1ba6ffd640 1 -- 172.21.15.73:0/129555038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb00bc020 con 0x7f1bb815c2a0 2024-09-12T03:38:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1ba6ffd640 1 -- 172.21.15.73:0/129555038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb00b8670 con 0x7f1bb815c2a0 2024-09-12T03:38:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1ba6ffd640 1 -- 172.21.15.73:0/129555038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb00b8a40 con 0x7f1bb815c2a0 2024-09-12T03:38:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb81642c0 con 0x7f1bb815c2a0 2024-09-12T03:38:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb8164880 con 0x7f1bb815c2a0 2024-09-12T03:38:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb806e000 con 0x7f1bb815c2a0 2024-09-12T03:38:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1ba6ffd640 1 -- 172.21.15.73:0/129555038 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1bb00bf020 con 0x7f1bb815c2a0 2024-09-12T03:38:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1ba6ffd640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1b980678c0 0x7f1b98069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1bb659c640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1b980678c0 0x7f1b98069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1ba6ffd640 1 -- 172.21.15.73:0/129555038 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f1bb0120ef0 con 0x7f1bb815c2a0 2024-09-12T03:38:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.653+0000 7f1bb659c640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1b980678c0 0x7f1b98069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80ad510 tx=0x7f1bac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:16.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.657+0000 7f1ba6ffd640 1 -- 172.21.15.73:0/129555038 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1bb00c6030 con 0x7f1bb815c2a0 2024-09-12T03:38:16.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.817+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bb80ae2f0 con 0x7f1b980678c0 2024-09-12T03:38:16.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.825+0000 7f1ba6ffd640 1 -- 172.21.15.73:0/129555038 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252061 (secure 0 0 0) 0x7f1bb80ae2f0 con 0x7f1b980678c0 2024-09-12T03:38:16.830 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:16.831 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1b980678c0 msgr2=0x7f1b98069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1b980678c0 0x7f1b98069d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80ad510 tx=0x7f1bac008040 comp rx=0 tx=0).stop 2024-09-12T03:38:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb815c2a0 msgr2=0x7f1bb814d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb815c2a0 0x7f1bb814d0b0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f1bb001a5a0 tx=0x7f1bb0019710 comp rx=0 tx=0).stop 2024-09-12T03:38:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 shutdown_connections 2024-09-12T03:38:16.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1b980678c0 0x7f1b98069d80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb815c2a0 0x7f1bb814d0b0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1bb815bec0 0x7f1bb814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 --2- 172.21.15.73:0/129555038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1bb80af470 0x7f1bb814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 >> 172.21.15.73:0/129555038 conn(0x7f1bb80b1f90 msgr2=0x7f1bb80adae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 shutdown_connections 2024-09-12T03:38:16.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:16.829+0000 7f1bbcb88640 1 -- 172.21.15.73:0/129555038 wait complete. 2024-09-12T03:38:16.848 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-12T03:38:15.853152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260136,"kb_used_data":10592,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714584,"statfs":{"total":773094113280,"available":772827734016,"internally_reserved":0,"allocated":10846208,"data_stored":5577396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001795"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353913+0000","last_change":"2024-09-12T03:38:11.384627+0000","last_active":"2024-09-12T03:38:12.353913+0000","last_peered":"2024-09-12T03:38:12.353913+0000","last_clean":"2024-09-12T03:38:12.353913+0000","last_became_active":"2024-09-12T03:38:11.376938+0000","last_became_peered":"2024-09-12T03:38:11.376938+0000","last_unstale":"2024-09-12T03:38:12.353913+0000","last_undegraded":"2024-09-12T03:38:12.353913+0000","last_fullsized":"2024-09-12T03:38:12.353913+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:30.105284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049780+0000","last_change":"2024-09-12T03:38:11.375766+0000","last_active":"2024-09-12T03:38:13.049780+0000","last_peered":"2024-09-12T03:38:13.049780+0000","last_clean":"2024-09-12T03:38:13.049780+0000","last_became_active":"2024-09-12T03:38:11.372614+0000","last_became_peered":"2024-09-12T03:38:11.372614+0000","last_unstale":"2024-09-12T03:38:13.049780+0000","last_undegraded":"2024-09-12T03:38:13.049780+0000","last_fullsized":"2024-09-12T03:38:13.049780+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.749756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353285+0000","last_change":"2024-09-12T03:38:11.371359+0000","last_active":"2024-09-12T03:38:12.353285+0000","last_peered":"2024-09-12T03:38:12.353285+0000","last_clean":"2024-09-12T03:38:12.353285+0000","last_became_active":"2024-09-12T03:38:11.370665+0000","last_became_peered":"2024-09-12T03:38:11.370665+0000","last_unstale":"2024-09-12T03:38:12.353285+0000","last_undegraded":"2024-09-12T03:38:12.353285+0000","last_fullsized":"2024-09-12T03:38:12.353285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:27.196459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355538+0000","last_change":"2024-09-12T03:38:11.413014+0000","last_active":"2024-09-12T03:38:12.355538+0000","last_peered":"2024-09-12T03:38:12.355538+0000","last_clean":"2024-09-12T03:38:12.355538+0000","last_became_active":"2024-09-12T03:38:11.412596+0000","last_became_peered":"2024-09-12T03:38:11.412596+0000","last_unstale":"2024-09-12T03:38:12.355538+0000","last_undegraded":"2024-09-12T03:38:12.355538+0000","last_fullsized":"2024-09-12T03:38:12.355538+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413879+0000","last_change":"2024-09-12T03:38:11.412827+0000","last_active":"2024-09-12T03:38:11.413879+0000","last_peered":"2024-09-12T03:38:11.413879+0000","last_clean":"2024-09-12T03:38:11.413879+0000","last_became_active":"2024-09-12T03:38:11.412492+0000","last_became_peered":"2024-09-12T03:38:11.412492+0000","last_unstale":"2024-09-12T03:38:11.413879+0000","last_undegraded":"2024-09-12T03:38:11.413879+0000","last_fullsized":"2024-09-12T03:38:11.413879+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049133+0000","last_change":"2024-09-12T03:38:11.379618+0000","last_active":"2024-09-12T03:38:13.049133+0000","last_peered":"2024-09-12T03:38:13.049133+0000","last_clean":"2024-09-12T03:38:13.049133+0000","last_became_active":"2024-09-12T03:38:11.378841+0000","last_became_peered":"2024-09-12T03:38:11.378841+0000","last_unstale":"2024-09-12T03:38:13.049133+0000","last_undegraded":"2024-09-12T03:38:13.049133+0000","last_fullsized":"2024-09-12T03:38:13.049133+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:21.300082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048866+0000","last_change":"2024-09-12T03:38:11.379887+0000","last_active":"2024-09-12T03:38:13.048866+0000","last_peered":"2024-09-12T03:38:13.048866+0000","last_clean":"2024-09-12T03:38:13.048866+0000","last_became_active":"2024-09-12T03:38:11.379102+0000","last_became_peered":"2024-09-12T03:38:11.379102+0000","last_unstale":"2024-09-12T03:38:13.048866+0000","last_undegraded":"2024-09-12T03:38:13.048866+0000","last_fullsized":"2024-09-12T03:38:13.048866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:28.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388655+0000","last_change":"2024-09-12T03:38:11.375885+0000","last_active":"2024-09-12T03:38:11.388655+0000","last_peered":"2024-09-12T03:38:11.388655+0000","last_clean":"2024-09-12T03:38:11.388655+0000","last_became_active":"2024-09-12T03:38:11.375504+0000","last_became_peered":"2024-09-12T03:38:11.375504+0000","last_unstale":"2024-09-12T03:38:11.388655+0000","last_undegraded":"2024-09-12T03:38:11.388655+0000","last_fullsized":"2024-09-12T03:38:11.388655+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:35.575296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049739+0000","last_change":"2024-09-12T03:38:11.392573+0000","last_active":"2024-09-12T03:38:13.049739+0000","last_peered":"2024-09-12T03:38:13.049739+0000","last_clean":"2024-09-12T03:38:13.049739+0000","last_became_active":"2024-09-12T03:38:11.387470+0000","last_became_peered":"2024-09-12T03:38:11.387470+0000","last_unstale":"2024-09-12T03:38:13.049739+0000","last_undegraded":"2024-09-12T03:38:13.049739+0000","last_fullsized":"2024-09-12T03:38:13.049739+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:40.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.383201+0000","last_change":"2024-09-12T03:38:11.378703+0000","last_active":"2024-09-12T03:38:11.383201+0000","last_peered":"2024-09-12T03:38:11.383201+0000","last_clean":"2024-09-12T03:38:11.383201+0000","last_became_active":"2024-09-12T03:38:11.378398+0000","last_became_peered":"2024-09-12T03:38:11.378398+0000","last_unstale":"2024-09-12T03:38:11.383201+0000","last_undegraded":"2024-09-12T03:38:11.383201+0000","last_fullsized":"2024-09-12T03:38:11.383201+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355575+0000","last_change":"2024-09-12T03:38:11.390773+0000","last_active":"2024-09-12T03:38:12.355575+0000","last_peered":"2024-09-12T03:38:12.355575+0000","last_clean":"2024-09-12T03:38:12.355575+0000","last_became_active":"2024-09-12T03:38:11.390033+0000","last_became_peered":"2024-09-12T03:38:11.390033+0000","last_unstale":"2024-09-12T03:38:12.355575+0000","last_undegraded":"2024-09-12T03:38:12.355575+0000","last_fullsized":"2024-09-12T03:38:12.355575+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414317+0000","last_change":"2024-09-12T03:38:11.389551+0000","last_active":"2024-09-12T03:38:11.414317+0000","last_peered":"2024-09-12T03:38:11.414317+0000","last_clean":"2024-09-12T03:38:11.414317+0000","last_became_active":"2024-09-12T03:38:11.382597+0000","last_became_peered":"2024-09-12T03:38:11.382597+0000","last_unstale":"2024-09-12T03:38:11.414317+0000","last_undegraded":"2024-09-12T03:38:11.414317+0000","last_fullsized":"2024-09-12T03:38:11.414317+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:44:05.859843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354540+0000","last_change":"2024-09-12T03:38:11.400083+0000","last_active":"2024-09-12T03:38:12.354540+0000","last_peered":"2024-09-12T03:38:12.354540+0000","last_clean":"2024-09-12T03:38:12.354540+0000","last_became_active":"2024-09-12T03:38:11.399735+0000","last_became_peered":"2024-09-12T03:38:11.399735+0000","last_unstale":"2024-09-12T03:38:12.354540+0000","last_undegraded":"2024-09-12T03:38:12.354540+0000","last_fullsized":"2024-09-12T03:38:12.354540+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.391723+0000","last_change":"2024-09-12T03:38:11.382202+0000","last_active":"2024-09-12T03:38:11.391723+0000","last_peered":"2024-09-12T03:38:11.391723+0000","last_clean":"2024-09-12T03:38:11.391723+0000","last_became_active":"2024-09-12T03:38:11.379979+0000","last_became_peered":"2024-09-12T03:38:11.379979+0000","last_unstale":"2024-09-12T03:38:11.391723+0000","last_undegraded":"2024-09-12T03:38:11.391723+0000","last_fullsized":"2024-09-12T03:38:11.391723+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404588+0000","last_change":"2024-09-12T03:38:11.400513+0000","last_active":"2024-09-12T03:38:11.404588+0000","last_peered":"2024-09-12T03:38:11.404588+0000","last_clean":"2024-09-12T03:38:11.404588+0000","last_became_active":"2024-09-12T03:38:11.399612+0000","last_became_peered":"2024-09-12T03:38:11.399612+0000","last_unstale":"2024-09-12T03:38:11.404588+0000","last_undegraded":"2024-09-12T03:38:11.404588+0000","last_fullsized":"2024-09-12T03:38:11.404588+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:18.349400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400905+0000","last_change":"2024-09-12T03:38:11.393997+0000","last_active":"2024-09-12T03:38:11.400905+0000","last_peered":"2024-09-12T03:38:11.400905+0000","last_clean":"2024-09-12T03:38:11.400905+0000","last_became_active":"2024-09-12T03:38:11.393283+0000","last_became_peered":"2024-09-12T03:38:11.393283+0000","last_unstale":"2024-09-12T03:38:11.400905+0000","last_undegraded":"2024-09-12T03:38:11.400905+0000","last_fullsized":"2024-09-12T03:38:11.400905+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354048+0000","last_change":"2024-09-12T03:38:11.376308+0000","last_active":"2024-09-12T03:38:12.354048+0000","last_peered":"2024-09-12T03:38:12.354048+0000","last_clean":"2024-09-12T03:38:12.354048+0000","last_became_active":"2024-09-12T03:38:11.372517+0000","last_became_peered":"2024-09-12T03:38:11.372517+0000","last_unstale":"2024-09-12T03:38:12.354048+0000","last_undegraded":"2024-09-12T03:38:12.354048+0000","last_fullsized":"2024-09-12T03:38:12.354048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:19.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050171+0000","last_change":"2024-09-12T03:38:11.384169+0000","last_active":"2024-09-12T03:38:13.050171+0000","last_peered":"2024-09-12T03:38:13.050171+0000","last_clean":"2024-09-12T03:38:13.050171+0000","last_became_active":"2024-09-12T03:38:11.379257+0000","last_became_peered":"2024-09-12T03:38:11.379257+0000","last_unstale":"2024-09-12T03:38:13.050171+0000","last_undegraded":"2024-09-12T03:38:13.050171+0000","last_fullsized":"2024-09-12T03:38:13.050171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:55.149939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353419+0000","last_change":"2024-09-12T03:38:11.378852+0000","last_active":"2024-09-12T03:38:12.353419+0000","last_peered":"2024-09-12T03:38:12.353419+0000","last_clean":"2024-09-12T03:38:12.353419+0000","last_became_active":"2024-09-12T03:38:11.378546+0000","last_became_peered":"2024-09-12T03:38:11.378546+0000","last_unstale":"2024-09-12T03:38:12.353419+0000","last_undegraded":"2024-09-12T03:38:12.353419+0000","last_fullsized":"2024-09-12T03:38:12.353419+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:25.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.411880+0000","last_change":"2024-09-12T03:38:11.375988+0000","last_active":"2024-09-12T03:38:11.411880+0000","last_peered":"2024-09-12T03:38:11.411880+0000","last_clean":"2024-09-12T03:38:11.411880+0000","last_became_active":"2024-09-12T03:38:11.375260+0000","last_became_peered":"2024-09-12T03:38:11.375260+0000","last_unstale":"2024-09-12T03:38:11.411880+0000","last_undegraded":"2024-09-12T03:38:11.411880+0000","last_fullsized":"2024-09-12T03:38:11.411880+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390309+0000","last_change":"2024-09-12T03:38:11.388685+0000","last_active":"2024-09-12T03:38:11.390309+0000","last_peered":"2024-09-12T03:38:11.390309+0000","last_clean":"2024-09-12T03:38:11.390309+0000","last_became_active":"2024-09-12T03:38:11.388328+0000","last_became_peered":"2024-09-12T03:38:11.388328+0000","last_unstale":"2024-09-12T03:38:11.390309+0000","last_undegraded":"2024-09-12T03:38:11.390309+0000","last_fullsized":"2024-09-12T03:38:11.390309+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:45:44.776547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.400494+0000","last_change":"2024-09-12T03:38:11.399867+0000","last_active":"2024-09-12T03:38:11.400494+0000","last_peered":"2024-09-12T03:38:11.400494+0000","last_clean":"2024-09-12T03:38:11.400494+0000","last_became_active":"2024-09-12T03:38:11.399587+0000","last_became_peered":"2024-09-12T03:38:11.399587+0000","last_unstale":"2024-09-12T03:38:11.400494+0000","last_undegraded":"2024-09-12T03:38:11.400494+0000","last_fullsized":"2024-09-12T03:38:11.400494+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354177+0000","last_change":"2024-09-12T03:38:11.361911+0000","last_active":"2024-09-12T03:38:12.354177+0000","last_peered":"2024-09-12T03:38:12.354177+0000","last_clean":"2024-09-12T03:38:12.354177+0000","last_became_active":"2024-09-12T03:38:11.361119+0000","last_became_peered":"2024-09-12T03:38:11.361119+0000","last_unstale":"2024-09-12T03:38:12.354177+0000","last_undegraded":"2024-09-12T03:38:12.354177+0000","last_fullsized":"2024-09-12T03:38:12.354177+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:57.066228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.378686+0000","last_change":"2024-09-12T03:38:11.368565+0000","last_active":"2024-09-12T03:38:11.378686+0000","last_peered":"2024-09-12T03:38:11.378686+0000","last_clean":"2024-09-12T03:38:11.378686+0000","last_became_active":"2024-09-12T03:38:11.367075+0000","last_became_peered":"2024-09-12T03:38:11.367075+0000","last_unstale":"2024-09-12T03:38:11.378686+0000","last_undegraded":"2024-09-12T03:38:11.378686+0000","last_fullsized":"2024-09-12T03:38:11.378686+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412038+0000","last_change":"2024-09-12T03:38:11.373854+0000","last_active":"2024-09-12T03:38:11.412038+0000","last_peered":"2024-09-12T03:38:11.412038+0000","last_clean":"2024-09-12T03:38:11.412038+0000","last_became_active":"2024-09-12T03:38:11.372933+0000","last_became_peered":"2024-09-12T03:38:11.372933+0000","last_unstale":"2024-09-12T03:38:11.412038+0000","last_undegraded":"2024-09-12T03:38:11.412038+0000","last_fullsized":"2024-09-12T03:38:11.412038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412130+0000","last_change":"2024-09-12T03:38:11.378651+0000","last_active":"2024-09-12T03:38:11.412130+0000","last_peered":"2024-09-12T03:38:11.412130+0000","last_clean":"2024-09-12T03:38:11.412130+0000","last_became_active":"2024-09-12T03:38:11.377912+0000","last_became_peered":"2024-09-12T03:38:11.377912+0000","last_unstale":"2024-09-12T03:38:11.412130+0000","last_undegraded":"2024-09-12T03:38:11.412130+0000","last_fullsized":"2024-09-12T03:38:11.412130+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355613+0000","last_change":"2024-09-12T03:38:11.403022+0000","last_active":"2024-09-12T03:38:12.355613+0000","last_peered":"2024-09-12T03:38:12.355613+0000","last_clean":"2024-09-12T03:38:12.355613+0000","last_became_active":"2024-09-12T03:38:11.402440+0000","last_became_peered":"2024-09-12T03:38:11.402440+0000","last_unstale":"2024-09-12T03:38:12.355613+0000","last_undegraded":"2024-09-12T03:38:12.355613+0000","last_fullsized":"2024-09-12T03:38:12.355613+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050416+0000","last_change":"2024-09-12T03:38:11.396719+0000","last_active":"2024-09-12T03:38:13.050416+0000","last_peered":"2024-09-12T03:38:13.050416+0000","last_clean":"2024-09-12T03:38:13.050416+0000","last_became_active":"2024-09-12T03:38:11.396036+0000","last_became_peered":"2024-09-12T03:38:11.396036+0000","last_unstale":"2024-09-12T03:38:13.050416+0000","last_undegraded":"2024-09-12T03:38:13.050416+0000","last_fullsized":"2024-09-12T03:38:13.050416+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:42.754775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389356+0000","last_change":"2024-09-12T03:38:11.386723+0000","last_active":"2024-09-12T03:38:11.389356+0000","last_peered":"2024-09-12T03:38:11.389356+0000","last_clean":"2024-09-12T03:38:11.389356+0000","last_became_active":"2024-09-12T03:38:11.386276+0000","last_became_peered":"2024-09-12T03:38:11.386276+0000","last_unstale":"2024-09-12T03:38:11.389356+0000","last_undegraded":"2024-09-12T03:38:11.389356+0000","last_fullsized":"2024-09-12T03:38:11.389356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:55.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412229+0000","last_change":"2024-09-12T03:38:11.373029+0000","last_active":"2024-09-12T03:38:11.412229+0000","last_peered":"2024-09-12T03:38:11.412229+0000","last_clean":"2024-09-12T03:38:11.412229+0000","last_became_active":"2024-09-12T03:38:11.372027+0000","last_became_peered":"2024-09-12T03:38:11.372027+0000","last_unstale":"2024-09-12T03:38:11.412229+0000","last_undegraded":"2024-09-12T03:38:11.412229+0000","last_fullsized":"2024-09-12T03:38:11.412229+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:00.143309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049267+0000","last_change":"2024-09-12T03:38:11.396412+0000","last_active":"2024-09-12T03:38:13.049267+0000","last_peered":"2024-09-12T03:38:13.049267+0000","last_clean":"2024-09-12T03:38:13.049267+0000","last_became_active":"2024-09-12T03:38:11.395717+0000","last_became_peered":"2024-09-12T03:38:11.395717+0000","last_unstale":"2024-09-12T03:38:13.049267+0000","last_undegraded":"2024-09-12T03:38:13.049267+0000","last_fullsized":"2024-09-12T03:38:13.049267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:03.504514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414159+0000","last_change":"2024-09-12T03:38:11.412866+0000","last_active":"2024-09-12T03:38:11.414159+0000","last_peered":"2024-09-12T03:38:11.414159+0000","last_clean":"2024-09-12T03:38:11.414159+0000","last_became_active":"2024-09-12T03:38:11.412507+0000","last_became_peered":"2024-09-12T03:38:11.412507+0000","last_unstale":"2024-09-12T03:38:11.414159+0000","last_undegraded":"2024-09-12T03:38:11.414159+0000","last_fullsized":"2024-09-12T03:38:11.414159+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:23.093665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353830+0000","last_change":"2024-09-12T03:38:11.383601+0000","last_active":"2024-09-12T03:38:12.353830+0000","last_peered":"2024-09-12T03:38:12.353830+0000","last_clean":"2024-09-12T03:38:12.353830+0000","last_became_active":"2024-09-12T03:38:11.381975+0000","last_became_peered":"2024-09-12T03:38:11.381975+0000","last_unstale":"2024-09-12T03:38:12.353830+0000","last_undegraded":"2024-09-12T03:38:12.353830+0000","last_fullsized":"2024-09-12T03:38:12.353830+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:14.464665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356288+0000","last_change":"2024-09-12T03:38:10.386396+0000","last_active":"2024-09-12T03:38:12.356288+0000","last_peered":"2024-09-12T03:38:12.356288+0000","last_clean":"2024-09-12T03:38:12.356288+0000","last_became_active":"2024-09-12T03:38:10.386049+0000","last_became_peered":"2024-09-12T03:38:10.386049+0000","last_unstale":"2024-09-12T03:38:12.356288+0000","last_undegraded":"2024-09-12T03:38:12.356288+0000","last_fullsized":"2024-09-12T03:38:12.356288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.120769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388945+0000","last_change":"2024-09-12T03:38:11.382219+0000","last_active":"2024-09-12T03:38:11.388945+0000","last_peered":"2024-09-12T03:38:11.388945+0000","last_clean":"2024-09-12T03:38:11.388945+0000","last_became_active":"2024-09-12T03:38:11.381850+0000","last_became_peered":"2024-09-12T03:38:11.381850+0000","last_unstale":"2024-09-12T03:38:11.388945+0000","last_undegraded":"2024-09-12T03:38:11.388945+0000","last_fullsized":"2024-09-12T03:38:11.388945+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:42.795485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.393105+0000","last_change":"2024-09-12T03:38:10.372155+0000","last_active":"2024-09-12T03:38:11.393105+0000","last_peered":"2024-09-12T03:38:11.393105+0000","last_clean":"2024-09-12T03:38:11.393105+0000","last_became_active":"2024-09-12T03:38:10.371286+0000","last_became_peered":"2024-09-12T03:38:10.371286+0000","last_unstale":"2024-09-12T03:38:11.393105+0000","last_undegraded":"2024-09-12T03:38:11.393105+0000","last_fullsized":"2024-09-12T03:38:11.393105+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:24.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412287+0000","last_change":"2024-09-12T03:38:11.379955+0000","last_active":"2024-09-12T03:38:11.412287+0000","last_peered":"2024-09-12T03:38:11.412287+0000","last_clean":"2024-09-12T03:38:11.412287+0000","last_became_active":"2024-09-12T03:38:11.379266+0000","last_became_peered":"2024-09-12T03:38:11.379266+0000","last_unstale":"2024-09-12T03:38:11.412287+0000","last_undegraded":"2024-09-12T03:38:11.412287+0000","last_fullsized":"2024-09-12T03:38:11.412287+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:10.970982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414531+0000","last_change":"2024-09-12T03:38:10.396126+0000","last_active":"2024-09-12T03:38:11.414531+0000","last_peered":"2024-09-12T03:38:11.414531+0000","last_clean":"2024-09-12T03:38:11.414531+0000","last_became_active":"2024-09-12T03:38:10.391204+0000","last_became_peered":"2024-09-12T03:38:10.391204+0000","last_unstale":"2024-09-12T03:38:11.414531+0000","last_undegraded":"2024-09-12T03:38:11.414531+0000","last_fullsized":"2024-09-12T03:38:11.414531+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354859+0000","last_change":"2024-09-12T03:38:11.390529+0000","last_active":"2024-09-12T03:38:12.354859+0000","last_peered":"2024-09-12T03:38:12.354859+0000","last_clean":"2024-09-12T03:38:12.354859+0000","last_became_active":"2024-09-12T03:38:11.389787+0000","last_became_peered":"2024-09-12T03:38:11.389787+0000","last_unstale":"2024-09-12T03:38:12.354859+0000","last_undegraded":"2024-09-12T03:38:12.354859+0000","last_fullsized":"2024-09-12T03:38:12.354859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.413407+0000","last_change":"2024-09-12T03:38:10.393267+0000","last_active":"2024-09-12T03:38:11.413407+0000","last_peered":"2024-09-12T03:38:11.413407+0000","last_clean":"2024-09-12T03:38:11.413407+0000","last_became_active":"2024-09-12T03:38:10.392994+0000","last_became_peered":"2024-09-12T03:38:10.392994+0000","last_unstale":"2024-09-12T03:38:11.413407+0000","last_undegraded":"2024-09-12T03:38:11.413407+0000","last_fullsized":"2024-09-12T03:38:11.413407+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355465+0000","last_change":"2024-09-12T03:38:11.377861+0000","last_active":"2024-09-12T03:38:12.355465+0000","last_peered":"2024-09-12T03:38:12.355465+0000","last_clean":"2024-09-12T03:38:12.355465+0000","last_became_active":"2024-09-12T03:38:11.377511+0000","last_became_peered":"2024-09-12T03:38:11.377511+0000","last_unstale":"2024-09-12T03:38:12.355465+0000","last_undegraded":"2024-09-12T03:38:12.355465+0000","last_fullsized":"2024-09-12T03:38:12.355465+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.403041+0000","last_change":"2024-09-12T03:38:10.386519+0000","last_active":"2024-09-12T03:38:11.403041+0000","last_peered":"2024-09-12T03:38:11.403041+0000","last_clean":"2024-09-12T03:38:11.403041+0000","last_became_active":"2024-09-12T03:38:10.385746+0000","last_became_peered":"2024-09-12T03:38:10.385746+0000","last_unstale":"2024-09-12T03:38:11.403041+0000","last_undegraded":"2024-09-12T03:38:11.403041+0000","last_fullsized":"2024-09-12T03:38:11.403041+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:47.841147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353683+0000","last_change":"2024-09-12T03:38:11.378856+0000","last_active":"2024-09-12T03:38:12.353683+0000","last_peered":"2024-09-12T03:38:12.353683+0000","last_clean":"2024-09-12T03:38:12.353683+0000","last_became_active":"2024-09-12T03:38:11.378491+0000","last_became_peered":"2024-09-12T03:38:11.378491+0000","last_unstale":"2024-09-12T03:38:12.353683+0000","last_undegraded":"2024-09-12T03:38:12.353683+0000","last_fullsized":"2024-09-12T03:38:12.353683+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.501014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354371+0000","last_change":"2024-09-12T03:38:10.394181+0000","last_active":"2024-09-12T03:38:12.354371+0000","last_peered":"2024-09-12T03:38:12.354371+0000","last_clean":"2024-09-12T03:38:12.354371+0000","last_became_active":"2024-09-12T03:38:10.393438+0000","last_became_peered":"2024-09-12T03:38:10.393438+0000","last_unstale":"2024-09-12T03:38:12.354371+0000","last_undegraded":"2024-09-12T03:38:12.354371+0000","last_fullsized":"2024-09-12T03:38:12.354371+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:59.138777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050611+0000","last_change":"2024-09-12T03:38:11.394463+0000","last_active":"2024-09-12T03:38:13.050611+0000","last_peered":"2024-09-12T03:38:13.050611+0000","last_clean":"2024-09-12T03:38:13.050611+0000","last_became_active":"2024-09-12T03:38:11.393809+0000","last_became_peered":"2024-09-12T03:38:11.393809+0000","last_unstale":"2024-09-12T03:38:13.050611+0000","last_undegraded":"2024-09-12T03:38:13.050611+0000","last_fullsized":"2024-09-12T03:38:13.050611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:21.531978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355550+0000","last_change":"2024-09-12T03:38:10.386837+0000","last_active":"2024-09-12T03:38:11.355550+0000","last_peered":"2024-09-12T03:38:11.355550+0000","last_clean":"2024-09-12T03:38:11.355550+0000","last_became_active":"2024-09-12T03:38:10.382683+0000","last_became_peered":"2024-09-12T03:38:10.382683+0000","last_unstale":"2024-09-12T03:38:11.355550+0000","last_undegraded":"2024-09-12T03:38:11.355550+0000","last_fullsized":"2024-09-12T03:38:11.355550+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356272+0000","last_change":"2024-09-12T03:38:11.387150+0000","last_active":"2024-09-12T03:38:12.356272+0000","last_peered":"2024-09-12T03:38:12.356272+0000","last_clean":"2024-09-12T03:38:12.356272+0000","last_became_active":"2024-09-12T03:38:11.386913+0000","last_became_peered":"2024-09-12T03:38:11.386913+0000","last_unstale":"2024-09-12T03:38:12.356272+0000","last_undegraded":"2024-09-12T03:38:12.356272+0000","last_fullsized":"2024-09-12T03:38:12.356272+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353698+0000","last_change":"2024-09-12T03:38:10.380693+0000","last_active":"2024-09-12T03:38:12.353698+0000","last_peered":"2024-09-12T03:38:12.353698+0000","last_clean":"2024-09-12T03:38:12.353698+0000","last_became_active":"2024-09-12T03:38:10.380423+0000","last_became_peered":"2024-09-12T03:38:10.380423+0000","last_unstale":"2024-09-12T03:38:12.353698+0000","last_undegraded":"2024-09-12T03:38:12.353698+0000","last_fullsized":"2024-09-12T03:38:12.353698+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353471+0000","last_change":"2024-09-12T03:38:11.383029+0000","last_active":"2024-09-12T03:38:12.353471+0000","last_peered":"2024-09-12T03:38:12.353471+0000","last_clean":"2024-09-12T03:38:12.353471+0000","last_became_active":"2024-09-12T03:38:11.382716+0000","last_became_peered":"2024-09-12T03:38:11.382716+0000","last_unstale":"2024-09-12T03:38:12.353471+0000","last_undegraded":"2024-09-12T03:38:12.353471+0000","last_fullsized":"2024-09-12T03:38:12.353471+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:12.353649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356264+0000","last_change":"2024-09-12T03:38:10.386626+0000","last_active":"2024-09-12T03:38:11.356264+0000","last_peered":"2024-09-12T03:38:11.356264+0000","last_clean":"2024-09-12T03:38:11.356264+0000","last_became_active":"2024-09-12T03:38:10.382526+0000","last_became_peered":"2024-09-12T03:38:10.382526+0000","last_unstale":"2024-09-12T03:38:11.356264+0000","last_undegraded":"2024-09-12T03:38:11.356264+0000","last_fullsized":"2024-09-12T03:38:11.356264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377375+0000","last_change":"2024-09-12T03:38:11.374433+0000","last_active":"2024-09-12T03:38:11.377375+0000","last_peered":"2024-09-12T03:38:11.377375+0000","last_clean":"2024-09-12T03:38:11.377375+0000","last_became_active":"2024-09-12T03:38:11.374104+0000","last_became_peered":"2024-09-12T03:38:11.374104+0000","last_unstale":"2024-09-12T03:38:11.377375+0000","last_undegraded":"2024-09-12T03:38:11.377375+0000","last_fullsized":"2024-09-12T03:38:11.377375+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:04.137930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.352779+0000","last_change":"2024-09-12T03:38:10.393712+0000","last_active":"2024-09-12T03:38:12.352779+0000","last_peered":"2024-09-12T03:38:12.352779+0000","last_clean":"2024-09-12T03:38:12.352779+0000","last_became_active":"2024-09-12T03:38:10.393273+0000","last_became_peered":"2024-09-12T03:38:10.393273+0000","last_unstale":"2024-09-12T03:38:12.352779+0000","last_undegraded":"2024-09-12T03:38:12.352779+0000","last_fullsized":"2024-09-12T03:38:12.352779+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:05.983923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389013+0000","last_change":"2024-09-12T03:38:11.376141+0000","last_active":"2024-09-12T03:38:11.389013+0000","last_peered":"2024-09-12T03:38:11.389013+0000","last_clean":"2024-09-12T03:38:11.389013+0000","last_became_active":"2024-09-12T03:38:11.375589+0000","last_became_peered":"2024-09-12T03:38:11.375589+0000","last_unstale":"2024-09-12T03:38:11.389013+0000","last_undegraded":"2024-09-12T03:38:11.389013+0000","last_fullsized":"2024-09-12T03:38:11.389013+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:48.925960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":15,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.392975+0000","last_change":"2024-09-12T03:38:10.377052+0000","last_active":"2024-09-12T03:38:11.392975+0000","last_peered":"2024-09-12T03:38:11.392975+0000","last_clean":"2024-09-12T03:38:11.392975+0000","last_became_active":"2024-09-12T03:38:10.376406+0000","last_became_peered":"2024-09-12T03:38:10.376406+0000","last_unstale":"2024-09-12T03:38:11.392975+0000","last_undegraded":"2024-09-12T03:38:11.392975+0000","last_fullsized":"2024-09-12T03:38:11.392975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:06.325275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377171+0000","last_change":"2024-09-12T03:38:11.373470+0000","last_active":"2024-09-12T03:38:11.377171+0000","last_peered":"2024-09-12T03:38:11.377171+0000","last_clean":"2024-09-12T03:38:11.377171+0000","last_became_active":"2024-09-12T03:38:11.369749+0000","last_became_peered":"2024-09-12T03:38:11.369749+0000","last_unstale":"2024-09-12T03:38:11.377171+0000","last_undegraded":"2024-09-12T03:38:11.377171+0000","last_fullsized":"2024-09-12T03:38:11.377171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:56.358146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050805+0000","last_change":"2024-09-12T03:38:10.390735+0000","last_active":"2024-09-12T03:38:13.050805+0000","last_peered":"2024-09-12T03:38:13.050805+0000","last_clean":"2024-09-12T03:38:13.050805+0000","last_became_active":"2024-09-12T03:38:10.389748+0000","last_became_peered":"2024-09-12T03:38:10.389748+0000","last_unstale":"2024-09-12T03:38:13.050805+0000","last_undegraded":"2024-09-12T03:38:13.050805+0000","last_fullsized":"2024-09-12T03:38:13.050805+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:13.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354800+0000","last_change":"2024-09-12T03:38:11.389078+0000","last_active":"2024-09-12T03:38:12.354800+0000","last_peered":"2024-09-12T03:38:12.354800+0000","last_clean":"2024-09-12T03:38:12.354800+0000","last_became_active":"2024-09-12T03:38:11.388369+0000","last_became_peered":"2024-09-12T03:38:11.388369+0000","last_unstale":"2024-09-12T03:38:12.354800+0000","last_undegraded":"2024-09-12T03:38:12.354800+0000","last_fullsized":"2024-09-12T03:38:12.354800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:50.506813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389574+0000","last_change":"2024-09-12T03:38:10.378214+0000","last_active":"2024-09-12T03:38:11.389574+0000","last_peered":"2024-09-12T03:38:11.389574+0000","last_clean":"2024-09-12T03:38:11.389574+0000","last_became_active":"2024-09-12T03:38:10.377904+0000","last_became_peered":"2024-09-12T03:38:10.377904+0000","last_unstale":"2024-09-12T03:38:11.389574+0000","last_undegraded":"2024-09-12T03:38:11.389574+0000","last_fullsized":"2024-09-12T03:38:11.389574+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050168+0000","last_change":"2024-09-12T03:38:11.377868+0000","last_active":"2024-09-12T03:38:13.050168+0000","last_peered":"2024-09-12T03:38:13.050168+0000","last_clean":"2024-09-12T03:38:13.050168+0000","last_became_active":"2024-09-12T03:38:11.377082+0000","last_became_peered":"2024-09-12T03:38:11.377082+0000","last_unstale":"2024-09-12T03:38:13.050168+0000","last_undegraded":"2024-09-12T03:38:13.050168+0000","last_fullsized":"2024-09-12T03:38:13.050168+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:19.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354576+0000","last_change":"2024-09-12T03:38:10.374595+0000","last_active":"2024-09-12T03:38:12.354576+0000","last_peered":"2024-09-12T03:38:12.354576+0000","last_clean":"2024-09-12T03:38:12.354576+0000","last_became_active":"2024-09-12T03:38:10.374184+0000","last_became_peered":"2024-09-12T03:38:10.374184+0000","last_unstale":"2024-09-12T03:38:12.354576+0000","last_undegraded":"2024-09-12T03:38:12.354576+0000","last_fullsized":"2024-09-12T03:38:12.354576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:09.966450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.414410+0000","last_change":"2024-09-12T03:38:11.413754+0000","last_active":"2024-09-12T03:38:11.414410+0000","last_peered":"2024-09-12T03:38:11.414410+0000","last_clean":"2024-09-12T03:38:11.414410+0000","last_became_active":"2024-09-12T03:38:11.413457+0000","last_became_peered":"2024-09-12T03:38:11.413457+0000","last_unstale":"2024-09-12T03:38:11.414410+0000","last_undegraded":"2024-09-12T03:38:11.414410+0000","last_fullsized":"2024-09-12T03:38:11.414410+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:39.890043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.357062+0000","last_change":"2024-09-12T03:38:10.397284+0000","last_active":"2024-09-12T03:38:11.357062+0000","last_peered":"2024-09-12T03:38:11.357062+0000","last_clean":"2024-09-12T03:38:11.357062+0000","last_became_active":"2024-09-12T03:38:10.397035+0000","last_became_peered":"2024-09-12T03:38:10.397035+0000","last_unstale":"2024-09-12T03:38:11.357062+0000","last_undegraded":"2024-09-12T03:38:11.357062+0000","last_fullsized":"2024-09-12T03:38:11.357062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:01.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354188+0000","last_change":"2024-09-12T03:38:11.377239+0000","last_active":"2024-09-12T03:38:12.354188+0000","last_peered":"2024-09-12T03:38:12.354188+0000","last_clean":"2024-09-12T03:38:12.354188+0000","last_became_active":"2024-09-12T03:38:11.373504+0000","last_became_peered":"2024-09-12T03:38:11.373504+0000","last_unstale":"2024-09-12T03:38:12.354188+0000","last_undegraded":"2024-09-12T03:38:12.354188+0000","last_fullsized":"2024-09-12T03:38:12.354188+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:42.442682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415226+0000","last_change":"2024-09-12T03:38:10.396181+0000","last_active":"2024-09-12T03:38:11.415226+0000","last_peered":"2024-09-12T03:38:11.415226+0000","last_clean":"2024-09-12T03:38:11.415226+0000","last_became_active":"2024-09-12T03:38:10.391810+0000","last_became_peered":"2024-09-12T03:38:10.391810+0000","last_unstale":"2024-09-12T03:38:11.415226+0000","last_undegraded":"2024-09-12T03:38:11.415226+0000","last_fullsized":"2024-09-12T03:38:11.415226+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389320+0000","last_change":"2024-09-12T03:38:11.386951+0000","last_active":"2024-09-12T03:38:11.389320+0000","last_peered":"2024-09-12T03:38:11.389320+0000","last_clean":"2024-09-12T03:38:11.389320+0000","last_became_active":"2024-09-12T03:38:11.386626+0000","last_became_peered":"2024-09-12T03:38:11.386626+0000","last_unstale":"2024-09-12T03:38:11.389320+0000","last_undegraded":"2024-09-12T03:38:11.389320+0000","last_fullsized":"2024-09-12T03:38:11.389320+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:57.218703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049995+0000","last_change":"2024-09-12T03:38:10.399566+0000","last_active":"2024-09-12T03:38:13.049995+0000","last_peered":"2024-09-12T03:38:13.049995+0000","last_clean":"2024-09-12T03:38:13.049995+0000","last_became_active":"2024-09-12T03:38:10.398778+0000","last_became_peered":"2024-09-12T03:38:10.398778+0000","last_unstale":"2024-09-12T03:38:13.049995+0000","last_undegraded":"2024-09-12T03:38:13.049995+0000","last_fullsized":"2024-09-12T03:38:13.049995+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.197401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050668+0000","last_change":"2024-09-12T03:38:11.393699+0000","last_active":"2024-09-12T03:38:13.050668+0000","last_peered":"2024-09-12T03:38:13.050668+0000","last_clean":"2024-09-12T03:38:13.050668+0000","last_became_active":"2024-09-12T03:38:11.387420+0000","last_became_peered":"2024-09-12T03:38:11.387420+0000","last_unstale":"2024-09-12T03:38:13.050668+0000","last_undegraded":"2024-09-12T03:38:13.050668+0000","last_fullsized":"2024-09-12T03:38:13.050668+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:19.710836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.415097+0000","last_change":"2024-09-12T03:38:10.394211+0000","last_active":"2024-09-12T03:38:11.415097+0000","last_peered":"2024-09-12T03:38:11.415097+0000","last_clean":"2024-09-12T03:38:11.415097+0000","last_became_active":"2024-09-12T03:38:10.393408+0000","last_became_peered":"2024-09-12T03:38:10.393408+0000","last_unstale":"2024-09-12T03:38:11.415097+0000","last_undegraded":"2024-09-12T03:38:11.415097+0000","last_fullsized":"2024-09-12T03:38:11.415097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:21.318043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.377196+0000","last_change":"2024-09-12T03:38:11.375483+0000","last_active":"2024-09-12T03:38:11.377196+0000","last_peered":"2024-09-12T03:38:11.377196+0000","last_clean":"2024-09-12T03:38:11.377196+0000","last_became_active":"2024-09-12T03:38:11.375033+0000","last_became_peered":"2024-09-12T03:38:11.375033+0000","last_unstale":"2024-09-12T03:38:11.377196+0000","last_undegraded":"2024-09-12T03:38:11.377196+0000","last_fullsized":"2024-09-12T03:38:11.377196+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:14.125301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355071+0000","last_change":"2024-09-12T03:38:10.387509+0000","last_active":"2024-09-12T03:38:12.355071+0000","last_peered":"2024-09-12T03:38:12.355071+0000","last_clean":"2024-09-12T03:38:12.355071+0000","last_became_active":"2024-09-12T03:38:10.386787+0000","last_became_peered":"2024-09-12T03:38:10.386787+0000","last_unstale":"2024-09-12T03:38:12.355071+0000","last_undegraded":"2024-09-12T03:38:12.355071+0000","last_fullsized":"2024-09-12T03:38:12.355071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353059+0000","last_change":"2024-09-12T03:38:11.377338+0000","last_active":"2024-09-12T03:38:12.353059+0000","last_peered":"2024-09-12T03:38:12.353059+0000","last_clean":"2024-09-12T03:38:12.353059+0000","last_became_active":"2024-09-12T03:38:11.376959+0000","last_became_peered":"2024-09-12T03:38:11.376959+0000","last_unstale":"2024-09-12T03:38:12.353059+0000","last_undegraded":"2024-09-12T03:38:12.353059+0000","last_fullsized":"2024-09-12T03:38:12.353059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:09.482818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.390601+0000","last_change":"2024-09-12T03:38:10.371802+0000","last_active":"2024-09-12T03:38:11.390601+0000","last_peered":"2024-09-12T03:38:11.390601+0000","last_clean":"2024-09-12T03:38:11.390601+0000","last_became_active":"2024-09-12T03:38:10.371392+0000","last_became_peered":"2024-09-12T03:38:10.371392+0000","last_unstale":"2024-09-12T03:38:11.390601+0000","last_undegraded":"2024-09-12T03:38:11.390601+0000","last_fullsized":"2024-09-12T03:38:11.390601+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:45.146362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353550+0000","last_change":"2024-09-12T03:38:11.369326+0000","last_active":"2024-09-12T03:38:12.353550+0000","last_peered":"2024-09-12T03:38:12.353550+0000","last_clean":"2024-09-12T03:38:12.353550+0000","last_became_active":"2024-09-12T03:38:11.368764+0000","last_became_peered":"2024-09-12T03:38:11.368764+0000","last_unstale":"2024-09-12T03:38:12.353550+0000","last_undegraded":"2024-09-12T03:38:12.353550+0000","last_fullsized":"2024-09-12T03:38:12.353550+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:26.615641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.356974+0000","last_change":"2024-09-12T03:38:10.371718+0000","last_active":"2024-09-12T03:38:11.356974+0000","last_peered":"2024-09-12T03:38:11.356974+0000","last_clean":"2024-09-12T03:38:11.356974+0000","last_became_active":"2024-09-12T03:38:10.371419+0000","last_became_peered":"2024-09-12T03:38:10.371419+0000","last_unstale":"2024-09-12T03:38:11.356974+0000","last_undegraded":"2024-09-12T03:38:11.356974+0000","last_fullsized":"2024-09-12T03:38:11.356974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.819443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355100+0000","last_change":"2024-09-12T03:38:11.401115+0000","last_active":"2024-09-12T03:38:12.355100+0000","last_peered":"2024-09-12T03:38:12.355100+0000","last_clean":"2024-09-12T03:38:12.355100+0000","last_became_active":"2024-09-12T03:38:11.400866+0000","last_became_peered":"2024-09-12T03:38:11.400866+0000","last_unstale":"2024-09-12T03:38:12.355100+0000","last_undegraded":"2024-09-12T03:38:12.355100+0000","last_fullsized":"2024-09-12T03:38:12.355100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051124+0000","last_change":"2024-09-12T03:38:10.400711+0000","last_active":"2024-09-12T03:38:13.051124+0000","last_peered":"2024-09-12T03:38:13.051124+0000","last_clean":"2024-09-12T03:38:13.051124+0000","last_became_active":"2024-09-12T03:38:10.399905+0000","last_became_peered":"2024-09-12T03:38:10.399905+0000","last_unstale":"2024-09-12T03:38:13.051124+0000","last_undegraded":"2024-09-12T03:38:13.051124+0000","last_fullsized":"2024-09-12T03:38:13.051124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:32.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388770+0000","last_change":"2024-09-12T03:38:11.381737+0000","last_active":"2024-09-12T03:38:11.388770+0000","last_peered":"2024-09-12T03:38:11.388770+0000","last_clean":"2024-09-12T03:38:11.388770+0000","last_became_active":"2024-09-12T03:38:11.381350+0000","last_became_peered":"2024-09-12T03:38:11.381350+0000","last_unstale":"2024-09-12T03:38:11.388770+0000","last_undegraded":"2024-09-12T03:38:11.388770+0000","last_fullsized":"2024-09-12T03:38:11.388770+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:55.796930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360809+0000","last_change":"2024-09-12T03:38:10.372995+0000","last_active":"2024-09-12T03:38:11.360809+0000","last_peered":"2024-09-12T03:38:11.360809+0000","last_clean":"2024-09-12T03:38:11.360809+0000","last_became_active":"2024-09-12T03:38:10.372390+0000","last_became_peered":"2024-09-12T03:38:10.372390+0000","last_unstale":"2024-09-12T03:38:11.360809+0000","last_undegraded":"2024-09-12T03:38:11.360809+0000","last_fullsized":"2024-09-12T03:38:11.360809+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:37.755261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353104+0000","last_change":"2024-09-12T03:38:11.382260+0000","last_active":"2024-09-12T03:38:12.353104+0000","last_peered":"2024-09-12T03:38:12.353104+0000","last_clean":"2024-09-12T03:38:12.353104+0000","last_became_active":"2024-09-12T03:38:11.375057+0000","last_became_peered":"2024-09-12T03:38:11.375057+0000","last_unstale":"2024-09-12T03:38:12.353104+0000","last_undegraded":"2024-09-12T03:38:12.353104+0000","last_fullsized":"2024-09-12T03:38:12.353104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389875+0000","last_change":"2024-09-12T03:38:10.378023+0000","last_active":"2024-09-12T03:38:11.389875+0000","last_peered":"2024-09-12T03:38:11.389875+0000","last_clean":"2024-09-12T03:38:11.389875+0000","last_became_active":"2024-09-12T03:38:10.377276+0000","last_became_peered":"2024-09-12T03:38:10.377276+0000","last_unstale":"2024-09-12T03:38:11.389875+0000","last_undegraded":"2024-09-12T03:38:11.389875+0000","last_fullsized":"2024-09-12T03:38:11.389875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.412023+0000","last_change":"2024-09-12T03:38:11.381329+0000","last_active":"2024-09-12T03:38:11.412023+0000","last_peered":"2024-09-12T03:38:11.412023+0000","last_clean":"2024-09-12T03:38:11.412023+0000","last_became_active":"2024-09-12T03:38:11.380636+0000","last_became_peered":"2024-09-12T03:38:11.380636+0000","last_unstale":"2024-09-12T03:38:11.412023+0000","last_undegraded":"2024-09-12T03:38:11.412023+0000","last_fullsized":"2024-09-12T03:38:11.412023+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:59.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"98'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353169+0000","last_change":"2024-09-12T03:38:10.381935+0000","last_active":"2024-09-12T03:38:12.353169+0000","last_peered":"2024-09-12T03:38:12.353169+0000","last_clean":"2024-09-12T03:38:12.353169+0000","last_became_active":"2024-09-12T03:38:10.381501+0000","last_became_peered":"2024-09-12T03:38:10.381501+0000","last_unstale":"2024-09-12T03:38:12.353169+0000","last_undegraded":"2024-09-12T03:38:12.353169+0000","last_fullsized":"2024-09-12T03:38:12.353169+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.397926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354781+0000","last_change":"2024-09-12T03:38:11.380067+0000","last_active":"2024-09-12T03:38:12.354781+0000","last_peered":"2024-09-12T03:38:12.354781+0000","last_clean":"2024-09-12T03:38:12.354781+0000","last_became_active":"2024-09-12T03:38:11.379715+0000","last_became_peered":"2024-09-12T03:38:11.379715+0000","last_unstale":"2024-09-12T03:38:12.354781+0000","last_undegraded":"2024-09-12T03:38:12.354781+0000","last_fullsized":"2024-09-12T03:38:12.354781+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050422+0000","last_change":"2024-09-12T03:38:10.398220+0000","last_active":"2024-09-12T03:38:13.050422+0000","last_peered":"2024-09-12T03:38:13.050422+0000","last_clean":"2024-09-12T03:38:13.050422+0000","last_became_active":"2024-09-12T03:38:10.390272+0000","last_became_peered":"2024-09-12T03:38:10.390272+0000","last_unstale":"2024-09-12T03:38:13.050422+0000","last_undegraded":"2024-09-12T03:38:13.050422+0000","last_fullsized":"2024-09-12T03:38:13.050422+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:07.384819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354667+0000","last_change":"2024-09-12T03:38:11.373341+0000","last_active":"2024-09-12T03:38:12.354667+0000","last_peered":"2024-09-12T03:38:12.354667+0000","last_clean":"2024-09-12T03:38:12.354667+0000","last_became_active":"2024-09-12T03:38:11.371198+0000","last_became_peered":"2024-09-12T03:38:11.371198+0000","last_unstale":"2024-09-12T03:38:12.354667+0000","last_undegraded":"2024-09-12T03:38:12.354667+0000","last_fullsized":"2024-09-12T03:38:12.354667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:48.990741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.352280+0000","last_change":"2024-09-12T03:38:10.391548+0000","last_active":"2024-09-12T03:38:11.352280+0000","last_peered":"2024-09-12T03:38:11.352280+0000","last_clean":"2024-09-12T03:38:11.352280+0000","last_became_active":"2024-09-12T03:38:10.391192+0000","last_became_peered":"2024-09-12T03:38:10.391192+0000","last_unstale":"2024-09-12T03:38:11.352280+0000","last_undegraded":"2024-09-12T03:38:11.352280+0000","last_fullsized":"2024-09-12T03:38:11.352280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388970+0000","last_change":"2024-09-12T03:38:11.376125+0000","last_active":"2024-09-12T03:38:11.388970+0000","last_peered":"2024-09-12T03:38:11.388970+0000","last_clean":"2024-09-12T03:38:11.388970+0000","last_became_active":"2024-09-12T03:38:11.375578+0000","last_became_peered":"2024-09-12T03:38:11.375578+0000","last_unstale":"2024-09-12T03:38:11.388970+0000","last_undegraded":"2024-09-12T03:38:11.388970+0000","last_fullsized":"2024-09-12T03:38:11.388970+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:09:37.856069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.355446+0000","last_change":"2024-09-12T03:38:10.392155+0000","last_active":"2024-09-12T03:38:11.355446+0000","last_peered":"2024-09-12T03:38:11.355446+0000","last_clean":"2024-09-12T03:38:11.355446+0000","last_became_active":"2024-09-12T03:38:10.391414+0000","last_became_peered":"2024-09-12T03:38:10.391414+0000","last_unstale":"2024-09-12T03:38:11.355446+0000","last_undegraded":"2024-09-12T03:38:11.355446+0000","last_fullsized":"2024-09-12T03:38:11.355446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.388839+0000","last_change":"2024-09-12T03:38:11.381890+0000","last_active":"2024-09-12T03:38:11.388839+0000","last_peered":"2024-09-12T03:38:11.388839+0000","last_clean":"2024-09-12T03:38:11.388839+0000","last_became_active":"2024-09-12T03:38:11.380922+0000","last_became_peered":"2024-09-12T03:38:11.380922+0000","last_unstale":"2024-09-12T03:38:11.388839+0000","last_undegraded":"2024-09-12T03:38:11.388839+0000","last_fullsized":"2024-09-12T03:38:11.388839+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:49.853977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.358028+0000","last_change":"2024-09-12T03:38:10.393564+0000","last_active":"2024-09-12T03:38:11.358028+0000","last_peered":"2024-09-12T03:38:11.358028+0000","last_clean":"2024-09-12T03:38:11.358028+0000","last_became_active":"2024-09-12T03:38:10.393172+0000","last_became_peered":"2024-09-12T03:38:10.393172+0000","last_unstale":"2024-09-12T03:38:11.358028+0000","last_undegraded":"2024-09-12T03:38:11.358028+0000","last_fullsized":"2024-09-12T03:38:11.358028+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:33.801197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.404380+0000","last_change":"2024-09-12T03:38:11.400545+0000","last_active":"2024-09-12T03:38:11.404380+0000","last_peered":"2024-09-12T03:38:11.404380+0000","last_clean":"2024-09-12T03:38:11.404380+0000","last_became_active":"2024-09-12T03:38:11.399766+0000","last_became_peered":"2024-09-12T03:38:11.399766+0000","last_unstale":"2024-09-12T03:38:11.404380+0000","last_undegraded":"2024-09-12T03:38:11.404380+0000","last_fullsized":"2024-09-12T03:38:11.404380+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049529+0000","last_change":"2024-09-12T03:38:10.396815+0000","last_active":"2024-09-12T03:38:13.049529+0000","last_peered":"2024-09-12T03:38:13.049529+0000","last_clean":"2024-09-12T03:38:13.049529+0000","last_became_active":"2024-09-12T03:38:10.389620+0000","last_became_peered":"2024-09-12T03:38:10.389620+0000","last_unstale":"2024-09-12T03:38:13.049529+0000","last_undegraded":"2024-09-12T03:38:13.049529+0000","last_fullsized":"2024-09-12T03:38:13.049529+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:50.642124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355855+0000","last_change":"2024-09-12T03:38:11.372417+0000","last_active":"2024-09-12T03:38:12.355855+0000","last_peered":"2024-09-12T03:38:12.355855+0000","last_clean":"2024-09-12T03:38:12.355855+0000","last_became_active":"2024-09-12T03:38:11.371689+0000","last_became_peered":"2024-09-12T03:38:11.371689+0000","last_unstale":"2024-09-12T03:38:12.355855+0000","last_undegraded":"2024-09-12T03:38:12.355855+0000","last_fullsized":"2024-09-12T03:38:12.355855+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.360600+0000","last_change":"2024-09-12T03:38:10.393789+0000","last_active":"2024-09-12T03:38:11.360600+0000","last_peered":"2024-09-12T03:38:11.360600+0000","last_clean":"2024-09-12T03:38:11.360600+0000","last_became_active":"2024-09-12T03:38:10.393378+0000","last_became_peered":"2024-09-12T03:38:10.393378+0000","last_unstale":"2024-09-12T03:38:11.360600+0000","last_undegraded":"2024-09-12T03:38:11.360600+0000","last_fullsized":"2024-09-12T03:38:11.360600+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:50.751585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354326+0000","last_change":"2024-09-12T03:38:11.362250+0000","last_active":"2024-09-12T03:38:12.354326+0000","last_peered":"2024-09-12T03:38:12.354326+0000","last_clean":"2024-09-12T03:38:12.354326+0000","last_became_active":"2024-09-12T03:38:11.361375+0000","last_became_peered":"2024-09-12T03:38:11.361375+0000","last_unstale":"2024-09-12T03:38:12.354326+0000","last_undegraded":"2024-09-12T03:38:12.354326+0000","last_fullsized":"2024-09-12T03:38:12.354326+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:22.065181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.389098+0000","last_change":"2024-09-12T03:38:10.372217+0000","last_active":"2024-09-12T03:38:11.389098+0000","last_peered":"2024-09-12T03:38:11.389098+0000","last_clean":"2024-09-12T03:38:11.389098+0000","last_became_active":"2024-09-12T03:38:10.371938+0000","last_became_peered":"2024-09-12T03:38:10.371938+0000","last_unstale":"2024-09-12T03:38:11.389098+0000","last_undegraded":"2024-09-12T03:38:11.389098+0000","last_fullsized":"2024-09-12T03:38:11.389098+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.905520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":304,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T03:38:11.366864+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:11.366864+0000","last_peered":"2024-09-12T03:38:11.366864+0000","last_clean":"2024-09-12T03:38:11.366864+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:11.366864+0000","last_undegraded":"2024-09-12T03:38:11.366864+0000","last_fullsized":"2024-09-12T03:38:11.366864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":1137835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1196032,"data_stored":547307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509489,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":547399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509490,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1200128,"data_stored":547341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1228800,"data_stored":556215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1818624,"data_stored":1146069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:16.993 INFO:tasks.ceph.mds.c.smithi073.stderr:2024-09-12T03:38:16.993+0000 7f45f98ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T03:38:19.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:19.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f010d3e6640 1 Processor -- start 2024-09-12T03:38:19.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f010d3e6640 1 -- start start 2024-09-12T03:38:19.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f010d3e6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f010806bcc0 0x7f010806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:19.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f010d3e6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01080d1d80 con 0x7f0108145d90 2024-09-12T03:38:19.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f010d3e6640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01080afa20 con 0x7f01080d1050 2024-09-12T03:38:19.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f010d3e6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f010806c670 con 0x7f010806bcc0 2024-09-12T03:38:19.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f0106ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0108145d90 0x7f01080b0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50824/0 (socket says 172.21.15.73:50824) 2024-09-12T03:38:19.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f0106ffd640 1 -- 172.21.15.73:0/512606061 learned_addr learned my addr 172.21.15.73:0/512606061 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:19.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f00fe7fc640 1 --2- 172.21.15.73:0/512606061 >> v2:172.21.15.73:3300/0 conn(0x7f010806bcc0 0x7f010806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:19.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f01067fc640 1 -- 172.21.15.73:0/512606061 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631746430 0 0) 0x7f01080d1d80 con 0x7f0108145d90 2024-09-12T03:38:19.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f00fe7fc640 1 -- 172.21.15.73:0/512606061 >> v1:172.21.15.150:6789/0 conn(0x7f01080d1050 legacy=0x7f01080d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:19.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f00fe7fc640 1 -- 172.21.15.73:0/512606061 >> v1:172.21.15.73:6789/0 conn(0x7f0108145d90 legacy=0x7f01080b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:19.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.981+0000 7f00fe7fc640 1 -- 172.21.15.73:0/512606061 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01080afd00 con 0x7f010806bcc0 2024-09-12T03:38:19.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f00fe7fc640 1 --2- 172.21.15.73:0/512606061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f010806bcc0 0x7f010806c130 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f00f00097c0 tx=0x7f00f001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc24e1ec02488485 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:19.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f01067fc640 1 -- 172.21.15.73:0/512606061 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f00b1070 con 0x7f010806bcc0 2024-09-12T03:38:19.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f01067fc640 1 -- 172.21.15.73:0/512606061 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f00ac640 con 0x7f010806bcc0 2024-09-12T03:38:19.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f01067fc640 1 -- 172.21.15.73:0/512606061 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f00aca10 con 0x7f010806bcc0 2024-09-12T03:38:19.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- 172.21.15.73:0/512606061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f010806bcc0 msgr2=0x7f010806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:19.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 --2- 172.21.15.73:0/512606061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f010806bcc0 0x7f010806c130 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f00f00097c0 tx=0x7f00f001c460 comp rx=0 tx=0).stop 2024-09-12T03:38:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- 172.21.15.73:0/512606061 shutdown_connections 2024-09-12T03:38:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 --2- 172.21.15.73:0/512606061 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f010806bcc0 0x7f010806c130 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- 172.21.15.73:0/512606061 >> 172.21.15.73:0/512606061 conn(0x7f010809aa00 msgr2=0x7f01080b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- 172.21.15.73:0/512606061 shutdown_connections 2024-09-12T03:38:19.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- 172.21.15.73:0/512606061 wait complete. 2024-09-12T03:38:19.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 Processor -- start 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- start start 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f010806bcc0 0x7f010809b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01080d1050 0x7f010815ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0108145d90 0x7f01080b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f01080b4ab0 con 0x7f0108145d90 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0108169fa0 con 0x7f01080d1050 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f010d3e6640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f010809b6c0 con 0x7f010806bcc0 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f01077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0108145d90 0x7f01080b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f01077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0108145d90 0x7f01080b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39598/0 (socket says 172.21.15.73:39598) 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.985+0000 7f01077fe640 1 -- 172.21.15.73:0/2893519304 learned_addr learned my addr 172.21.15.73:0/2893519304 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f00fe7fc640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01080d1050 0x7f010815ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:19.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f0106ffd640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f010806bcc0 0x7f010809b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f01077fe640 1 -- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f010806bcc0 msgr2=0x7f010809b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f01077fe640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f010806bcc0 0x7f010809b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f01077fe640 1 -- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01080d1050 msgr2=0x7f010815ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f01077fe640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01080d1050 0x7f010815ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f01077fe640 1 -- 172.21.15.73:0/2893519304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010813c670 con 0x7f0108145d90 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f01077fe640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0108145d90 0x7f01080b1110 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f010000c7b0 tx=0x7f010000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f00fffff640 1 -- 172.21.15.73:0/2893519304 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100004b70 con 0x7f0108145d90 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f00fffff640 1 -- 172.21.15.73:0/2893519304 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0100004d10 con 0x7f0108145d90 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010813c950 con 0x7f0108145d90 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f00fffff640 1 -- 172.21.15.73:0/2893519304 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010000aa90 con 0x7f0108145d90 2024-09-12T03:38:19.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010815b170 con 0x7f0108145d90 2024-09-12T03:38:19.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01080d1d80 con 0x7f0108145d90 2024-09-12T03:38:19.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f00fffff640 1 -- 172.21.15.73:0/2893519304 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f010000ac30 con 0x7f0108145d90 2024-09-12T03:38:19.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f00fffff640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00e80678c0 0x7f00e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:19.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f00fffff640 1 -- 172.21.15.73:0/2893519304 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f0100086680 con 0x7f0108145d90 2024-09-12T03:38:19.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f0106ffd640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00e80678c0 0x7f00e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:19.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.989+0000 7f0106ffd640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00e80678c0 0x7f00e8069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f00f8000f70 tx=0x7f00f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:19.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:19.993+0000 7f00fffff640 1 -- 172.21.15.73:0/2893519304 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0100020070 con 0x7f0108145d90 2024-09-12T03:38:20.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.153+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f010813cfa0 con 0x7f00e80678c0 2024-09-12T03:38:20.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f00fffff640 1 -- 172.21.15.73:0/2893519304 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252065 (secure 0 0 0) 0x7f010813cfa0 con 0x7f00e80678c0 2024-09-12T03:38:20.175 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:20.177 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:20.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00e80678c0 msgr2=0x7f00e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00e80678c0 0x7f00e8069d80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f00f8000f70 tx=0x7f00f8009040 comp rx=0 tx=0).stop 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0108145d90 msgr2=0x7f01080b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0108145d90 0x7f01080b1110 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f010000c7b0 tx=0x7f010000cc70 comp rx=0 tx=0).stop 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 shutdown_connections 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00e80678c0 0x7f00e8069d80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0108145d90 0x7f01080b1110 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01080d1050 0x7f010815ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 --2- 172.21.15.73:0/2893519304 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f010806bcc0 0x7f010809b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 >> 172.21.15.73:0/2893519304 conn(0x7f010809aa00 msgr2=0x7f01080b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 shutdown_connections 2024-09-12T03:38:20.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.173+0000 7f010d3e6640 1 -- 172.21.15.73:0/2893519304 wait complete. 2024-09-12T03:38:20.192 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-12T03:38:19.854497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260188,"kb_used_data":10664,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714532,"statfs":{"total":773094113280,"available":772827680768,"internally_reserved":0,"allocated":10919936,"data_stored":5617548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.512871"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353913+0000","last_change":"2024-09-12T03:38:11.384627+0000","last_active":"2024-09-12T03:38:12.353913+0000","last_peered":"2024-09-12T03:38:12.353913+0000","last_clean":"2024-09-12T03:38:12.353913+0000","last_became_active":"2024-09-12T03:38:11.376938+0000","last_became_peered":"2024-09-12T03:38:11.376938+0000","last_unstale":"2024-09-12T03:38:12.353913+0000","last_undegraded":"2024-09-12T03:38:12.353913+0000","last_fullsized":"2024-09-12T03:38:12.353913+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:30.105284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049780+0000","last_change":"2024-09-12T03:38:11.375766+0000","last_active":"2024-09-12T03:38:13.049780+0000","last_peered":"2024-09-12T03:38:13.049780+0000","last_clean":"2024-09-12T03:38:13.049780+0000","last_became_active":"2024-09-12T03:38:11.372614+0000","last_became_peered":"2024-09-12T03:38:11.372614+0000","last_unstale":"2024-09-12T03:38:13.049780+0000","last_undegraded":"2024-09-12T03:38:13.049780+0000","last_fullsized":"2024-09-12T03:38:13.049780+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:26:03.749756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353285+0000","last_change":"2024-09-12T03:38:11.371359+0000","last_active":"2024-09-12T03:38:12.353285+0000","last_peered":"2024-09-12T03:38:12.353285+0000","last_clean":"2024-09-12T03:38:12.353285+0000","last_became_active":"2024-09-12T03:38:11.370665+0000","last_became_peered":"2024-09-12T03:38:11.370665+0000","last_unstale":"2024-09-12T03:38:12.353285+0000","last_undegraded":"2024-09-12T03:38:12.353285+0000","last_fullsized":"2024-09-12T03:38:12.353285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:27.196459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355538+0000","last_change":"2024-09-12T03:38:11.413014+0000","last_active":"2024-09-12T03:38:12.355538+0000","last_peered":"2024-09-12T03:38:12.355538+0000","last_clean":"2024-09-12T03:38:12.355538+0000","last_became_active":"2024-09-12T03:38:11.412596+0000","last_became_peered":"2024-09-12T03:38:11.412596+0000","last_unstale":"2024-09-12T03:38:12.355538+0000","last_undegraded":"2024-09-12T03:38:12.355538+0000","last_fullsized":"2024-09-12T03:38:12.355538+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:22:53.190009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050262+0000","last_change":"2024-09-12T03:38:11.412827+0000","last_active":"2024-09-12T03:38:13.050262+0000","last_peered":"2024-09-12T03:38:13.050262+0000","last_clean":"2024-09-12T03:38:13.050262+0000","last_became_active":"2024-09-12T03:38:11.412492+0000","last_became_peered":"2024-09-12T03:38:11.412492+0000","last_unstale":"2024-09-12T03:38:13.050262+0000","last_undegraded":"2024-09-12T03:38:13.050262+0000","last_fullsized":"2024-09-12T03:38:13.050262+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:50.506813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049133+0000","last_change":"2024-09-12T03:38:11.379618+0000","last_active":"2024-09-12T03:38:13.049133+0000","last_peered":"2024-09-12T03:38:13.049133+0000","last_clean":"2024-09-12T03:38:13.049133+0000","last_became_active":"2024-09-12T03:38:11.378841+0000","last_became_peered":"2024-09-12T03:38:11.378841+0000","last_unstale":"2024-09-12T03:38:13.049133+0000","last_undegraded":"2024-09-12T03:38:13.049133+0000","last_fullsized":"2024-09-12T03:38:13.049133+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:21.300082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048866+0000","last_change":"2024-09-12T03:38:11.379887+0000","last_active":"2024-09-12T03:38:13.048866+0000","last_peered":"2024-09-12T03:38:13.048866+0000","last_clean":"2024-09-12T03:38:13.048866+0000","last_became_active":"2024-09-12T03:38:11.379102+0000","last_became_peered":"2024-09-12T03:38:11.379102+0000","last_unstale":"2024-09-12T03:38:13.048866+0000","last_undegraded":"2024-09-12T03:38:13.048866+0000","last_fullsized":"2024-09-12T03:38:13.048866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:28.232355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048938+0000","last_change":"2024-09-12T03:38:11.375885+0000","last_active":"2024-09-12T03:38:13.048938+0000","last_peered":"2024-09-12T03:38:13.048938+0000","last_clean":"2024-09-12T03:38:13.048938+0000","last_became_active":"2024-09-12T03:38:11.375504+0000","last_became_peered":"2024-09-12T03:38:11.375504+0000","last_unstale":"2024-09-12T03:38:13.048938+0000","last_undegraded":"2024-09-12T03:38:13.048938+0000","last_fullsized":"2024-09-12T03:38:13.048938+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:09.152739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049739+0000","last_change":"2024-09-12T03:38:11.392573+0000","last_active":"2024-09-12T03:38:13.049739+0000","last_peered":"2024-09-12T03:38:13.049739+0000","last_clean":"2024-09-12T03:38:13.049739+0000","last_became_active":"2024-09-12T03:38:11.387470+0000","last_became_peered":"2024-09-12T03:38:11.387470+0000","last_unstale":"2024-09-12T03:38:13.049739+0000","last_undegraded":"2024-09-12T03:38:13.049739+0000","last_fullsized":"2024-09-12T03:38:13.049739+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:40.578371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051332+0000","last_change":"2024-09-12T03:38:11.378703+0000","last_active":"2024-09-12T03:38:13.051332+0000","last_peered":"2024-09-12T03:38:13.051332+0000","last_clean":"2024-09-12T03:38:13.051332+0000","last_became_active":"2024-09-12T03:38:11.378398+0000","last_became_peered":"2024-09-12T03:38:11.378398+0000","last_unstale":"2024-09-12T03:38:13.051332+0000","last_undegraded":"2024-09-12T03:38:13.051332+0000","last_fullsized":"2024-09-12T03:38:13.051332+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355575+0000","last_change":"2024-09-12T03:38:11.390773+0000","last_active":"2024-09-12T03:38:12.355575+0000","last_peered":"2024-09-12T03:38:12.355575+0000","last_clean":"2024-09-12T03:38:12.355575+0000","last_became_active":"2024-09-12T03:38:11.390033+0000","last_became_peered":"2024-09-12T03:38:11.390033+0000","last_unstale":"2024-09-12T03:38:12.355575+0000","last_undegraded":"2024-09-12T03:38:12.355575+0000","last_fullsized":"2024-09-12T03:38:12.355575+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051483+0000","last_change":"2024-09-12T03:38:11.389551+0000","last_active":"2024-09-12T03:38:13.051483+0000","last_peered":"2024-09-12T03:38:13.051483+0000","last_clean":"2024-09-12T03:38:13.051483+0000","last_became_active":"2024-09-12T03:38:11.382597+0000","last_became_peered":"2024-09-12T03:38:11.382597+0000","last_unstale":"2024-09-12T03:38:13.051483+0000","last_undegraded":"2024-09-12T03:38:13.051483+0000","last_fullsized":"2024-09-12T03:38:13.051483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:48.990741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354540+0000","last_change":"2024-09-12T03:38:11.400083+0000","last_active":"2024-09-12T03:38:12.354540+0000","last_peered":"2024-09-12T03:38:12.354540+0000","last_clean":"2024-09-12T03:38:12.354540+0000","last_became_active":"2024-09-12T03:38:11.399735+0000","last_became_peered":"2024-09-12T03:38:11.399735+0000","last_unstale":"2024-09-12T03:38:12.354540+0000","last_undegraded":"2024-09-12T03:38:12.354540+0000","last_fullsized":"2024-09-12T03:38:12.354540+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048138+0000","last_change":"2024-09-12T03:38:11.382202+0000","last_active":"2024-09-12T03:38:13.048138+0000","last_peered":"2024-09-12T03:38:13.048138+0000","last_clean":"2024-09-12T03:38:13.048138+0000","last_became_active":"2024-09-12T03:38:11.379979+0000","last_became_peered":"2024-09-12T03:38:11.379979+0000","last_unstale":"2024-09-12T03:38:13.048138+0000","last_undegraded":"2024-09-12T03:38:13.048138+0000","last_fullsized":"2024-09-12T03:38:13.048138+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:30.832292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.047934+0000","last_change":"2024-09-12T03:38:11.400513+0000","last_active":"2024-09-12T03:38:13.047934+0000","last_peered":"2024-09-12T03:38:13.047934+0000","last_clean":"2024-09-12T03:38:13.047934+0000","last_became_active":"2024-09-12T03:38:11.399612+0000","last_became_peered":"2024-09-12T03:38:11.399612+0000","last_unstale":"2024-09-12T03:38:13.047934+0000","last_undegraded":"2024-09-12T03:38:13.047934+0000","last_fullsized":"2024-09-12T03:38:13.047934+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:40.716016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.047876+0000","last_change":"2024-09-12T03:38:11.393997+0000","last_active":"2024-09-12T03:38:13.047876+0000","last_peered":"2024-09-12T03:38:13.047876+0000","last_clean":"2024-09-12T03:38:13.047876+0000","last_became_active":"2024-09-12T03:38:11.393283+0000","last_became_peered":"2024-09-12T03:38:11.393283+0000","last_unstale":"2024-09-12T03:38:13.047876+0000","last_undegraded":"2024-09-12T03:38:13.047876+0000","last_fullsized":"2024-09-12T03:38:13.047876+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:15.596728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354048+0000","last_change":"2024-09-12T03:38:11.376308+0000","last_active":"2024-09-12T03:38:12.354048+0000","last_peered":"2024-09-12T03:38:12.354048+0000","last_clean":"2024-09-12T03:38:12.354048+0000","last_became_active":"2024-09-12T03:38:11.372517+0000","last_became_peered":"2024-09-12T03:38:11.372517+0000","last_unstale":"2024-09-12T03:38:12.354048+0000","last_undegraded":"2024-09-12T03:38:12.354048+0000","last_fullsized":"2024-09-12T03:38:12.354048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:00:19.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050171+0000","last_change":"2024-09-12T03:38:11.384169+0000","last_active":"2024-09-12T03:38:13.050171+0000","last_peered":"2024-09-12T03:38:13.050171+0000","last_clean":"2024-09-12T03:38:13.050171+0000","last_became_active":"2024-09-12T03:38:11.379257+0000","last_became_peered":"2024-09-12T03:38:11.379257+0000","last_unstale":"2024-09-12T03:38:13.050171+0000","last_undegraded":"2024-09-12T03:38:13.050171+0000","last_fullsized":"2024-09-12T03:38:13.050171+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:55.149939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353419+0000","last_change":"2024-09-12T03:38:11.378852+0000","last_active":"2024-09-12T03:38:12.353419+0000","last_peered":"2024-09-12T03:38:12.353419+0000","last_clean":"2024-09-12T03:38:12.353419+0000","last_became_active":"2024-09-12T03:38:11.378546+0000","last_became_peered":"2024-09-12T03:38:11.378546+0000","last_unstale":"2024-09-12T03:38:12.353419+0000","last_undegraded":"2024-09-12T03:38:12.353419+0000","last_fullsized":"2024-09-12T03:38:12.353419+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:25.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051698+0000","last_change":"2024-09-12T03:38:11.375988+0000","last_active":"2024-09-12T03:38:13.051698+0000","last_peered":"2024-09-12T03:38:13.051698+0000","last_clean":"2024-09-12T03:38:13.051698+0000","last_became_active":"2024-09-12T03:38:11.375260+0000","last_became_peered":"2024-09-12T03:38:11.375260+0000","last_unstale":"2024-09-12T03:38:13.051698+0000","last_undegraded":"2024-09-12T03:38:13.051698+0000","last_fullsized":"2024-09-12T03:38:13.051698+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:50.506813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050355+0000","last_change":"2024-09-12T03:38:11.388685+0000","last_active":"2024-09-12T03:38:13.050355+0000","last_peered":"2024-09-12T03:38:13.050355+0000","last_clean":"2024-09-12T03:38:13.050355+0000","last_became_active":"2024-09-12T03:38:11.388328+0000","last_became_peered":"2024-09-12T03:38:11.388328+0000","last_unstale":"2024-09-12T03:38:13.050355+0000","last_undegraded":"2024-09-12T03:38:13.050355+0000","last_fullsized":"2024-09-12T03:38:13.050355+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:38:24.316924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049052+0000","last_change":"2024-09-12T03:38:11.399867+0000","last_active":"2024-09-12T03:38:13.049052+0000","last_peered":"2024-09-12T03:38:13.049052+0000","last_clean":"2024-09-12T03:38:13.049052+0000","last_became_active":"2024-09-12T03:38:11.399587+0000","last_became_peered":"2024-09-12T03:38:11.399587+0000","last_unstale":"2024-09-12T03:38:13.049052+0000","last_undegraded":"2024-09-12T03:38:13.049052+0000","last_fullsized":"2024-09-12T03:38:13.049052+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:22.065181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354177+0000","last_change":"2024-09-12T03:38:11.361911+0000","last_active":"2024-09-12T03:38:12.354177+0000","last_peered":"2024-09-12T03:38:12.354177+0000","last_clean":"2024-09-12T03:38:12.354177+0000","last_became_active":"2024-09-12T03:38:11.361119+0000","last_became_peered":"2024-09-12T03:38:11.361119+0000","last_unstale":"2024-09-12T03:38:12.354177+0000","last_undegraded":"2024-09-12T03:38:12.354177+0000","last_fullsized":"2024-09-12T03:38:12.354177+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:08:57.066228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048494+0000","last_change":"2024-09-12T03:38:11.368565+0000","last_active":"2024-09-12T03:38:13.048494+0000","last_peered":"2024-09-12T03:38:13.048494+0000","last_clean":"2024-09-12T03:38:13.048494+0000","last_became_active":"2024-09-12T03:38:11.367075+0000","last_became_peered":"2024-09-12T03:38:11.367075+0000","last_unstale":"2024-09-12T03:38:13.048494+0000","last_undegraded":"2024-09-12T03:38:13.048494+0000","last_fullsized":"2024-09-12T03:38:13.048494+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:12.072861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051886+0000","last_change":"2024-09-12T03:38:11.373854+0000","last_active":"2024-09-12T03:38:13.051886+0000","last_peered":"2024-09-12T03:38:13.051886+0000","last_clean":"2024-09-12T03:38:13.051886+0000","last_became_active":"2024-09-12T03:38:11.372933+0000","last_became_peered":"2024-09-12T03:38:11.372933+0000","last_unstale":"2024-09-12T03:38:13.051886+0000","last_undegraded":"2024-09-12T03:38:13.051886+0000","last_fullsized":"2024-09-12T03:38:13.051886+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051864+0000","last_change":"2024-09-12T03:38:11.378651+0000","last_active":"2024-09-12T03:38:13.051864+0000","last_peered":"2024-09-12T03:38:13.051864+0000","last_clean":"2024-09-12T03:38:13.051864+0000","last_became_active":"2024-09-12T03:38:11.377912+0000","last_became_peered":"2024-09-12T03:38:11.377912+0000","last_unstale":"2024-09-12T03:38:13.051864+0000","last_undegraded":"2024-09-12T03:38:13.051864+0000","last_fullsized":"2024-09-12T03:38:13.051864+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355613+0000","last_change":"2024-09-12T03:38:11.403022+0000","last_active":"2024-09-12T03:38:12.355613+0000","last_peered":"2024-09-12T03:38:12.355613+0000","last_clean":"2024-09-12T03:38:12.355613+0000","last_became_active":"2024-09-12T03:38:11.402440+0000","last_became_peered":"2024-09-12T03:38:11.402440+0000","last_unstale":"2024-09-12T03:38:12.355613+0000","last_undegraded":"2024-09-12T03:38:12.355613+0000","last_fullsized":"2024-09-12T03:38:12.355613+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050416+0000","last_change":"2024-09-12T03:38:11.396719+0000","last_active":"2024-09-12T03:38:13.050416+0000","last_peered":"2024-09-12T03:38:13.050416+0000","last_clean":"2024-09-12T03:38:13.050416+0000","last_became_active":"2024-09-12T03:38:11.396036+0000","last_became_peered":"2024-09-12T03:38:11.396036+0000","last_unstale":"2024-09-12T03:38:13.050416+0000","last_undegraded":"2024-09-12T03:38:13.050416+0000","last_fullsized":"2024-09-12T03:38:13.050416+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:42.754775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050558+0000","last_change":"2024-09-12T03:38:11.386723+0000","last_active":"2024-09-12T03:38:13.050558+0000","last_peered":"2024-09-12T03:38:13.050558+0000","last_clean":"2024-09-12T03:38:13.050558+0000","last_became_active":"2024-09-12T03:38:11.386276+0000","last_became_peered":"2024-09-12T03:38:11.386276+0000","last_unstale":"2024-09-12T03:38:13.050558+0000","last_undegraded":"2024-09-12T03:38:13.050558+0000","last_fullsized":"2024-09-12T03:38:13.050558+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:24.947748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049780+0000","last_change":"2024-09-12T03:38:11.373029+0000","last_active":"2024-09-12T03:38:13.049780+0000","last_peered":"2024-09-12T03:38:13.049780+0000","last_clean":"2024-09-12T03:38:13.049780+0000","last_became_active":"2024-09-12T03:38:11.372027+0000","last_became_peered":"2024-09-12T03:38:11.372027+0000","last_unstale":"2024-09-12T03:38:13.049780+0000","last_undegraded":"2024-09-12T03:38:13.049780+0000","last_fullsized":"2024-09-12T03:38:13.049780+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:47.115952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049267+0000","last_change":"2024-09-12T03:38:11.396412+0000","last_active":"2024-09-12T03:38:13.049267+0000","last_peered":"2024-09-12T03:38:13.049267+0000","last_clean":"2024-09-12T03:38:13.049267+0000","last_became_active":"2024-09-12T03:38:11.395717+0000","last_became_peered":"2024-09-12T03:38:11.395717+0000","last_unstale":"2024-09-12T03:38:13.049267+0000","last_undegraded":"2024-09-12T03:38:13.049267+0000","last_fullsized":"2024-09-12T03:38:13.049267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:50:03.504514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049331+0000","last_change":"2024-09-12T03:38:11.412866+0000","last_active":"2024-09-12T03:38:13.049331+0000","last_peered":"2024-09-12T03:38:13.049331+0000","last_clean":"2024-09-12T03:38:13.049331+0000","last_became_active":"2024-09-12T03:38:11.412507+0000","last_became_peered":"2024-09-12T03:38:11.412507+0000","last_unstale":"2024-09-12T03:38:13.049331+0000","last_undegraded":"2024-09-12T03:38:13.049331+0000","last_fullsized":"2024-09-12T03:38:13.049331+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:30.723083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353830+0000","last_change":"2024-09-12T03:38:11.383601+0000","last_active":"2024-09-12T03:38:12.353830+0000","last_peered":"2024-09-12T03:38:12.353830+0000","last_clean":"2024-09-12T03:38:12.353830+0000","last_became_active":"2024-09-12T03:38:11.381975+0000","last_became_peered":"2024-09-12T03:38:11.381975+0000","last_unstale":"2024-09-12T03:38:12.353830+0000","last_undegraded":"2024-09-12T03:38:12.353830+0000","last_fullsized":"2024-09-12T03:38:12.353830+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:14.464665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356288+0000","last_change":"2024-09-12T03:38:10.386396+0000","last_active":"2024-09-12T03:38:12.356288+0000","last_peered":"2024-09-12T03:38:12.356288+0000","last_clean":"2024-09-12T03:38:12.356288+0000","last_became_active":"2024-09-12T03:38:10.386049+0000","last_became_peered":"2024-09-12T03:38:10.386049+0000","last_unstale":"2024-09-12T03:38:12.356288+0000","last_undegraded":"2024-09-12T03:38:12.356288+0000","last_fullsized":"2024-09-12T03:38:12.356288+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.120769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049378+0000","last_change":"2024-09-12T03:38:11.382219+0000","last_active":"2024-09-12T03:38:13.049378+0000","last_peered":"2024-09-12T03:38:13.049378+0000","last_clean":"2024-09-12T03:38:13.049378+0000","last_became_active":"2024-09-12T03:38:11.381850+0000","last_became_peered":"2024-09-12T03:38:11.381850+0000","last_unstale":"2024-09-12T03:38:13.049378+0000","last_undegraded":"2024-09-12T03:38:13.049378+0000","last_fullsized":"2024-09-12T03:38:13.049378+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:07.662989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049456+0000","last_change":"2024-09-12T03:38:10.372155+0000","last_active":"2024-09-12T03:38:13.049456+0000","last_peered":"2024-09-12T03:38:13.049456+0000","last_clean":"2024-09-12T03:38:13.049456+0000","last_became_active":"2024-09-12T03:38:10.371286+0000","last_became_peered":"2024-09-12T03:38:10.371286+0000","last_unstale":"2024-09-12T03:38:13.049456+0000","last_undegraded":"2024-09-12T03:38:13.049456+0000","last_fullsized":"2024-09-12T03:38:13.049456+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:24.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050165+0000","last_change":"2024-09-12T03:38:11.379955+0000","last_active":"2024-09-12T03:38:13.050165+0000","last_peered":"2024-09-12T03:38:13.050165+0000","last_clean":"2024-09-12T03:38:13.050165+0000","last_became_active":"2024-09-12T03:38:11.379266+0000","last_became_peered":"2024-09-12T03:38:11.379266+0000","last_unstale":"2024-09-12T03:38:13.050165+0000","last_undegraded":"2024-09-12T03:38:13.050165+0000","last_fullsized":"2024-09-12T03:38:13.050165+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:22.065181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051452+0000","last_change":"2024-09-12T03:38:10.396126+0000","last_active":"2024-09-12T03:38:13.051452+0000","last_peered":"2024-09-12T03:38:13.051452+0000","last_clean":"2024-09-12T03:38:13.051452+0000","last_became_active":"2024-09-12T03:38:10.391204+0000","last_became_peered":"2024-09-12T03:38:10.391204+0000","last_unstale":"2024-09-12T03:38:13.051452+0000","last_undegraded":"2024-09-12T03:38:13.051452+0000","last_fullsized":"2024-09-12T03:38:13.051452+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354859+0000","last_change":"2024-09-12T03:38:11.390529+0000","last_active":"2024-09-12T03:38:12.354859+0000","last_peered":"2024-09-12T03:38:12.354859+0000","last_clean":"2024-09-12T03:38:12.354859+0000","last_became_active":"2024-09-12T03:38:11.389787+0000","last_became_peered":"2024-09-12T03:38:11.389787+0000","last_unstale":"2024-09-12T03:38:12.354859+0000","last_undegraded":"2024-09-12T03:38:12.354859+0000","last_fullsized":"2024-09-12T03:38:12.354859+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051019+0000","last_change":"2024-09-12T03:38:10.393267+0000","last_active":"2024-09-12T03:38:13.051019+0000","last_peered":"2024-09-12T03:38:13.051019+0000","last_clean":"2024-09-12T03:38:13.051019+0000","last_became_active":"2024-09-12T03:38:10.392994+0000","last_became_peered":"2024-09-12T03:38:10.392994+0000","last_unstale":"2024-09-12T03:38:13.051019+0000","last_undegraded":"2024-09-12T03:38:13.051019+0000","last_fullsized":"2024-09-12T03:38:13.051019+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355465+0000","last_change":"2024-09-12T03:38:11.377861+0000","last_active":"2024-09-12T03:38:12.355465+0000","last_peered":"2024-09-12T03:38:12.355465+0000","last_clean":"2024-09-12T03:38:12.355465+0000","last_became_active":"2024-09-12T03:38:11.377511+0000","last_became_peered":"2024-09-12T03:38:11.377511+0000","last_unstale":"2024-09-12T03:38:12.355465+0000","last_undegraded":"2024-09-12T03:38:12.355465+0000","last_fullsized":"2024-09-12T03:38:12.355465+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048731+0000","last_change":"2024-09-12T03:38:10.386519+0000","last_active":"2024-09-12T03:38:13.048731+0000","last_peered":"2024-09-12T03:38:13.048731+0000","last_clean":"2024-09-12T03:38:13.048731+0000","last_became_active":"2024-09-12T03:38:10.385746+0000","last_became_peered":"2024-09-12T03:38:10.385746+0000","last_unstale":"2024-09-12T03:38:13.048731+0000","last_undegraded":"2024-09-12T03:38:13.048731+0000","last_fullsized":"2024-09-12T03:38:13.048731+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:47.841147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353683+0000","last_change":"2024-09-12T03:38:11.378856+0000","last_active":"2024-09-12T03:38:12.353683+0000","last_peered":"2024-09-12T03:38:12.353683+0000","last_clean":"2024-09-12T03:38:12.353683+0000","last_became_active":"2024-09-12T03:38:11.378491+0000","last_became_peered":"2024-09-12T03:38:11.378491+0000","last_unstale":"2024-09-12T03:38:12.353683+0000","last_undegraded":"2024-09-12T03:38:12.353683+0000","last_fullsized":"2024-09-12T03:38:12.353683+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:53.501014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354371+0000","last_change":"2024-09-12T03:38:10.394181+0000","last_active":"2024-09-12T03:38:12.354371+0000","last_peered":"2024-09-12T03:38:12.354371+0000","last_clean":"2024-09-12T03:38:12.354371+0000","last_became_active":"2024-09-12T03:38:10.393438+0000","last_became_peered":"2024-09-12T03:38:10.393438+0000","last_unstale":"2024-09-12T03:38:12.354371+0000","last_undegraded":"2024-09-12T03:38:12.354371+0000","last_fullsized":"2024-09-12T03:38:12.354371+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:59.138777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050611+0000","last_change":"2024-09-12T03:38:11.394463+0000","last_active":"2024-09-12T03:38:13.050611+0000","last_peered":"2024-09-12T03:38:13.050611+0000","last_clean":"2024-09-12T03:38:13.050611+0000","last_became_active":"2024-09-12T03:38:11.393809+0000","last_became_peered":"2024-09-12T03:38:11.393809+0000","last_unstale":"2024-09-12T03:38:13.050611+0000","last_undegraded":"2024-09-12T03:38:13.050611+0000","last_fullsized":"2024-09-12T03:38:13.050611+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:21.531978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050624+0000","last_change":"2024-09-12T03:38:10.386837+0000","last_active":"2024-09-12T03:38:13.050624+0000","last_peered":"2024-09-12T03:38:13.050624+0000","last_clean":"2024-09-12T03:38:13.050624+0000","last_became_active":"2024-09-12T03:38:10.382683+0000","last_became_peered":"2024-09-12T03:38:10.382683+0000","last_unstale":"2024-09-12T03:38:13.050624+0000","last_undegraded":"2024-09-12T03:38:13.050624+0000","last_fullsized":"2024-09-12T03:38:13.050624+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.356272+0000","last_change":"2024-09-12T03:38:11.387150+0000","last_active":"2024-09-12T03:38:12.356272+0000","last_peered":"2024-09-12T03:38:12.356272+0000","last_clean":"2024-09-12T03:38:12.356272+0000","last_became_active":"2024-09-12T03:38:11.386913+0000","last_became_peered":"2024-09-12T03:38:11.386913+0000","last_unstale":"2024-09-12T03:38:12.356272+0000","last_undegraded":"2024-09-12T03:38:12.356272+0000","last_fullsized":"2024-09-12T03:38:12.356272+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:32.729366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353698+0000","last_change":"2024-09-12T03:38:10.380693+0000","last_active":"2024-09-12T03:38:12.353698+0000","last_peered":"2024-09-12T03:38:12.353698+0000","last_clean":"2024-09-12T03:38:12.353698+0000","last_became_active":"2024-09-12T03:38:10.380423+0000","last_became_peered":"2024-09-12T03:38:10.380423+0000","last_unstale":"2024-09-12T03:38:12.353698+0000","last_undegraded":"2024-09-12T03:38:12.353698+0000","last_fullsized":"2024-09-12T03:38:12.353698+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353471+0000","last_change":"2024-09-12T03:38:11.383029+0000","last_active":"2024-09-12T03:38:12.353471+0000","last_peered":"2024-09-12T03:38:12.353471+0000","last_clean":"2024-09-12T03:38:12.353471+0000","last_became_active":"2024-09-12T03:38:11.382716+0000","last_became_peered":"2024-09-12T03:38:11.382716+0000","last_unstale":"2024-09-12T03:38:12.353471+0000","last_undegraded":"2024-09-12T03:38:12.353471+0000","last_fullsized":"2024-09-12T03:38:12.353471+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:12.353649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051761+0000","last_change":"2024-09-12T03:38:10.386626+0000","last_active":"2024-09-12T03:38:13.051761+0000","last_peered":"2024-09-12T03:38:13.051761+0000","last_clean":"2024-09-12T03:38:13.051761+0000","last_became_active":"2024-09-12T03:38:10.382526+0000","last_became_peered":"2024-09-12T03:38:10.382526+0000","last_unstale":"2024-09-12T03:38:13.051761+0000","last_undegraded":"2024-09-12T03:38:13.051761+0000","last_fullsized":"2024-09-12T03:38:13.051761+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048594+0000","last_change":"2024-09-12T03:38:11.374433+0000","last_active":"2024-09-12T03:38:13.048594+0000","last_peered":"2024-09-12T03:38:13.048594+0000","last_clean":"2024-09-12T03:38:13.048594+0000","last_became_active":"2024-09-12T03:38:11.374104+0000","last_became_peered":"2024-09-12T03:38:11.374104+0000","last_unstale":"2024-09-12T03:38:13.048594+0000","last_undegraded":"2024-09-12T03:38:13.048594+0000","last_fullsized":"2024-09-12T03:38:13.048594+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:47.115952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.352779+0000","last_change":"2024-09-12T03:38:10.393712+0000","last_active":"2024-09-12T03:38:12.352779+0000","last_peered":"2024-09-12T03:38:12.352779+0000","last_clean":"2024-09-12T03:38:12.352779+0000","last_became_active":"2024-09-12T03:38:10.393273+0000","last_became_peered":"2024-09-12T03:38:10.393273+0000","last_unstale":"2024-09-12T03:38:12.352779+0000","last_undegraded":"2024-09-12T03:38:12.352779+0000","last_fullsized":"2024-09-12T03:38:12.352779+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:05.983923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049793+0000","last_change":"2024-09-12T03:38:11.376141+0000","last_active":"2024-09-12T03:38:13.049793+0000","last_peered":"2024-09-12T03:38:13.049793+0000","last_clean":"2024-09-12T03:38:13.049793+0000","last_became_active":"2024-09-12T03:38:11.375589+0000","last_became_peered":"2024-09-12T03:38:11.375589+0000","last_unstale":"2024-09-12T03:38:13.049793+0000","last_undegraded":"2024-09-12T03:38:13.049793+0000","last_fullsized":"2024-09-12T03:38:13.049793+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:50.074995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"97'3","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048908+0000","last_change":"2024-09-12T03:38:10.377052+0000","last_active":"2024-09-12T03:38:13.048908+0000","last_peered":"2024-09-12T03:38:13.048908+0000","last_clean":"2024-09-12T03:38:13.048908+0000","last_became_active":"2024-09-12T03:38:10.376406+0000","last_became_peered":"2024-09-12T03:38:10.376406+0000","last_unstale":"2024-09-12T03:38:13.048908+0000","last_undegraded":"2024-09-12T03:38:13.048908+0000","last_fullsized":"2024-09-12T03:38:13.048908+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:06.325275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050466+0000","last_change":"2024-09-12T03:38:11.373470+0000","last_active":"2024-09-12T03:38:13.050466+0000","last_peered":"2024-09-12T03:38:13.050466+0000","last_clean":"2024-09-12T03:38:13.050466+0000","last_became_active":"2024-09-12T03:38:11.369749+0000","last_became_peered":"2024-09-12T03:38:11.369749+0000","last_unstale":"2024-09-12T03:38:13.050466+0000","last_undegraded":"2024-09-12T03:38:13.050466+0000","last_fullsized":"2024-09-12T03:38:13.050466+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:48.845679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"97'6","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050805+0000","last_change":"2024-09-12T03:38:10.390735+0000","last_active":"2024-09-12T03:38:13.050805+0000","last_peered":"2024-09-12T03:38:13.050805+0000","last_clean":"2024-09-12T03:38:13.050805+0000","last_became_active":"2024-09-12T03:38:10.389748+0000","last_became_peered":"2024-09-12T03:38:10.389748+0000","last_unstale":"2024-09-12T03:38:13.050805+0000","last_undegraded":"2024-09-12T03:38:13.050805+0000","last_fullsized":"2024-09-12T03:38:13.050805+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:13.400821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354800+0000","last_change":"2024-09-12T03:38:11.389078+0000","last_active":"2024-09-12T03:38:12.354800+0000","last_peered":"2024-09-12T03:38:12.354800+0000","last_clean":"2024-09-12T03:38:12.354800+0000","last_became_active":"2024-09-12T03:38:11.388369+0000","last_became_peered":"2024-09-12T03:38:11.388369+0000","last_unstale":"2024-09-12T03:38:12.354800+0000","last_undegraded":"2024-09-12T03:38:12.354800+0000","last_fullsized":"2024-09-12T03:38:12.354800+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:50.506813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050513+0000","last_change":"2024-09-12T03:38:10.378214+0000","last_active":"2024-09-12T03:38:13.050513+0000","last_peered":"2024-09-12T03:38:13.050513+0000","last_clean":"2024-09-12T03:38:13.050513+0000","last_became_active":"2024-09-12T03:38:10.377904+0000","last_became_peered":"2024-09-12T03:38:10.377904+0000","last_unstale":"2024-09-12T03:38:13.050513+0000","last_undegraded":"2024-09-12T03:38:13.050513+0000","last_fullsized":"2024-09-12T03:38:13.050513+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:23.393315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050168+0000","last_change":"2024-09-12T03:38:11.377868+0000","last_active":"2024-09-12T03:38:13.050168+0000","last_peered":"2024-09-12T03:38:13.050168+0000","last_clean":"2024-09-12T03:38:13.050168+0000","last_became_active":"2024-09-12T03:38:11.377082+0000","last_became_peered":"2024-09-12T03:38:11.377082+0000","last_unstale":"2024-09-12T03:38:13.050168+0000","last_undegraded":"2024-09-12T03:38:13.050168+0000","last_fullsized":"2024-09-12T03:38:13.050168+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:07:19.362686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354576+0000","last_change":"2024-09-12T03:38:10.374595+0000","last_active":"2024-09-12T03:38:12.354576+0000","last_peered":"2024-09-12T03:38:12.354576+0000","last_clean":"2024-09-12T03:38:12.354576+0000","last_became_active":"2024-09-12T03:38:10.374184+0000","last_became_peered":"2024-09-12T03:38:10.374184+0000","last_unstale":"2024-09-12T03:38:12.354576+0000","last_undegraded":"2024-09-12T03:38:12.354576+0000","last_fullsized":"2024-09-12T03:38:12.354576+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:09.966450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049087+0000","last_change":"2024-09-12T03:38:11.413754+0000","last_active":"2024-09-12T03:38:13.049087+0000","last_peered":"2024-09-12T03:38:13.049087+0000","last_clean":"2024-09-12T03:38:13.049087+0000","last_became_active":"2024-09-12T03:38:11.413457+0000","last_became_peered":"2024-09-12T03:38:11.413457+0000","last_unstale":"2024-09-12T03:38:13.049087+0000","last_undegraded":"2024-09-12T03:38:13.049087+0000","last_fullsized":"2024-09-12T03:38:13.049087+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:36.521588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049420+0000","last_change":"2024-09-12T03:38:10.397284+0000","last_active":"2024-09-12T03:38:13.049420+0000","last_peered":"2024-09-12T03:38:13.049420+0000","last_clean":"2024-09-12T03:38:13.049420+0000","last_became_active":"2024-09-12T03:38:10.397035+0000","last_became_peered":"2024-09-12T03:38:10.397035+0000","last_unstale":"2024-09-12T03:38:13.049420+0000","last_undegraded":"2024-09-12T03:38:13.049420+0000","last_fullsized":"2024-09-12T03:38:13.049420+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:01.920319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354188+0000","last_change":"2024-09-12T03:38:11.377239+0000","last_active":"2024-09-12T03:38:12.354188+0000","last_peered":"2024-09-12T03:38:12.354188+0000","last_clean":"2024-09-12T03:38:12.354188+0000","last_became_active":"2024-09-12T03:38:11.373504+0000","last_became_peered":"2024-09-12T03:38:11.373504+0000","last_unstale":"2024-09-12T03:38:12.354188+0000","last_undegraded":"2024-09-12T03:38:12.354188+0000","last_fullsized":"2024-09-12T03:38:12.354188+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:42.442682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"97'8","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048389+0000","last_change":"2024-09-12T03:38:10.396181+0000","last_active":"2024-09-12T03:38:13.048389+0000","last_peered":"2024-09-12T03:38:13.048389+0000","last_clean":"2024-09-12T03:38:13.048389+0000","last_became_active":"2024-09-12T03:38:10.391810+0000","last_became_peered":"2024-09-12T03:38:10.391810+0000","last_unstale":"2024-09-12T03:38:13.048389+0000","last_undegraded":"2024-09-12T03:38:13.048389+0000","last_fullsized":"2024-09-12T03:38:13.048389+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:25.457204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049704+0000","last_change":"2024-09-12T03:38:11.386951+0000","last_active":"2024-09-12T03:38:13.049704+0000","last_peered":"2024-09-12T03:38:13.049704+0000","last_clean":"2024-09-12T03:38:13.049704+0000","last_became_active":"2024-09-12T03:38:11.386626+0000","last_became_peered":"2024-09-12T03:38:11.386626+0000","last_unstale":"2024-09-12T03:38:13.049704+0000","last_undegraded":"2024-09-12T03:38:13.049704+0000","last_fullsized":"2024-09-12T03:38:13.049704+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:19.843152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049995+0000","last_change":"2024-09-12T03:38:10.399566+0000","last_active":"2024-09-12T03:38:13.049995+0000","last_peered":"2024-09-12T03:38:13.049995+0000","last_clean":"2024-09-12T03:38:13.049995+0000","last_became_active":"2024-09-12T03:38:10.398778+0000","last_became_peered":"2024-09-12T03:38:10.398778+0000","last_unstale":"2024-09-12T03:38:13.049995+0000","last_undegraded":"2024-09-12T03:38:13.049995+0000","last_fullsized":"2024-09-12T03:38:13.049995+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:12:35.197401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050668+0000","last_change":"2024-09-12T03:38:11.393699+0000","last_active":"2024-09-12T03:38:13.050668+0000","last_peered":"2024-09-12T03:38:13.050668+0000","last_clean":"2024-09-12T03:38:13.050668+0000","last_became_active":"2024-09-12T03:38:11.387420+0000","last_became_peered":"2024-09-12T03:38:11.387420+0000","last_unstale":"2024-09-12T03:38:13.050668+0000","last_undegraded":"2024-09-12T03:38:13.050668+0000","last_fullsized":"2024-09-12T03:38:13.050668+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:19.710836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049062+0000","last_change":"2024-09-12T03:38:10.394211+0000","last_active":"2024-09-12T03:38:13.049062+0000","last_peered":"2024-09-12T03:38:13.049062+0000","last_clean":"2024-09-12T03:38:13.049062+0000","last_became_active":"2024-09-12T03:38:10.393408+0000","last_became_peered":"2024-09-12T03:38:10.393408+0000","last_unstale":"2024-09-12T03:38:13.049062+0000","last_undegraded":"2024-09-12T03:38:13.049062+0000","last_fullsized":"2024-09-12T03:38:13.049062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:21.318043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050245+0000","last_change":"2024-09-12T03:38:11.375483+0000","last_active":"2024-09-12T03:38:13.050245+0000","last_peered":"2024-09-12T03:38:13.050245+0000","last_clean":"2024-09-12T03:38:13.050245+0000","last_became_active":"2024-09-12T03:38:11.375033+0000","last_became_peered":"2024-09-12T03:38:11.375033+0000","last_unstale":"2024-09-12T03:38:13.050245+0000","last_undegraded":"2024-09-12T03:38:13.050245+0000","last_fullsized":"2024-09-12T03:38:13.050245+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:48.990741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355071+0000","last_change":"2024-09-12T03:38:10.387509+0000","last_active":"2024-09-12T03:38:12.355071+0000","last_peered":"2024-09-12T03:38:12.355071+0000","last_clean":"2024-09-12T03:38:12.355071+0000","last_became_active":"2024-09-12T03:38:10.386787+0000","last_became_peered":"2024-09-12T03:38:10.386787+0000","last_unstale":"2024-09-12T03:38:12.355071+0000","last_undegraded":"2024-09-12T03:38:12.355071+0000","last_fullsized":"2024-09-12T03:38:12.355071+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:03.133398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353059+0000","last_change":"2024-09-12T03:38:11.377338+0000","last_active":"2024-09-12T03:38:12.353059+0000","last_peered":"2024-09-12T03:38:12.353059+0000","last_clean":"2024-09-12T03:38:12.353059+0000","last_became_active":"2024-09-12T03:38:11.376959+0000","last_became_peered":"2024-09-12T03:38:11.376959+0000","last_unstale":"2024-09-12T03:38:12.353059+0000","last_undegraded":"2024-09-12T03:38:12.353059+0000","last_fullsized":"2024-09-12T03:38:12.353059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:09.482818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050688+0000","last_change":"2024-09-12T03:38:10.371802+0000","last_active":"2024-09-12T03:38:13.050688+0000","last_peered":"2024-09-12T03:38:13.050688+0000","last_clean":"2024-09-12T03:38:13.050688+0000","last_became_active":"2024-09-12T03:38:10.371392+0000","last_became_peered":"2024-09-12T03:38:10.371392+0000","last_unstale":"2024-09-12T03:38:13.050688+0000","last_undegraded":"2024-09-12T03:38:13.050688+0000","last_fullsized":"2024-09-12T03:38:13.050688+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:45.146362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353550+0000","last_change":"2024-09-12T03:38:11.369326+0000","last_active":"2024-09-12T03:38:12.353550+0000","last_peered":"2024-09-12T03:38:12.353550+0000","last_clean":"2024-09-12T03:38:12.353550+0000","last_became_active":"2024-09-12T03:38:11.368764+0000","last_became_peered":"2024-09-12T03:38:11.368764+0000","last_unstale":"2024-09-12T03:38:12.353550+0000","last_undegraded":"2024-09-12T03:38:12.353550+0000","last_fullsized":"2024-09-12T03:38:12.353550+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:26.615641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049566+0000","last_change":"2024-09-12T03:38:10.371718+0000","last_active":"2024-09-12T03:38:13.049566+0000","last_peered":"2024-09-12T03:38:13.049566+0000","last_clean":"2024-09-12T03:38:13.049566+0000","last_became_active":"2024-09-12T03:38:10.371419+0000","last_became_peered":"2024-09-12T03:38:10.371419+0000","last_unstale":"2024-09-12T03:38:13.049566+0000","last_undegraded":"2024-09-12T03:38:13.049566+0000","last_fullsized":"2024-09-12T03:38:13.049566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:55.819443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355100+0000","last_change":"2024-09-12T03:38:11.401115+0000","last_active":"2024-09-12T03:38:12.355100+0000","last_peered":"2024-09-12T03:38:12.355100+0000","last_clean":"2024-09-12T03:38:12.355100+0000","last_became_active":"2024-09-12T03:38:11.400866+0000","last_became_peered":"2024-09-12T03:38:11.400866+0000","last_unstale":"2024-09-12T03:38:12.355100+0000","last_undegraded":"2024-09-12T03:38:12.355100+0000","last_fullsized":"2024-09-12T03:38:12.355100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:22.322576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051124+0000","last_change":"2024-09-12T03:38:10.400711+0000","last_active":"2024-09-12T03:38:13.051124+0000","last_peered":"2024-09-12T03:38:13.051124+0000","last_clean":"2024-09-12T03:38:13.051124+0000","last_became_active":"2024-09-12T03:38:10.399905+0000","last_became_peered":"2024-09-12T03:38:10.399905+0000","last_unstale":"2024-09-12T03:38:13.051124+0000","last_undegraded":"2024-09-12T03:38:13.051124+0000","last_fullsized":"2024-09-12T03:38:13.051124+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:32.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050871+0000","last_change":"2024-09-12T03:38:11.381737+0000","last_active":"2024-09-12T03:38:13.050871+0000","last_peered":"2024-09-12T03:38:13.050871+0000","last_clean":"2024-09-12T03:38:13.050871+0000","last_became_active":"2024-09-12T03:38:11.381350+0000","last_became_peered":"2024-09-12T03:38:11.381350+0000","last_unstale":"2024-09-12T03:38:13.050871+0000","last_undegraded":"2024-09-12T03:38:13.050871+0000","last_fullsized":"2024-09-12T03:38:13.050871+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:21:05.528964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049837+0000","last_change":"2024-09-12T03:38:10.372995+0000","last_active":"2024-09-12T03:38:13.049837+0000","last_peered":"2024-09-12T03:38:13.049837+0000","last_clean":"2024-09-12T03:38:13.049837+0000","last_became_active":"2024-09-12T03:38:10.372390+0000","last_became_peered":"2024-09-12T03:38:10.372390+0000","last_unstale":"2024-09-12T03:38:13.049837+0000","last_undegraded":"2024-09-12T03:38:13.049837+0000","last_fullsized":"2024-09-12T03:38:13.049837+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:37.755261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353104+0000","last_change":"2024-09-12T03:38:11.382260+0000","last_active":"2024-09-12T03:38:12.353104+0000","last_peered":"2024-09-12T03:38:12.353104+0000","last_clean":"2024-09-12T03:38:12.353104+0000","last_became_active":"2024-09-12T03:38:11.375057+0000","last_became_peered":"2024-09-12T03:38:11.375057+0000","last_unstale":"2024-09-12T03:38:12.353104+0000","last_undegraded":"2024-09-12T03:38:12.353104+0000","last_fullsized":"2024-09-12T03:38:12.353104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:44.110319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051296+0000","last_change":"2024-09-12T03:38:10.378023+0000","last_active":"2024-09-12T03:38:13.051296+0000","last_peered":"2024-09-12T03:38:13.051296+0000","last_clean":"2024-09-12T03:38:13.051296+0000","last_became_active":"2024-09-12T03:38:10.377276+0000","last_became_peered":"2024-09-12T03:38:10.377276+0000","last_unstale":"2024-09-12T03:38:13.051296+0000","last_undegraded":"2024-09-12T03:38:13.051296+0000","last_fullsized":"2024-09-12T03:38:13.051296+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:17.335224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048381+0000","last_change":"2024-09-12T03:38:11.381329+0000","last_active":"2024-09-12T03:38:13.048381+0000","last_peered":"2024-09-12T03:38:13.048381+0000","last_clean":"2024-09-12T03:38:13.048381+0000","last_became_active":"2024-09-12T03:38:11.380636+0000","last_became_peered":"2024-09-12T03:38:11.380636+0000","last_unstale":"2024-09-12T03:38:13.048381+0000","last_undegraded":"2024-09-12T03:38:13.048381+0000","last_fullsized":"2024-09-12T03:38:13.048381+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:12.072861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"98'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.353169+0000","last_change":"2024-09-12T03:38:10.381935+0000","last_active":"2024-09-12T03:38:12.353169+0000","last_peered":"2024-09-12T03:38:12.353169+0000","last_clean":"2024-09-12T03:38:12.353169+0000","last_became_active":"2024-09-12T03:38:10.381501+0000","last_became_peered":"2024-09-12T03:38:10.381501+0000","last_unstale":"2024-09-12T03:38:12.353169+0000","last_undegraded":"2024-09-12T03:38:12.353169+0000","last_fullsized":"2024-09-12T03:38:12.353169+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:56:47.397926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354781+0000","last_change":"2024-09-12T03:38:11.380067+0000","last_active":"2024-09-12T03:38:12.354781+0000","last_peered":"2024-09-12T03:38:12.354781+0000","last_clean":"2024-09-12T03:38:12.354781+0000","last_became_active":"2024-09-12T03:38:11.379715+0000","last_became_peered":"2024-09-12T03:38:11.379715+0000","last_unstale":"2024-09-12T03:38:12.354781+0000","last_undegraded":"2024-09-12T03:38:12.354781+0000","last_fullsized":"2024-09-12T03:38:12.354781+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:07.329807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.050422+0000","last_change":"2024-09-12T03:38:10.398220+0000","last_active":"2024-09-12T03:38:13.050422+0000","last_peered":"2024-09-12T03:38:13.050422+0000","last_clean":"2024-09-12T03:38:13.050422+0000","last_became_active":"2024-09-12T03:38:10.390272+0000","last_became_peered":"2024-09-12T03:38:10.390272+0000","last_unstale":"2024-09-12T03:38:13.050422+0000","last_undegraded":"2024-09-12T03:38:13.050422+0000","last_fullsized":"2024-09-12T03:38:13.050422+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:07.384819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354667+0000","last_change":"2024-09-12T03:38:11.373341+0000","last_active":"2024-09-12T03:38:12.354667+0000","last_peered":"2024-09-12T03:38:12.354667+0000","last_clean":"2024-09-12T03:38:12.354667+0000","last_became_active":"2024-09-12T03:38:11.371198+0000","last_became_peered":"2024-09-12T03:38:11.371198+0000","last_unstale":"2024-09-12T03:38:12.354667+0000","last_undegraded":"2024-09-12T03:38:12.354667+0000","last_fullsized":"2024-09-12T03:38:12.354667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:48.990741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051036+0000","last_change":"2024-09-12T03:38:10.391548+0000","last_active":"2024-09-12T03:38:13.051036+0000","last_peered":"2024-09-12T03:38:13.051036+0000","last_clean":"2024-09-12T03:38:13.051036+0000","last_became_active":"2024-09-12T03:38:10.391192+0000","last_became_peered":"2024-09-12T03:38:10.391192+0000","last_unstale":"2024-09-12T03:38:13.051036+0000","last_undegraded":"2024-09-12T03:38:13.051036+0000","last_fullsized":"2024-09-12T03:38:13.051036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:06:45.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049083+0000","last_change":"2024-09-12T03:38:11.376125+0000","last_active":"2024-09-12T03:38:13.049083+0000","last_peered":"2024-09-12T03:38:13.049083+0000","last_clean":"2024-09-12T03:38:13.049083+0000","last_became_active":"2024-09-12T03:38:11.375578+0000","last_became_peered":"2024-09-12T03:38:11.375578+0000","last_unstale":"2024-09-12T03:38:13.049083+0000","last_undegraded":"2024-09-12T03:38:13.049083+0000","last_fullsized":"2024-09-12T03:38:13.049083+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:51.944442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.051222+0000","last_change":"2024-09-12T03:38:10.392155+0000","last_active":"2024-09-12T03:38:13.051222+0000","last_peered":"2024-09-12T03:38:13.051222+0000","last_clean":"2024-09-12T03:38:13.051222+0000","last_became_active":"2024-09-12T03:38:10.391414+0000","last_became_peered":"2024-09-12T03:38:10.391414+0000","last_unstale":"2024-09-12T03:38:13.051222+0000","last_undegraded":"2024-09-12T03:38:13.051222+0000","last_fullsized":"2024-09-12T03:38:13.051222+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049584+0000","last_change":"2024-09-12T03:38:11.381890+0000","last_active":"2024-09-12T03:38:13.049584+0000","last_peered":"2024-09-12T03:38:13.049584+0000","last_clean":"2024-09-12T03:38:13.049584+0000","last_became_active":"2024-09-12T03:38:11.380922+0000","last_became_peered":"2024-09-12T03:38:11.380922+0000","last_unstale":"2024-09-12T03:38:13.049584+0000","last_undegraded":"2024-09-12T03:38:13.049584+0000","last_fullsized":"2024-09-12T03:38:13.049584+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:52.138486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049936+0000","last_change":"2024-09-12T03:38:10.393564+0000","last_active":"2024-09-12T03:38:13.049936+0000","last_peered":"2024-09-12T03:38:13.049936+0000","last_clean":"2024-09-12T03:38:13.049936+0000","last_became_active":"2024-09-12T03:38:10.393172+0000","last_became_peered":"2024-09-12T03:38:10.393172+0000","last_unstale":"2024-09-12T03:38:13.049936+0000","last_undegraded":"2024-09-12T03:38:13.049936+0000","last_fullsized":"2024-09-12T03:38:13.049936+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:33.801197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049190+0000","last_change":"2024-09-12T03:38:11.400545+0000","last_active":"2024-09-12T03:38:13.049190+0000","last_peered":"2024-09-12T03:38:13.049190+0000","last_clean":"2024-09-12T03:38:13.049190+0000","last_became_active":"2024-09-12T03:38:11.399766+0000","last_became_peered":"2024-09-12T03:38:11.399766+0000","last_unstale":"2024-09-12T03:38:13.049190+0000","last_undegraded":"2024-09-12T03:38:13.049190+0000","last_fullsized":"2024-09-12T03:38:13.049190+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T15:03:32.905725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049529+0000","last_change":"2024-09-12T03:38:10.396815+0000","last_active":"2024-09-12T03:38:13.049529+0000","last_peered":"2024-09-12T03:38:13.049529+0000","last_clean":"2024-09-12T03:38:13.049529+0000","last_became_active":"2024-09-12T03:38:10.389620+0000","last_became_peered":"2024-09-12T03:38:10.389620+0000","last_unstale":"2024-09-12T03:38:13.049529+0000","last_undegraded":"2024-09-12T03:38:13.049529+0000","last_fullsized":"2024-09-12T03:38:13.049529+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:50.642124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.355855+0000","last_change":"2024-09-12T03:38:11.372417+0000","last_active":"2024-09-12T03:38:12.355855+0000","last_peered":"2024-09-12T03:38:12.355855+0000","last_clean":"2024-09-12T03:38:12.355855+0000","last_became_active":"2024-09-12T03:38:11.371689+0000","last_became_peered":"2024-09-12T03:38:11.371689+0000","last_unstale":"2024-09-12T03:38:12.355855+0000","last_undegraded":"2024-09-12T03:38:12.355855+0000","last_fullsized":"2024-09-12T03:38:12.355855+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.866541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049975+0000","last_change":"2024-09-12T03:38:10.393789+0000","last_active":"2024-09-12T03:38:13.049975+0000","last_peered":"2024-09-12T03:38:13.049975+0000","last_clean":"2024-09-12T03:38:13.049975+0000","last_became_active":"2024-09-12T03:38:10.393378+0000","last_became_peered":"2024-09-12T03:38:10.393378+0000","last_unstale":"2024-09-12T03:38:13.049975+0000","last_undegraded":"2024-09-12T03:38:13.049975+0000","last_fullsized":"2024-09-12T03:38:13.049975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:34:50.751585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:12.354326+0000","last_change":"2024-09-12T03:38:11.362250+0000","last_active":"2024-09-12T03:38:12.354326+0000","last_peered":"2024-09-12T03:38:12.354326+0000","last_clean":"2024-09-12T03:38:12.354326+0000","last_became_active":"2024-09-12T03:38:11.361375+0000","last_became_peered":"2024-09-12T03:38:11.361375+0000","last_unstale":"2024-09-12T03:38:12.354326+0000","last_undegraded":"2024-09-12T03:38:12.354326+0000","last_fullsized":"2024-09-12T03:38:12.354326+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:10.334912+0000","last_clean_scrub_stamp":"2024-09-12T03:38:10.334912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:22.065181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.049761+0000","last_change":"2024-09-12T03:38:10.372217+0000","last_active":"2024-09-12T03:38:13.049761+0000","last_peered":"2024-09-12T03:38:13.049761+0000","last_clean":"2024-09-12T03:38:13.049761+0000","last_became_active":"2024-09-12T03:38:10.371938+0000","last_became_peered":"2024-09-12T03:38:10.371938+0000","last_unstale":"2024-09-12T03:38:13.049761+0000","last_undegraded":"2024-09-12T03:38:13.049761+0000","last_fullsized":"2024-09-12T03:38:13.049761+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:38:09.330380+0000","last_clean_scrub_stamp":"2024-09-12T03:38:09.330380+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.905520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":306,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-12T03:38:13.048145+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:13.048145+0000","last_peered":"2024-09-12T03:38:13.048145+0000","last_clean":"2024-09-12T03:38:13.048145+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:13.048145+0000","last_undegraded":"2024-09-12T03:38:13.048145+0000","last_fullsized":"2024-09-12T03:38:13.048145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1810432,"data_stored":1144527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509491,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1208320,"data_stored":553999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1216512,"data_stored":554091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":554581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":554033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509489,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":554033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1228800,"data_stored":556215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1818624,"data_stored":1146069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:20.197 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:38:20.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T03:38:20.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cdd33b640 1 Processor -- start 2024-09-12T03:38:20.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cdd33b640 1 -- start start 2024-09-12T03:38:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cdd33b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 0x7f7cd806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cdd33b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd80ce8d0 con 0x7f7cd8073100 2024-09-12T03:38:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cdd33b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd80cebb0 con 0x7f7cd80cc870 2024-09-12T03:38:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cdd33b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd80cee90 con 0x7f7cd80cf970 2024-09-12T03:38:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7cd8073100 0x7f7cd80cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50826/0 (socket says 172.21.15.73:50826) 2024-09-12T03:38:20.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 -- 172.21.15.73:0/2662275738 learned_addr learned my addr 172.21.15.73:0/2662275738 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd77fe640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 0x7f7cd806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140272793 0 0) 0x7f7cd80ce8d0 con 0x7f7cd8073100 2024-09-12T03:38:20.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc0003530 con 0x7f7cd8073100 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3345568478 0 0) 0x7f7cc0003530 con 0x7f7cd8073100 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 msgr2=0x7f7cd806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 0x7f7cd806de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 >> v1:172.21.15.150:6789/0 conn(0x7f7cd80cc870 legacy=0x7f7cd80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd80cf170 con 0x7f7cd8073100 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f7ccc001680 con 0x7f7cd8073100 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 >> v1:172.21.15.73:6789/0 conn(0x7f7cd8073100 legacy=0x7f7cd80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 0x7f7cc00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cc0004020 0x7f7cc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cc0004d50 0x7f7cc00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd80cee90 con 0x7f7cc0004020 2024-09-12T03:38:20.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc000bb90 con 0x7f7cc0004d50 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc000bd90 con 0x7f7cd80cf970 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cc0004020 0x7f7cc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd6ffd640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 0x7f7cc00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd77fe640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cc0004d50 0x7f7cc00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 -- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 msgr2=0x7f7cc00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cd80cf970 0x7f7cc00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 -- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cc0004d50 msgr2=0x7f7cc00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cc0004d50 0x7f7cc00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.357+0000 7f7cd67fc640 1 -- 172.21.15.73:0/2662275738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc0003530 con 0x7f7cc0004020 2024-09-12T03:38:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd67fc640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cc0004020 0x7f7cc0004810 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c190 tx=0x7f7ccc01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95956d9d344bad02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc007d00 con 0x7f7cc0004020 2024-09-12T03:38:20.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc005b00 con 0x7f7cc0004020 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd5ffb640 1 -- 172.21.15.73:0/2662275738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc007070 con 0x7f7cc0004020 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2662275738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cc0004020 msgr2=0x7f7cc0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 --2- 172.21.15.73:0/2662275738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cc0004020 0x7f7cc0004810 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c190 tx=0x7f7ccc01f390 comp rx=0 tx=0).stop 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd77fe640 1 -- 172.21.15.73:0/2662275738 reap_dead start 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2662275738 shutdown_connections 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2662275738 >> 172.21.15.73:0/2662275738 conn(0x7f7cd80b1c80 msgr2=0x7f7cd80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2662275738 shutdown_connections 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2662275738 wait complete. 2024-09-12T03:38:20.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 Processor -- start 2024-09-12T03:38:20.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- start start 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc0004020 0x7f7cd80ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cd815c870 0x7f7cd80ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd8141760 0x7f7cd8141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd8145fd0 con 0x7f7cd8141760 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd8145e50 con 0x7f7cd815c870 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cdd33b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd806de00 con 0x7f7cc0004020 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd8141760 0x7f7cd8141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd8141760 0x7f7cd8141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39622/0 (socket says 172.21.15.73:39622) 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd77fe640 1 -- 172.21.15.73:0/2635943082 learned_addr learned my addr 172.21.15.73:0/2635943082 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:20.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.361+0000 7f7cd6ffd640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc0004020 0x7f7cd80ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd67fc640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cd815c870 0x7f7cd80ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd77fe640 1 -- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc0004020 msgr2=0x7f7cd80ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd77fe640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc0004020 0x7f7cd80ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd77fe640 1 -- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cd815c870 msgr2=0x7f7cd80ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd77fe640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cd815c870 0x7f7cd80ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd77fe640 1 -- 172.21.15.73:0/2635943082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd815ce30 con 0x7f7cd8141760 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd77fe640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd8141760 0x7f7cd8141be0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7cd809e2b0 tx=0x7f7cd0009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cbf7fe640 1 -- 172.21.15.73:0/2635943082 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0007d50 con 0x7f7cd8141760 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cbf7fe640 1 -- 172.21.15.73:0/2635943082 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd0019070 con 0x7f7cd8141760 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd815d110 con 0x7f7cd8141760 2024-09-12T03:38:20.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cbf7fe640 1 -- 172.21.15.73:0/2635943082 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0014650 con 0x7f7cd8141760 2024-09-12T03:38:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd815d6d0 con 0x7f7cd8141760 2024-09-12T03:38:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd80ccc50 con 0x7f7cd8141760 2024-09-12T03:38:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cbf7fe640 1 -- 172.21.15.73:0/2635943082 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7cd00147f0 con 0x7f7cd8141760 2024-09-12T03:38:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cbf7fe640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7cc40678c0 0x7f7cc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cbf7fe640 1 -- 172.21.15.73:0/2635943082 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f7cd0086310 con 0x7f7cd8141760 2024-09-12T03:38:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd6ffd640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7cc40678c0 0x7f7cc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.365+0000 7f7cd6ffd640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7cc40678c0 0x7f7cc4069d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8005510 tx=0x7f7cc8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:20.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.369+0000 7f7cbf7fe640 1 -- 172.21.15.73:0/2635943082 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7cd0056d50 con 0x7f7cd8141760 2024-09-12T03:38:20.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.585+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7cd80af660 con 0x7f7cd8141760 2024-09-12T03:38:20.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.589+0000 7f7cbf7fe640 1 -- 172.21.15.73:0/2635943082 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f7cd0056650 con 0x7f7cd8141760 2024-09-12T03:38:20.592 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-12T03:38:20.592 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATYeJmu1z3LRAA5QZwkqz69HKdDKfG0S3TMg== 2024-09-12T03:38:20.592 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-09-12T03:38:20.592 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-09-12T03:38:20.592 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T03:38:20.592 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-09-12T03:38:20.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7cc40678c0 msgr2=0x7f7cc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7cc40678c0 0x7f7cc4069d80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8005510 tx=0x7f7cc8009040 comp rx=0 tx=0).stop 2024-09-12T03:38:20.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd8141760 msgr2=0x7f7cd8141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd8141760 0x7f7cd8141be0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7cd809e2b0 tx=0x7f7cd0009dc0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 shutdown_connections 2024-09-12T03:38:20.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f7cc40678c0 0x7f7cc4069d80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd8141760 0x7f7cd8141be0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7cd815c870 0x7f7cd80ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 --2- 172.21.15.73:0/2635943082 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f7cc0004020 0x7f7cd80ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 >> 172.21.15.73:0/2635943082 conn(0x7f7cd80b1c80 msgr2=0x7f7cd80afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:20.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 shutdown_connections 2024-09-12T03:38:20.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.593+0000 7f7cdd33b640 1 -- 172.21.15.73:0/2635943082 wait complete. 2024-09-12T03:38:20.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:38:20.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.721+0000 7f1fea2a5640 1 Processor -- start 2024-09-12T03:38:20.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.721+0000 7f1fea2a5640 1 -- start start 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1fe40ce9d0 0x7f1fe40cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40cf920 0x7f1fe40d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe406d9c0 con 0x7f1fe415e5f0 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe406d7a0 con 0x7f1fe40ce9d0 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe406dca0 con 0x7f1fe40cf920 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe37fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1fe40ce9d0 0x7f1fe40cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1fe415e5f0 0x7f1fe406d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50834/0 (socket says 172.21.15.73:50834) 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe3fff640 1 -- 172.21.15.73:0/1794431581 learned_addr learned my addr 172.21.15.73:0/1794431581 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe37fe640 1 -- 172.21.15.73:0/1794431581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40cf920 msgr2=0x7f1fe40d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe37fe640 1 --2- 172.21.15.73:0/1794431581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40cf920 0x7f1fe40d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe37fe640 1 -- 172.21.15.73:0/1794431581 >> v1:172.21.15.73:6789/0 conn(0x7f1fe415e5f0 legacy=0x7f1fe406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe37fe640 1 -- 172.21.15.73:0/1794431581 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe406df80 con 0x7f1fe40ce9d0 2024-09-12T03:38:20.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe2ffd640 1 -- 172.21.15.73:0/1794431581 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945675245 0 0) 0x7f1fe406d9c0 con 0x7f1fe415e5f0 2024-09-12T03:38:20.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe37fe640 1 --2- 172.21.15.73:0/1794431581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe40ce9d0 0x7f1fe40cf3e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0097c0 tx=0x7f1fcc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d3f2ca50854838 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:20.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe2ffd640 1 -- 172.21.15.73:0/1794431581 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0b1070 con 0x7f1fe40ce9d0 2024-09-12T03:38:20.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe2ffd640 1 -- 172.21.15.73:0/1794431581 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0ac410 con 0x7f1fe40ce9d0 2024-09-12T03:38:20.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fe2ffd640 1 -- 172.21.15.73:0/1794431581 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0ac7e0 con 0x7f1fe40ce9d0 2024-09-12T03:38:20.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 -- 172.21.15.73:0/1794431581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe40ce9d0 msgr2=0x7f1fe40cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/1794431581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe40ce9d0 0x7f1fe40cf3e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0097c0 tx=0x7f1fcc01c4a0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 -- 172.21.15.73:0/1794431581 shutdown_connections 2024-09-12T03:38:20.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/1794431581 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40cf920 0x7f1fe40d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/1794431581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe40ce9d0 0x7f1fe40cf3e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 -- 172.21.15.73:0/1794431581 >> 172.21.15.73:0/1794431581 conn(0x7f1fe4074030 msgr2=0x7f1fe409d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:20.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.725+0000 7f1fea2a5640 1 -- 172.21.15.73:0/1794431581 shutdown_connections 2024-09-12T03:38:20.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- 172.21.15.73:0/1794431581 wait complete. 2024-09-12T03:38:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 Processor -- start 2024-09-12T03:38:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- start start 2024-09-12T03:38:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fe40cf920 0x7f1fe40c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40c83f0 0x7f1fe4149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe4149760 0x7f1fe4149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe40d3b00 con 0x7f1fe4149760 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe40cfd90 con 0x7f1fe40cf920 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe40d3c80 con 0x7f1fe40c83f0 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe4149760 0x7f1fe4149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe4149760 0x7f1fe4149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39640/0 (socket says 172.21.15.73:39640) 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 -- 172.21.15.73:0/3022018919 learned_addr learned my addr 172.21.15.73:0/3022018919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe3fff640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fe40cf920 0x7f1fe40c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 -- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40c83f0 msgr2=0x7f1fe4149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe37fe640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40c83f0 0x7f1fe4149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40c83f0 0x7f1fe4149220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 -- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fe40cf920 msgr2=0x7f1fe40c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fe40cf920 0x7f1fe40c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 -- 172.21.15.73:0/3022018919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe415b2c0 con 0x7f1fe4149760 2024-09-12T03:38:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe8842640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe4149760 0x7f1fe4149be0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00b440 tx=0x7f1fdc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe0ff9640 1 -- 172.21.15.73:0/3022018919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc015020 con 0x7f1fe4149760 2024-09-12T03:38:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe0ff9640 1 -- 172.21.15.73:0/3022018919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc011850 con 0x7f1fe4149760 2024-09-12T03:38:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe415b5a0 con 0x7f1fe4149760 2024-09-12T03:38:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fe0ff9640 1 -- 172.21.15.73:0/3022018919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc011c40 con 0x7f1fe4149760 2024-09-12T03:38:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe415bb60 con 0x7f1fe4149760 2024-09-12T03:38:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.729+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe40c87d0 con 0x7f1fe4149760 2024-09-12T03:38:20.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.733+0000 7f1fe0ff9640 1 -- 172.21.15.73:0/3022018919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fdc018020 con 0x7f1fe4149760 2024-09-12T03:38:20.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.733+0000 7f1fe0ff9640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1fc40678c0 0x7f1fc4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:20.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.733+0000 7f1fe0ff9640 1 -- 172.21.15.73:0/3022018919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 6101+0+0 (secure 0 0 0) 0x7f1fdc085ca0 con 0x7f1fe4149760 2024-09-12T03:38:20.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.733+0000 7f1fe3fff640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1fc40678c0 0x7f1fc4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:20.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.733+0000 7f1fe3fff640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1fc40678c0 0x7f1fc4069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40012f0 tx=0x7f1fd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:20.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.737+0000 7f1fe0ff9640 1 -- 172.21.15.73:0/3022018919 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1fdc01f020 con 0x7f1fe4149760 2024-09-12T03:38:20.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.921+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fe4075140 con 0x7f1fe4149760 2024-09-12T03:38:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fe0ff9640 1 -- 172.21.15.73:0/3022018919 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f1fdc0172c0 con 0x7f1fe4149760 2024-09-12T03:38:20.925 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:20.925 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"btime":"2024-09-12T03:38:14:379931+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5521,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2804939638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2804939638},{"type":"v1","addr":"172.21.15.150:6833","nonce":2804939638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2609449242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2609449242},{"type":"v1","addr":"172.21.15.150:6835","nonce":2609449242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3463752136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3463752136},{"type":"v1","addr":"172.21.15.73:6835","nonce":3463752136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:38:10.712259+0000","modified":"2024-09-12T03:38:13.741150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3586054053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3586054053},{"type":"v1","addr":"172.21.15.73:6837","nonce":3586054053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6579,"qdb_cluster":[6579]},"id":7}]} 2024-09-12T03:38:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 56 2024-09-12T03:38:20.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1fc40678c0 msgr2=0x7f1fc4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1fc40678c0 0x7f1fc4069d80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1fd40012f0 tx=0x7f1fd4009040 comp rx=0 tx=0).stop 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe4149760 msgr2=0x7f1fe4149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe4149760 0x7f1fe4149be0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00b440 tx=0x7f1fdc00b900 comp rx=0 tx=0).stop 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 shutdown_connections 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1fc40678c0 0x7f1fc4069d80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fe4149760 0x7f1fe4149be0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1fe40c83f0 0x7f1fe4149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 --2- 172.21.15.73:0/3022018919 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fe40cf920 0x7f1fe40c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 >> 172.21.15.73:0/3022018919 conn(0x7f1fe40ce9d0 msgr2=0x7f1fe40d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 shutdown_connections 2024-09-12T03:38:20.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:20.925+0000 7f1fea2a5640 1 -- 172.21.15.73:0/3022018919 wait complete. 2024-09-12T03:38:21.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T03:38:10.712259+0000', 'modified': '2024-09-12T03:38:13.741150+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6579}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6579': {'gid': 6579, 'name': 'c', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/3586054053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3586054053}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3586054053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6579, 'qdb_cluster': [6579]} 2024-09-12T03:38:21.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T03:38:21.346 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-12T03:38:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.473+0000 7fb153033640 1 Processor -- start 2024-09-12T03:38:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.473+0000 7fb153033640 1 -- start start 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c06f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb14c15f3a0 0x7fb14c0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb14c070250 con 0x7fb14c06fe50 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb14c152480 con 0x7fb14c15f3a0 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c0aede0 con 0x7fb14c1520a0 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb14bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb14c06fe50 0x7fb14c15ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50838/0 (socket says 172.21.15.73:50838) 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb14bfff640 1 -- 172.21.15.73:0/1716225012 learned_addr learned my addr 172.21.15.73:0/1716225012 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb1515d0640 1 --2- 172.21.15.73:0/1716225012 >> v2:172.21.15.73:3300/0 conn(0x7fb14c15f3a0 0x7fb14c0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb14b7fe640 1 -- 172.21.15.73:0/1716225012 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352352057 0 0) 0x7fb14c070250 con 0x7fb14c06fe50 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb150dcf640 1 --2- 172.21.15.73:0/1716225012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c06f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb14b7fe640 1 -- 172.21.15.73:0/1716225012 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb134003530 con 0x7fb14c06fe50 2024-09-12T03:38:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb1515d0640 1 -- 172.21.15.73:0/1716225012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 msgr2=0x7fb14c06f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb1515d0640 1 --2- 172.21.15.73:0/1716225012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c06f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb1515d0640 1 -- 172.21.15.73:0/1716225012 >> v1:172.21.15.73:6789/0 conn(0x7fb14c06fe50 legacy=0x7fb14c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb1515d0640 1 -- 172.21.15.73:0/1716225012 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c15fa10 con 0x7fb14c15f3a0 2024-09-12T03:38:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb150dcf640 1 --2- 172.21.15.73:0/1716225012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb1515d0640 1 --2- 172.21.15.73:0/1716225012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c15f3a0 0x7fb14c0adc80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb144009d90 tx=0x7fb14401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d874566799db5eef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb14b7fe640 1 -- 172.21.15.73:0/1716225012 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440b2070 con 0x7fb14c15f3a0 2024-09-12T03:38:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb14b7fe640 1 -- 172.21.15.73:0/1716225012 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1440a5a30 con 0x7fb14c15f3a0 2024-09-12T03:38:21.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb14b7fe640 1 -- 172.21.15.73:0/1716225012 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440a5de0 con 0x7fb14c15f3a0 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- 172.21.15.73:0/1716225012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c15f3a0 msgr2=0x7fb14c0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 --2- 172.21.15.73:0/1716225012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c15f3a0 0x7fb14c0adc80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb144009d90 tx=0x7fb14401c970 comp rx=0 tx=0).stop 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- 172.21.15.73:0/1716225012 shutdown_connections 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 --2- 172.21.15.73:0/1716225012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c15f3a0 0x7fb14c0adc80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 --2- 172.21.15.73:0/1716225012 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c06f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- 172.21.15.73:0/1716225012 >> 172.21.15.73:0/1716225012 conn(0x7fb14c0b1f90 msgr2=0x7fb14c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- 172.21.15.73:0/1716225012 shutdown_connections 2024-09-12T03:38:21.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.477+0000 7fb153033640 1 -- 172.21.15.73:0/1716225012 wait complete. 2024-09-12T03:38:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 Processor -- start 2024-09-12T03:38:21.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 -- start start 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c06fe50 0x7fb14c15aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14c15f3a0 0x7fb14c099ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c073d30 con 0x7fb14c06fe50 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c073a50 con 0x7fb14c15f3a0 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c167f10 con 0x7fb14c1520a0 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c06fe50 0x7fb14c15aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c06fe50 0x7fb14c15aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39660/0 (socket says 172.21.15.73:39660) 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 -- 172.21.15.73:0/1326721489 learned_addr learned my addr 172.21.15.73:0/1326721489 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 -- 172.21.15.73:0/1326721489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 msgr2=0x7fb14c145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 -- 172.21.15.73:0/1326721489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14c15f3a0 msgr2=0x7fb14c099ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14c15f3a0 0x7fb14c099ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 -- 172.21.15.73:0/1326721489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c0b1420 con 0x7fb14c06fe50 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb150dcf640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c06fe50 0x7fb14c15aac0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00ed40 tx=0x7fb13c007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb1497fa640 1 -- 172.21.15.73:0/1326721489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00ce10 con 0x7fb14c06fe50 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb1497fa640 1 -- 172.21.15.73:0/1326721489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13c010440 con 0x7fb14c06fe50 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c150d90 con 0x7fb14c06fe50 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb1497fa640 1 -- 172.21.15.73:0/1326721489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c010830 con 0x7fb14c06fe50 2024-09-12T03:38:21.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.481+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c151350 con 0x7fb14c06fe50 2024-09-12T03:38:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1497fa640 1 -- 172.21.15.73:0/1326721489 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb13c00b030 con 0x7fb14c06fe50 2024-09-12T03:38:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1497fa640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1497fa640 1 -- 172.21.15.73:0/1326721489 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6130+0+0 (secure 0 0 0) 0x7fb13c088640 con 0x7fb14c06fe50 2024-09-12T03:38:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb14bfff640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb14bfff640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1380678c0 0x7fb138069d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb140007fd0 tx=0x7fb140007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 Processor -- start 2024-09-12T03:38:21.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- start start 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dbd70 0x55fe1b4dc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dc690 0x55fe1b492160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4926a0 0x55fe1b492a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b375b60 con 0x55fe1b4926a0 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b2dcc70 con 0x55fe1b4dc690 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55fe1b282ed0 con 0x55fe1b4dbd70 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4926a0 0x55fe1b492a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4926a0 0x55fe1b492a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39666/0 (socket says 172.21.15.73:39666) 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 -- 172.21.15.73:0/1849088629 learned_addr learned my addr 172.21.15.73:0/1849088629 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb150dcf640 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dbd70 0x55fe1b4dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb14bfff640 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dc690 0x55fe1b492160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 -- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dbd70 msgr2=0x55fe1b4dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dbd70 0x55fe1b4dc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 -- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dc690 msgr2=0x55fe1b492160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dc690 0x55fe1b492160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 -- 172.21.15.73:0/1849088629 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1b294e50 con 0x55fe1b4926a0 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb150dcf640 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dbd70 0x55fe1b4dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb14bfff640 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dc690 0x55fe1b492160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1515d0640 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4926a0 0x55fe1b492a80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb14401a5a0 tx=0x7fb144004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806bf4145d1d190d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1327fc640 1 -- 172.21.15.73:0/1849088629 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440b2050 con 0x55fe1b4926a0 2024-09-12T03:38:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1327fc640 1 -- 172.21.15.73:0/1849088629 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1440be070 con 0x55fe1b4926a0 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1327fc640 1 -- 172.21.15.73:0/1849088629 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440a5c70 con 0x55fe1b4926a0 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- 172.21.15.73:0/1849088629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4926a0 msgr2=0x55fe1b492a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4926a0 0x55fe1b492a80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb14401a5a0 tx=0x7fb144004a50 comp rx=0 tx=0).stop 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- 172.21.15.73:0/1849088629 shutdown_connections 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4926a0 0x55fe1b492a80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dc690 0x55fe1b492160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 --2- 172.21.15.73:0/1849088629 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dbd70 0x55fe1b4dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- 172.21.15.73:0/1849088629 >> 172.21.15.73:0/1849088629 conn(0x55fe1b494600 msgr2=0x55fe1b48c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- 172.21.15.73:0/1849088629 shutdown_connections 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.485+0000 7fb1560ef000 1 -- 172.21.15.73:0/1849088629 wait complete. 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- start start 2024-09-12T03:38:21.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 Processor -- start 2024-09-12T03:38:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b33eb00 con 0x55fe1b4dbd70 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b2b7360 con 0x55fe1b4c8490 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55fe1b2b42d0 con 0x55fe1b4dc690 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 10 client.0 _ll_register_callbacks cb 0x55fe1b479820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4e1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39668/0 (socket says 172.21.15.73:39668) 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 -- 172.21.15.73:0/871839852 learned_addr learned my addr 172.21.15.73:0/871839852 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1515d0640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb14bfff640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 -- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 msgr2=0x55fe1b4e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 -- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 msgr2=0x55fe1b4c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 -- 172.21.15.73:0/871839852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1b283120 con 0x55fe1b4dbd70 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb14bfff640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1515d0640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb150dcf640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4e1eb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb13c058530 tx=0x7fb13c058ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dceb5f054dacbb30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 1 -- 172.21.15.73:0/871839852 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c061410 con 0x55fe1b4dbd70 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 1 -- 172.21.15.73:0/871839852 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6130+0+0 (secure 0 0 0) 0x7fb13c056b30 con 0x55fe1b4dbd70 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1440be070 con 0x55fe1b4dbd70 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 1 -- 172.21.15.73:0/871839852 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb13c054ea0 con 0x55fe1b4dbd70 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 10 client.6729 fetch_fsmap learned FSMap version 56 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55fe1b27c450 con 0x55fe1b4dbd70 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 1 -- 172.21.15.73:0/871839852 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1440be070 con 0x55fe1b4dbd70 2024-09-12T03:38:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 1 -- 172.21.15.73:0/871839852 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7fb13c060f80 con 0x55fe1b4dbd70 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 10 client.6729 fetch_fsmap finished waiting for FSMap version 56 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 10 client.6729 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 20 client.6729 populate_metadata read hostname 'smithi073' 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4c9280 0x55fe1b4c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 4 client.6729 mds_command: new command op to 6579 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 --> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe1b276c00 con 0x55fe1b4c9280 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb14bfff640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4c9280 0x55fe1b4c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb14bfff640 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4c9280 0x55fe1b4c9660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f843ddf67e371d8c server_cookie=ec7aac072182df5 in_seq=0 out_seq=0 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 10 client.6729 ms_handle_connect on v2:172.21.15.73:6836/3586054053 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 1 -- 172.21.15.73:0/871839852 <== mds.0 v2:172.21.15.73:6836/3586054053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe1b276c00 con 0x55fe1b4c9280 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb12b7fe640 10 client.6729 handle_command_reply: tid=0 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 client.6729 shutdown 2024-09-12T03:38:21.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 msgr2=0x55fe1b4e1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.489+0000 7fb1560ef000 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4e1eb0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb13c058530 tx=0x7fb13c058ff0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 shutdown_connections 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4c9280 0x55fe1b4c9660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb12b7fe640 0 client.6729 ms_handle_reset on v2:172.21.15.73:6836/3586054053 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 --2- 172.21.15.73:0/871839852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4e1eb0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 >> 172.21.15.73:0/871839852 conn(0x55fe1b4926a0 msgr2=0x55fe1b4939b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 shutdown_connections 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 1 -- 172.21.15.73:0/871839852 wait complete. 2024-09-12T03:38:21.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.493+0000 7fb1560ef000 20 client.6729 trim_cache size 0 max 16384 2024-09-12T03:38:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 Processor -- start 2024-09-12T03:38:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- start start 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4f2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c1fea50 con 0x55fe1b4dbd70 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c06f4b0 con 0x55fe1b4c8490 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb14c1fe430 con 0x55fe1b4dc690 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39674/0 (socket says 172.21.15.73:39674) 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 -- 172.21.15.73:0/3258430127 learned_addr learned my addr 172.21.15.73:0/3258430127 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb150dcf640 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 -- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 msgr2=0x55fe1b4e0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 -- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 msgr2=0x55fe1b4f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 -- 172.21.15.73:0/3258430127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe1b4c8be0 con 0x55fe1b4dbd70 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb150dcf640 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb14bfff640 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4f27a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb140001ec0 tx=0x7fb140010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5228f3e6b571a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb131ffb640 1 -- 172.21.15.73:0/3258430127 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140005aa0 con 0x55fe1b4dbd70 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb131ffb640 1 -- 172.21.15.73:0/3258430127 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb140005c40 con 0x55fe1b4dbd70 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb131ffb640 1 -- 172.21.15.73:0/3258430127 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140006050 con 0x55fe1b4dbd70 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- 172.21.15.73:0/3258430127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 msgr2=0x55fe1b4f27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4f27a0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb140001ec0 tx=0x7fb140010000 comp rx=0 tx=0).stop 2024-09-12T03:38:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- 172.21.15.73:0/3258430127 shutdown_connections 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dbd70 0x55fe1b4f27a0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4dc690 0x55fe1b4e0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3258430127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4c8490 0x55fe1b4f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- 172.21.15.73:0/3258430127 >> 172.21.15.73:0/3258430127 conn(0x55fe1b4926a0 msgr2=0x55fe1b48cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- 172.21.15.73:0/3258430127 shutdown_connections 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.509+0000 7fb1560ef000 1 -- 172.21.15.73:0/3258430127 wait complete. 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- start start 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 Processor -- start 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4c8490 0x55fe1b54f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dbd70 0x55fe1b54fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dc690 0x55fe1b4e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b2dbf80 con 0x55fe1b4dc690 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x55fe1b294ca0 con 0x55fe1b4dbd70 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x55fe1b2e12a0 con 0x55fe1b4c8490 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 10 client.0 _ll_register_callbacks cb 0x7fb13c007f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dc690 0x55fe1b4e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dc690 0x55fe1b4e5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39680/0 (socket says 172.21.15.73:39680) 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 -- 172.21.15.73:0/3443774324 learned_addr learned my addr 172.21.15.73:0/3443774324 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb150dcf640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4c8490 0x55fe1b54f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb14bfff640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dbd70 0x55fe1b54fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 -- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4c8490 msgr2=0x55fe1b54f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4c8490 0x55fe1b54f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 -- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dbd70 msgr2=0x55fe1b54fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dbd70 0x55fe1b54fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 -- 172.21.15.73:0/3443774324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe1b263fd0 con 0x55fe1b4dc690 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb14bfff640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dbd70 0x55fe1b54fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1515d0640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dc690 0x55fe1b4e5cf0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb14401d210 tx=0x7fb144019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8de334c047d7260 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 1 -- 172.21.15.73:0/3443774324 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440c6070 con 0x55fe1b4dc690 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 1 -- 172.21.15.73:0/3443774324 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 6130+0+0 (secure 0 0 0) 0x7fb1440a5a30 con 0x55fe1b4dc690 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb140005c40 con 0x55fe1b4dc690 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 1 -- 172.21.15.73:0/3443774324 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb1440d3050 con 0x55fe1b4dc690 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 10 client.6735 fetch_fsmap learned FSMap version 56 2024-09-12T03:38:21.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55fe1b35f750 con 0x55fe1b4dc690 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 1 -- 172.21.15.73:0/3443774324 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb140005c40 con 0x55fe1b4dc690 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 1 -- 172.21.15.73:0/3443774324 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7fb1440d6020 con 0x55fe1b4dc690 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 10 client.6735 fetch_fsmap finished waiting for FSMap version 56 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 10 client.6735 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 20 client.6735 populate_metadata read hostname 'smithi073' 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4e6230 0x55fe1b4e6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 4 client.6735 mds_command: new command op to 6579 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 --> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] -- command(tid 0: {"prefix": "status"}) -- 0x55fe1b2ea3a0 con 0x55fe1b4e6230 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb150dcf640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4e6230 0x55fe1b4e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb150dcf640 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4e6230 0x55fe1b4e6610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ecda803446ccd2c server_cookie=37457d57093a7c24 in_seq=0 out_seq=0 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 10 client.6735 ms_handle_connect on v2:172.21.15.73:6836/3586054053 2024-09-12T03:38:21.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 1 -- 172.21.15.73:0/3443774324 <== mds.0 v2:172.21.15.73:6836/3586054053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55fe1b2ea3a0 con 0x55fe1b4e6230 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 10 client.6735 handle_command_reply: tid=0 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 client.6735 shutdown 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dc690 msgr2=0x55fe1b4e5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dc690 0x55fe1b4e5cf0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb14401d210 tx=0x7fb144019710 comp rx=0 tx=0).stop 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 shutdown_connections 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:6836/3586054053,v1:172.21.15.73:6837/3586054053] conn(0x55fe1b4e6230 0x55fe1b4e6610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fe1b4dc690 0x55fe1b4e5cf0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fe1b4dbd70 0x55fe1b54fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb12b7fe640 0 client.6735 ms_handle_reset on v2:172.21.15.73:6836/3586054053 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 --2- 172.21.15.73:0/3443774324 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55fe1b4c8490 0x55fe1b54f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 >> 172.21.15.73:0/3443774324 conn(0x55fe1b4926a0 msgr2=0x55fe1b4f1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 shutdown_connections 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 1 -- 172.21.15.73:0/3443774324 wait complete. 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.513+0000 7fb1560ef000 20 client.6735 trim_cache size 0 max 16384 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "7f20e802-78a7-4f58-bc5b-05a554b3f603", 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6579, 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-09-12T03:38:21.527 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-09-12T03:38:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.149008676999999, 2024-09-12T03:38:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 56, 2024-09-12T03:38:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 99, 2024-09-12T03:38:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 98, 2024-09-12T03:38:21.528 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 15.52333112 2024-09-12T03:38:21.528 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1380678c0 msgr2=0x7fb138069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1380678c0 0x7fb138069d80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb140007fd0 tx=0x7fb140007900 comp rx=0 tx=0).stop 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c06fe50 msgr2=0x7fb14c15aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c06fe50 0x7fb14c15aac0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00ed40 tx=0x7fb13c007410 comp rx=0 tx=0).stop 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 shutdown_connections 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb1380678c0 0x7fb138069d80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb14c15f3a0 0x7fb14c099ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb14c1520a0 0x7fb14c145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 --2- 172.21.15.73:0/1326721489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14c06fe50 0x7fb14c15aac0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 >> 172.21.15.73:0/1326721489 conn(0x7fb14c0b1f90 msgr2=0x7fb14c0b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 shutdown_connections 2024-09-12T03:38:21.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.517+0000 7fb153033640 1 -- 172.21.15.73:0/1326721489 wait complete. 2024-09-12T03:38:21.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:38:21.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.641+0000 7f1281e7d640 1 Processor -- start 2024-09-12T03:38:21.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.641+0000 7f1281e7d640 1 -- start start 2024-09-12T03:38:21.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f1281e7d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f127c15bec0 0x7f127c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f1281e7d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 0x7f127c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f1281e7d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127c0b3290 con 0x7f127c0af2a0 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f1281e7d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f127c0b3570 con 0x7f127c15bec0 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f1281e7d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f127c0b3850 con 0x7f127c15c2a0 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f127c0af2a0 0x7f127c15fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50844/0 (socket says 172.21.15.73:50844) 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127bfff640 1 -- 172.21.15.73:0/654148361 learned_addr learned my addr 172.21.15.73:0/654148361 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127b7fe640 1 --2- 172.21.15.73:0/654148361 >> v2:172.21.15.150:3300/0 conn(0x7f127c15bec0 0x7f127c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127affd640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 0x7f127c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522300515 0 0) 0x7f127c0b3290 con 0x7f127c0af2a0 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1264003530 con 0x7f127c0af2a0 2024-09-12T03:38:21.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2024630139 0 0) 0x7f1264003530 con 0x7f127c0af2a0 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 msgr2=0x7f127c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 0x7f127c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 >> v2:172.21.15.150:3300/0 conn(0x7f127c15bec0 msgr2=0x7f127c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 --2- 172.21.15.73:0/654148361 >> v2:172.21.15.150:3300/0 conn(0x7f127c15bec0 0x7f127c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c0b3b30 con 0x7f127c0af2a0 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f1274001a00 con 0x7f127c0af2a0 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 >> v1:172.21.15.73:6789/0 conn(0x7f127c0af2a0 legacy=0x7f127c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f1264003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 0x7f1264004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1264004d50 0x7f12640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0b3570 con 0x7f12640039c0 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0b3850 con 0x7f1264004d50 2024-09-12T03:38:21.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f126400b9d0 con 0x7f127c15c2a0 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127b7fe640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f1264003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127affd640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 0x7f1264004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127b7fe640 1 -- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 msgr2=0x7f1264004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127bfff640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1264004d50 0x7f12640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127b7fe640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 0x7f1264004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127b7fe640 1 -- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1264004d50 msgr2=0x7f12640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127b7fe640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1264004d50 0x7f12640051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127b7fe640 1 -- 172.21.15.73:0/654148361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1264003530 con 0x7f12640039c0 2024-09-12T03:38:21.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.645+0000 7f127affd640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c15c2a0 0x7f1264004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:21.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f127b7fe640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f1264003de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f126c009ae0 tx=0x7f126c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adcef45d24e5971 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b2070 con 0x7f12640039c0 2024-09-12T03:38:21.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c0a5650 con 0x7f12640039c0 2024-09-12T03:38:21.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f127a7fc640 1 -- 172.21.15.73:0/654148361 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0096b0 con 0x7f12640039c0 2024-09-12T03:38:21.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 -- 172.21.15.73:0/654148361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 msgr2=0x7f1264003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 --2- 172.21.15.73:0/654148361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f1264003de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f126c009ae0 tx=0x7f126c01ca80 comp rx=0 tx=0).stop 2024-09-12T03:38:21.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f127bfff640 1 -- 172.21.15.73:0/654148361 reap_dead start 2024-09-12T03:38:21.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 -- 172.21.15.73:0/654148361 shutdown_connections 2024-09-12T03:38:21.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 -- 172.21.15.73:0/654148361 >> 172.21.15.73:0/654148361 conn(0x7f127c0b1f90 msgr2=0x7f127c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 -- 172.21.15.73:0/654148361 shutdown_connections 2024-09-12T03:38:21.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 -- 172.21.15.73:0/654148361 wait complete. 2024-09-12T03:38:21.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 Processor -- start 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.649+0000 7f1281e7d640 1 -- start start 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f127c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1578b0 0x7f127c1533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c153910 0x7f127c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0af6d0 con 0x7f12640039c0 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0ad740 con 0x7f127c1578b0 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f127c166ff0 con 0x7f127c153910 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f127c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f127c151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39698/0 (socket says 172.21.15.73:39698) 2024-09-12T03:38:21.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 -- 172.21.15.73:0/3265688453 learned_addr learned my addr 172.21.15.73:0/3265688453 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 -- 172.21.15.73:0/3265688453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c153910 msgr2=0x7f127c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c153910 0x7f127c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 -- 172.21.15.73:0/3265688453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1578b0 msgr2=0x7f127c1533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1578b0 0x7f127c1533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 -- 172.21.15.73:0/3265688453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c15e710 con 0x7f12640039c0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127b7fe640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f127c151af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f126c009ae0 tx=0x7f1264005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1263fff640 1 -- 172.21.15.73:0/3265688453 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b2040 con 0x7f12640039c0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1263fff640 1 -- 172.21.15.73:0/3265688453 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c00f000 con 0x7f12640039c0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1263fff640 1 -- 172.21.15.73:0/3265688453 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c0096b0 con 0x7f12640039c0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c15e9f0 con 0x7f12640039c0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c15efb0 con 0x7f12640039c0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127c153d30 con 0x7f12640039c0 2024-09-12T03:38:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1263fff640 1 -- 172.21.15.73:0/3265688453 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f126c0c0030 con 0x7f12640039c0 2024-09-12T03:38:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1263fff640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f12680678c0 0x7f1268069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f1263fff640 1 -- 172.21.15.73:0/3265688453 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6130+0+0 (secure 0 0 0) 0x7f126c11fa10 con 0x7f12640039c0 2024-09-12T03:38:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127affd640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f12680678c0 0x7f1268069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.653+0000 7f127affd640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f12680678c0 0x7f1268069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f127c09e550 tx=0x7f1270008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.657+0000 7f1263fff640 1 -- 172.21.15.73:0/3265688453 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f126c0c7060 con 0x7f12640039c0 2024-09-12T03:38:21.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f127c06fcd0 con 0x7f12640039c0 2024-09-12T03:38:21.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1263fff640 1 -- 172.21.15.73:0/3265688453 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7f126c11f070 con 0x7f12640039c0 2024-09-12T03:38:21.862 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:38:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f12680678c0 msgr2=0x7f1268069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f12680678c0 0x7f1268069d80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f127c09e550 tx=0x7f1270008040 comp rx=0 tx=0).stop 2024-09-12T03:38:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 msgr2=0x7f127c151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f127c151af0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f126c009ae0 tx=0x7f1264005840 comp rx=0 tx=0).stop 2024-09-12T03:38:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 shutdown_connections 2024-09-12T03:38:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f12680678c0 0x7f1268069d80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f127c153910 0x7f127c155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f127c1578b0 0x7f127c1533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 --2- 172.21.15.73:0/3265688453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12640039c0 0x7f127c151af0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 >> 172.21.15.73:0/3265688453 conn(0x7f127c0b1f90 msgr2=0x7f127c154930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 shutdown_connections 2024-09-12T03:38:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:21.861+0000 7f1281e7d640 1 -- 172.21.15.73:0/3265688453 wait complete. 2024-09-12T03:38:21.881 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:38:21.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:38:21.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-09-12T03:38:21.881 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T03:38:21.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:21.881 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:38:21.881 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:38:21.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:38:21.882 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:38:21.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:21.882 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-09-12T03:38:21.888 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:38:21.888 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-09-12T03:38:21.889 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42267sec preferred_lft 42267sec 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:09:0d:c6:53 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:38:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:38:21.891 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:21.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:21.892 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:38:21.942 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-12T03:38:21.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:21.944 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:38:21.993 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:38:21.994 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:38:21.994 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-09-12T03:38:21.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:38:21.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:38:21.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:38:21.994 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-09-12T03:38:22.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:38:22.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:38:22.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:22.114 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:38:22.162 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T03:38:22.162 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:38:22.162 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:38:22.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:22.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-09-12T03:38:22.218 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-12T03:38:22.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:38:22.219 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:22.270 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T03:38:22.270 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:38:22.270 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:22.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:38:22.375 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:38:22.424 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:38:22.424 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:38:22.424 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:38:22.424 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:38:22.424 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:38:22.424 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:38:22.424 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:38:22.425 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:22.426 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:22.427 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:22.427 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:22.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:22.428 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:38:22.477 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:38:22.477 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-12T03:38:22.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:38:22.536 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:38:22.581 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:38:22.581 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:38:22.581 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:38:22.582 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:38:22.583 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:22.584 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:22.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:22.585 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:38:22.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-09-12T03:38:22.601+0000 7f393e596580 -1 init, newargv = 0x55e70a3a4ef0 newargc=15 2024-09-12T03:38:22.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[44495]: starting ceph client 2024-09-12T03:38:22.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[44495]: starting fuse 2024-09-12T03:38:23.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-09-12T03:38:23.726 DEBUG:teuthology.orchestra.run.smithi073:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:38:23.776 INFO:teuthology.orchestra.run.smithi073.stdout:/sys 2024-09-12T03:38:23.776 INFO:teuthology.orchestra.run.smithi073.stdout:/proc 2024-09-12T03:38:23.776 INFO:teuthology.orchestra.run.smithi073.stdout:/dev 2024-09-12T03:38:23.776 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/pts 2024-09-12T03:38:23.776 INFO:teuthology.orchestra.run.smithi073.stdout:/run 2024-09-12T03:38:23.776 INFO:teuthology.orchestra.run.smithi073.stdout:/ 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/security 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/shm 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/run/lock 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/cgroup 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/pstore 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/bpf 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/hugepages 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/dev/mqueue 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/debug 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/tracing 2024-09-12T03:38:23.777 INFO:teuthology.orchestra.run.smithi073.stdout:/proc/fs/nfsd 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/fs/fuse/connections 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/sys/kernel/config 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/run/rpc_pipefs 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/run/user/1000 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-0 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-1 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-2 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/var/lib/ceph/osd/ceph-3 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:23.778 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:23.779 INFO:teuthology.orchestra.run.smithi073.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:23.779 INFO:teuthology.orchestra.run.smithi073.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:23.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:23.780 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-09-12T03:38:23.825 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-09-12T03:38:23.825 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-12T03:38:23.826 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-09-12T03:38:23.827 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:38:23.828 DEBUG:teuthology.orchestra.run.smithi073:> 2024-09-12T03:38:23.828 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-09-12T03:38:23.828 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-09-12T03:38:23.951 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.44495.asok 2024-09-12T03:38:23.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:38:23.962 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44495.asok 2024-09-12T03:38:23.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:23.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44495.asok status 2024-09-12T03:38:24.114 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:24.114 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-09-12T03:38:24.114 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "44495", 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 6747, 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-09-12T03:38:24.115 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6747 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 653579061 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-09-12T03:38:24.116 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 653579061 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.6747 192.168.0.1:0/653579061", 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/653579061", 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 56, 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 100, 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-09-12T03:38:24.117 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:24.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:24.130 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-09-12T03:38:24.130 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:24.136 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-09-12T03:38:24.136 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:24.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:24.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:24.188 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T03:38:24.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.349+0000 7fe609b39640 1 Processor -- start 2024-09-12T03:38:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe609b39640 1 -- start start 2024-09-12T03:38:24.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe609b39640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe60415bec0 0x7fe6040ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe609b39640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 0x7fe60406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe609b39640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6040b3290 con 0x7fe60415c2a0 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe609b39640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe6040b3570 con 0x7fe60415bec0 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe609b39640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040b3850 con 0x7fe6040af470 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6037fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe60415bec0 0x7fe6040ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6037fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe60415bec0 0x7fe6040ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39706/0 (socket says 172.21.15.73:39706) 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe602ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe60415c2a0 0x7fe6040aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50848/0 (socket says 172.21.15.73:50848) 2024-09-12T03:38:24.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6037fe640 1 -- 172.21.15.73:0/4241376182 learned_addr learned my addr 172.21.15.73:0/4241376182 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe603fff640 1 --2- 172.21.15.73:0/4241376182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 0x7fe60406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6037fe640 1 -- 172.21.15.73:0/4241376182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 msgr2=0x7fe60406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6037fe640 1 --2- 172.21.15.73:0/4241376182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 0x7fe60406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6037fe640 1 -- 172.21.15.73:0/4241376182 >> v1:172.21.15.73:6789/0 conn(0x7fe60415c2a0 legacy=0x7fe6040aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6027fc640 1 -- 172.21.15.73:0/4241376182 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611997775 0 0) 0x7fe6040b3290 con 0x7fe60415c2a0 2024-09-12T03:38:24.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.353+0000 7fe6037fe640 1 -- 172.21.15.73:0/4241376182 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6040b3b30 con 0x7fe60415bec0 2024-09-12T03:38:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe6037fe640 1 --2- 172.21.15.73:0/4241376182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415bec0 0x7fe6040ad200 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009870 tx=0x7fe5f401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ffa24b17f2a770 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe6027fc640 1 -- 172.21.15.73:0/4241376182 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40aa600 con 0x7fe60415bec0 2024-09-12T03:38:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe6027fc640 1 -- 172.21.15.73:0/4241376182 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f40af070 con 0x7fe60415bec0 2024-09-12T03:38:24.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe6027fc640 1 -- 172.21.15.73:0/4241376182 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40aa9c0 con 0x7fe60415bec0 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- 172.21.15.73:0/4241376182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415bec0 msgr2=0x7fe6040ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 --2- 172.21.15.73:0/4241376182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415bec0 0x7fe6040ad200 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009870 tx=0x7fe5f401c4a0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- 172.21.15.73:0/4241376182 shutdown_connections 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 --2- 172.21.15.73:0/4241376182 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 0x7fe60406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 --2- 172.21.15.73:0/4241376182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415bec0 0x7fe6040ad200 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- 172.21.15.73:0/4241376182 >> 172.21.15.73:0/4241376182 conn(0x7fe6040b1f90 msgr2=0x7fe6040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- 172.21.15.73:0/4241376182 shutdown_connections 2024-09-12T03:38:24.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- 172.21.15.73:0/4241376182 wait complete. 2024-09-12T03:38:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 Processor -- start 2024-09-12T03:38:24.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- start start 2024-09-12T03:38:24.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 0x7fe604149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe60415bec0 0x7fe60415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415c2a0 0x7fe60414d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe60406ed50 con 0x7fe60415c2a0 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe6040ad740 con 0x7fe60415bec0 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe60406eed0 con 0x7fe6040af470 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415c2a0 0x7fe60414d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415c2a0 0x7fe60414d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39708/0 (socket says 172.21.15.73:39708) 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 -- 172.21.15.73:0/3112722230 learned_addr learned my addr 172.21.15.73:0/3112722230 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 -- 172.21.15.73:0/3112722230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 msgr2=0x7fe604149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 0x7fe604149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 -- 172.21.15.73:0/3112722230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe60415bec0 msgr2=0x7fe60415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe60415bec0 0x7fe60415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 -- 172.21.15.73:0/3112722230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60414da10 con 0x7fe60415c2a0 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe603fff640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415c2a0 0x7fe60414d4d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00cd70 tx=0x7fe5fc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe5fbfff640 1 -- 172.21.15.73:0/3112722230 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc003ba0 con 0x7fe60415c2a0 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe5fbfff640 1 -- 172.21.15.73:0/3112722230 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5fc003d40 con 0x7fe60415c2a0 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60415d320 con 0x7fe60415c2a0 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.357+0000 7fe5fbfff640 1 -- 172.21.15.73:0/3112722230 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc004240 con 0x7fe60415c2a0 2024-09-12T03:38:24.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.361+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60415d8e0 con 0x7fe60415c2a0 2024-09-12T03:38:24.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.361+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60406e000 con 0x7fe60415c2a0 2024-09-12T03:38:24.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.361+0000 7fe5fbfff640 1 -- 172.21.15.73:0/3112722230 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5fc0043e0 con 0x7fe60415c2a0 2024-09-12T03:38:24.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.361+0000 7fe5fbfff640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678c0 0x7fe5e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:24.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.361+0000 7fe5fbfff640 1 -- 172.21.15.73:0/3112722230 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7fe5fc086820 con 0x7fe60415c2a0 2024-09-12T03:38:24.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.361+0000 7fe6037fe640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678c0 0x7fe5e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:24.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.361+0000 7fe6037fe640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678c0 0x7fe5e4069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40ae000 tx=0x7fe5f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:24.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.365+0000 7fe5fbfff640 1 -- 172.21.15.73:0/3112722230 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe5fc01d340 con 0x7fe60415c2a0 2024-09-12T03:38:24.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe60406fcd0 con 0x7fe60415c2a0 2024-09-12T03:38:24.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe5fbfff640 1 -- 172.21.15.73:0/3112722230 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7fe5fc057240 con 0x7fe60415c2a0 2024-09-12T03:38:24.566 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678c0 msgr2=0x7fe5e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678c0 0x7fe5e4069d80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40ae000 tx=0x7fe5f4008040 comp rx=0 tx=0).stop 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415c2a0 msgr2=0x7fe60414d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415c2a0 0x7fe60414d4d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00cd70 tx=0x7fe5fc00a660 comp rx=0 tx=0).stop 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 shutdown_connections 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5e40678c0 0x7fe5e4069d80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe60415c2a0 0x7fe60414d4d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe60415bec0 0x7fe60415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 --2- 172.21.15.73:0/3112722230 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe6040af470 0x7fe604149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 >> 172.21.15.73:0/3112722230 conn(0x7fe6040b1f90 msgr2=0x7fe6040cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 shutdown_connections 2024-09-12T03:38:24.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:24.565+0000 7fe609b39640 1 -- 172.21.15.73:0/3112722230 wait complete. 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T03:38:24.584 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:38:24.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:24.585 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2024-09-12T03:38:24.592 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42275sec preferred_lft 42275sec 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-12T03:38:24.593 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:51:d6:37:b1 brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-12T03:38:24.594 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.595 INFO:teuthology.orchestra.run.smithi150.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T03:38:24.595 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:24.595 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-12T03:38:24.595 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2024-09-12T03:38:24.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:24.595 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T03:38:24.647 INFO:teuthology.orchestra.run.smithi150.stdout:1 2024-09-12T03:38:24.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:24.649 DEBUG:teuthology.orchestra.run.smithi150:> route 2024-09-12T03:38:24.699 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2024-09-12T03:38:24.699 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T03:38:24.699 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-12T03:38:24.699 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T03:38:24.699 INFO:teuthology.orchestra.run.smithi150.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-12T03:38:24.699 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-12T03:38:24.699 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T03:38:24.700 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:38:24.700 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:38:24.700 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-12T03:38:24.700 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T03:38:24.700 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T03:38:24.700 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2024-09-12T03:38:24.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T03:38:24.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T03:38:24.700 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T03:38:24.700 DEBUG:teuthology.orchestra.run.smithi150:> ') 2024-09-12T03:38:24.789 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:38:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T03:38:24.816 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:38:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:38:24.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:24.824 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:38:24.829 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:38:24.830 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:38:24.830 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:38:24.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:24.830 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2024-09-12T03:38:24.881 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-12T03:38:24.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:38:24.881 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:24.928 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T03:38:24.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T03:38:24.928 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:24.976 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:38:25.038 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:38:25.089 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:38:25.090 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:38:25.091 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:25.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:25.093 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:38:25.139 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T03:38:25.140 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-12T03:38:25.184 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:38:25.197 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:38:25.244 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:38:25.244 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:38:25.244 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:38:25.244 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:38:25.244 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:38:25.245 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:38:25.245 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:38:25.245 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:38:25.245 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:38:25.245 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:38:25.245 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:38:25.246 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:38:25.246 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:38:25.246 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:38:25.246 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:38:25.246 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:38:25.246 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:38:25.247 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:38:25.247 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:38:25.247 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:38:25.247 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:38:25.247 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:38:25.248 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:25.249 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:25.249 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:25.249 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:25.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:25.250 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:38:25.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:2024-09-12T03:38:25.263+0000 7efc775ff580 -1 init, newargv = 0x563217825150 newargc=15 2024-09-12T03:38:25.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35645]: starting ceph client 2024-09-12T03:38:25.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35645]: starting fuse 2024-09-12T03:38:26.370 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2024-09-12T03:38:26.386 DEBUG:teuthology.orchestra.run.smithi150:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T03:38:26.436 INFO:teuthology.orchestra.run.smithi150.stdout:/sys 2024-09-12T03:38:26.436 INFO:teuthology.orchestra.run.smithi150.stdout:/proc 2024-09-12T03:38:26.436 INFO:teuthology.orchestra.run.smithi150.stdout:/dev 2024-09-12T03:38:26.436 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/pts 2024-09-12T03:38:26.436 INFO:teuthology.orchestra.run.smithi150.stdout:/run 2024-09-12T03:38:26.436 INFO:teuthology.orchestra.run.smithi150.stdout:/ 2024-09-12T03:38:26.436 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/security 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/shm 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/run/lock 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/cgroup 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/pstore 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/bpf 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/hugepages 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/mqueue 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/debug 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/tracing 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/proc/fs/nfsd 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/fs/fuse/connections 2024-09-12T03:38:26.437 INFO:teuthology.orchestra.run.smithi150.stdout:/sys/kernel/config 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/run/credentials/systemd-sysusers.service 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/run/rpc_pipefs 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/run/user/1000 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-4 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-5 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-6 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/var/lib/ceph/osd/ceph-7 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:26.439 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:26.439 INFO:teuthology.orchestra.run.smithi150.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:26.439 INFO:teuthology.orchestra.run.smithi150.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:26.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.440 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2024-09-12T03:38:26.488 INFO:teuthology.orchestra.run.smithi150.stdout:45 2024-09-12T03:38:26.488 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> sudo stdin-killer -- python3 -c ' 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> import re 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-12T03:38:26.489 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> return f 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:26.490 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.1")) 2024-09-12T03:38:26.491 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:38:26.612 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.1.35645.asok 2024-09-12T03:38:26.616 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:38:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:38:26.625 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.35645.asok 2024-09-12T03:38:26.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.628 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.35645.asok status 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "1", 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "35645", 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2024-09-12T03:38:26.774 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 5593, 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 5593 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:38:26.775 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2675544663 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "192.168.0.1:0", 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2675544663 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.5593 192.168.0.1:0/2675544663", 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "192.168.0.1:0/2675544663", 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 56, 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 100, 2024-09-12T03:38:26.776 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2024-09-12T03:38:26.777 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2024-09-12T03:38:26.777 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2024-09-12T03:38:26.777 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-09-12T03:38:26.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.787 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2024-09-12T03:38:26.787 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:26.793 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2024-09-12T03:38:26.794 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:26.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.794 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:26.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.847 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_files) 2024-09-12T03:38:26.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.862 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir_data) 2024-09-12T03:38:26.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.915 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 100 ./subdir_files) 2024-09-12T03:38:26.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:26.973 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 104857600 ./subdir_data) 2024-09-12T03:38:27.028 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:27.028 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:27.035 DEBUG:teuthology.orchestra.run.smithi150:> stdin-killer -- python3 -c ' 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> import uuid 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> n = 20 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> create_hard_links = False 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> if 0 > 0: 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> create_hard_links = True 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> dpath = os.path.dirname(path) 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> fnameprefix = os.path.basename(path) 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> os.makedirs(dpath, exist_ok=True) 2024-09-12T03:38:27.036 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.037 DEBUG:teuthology.orchestra.run.smithi150:> try: 2024-09-12T03:38:27.037 DEBUG:teuthology.orchestra.run.smithi150:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T03:38:27.037 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.037 DEBUG:teuthology.orchestra.run.smithi150:> for i in range(n): 2024-09-12T03:38:27.037 DEBUG:teuthology.orchestra.run.smithi150:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T03:38:27.037 DEBUG:teuthology.orchestra.run.smithi150:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T03:38:27.037 DEBUG:teuthology.orchestra.run.smithi150:> f.write(f"{i}") 2024-09-12T03:38:27.039 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> f.flush() 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> os.fsync(f.fileno()) 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> os.unlink(fpath) 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> os.fsync(dirfd) 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> if create_hard_links: 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> for j in range(0): 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> os.fsync(dirfd) 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> finally: 2024-09-12T03:38:27.040 DEBUG:teuthology.orchestra.run.smithi150:> os.close(dirfd) 2024-09-12T03:38:27.041 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:38:27.377 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:38:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T03:38:27.386 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:27.386 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:27.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:27.437 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=20 seek=0) 2024-09-12T03:38:27.666 INFO:teuthology.orchestra.run.smithi150.stderr:20+0 records in 2024-09-12T03:38:27.667 INFO:teuthology.orchestra.run.smithi150.stderr:20+0 records out 2024-09-12T03:38:27.667 INFO:teuthology.orchestra.run.smithi150.stderr:20971520 bytes (21 MB, 20 MiB) copied, 0.175429 s, 120 MB/s 2024-09-12T03:38:27.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:27.668 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_files -v 10 ./subdir_files) 2024-09-12T03:38:27.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:27.682 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1048576 ./subdir_data) 2024-09-12T03:38:27.737 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:27.737 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:27.743 DEBUG:teuthology.orchestra.run.smithi150:> stdin-killer -- python3 -c ' 2024-09-12T03:38:27.743 DEBUG:teuthology.orchestra.run.smithi150:> import os 2024-09-12T03:38:27.743 DEBUG:teuthology.orchestra.run.smithi150:> import uuid 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> n = 40 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> create_hard_links = False 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> if 0 > 0: 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> create_hard_links = True 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> path = "/home/ubuntu/cephtest/mnt.1/subdir_files/file" 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> dpath = os.path.dirname(path) 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> fnameprefix = os.path.basename(path) 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> os.makedirs(dpath, exist_ok=True) 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> try: 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T03:38:27.744 DEBUG:teuthology.orchestra.run.smithi150:> 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> for i in range(n): 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> f.write(f"{i}") 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> f.flush() 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> os.fsync(f.fileno()) 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> os.unlink(fpath) 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> os.fsync(dirfd) 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> if create_hard_links: 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> for j in range(0): 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T03:38:27.745 DEBUG:teuthology.orchestra.run.smithi150:> if False: 2024-09-12T03:38:27.746 DEBUG:teuthology.orchestra.run.smithi150:> os.fsync(dirfd) 2024-09-12T03:38:27.746 DEBUG:teuthology.orchestra.run.smithi150:> finally: 2024-09-12T03:38:27.746 DEBUG:teuthology.orchestra.run.smithi150:> os.close(dirfd) 2024-09-12T03:38:27.746 DEBUG:teuthology.orchestra.run.smithi150:> ' 2024-09-12T03:38:28.128 INFO:teuthology.orchestra.run.smithi150.stderr:Traceback (most recent call last): 2024-09-12T03:38:28.128 INFO:teuthology.orchestra.run.smithi150.stderr: File "", line 20, in 2024-09-12T03:38:28.128 INFO:teuthology.orchestra.run.smithi150.stderr:OSError: [Errno 122] Disk quota exceeded: '/home/ubuntu/cephtest/mnt.1/subdir_files/file_20' 2024-09-12T03:38:28.138 INFO:teuthology.orchestra.run.smithi150.stderr:2024-09-12T03:38:28 stdin-killer INFO: command exited with status 1: exiting normally with same code! 2024-09-12T03:38:28.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:38:28.146 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:28.146 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:28.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:28.193 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.1 && exec dd if=/dev/urandom of=subdir_data/file bs=1M conv=fdatasync count=40 seek=0) 2024-09-12T03:38:28.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:38:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:dd: error writing 'subdir_data/file': Disk quota exceeded 2024-09-12T03:38:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:3+0 records in 2024-09-12T03:38:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2+0 records out 2024-09-12T03:38:28.272 INFO:teuthology.orchestra.run.smithi150.stderr:2359296 bytes (2.4 MB, 2.2 MiB) copied, 0.0173203 s, 136 MB/s 2024-09-12T03:38:28.272 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T03:38:28.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:38:28.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T03:38:28.373 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T03:38:28.373 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:38:28.373 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:38:28.373 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:28.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:38:28.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411c47a640 1 Processor -- start 2024-09-12T03:38:28.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411c47a640 1 -- start start 2024-09-12T03:38:28.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411c47a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4114070020 0x7f411415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411c47a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41140aede0 con 0x7f411415f1d0 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411c47a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411415fa10 con 0x7f41141520a0 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411c47a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f4114152480 con 0x7f4114070020 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411aa17640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f411415f1d0 0x7f41140adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50206/0 (socket says 172.21.15.73:50206) 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f411aa17640 1 -- 172.21.15.73:0/870178342 learned_addr learned my addr 172.21.15.73:0/870178342 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119a15640 1 --2- 172.21.15.73:0/870178342 >> v2:172.21.15.150:3300/0 conn(0x7f4114070020 0x7f411415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986278942 0 0) 0x7f41140aede0 con 0x7f411415f1d0 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4100003530 con 0x7f411415f1d0 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473846777 0 0) 0x7f4100003530 con 0x7f411415f1d0 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 >> v2:172.21.15.150:3300/0 conn(0x7f4114070020 msgr2=0x7f411415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:28.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 --2- 172.21.15.73:0/870178342 >> v2:172.21.15.150:3300/0 conn(0x7f4114070020 0x7f411415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 >> v1:172.21.15.150:6789/0 conn(0x7f41141520a0 legacy=0x7f411406f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4114074250 con 0x7f411415f1d0 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f410c001a00 con 0x7f411415f1d0 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 >> v1:172.21.15.73:6789/0 conn(0x7f411415f1d0 legacy=0x7f41140adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41000039c0 0x7f4100003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4100004810 0x7f4100004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000051d0 0x7f410000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f410000c0f0 con 0x7f41000039c0 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f410000c2a0 con 0x7f41000051d0 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.549+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f410000c4a0 con 0x7f4100004810 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411a216640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41000039c0 0x7f4100003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411aa17640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000051d0 0x7f410000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411a216640 1 -- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4100004810 msgr2=0x7f4100004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:28.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f4119a15640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4100004810 0x7f4100004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411a216640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f4100004810 0x7f4100004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411a216640 1 -- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000051d0 msgr2=0x7f410000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:28.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411a216640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000051d0 0x7f410000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411a216640 1 -- 172.21.15.73:0/870178342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4100003530 con 0x7f41000039c0 2024-09-12T03:38:28.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411aa17640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000051d0 0x7f410000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:28.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411aa17640 1 -- 172.21.15.73:0/870178342 reap_dead start 2024-09-12T03:38:28.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411a216640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41000039c0 0x7f4100003de0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f4110001780 tx=0x7f411001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775234908eaae5e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:28.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41100013a0 con 0x7f41000039c0 2024-09-12T03:38:28.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41100052f0 con 0x7f41000039c0 2024-09-12T03:38:28.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f4119214640 1 -- 172.21.15.73:0/870178342 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110003840 con 0x7f41000039c0 2024-09-12T03:38:28.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411c47a640 1 -- 172.21.15.73:0/870178342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41000039c0 msgr2=0x7f4100003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411c47a640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41000039c0 0x7f4100003de0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f4110001780 tx=0x7f411001c3d0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411c47a640 1 -- 172.21.15.73:0/870178342 shutdown_connections 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411c47a640 1 --2- 172.21.15.73:0/870178342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41000039c0 0x7f4100003de0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411c47a640 1 -- 172.21.15.73:0/870178342 >> 172.21.15.73:0/870178342 conn(0x7f41140b1f90 msgr2=0x7f41140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411c47a640 1 -- 172.21.15.73:0/870178342 shutdown_connections 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.553+0000 7f411c47a640 1 -- 172.21.15.73:0/870178342 wait complete. 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 Processor -- start 2024-09-12T03:38:28.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 -- start start 2024-09-12T03:38:28.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000039c0 0x7f411414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41141eb700 0x7f41141ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41141e8150 0x7f41141e85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f411406fd20 con 0x7f41141e8150 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f4114073d30 con 0x7f41000039c0 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f411406fea0 con 0x7f41141eb700 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41141e8150 0x7f41141e85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41141e8150 0x7f41141e85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58376/0 (socket says 172.21.15.73:58376) 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 -- 172.21.15.73:0/2448066896 learned_addr learned my addr 172.21.15.73:0/2448066896 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411a216640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000039c0 0x7f411414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f4119a15640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41141eb700 0x7f41141ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 -- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41141eb700 msgr2=0x7f41141ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41141eb700 0x7f41141ebb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 -- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000039c0 msgr2=0x7f411414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000039c0 0x7f411414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 -- 172.21.15.73:0/2448066896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411414ebc0 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f4119a15640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41141eb700 0x7f41141ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411aa17640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41141e8150 0x7f41141e85d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f411415f5b0 tx=0x7f410c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f410affd640 1 -- 172.21.15.73:0/2448066896 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c004d70 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f410affd640 1 -- 172.21.15.73:0/2448066896 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410c00bb80 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41141e7d40 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f410affd640 1 -- 172.21.15.73:0/2448066896 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c007070 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f411414f090 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f411414fe50 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.557+0000 7f410affd640 1 -- 172.21.15.73:0/2448066896 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f410c01b020 con 0x7f41141e8150 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.561+0000 7f410affd640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40f80678f0 0x7f40f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:28.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.561+0000 7f410affd640 1 -- 172.21.15.73:0/2448066896 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7f410c085e10 con 0x7f41141e8150 2024-09-12T03:38:28.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.561+0000 7f411a216640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40f80678f0 0x7f40f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:28.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.561+0000 7f411a216640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40f80678f0 0x7f40f8069db0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4110001750 tx=0x7f41100011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:28.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.565+0000 7f410affd640 1 -- 172.21.15.73:0/2448066896 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f410c056830 con 0x7f41141e8150 2024-09-12T03:38:28.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.737+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4114068e50 con 0x7f41141e8150 2024-09-12T03:38:28.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.737+0000 7f410affd640 1 -- 172.21.15.73:0/2448066896 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v100) ==== 80+0+0 (secure 0 0 0) 0x7f410c056130 con 0x7f41141e8150 2024-09-12T03:38:28.739 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:38:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40f80678f0 msgr2=0x7f40f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40f80678f0 0x7f40f8069db0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4110001750 tx=0x7f41100011a0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41141e8150 msgr2=0x7f41141e85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41141e8150 0x7f41141e85d0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f411415f5b0 tx=0x7f410c00b4a0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 shutdown_connections 2024-09-12T03:38:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f40f80678f0 0x7f40f8069db0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41141e8150 0x7f41141e85d0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f41141eb700 0x7f41141ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 --2- 172.21.15.73:0/2448066896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41000039c0 0x7f411414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:28.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 >> 172.21.15.73:0/2448066896 conn(0x7f41140b1f90 msgr2=0x7f41140afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:28.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 shutdown_connections 2024-09-12T03:38:28.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:28.741+0000 7f411c47a640 1 -- 172.21.15.73:0/2448066896 wait complete. 2024-09-12T03:38:28.757 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-09-12T03:38:28.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:28.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-12T03:38:28.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[44495]: fuse finished with error 0 and tester_r 0 2024-09-12T03:38:28.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:38:28.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:28.769 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T03:38:28.845 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:38:28.845 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:28.845 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:28.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T03:38:29.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee2a1d3640 1 Processor -- start 2024-09-12T03:38:29.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee2a1d3640 1 -- start start 2024-09-12T03:38:29.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee2a1d3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fee240b39a0 0x7fee2406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee2a1d3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee2406ec60 con 0x7fee2406e4b0 2024-09-12T03:38:29.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee2a1d3640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee2406ef40 con 0x7fee241587a0 2024-09-12T03:38:29.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee2a1d3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fee2406f870 con 0x7fee240b39a0 2024-09-12T03:38:29.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee22ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fee240b39a0 0x7fee2406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee23fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fee2406e4b0 0x7fee24072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50220/0 (socket says 172.21.15.73:50220) 2024-09-12T03:38:29.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee23fff640 1 -- 172.21.15.73:0/2925397404 learned_addr learned my addr 172.21.15.73:0/2925397404 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:29.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee22ffd640 1 -- 172.21.15.73:0/2925397404 >> v1:172.21.15.150:6789/0 conn(0x7fee241587a0 legacy=0x7fee240b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee22ffd640 1 -- 172.21.15.73:0/2925397404 >> v1:172.21.15.73:6789/0 conn(0x7fee2406e4b0 legacy=0x7fee24072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee227fc640 1 -- 172.21.15.73:0/2925397404 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612206335 0 0) 0x7fee2406ec60 con 0x7fee2406e4b0 2024-09-12T03:38:29.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.017+0000 7fee22ffd640 1 -- 172.21.15.73:0/2925397404 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2406f220 con 0x7fee240b39a0 2024-09-12T03:38:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee22ffd640 1 --2- 172.21.15.73:0/2925397404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee240b39a0 0x7fee2406df70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fee2406f9f0 tx=0x7fee0c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52332825f05667e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee227fc640 1 -- 172.21.15.73:0/2925397404 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0ab650 con 0x7fee240b39a0 2024-09-12T03:38:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee227fc640 1 -- 172.21.15.73:0/2925397404 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0c0b0070 con 0x7fee240b39a0 2024-09-12T03:38:29.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee227fc640 1 -- 172.21.15.73:0/2925397404 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0aba10 con 0x7fee240b39a0 2024-09-12T03:38:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 -- 172.21.15.73:0/2925397404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee240b39a0 msgr2=0x7fee2406df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/2925397404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee240b39a0 0x7fee2406df70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fee2406f9f0 tx=0x7fee0c01c430 comp rx=0 tx=0).stop 2024-09-12T03:38:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 -- 172.21.15.73:0/2925397404 shutdown_connections 2024-09-12T03:38:29.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/2925397404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee240b39a0 0x7fee2406df70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 -- 172.21.15.73:0/2925397404 >> 172.21.15.73:0/2925397404 conn(0x7fee240b1f90 msgr2=0x7fee240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 -- 172.21.15.73:0/2925397404 shutdown_connections 2024-09-12T03:38:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 -- 172.21.15.73:0/2925397404 wait complete. 2024-09-12T03:38:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 Processor -- start 2024-09-12T03:38:29.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.021+0000 7fee2a1d3640 1 -- start start 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee2406e4b0 0x7fee24147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee240b39a0 0x7fee24151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee241587a0 0x7fee241544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fee24073200 con 0x7fee2406e4b0 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fee24073080 con 0x7fee240b39a0 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fee24073380 con 0x7fee241587a0 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee2406e4b0 0x7fee24147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee2406e4b0 0x7fee24147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58390/0 (socket says 172.21.15.73:58390) 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 -- 172.21.15.73:0/4097932738 learned_addr learned my addr 172.21.15.73:0/4097932738 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee22ffd640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee240b39a0 0x7fee24151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee23fff640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee241587a0 0x7fee241544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 -- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee241587a0 msgr2=0x7fee241544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee241587a0 0x7fee241544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 -- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee240b39a0 msgr2=0x7fee24151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee240b39a0 0x7fee24151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 -- 172.21.15.73:0/4097932738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee24152680 con 0x7fee2406e4b0 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee237fe640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee2406e4b0 0x7fee24147250 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00ba50 tx=0x7fee1c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee1bfff640 1 -- 172.21.15.73:0/4097932738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c019070 con 0x7fee2406e4b0 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee1bfff640 1 -- 172.21.15.73:0/4097932738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c00cc20 con 0x7fee2406e4b0 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee24152960 con 0x7fee2406e4b0 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee1bfff640 1 -- 172.21.15.73:0/4097932738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c014680 con 0x7fee2406e4b0 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee24152f20 con 0x7fee2406e4b0 2024-09-12T03:38:29.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee24070080 con 0x7fee2406e4b0 2024-09-12T03:38:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee1bfff640 1 -- 172.21.15.73:0/4097932738 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fee1c01c070 con 0x7fee2406e4b0 2024-09-12T03:38:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee1bfff640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fee040678c0 0x7fee04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee22ffd640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fee040678c0 0x7fee04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.025+0000 7fee1bfff640 1 -- 172.21.15.73:0/4097932738 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7fee1c085aa0 con 0x7fee2406e4b0 2024-09-12T03:38:29.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.029+0000 7fee22ffd640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fee040678c0 0x7fee04069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0af000 tx=0x7fee0c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:29.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.033+0000 7fee1bfff640 1 -- 172.21.15.73:0/4097932738 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fee1c055e70 con 0x7fee2406e4b0 2024-09-12T03:38:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.205+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee24161680 con 0x7fee2406e4b0 2024-09-12T03:38:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.205+0000 7fee1bfff640 1 -- 172.21.15.73:0/4097932738 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v100) ==== 80+0+0 (secure 0 0 0) 0x7fee1c05a170 con 0x7fee2406e4b0 2024-09-12T03:38:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-09-12T03:38:29.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fee040678c0 msgr2=0x7fee04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fee040678c0 0x7fee04069d80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0af000 tx=0x7fee0c0a7000 comp rx=0 tx=0).stop 2024-09-12T03:38:29.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee2406e4b0 msgr2=0x7fee24147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee2406e4b0 0x7fee24147250 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00ba50 tx=0x7fee1c00bf10 comp rx=0 tx=0).stop 2024-09-12T03:38:29.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 shutdown_connections 2024-09-12T03:38:29.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fee040678c0 0x7fee04069d80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fee241587a0 0x7fee241544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee240b39a0 0x7fee24151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 --2- 172.21.15.73:0/4097932738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee2406e4b0 0x7fee24147250 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 >> 172.21.15.73:0/4097932738 conn(0x7fee240b1f90 msgr2=0x7fee24151170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:29.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 shutdown_connections 2024-09-12T03:38:29.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.209+0000 7fee2a1d3640 1 -- 172.21.15.73:0/4097932738 wait complete. 2024-09-12T03:38:29.226 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2024-09-12T03:38:29.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:29.227 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-12T03:38:29.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi150.stderr:ceph-fuse[35645]: fuse finished with error 0 and tester_r 0 2024-09-12T03:38:29.243 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:38:29.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:29.243 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T03:38:29.415 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:38:29.416 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:38:29.416 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:29.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:38:29.422 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:38:29.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:29.422 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T03:38:29.469 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-09-12T03:38:29.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:38:29.470 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T03:38:29.471 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:29.471 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:29.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:38:29.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:38:29.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:29.477 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T03:38:29.523 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-09-12T03:38:29.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:38:29.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:38:29.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 Processor -- start 2024-09-12T03:38:29.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 -- start start 2024-09-12T03:38:29.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c7415bec0 0x7f6c740ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f6c740af2a0 0x7f6c7415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6c740b3290 con 0x7f6c7415bec0 2024-09-12T03:38:29.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f6c740b3570 con 0x7f6c740af2a0 2024-09-12T03:38:29.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c7b768640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6c740b3850 con 0x7f6c7415c2a0 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.657+0000 7f6c79504640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c7415bec0 0x7f6c740ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c7415bec0 0x7f6c740ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58400/0 (socket says 172.21.15.73:58400) 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 -- 172.21.15.73:0/1862296600 learned_addr learned my addr 172.21.15.73:0/1862296600 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c78d03640 1 --2- 172.21.15.73:0/1862296600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79d05640 1 --2- 172.21.15.73:0/1862296600 >> v2:172.21.15.150:3300/0 conn(0x7f6c740af2a0 0x7f6c7415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 -- 172.21.15.73:0/1862296600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 msgr2=0x7f6c740aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 --2- 172.21.15.73:0/1862296600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 -- 172.21.15.73:0/1862296600 >> v2:172.21.15.150:3300/0 conn(0x7f6c740af2a0 msgr2=0x7f6c7415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 --2- 172.21.15.73:0/1862296600 >> v2:172.21.15.150:3300/0 conn(0x7f6c740af2a0 0x7f6c7415fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 -- 172.21.15.73:0/1862296600 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c740b3b30 con 0x7f6c7415bec0 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c78d03640 1 --2- 172.21.15.73:0/1862296600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:29.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79d05640 1 --2- 172.21.15.73:0/1862296600 >> v2:172.21.15.150:3300/0 conn(0x7f6c740af2a0 0x7f6c7415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:29.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c79504640 1 --2- 172.21.15.73:0/1862296600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c740ad200 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6c7406dc90 tx=0x7f6c7001c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c982198252ac44c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:29.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c6bfff640 1 -- 172.21.15.73:0/1862296600 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700a5580 con 0x7f6c7415bec0 2024-09-12T03:38:29.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c6bfff640 1 -- 172.21.15.73:0/1862296600 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c700a5720 con 0x7f6c7415bec0 2024-09-12T03:38:29.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c6bfff640 1 -- 172.21.15.73:0/1862296600 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700a5af0 con 0x7f6c7415bec0 2024-09-12T03:38:29.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 -- 172.21.15.73:0/1862296600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 msgr2=0x7f6c740ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 --2- 172.21.15.73:0/1862296600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c740ad200 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6c7406dc90 tx=0x7f6c7001c700 comp rx=0 tx=0).stop 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 -- 172.21.15.73:0/1862296600 shutdown_connections 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 --2- 172.21.15.73:0/1862296600 >> v2:172.21.15.150:3300/0 conn(0x7f6c740af2a0 0x7f6c7415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 --2- 172.21.15.73:0/1862296600 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 --2- 172.21.15.73:0/1862296600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c740ad200 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 -- 172.21.15.73:0/1862296600 >> 172.21.15.73:0/1862296600 conn(0x7f6c740b1f90 msgr2=0x7f6c740b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 -- 172.21.15.73:0/1862296600 shutdown_connections 2024-09-12T03:38:29.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.661+0000 7f6c7b768640 1 -- 172.21.15.73:0/1862296600 wait complete. 2024-09-12T03:38:29.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 Processor -- start 2024-09-12T03:38:29.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 -- start start 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740af2a0 0x7f6c74148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c7414f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740af6b0 con 0x7f6c7415bec0 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f6c740ad740 con 0x7f6c740af2a0 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7406e000 con 0x7f6c7415c2a0 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c7414f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c7414f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58410/0 (socket says 172.21.15.73:58410) 2024-09-12T03:38:29.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 -- 172.21.15.73:0/4149116613 learned_addr learned my addr 172.21.15.73:0/4149116613 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c79d05640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c79504640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740af2a0 0x7f6c74148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 -- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 msgr2=0x7f6c740d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 -- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740af2a0 msgr2=0x7f6c74148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740af2a0 0x7f6c74148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 -- 172.21.15.73:0/4149116613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c741491c0 con 0x7f6c7415bec0 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c79504640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740af2a0 0x7f6c74148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c78d03640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c7414f5a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400d800 tx=0x7f6c6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c69ffb640 1 -- 172.21.15.73:0/4149116613 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400b6c0 con 0x7f6c7415bec0 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c69ffb640 1 -- 172.21.15.73:0/4149116613 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c64019070 con 0x7f6c7415bec0 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c741494a0 con 0x7f6c7415bec0 2024-09-12T03:38:29.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c69ffb640 1 -- 172.21.15.73:0/4149116613 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400baa0 con 0x7f6c7415bec0 2024-09-12T03:38:29.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.665+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c74149a60 con 0x7f6c7415bec0 2024-09-12T03:38:29.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.669+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c740ad200 con 0x7f6c7415bec0 2024-09-12T03:38:29.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.669+0000 7f6c69ffb640 1 -- 172.21.15.73:0/4149116613 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c6400bc40 con 0x7f6c7415bec0 2024-09-12T03:38:29.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.669+0000 7f6c69ffb640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c580678c0 0x7f6c58069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:29.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.669+0000 7f6c69ffb640 1 -- 172.21.15.73:0/4149116613 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7f6c640861e0 con 0x7f6c7415bec0 2024-09-12T03:38:29.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.669+0000 7f6c79504640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c580678c0 0x7f6c58069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:29.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.669+0000 7f6c79504640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c580678c0 0x7f6c58069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c700ae000 tx=0x7f6c700a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:29.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.673+0000 7f6c69ffb640 1 -- 172.21.15.73:0/4149116613 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6c64056b70 con 0x7f6c7415bec0 2024-09-12T03:38:29.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.869+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c7406fcd0 con 0x7f6c7415bec0 2024-09-12T03:38:29.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.869+0000 7f6c69ffb640 1 -- 172.21.15.73:0/4149116613 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f6c64056470 con 0x7f6c7415bec0 2024-09-12T03:38:29.872 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:29.872 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"btime":"2024-09-12T03:38:14:379931+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5521,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2804939638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2804939638},{"type":"v1","addr":"172.21.15.150:6833","nonce":2804939638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2609449242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2609449242},{"type":"v1","addr":"172.21.15.150:6835","nonce":2609449242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3463752136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3463752136},{"type":"v1","addr":"172.21.15.73:6835","nonce":3463752136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:38:10.712259+0000","modified":"2024-09-12T03:38:13.741150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3586054053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3586054053},{"type":"v1","addr":"172.21.15.73:6837","nonce":3586054053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6579,"qdb_cluster":[6579]},"id":7}]} 2024-09-12T03:38:29.873 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 56 2024-09-12T03:38:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c580678c0 msgr2=0x7f6c58069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c580678c0 0x7f6c58069d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c700ae000 tx=0x7f6c700a7070 comp rx=0 tx=0).stop 2024-09-12T03:38:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 msgr2=0x7f6c7414f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c7414f5a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400d800 tx=0x7f6c6400dcc0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 shutdown_connections 2024-09-12T03:38:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f6c580678c0 0x7f6c58069d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c7415bec0 0x7f6c7414f5a0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f6c7415c2a0 0x7f6c740d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 --2- 172.21.15.73:0/4149116613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c740af2a0 0x7f6c74148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 >> 172.21.15.73:0/4149116613 conn(0x7f6c740b1f90 msgr2=0x7f6c740b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 shutdown_connections 2024-09-12T03:38:29.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:29.873+0000 7f6c7b768640 1 -- 172.21.15.73:0/4149116613 wait complete. 2024-09-12T03:38:29.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:38:30.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55c63a640 1 Processor -- start 2024-09-12T03:38:30.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55c63a640 1 -- start start 2024-09-12T03:38:30.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55c63a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe55409aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55c63a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe55406c3d0 0x7fe55415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55c63a640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5540b5c90 con 0x7fe5540b40c0 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55c63a640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe5540b4860 con 0x7fe55406c3d0 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55c63a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe5540b4580 con 0x7fe55415e450 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55a3d6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe55409aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55abd7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe55406c3d0 0x7fe55415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55a3d6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe55409aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:33586/0 (socket says 172.21.15.73:33586) 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.001+0000 7fe55a3d6640 1 -- 172.21.15.73:0/177415992 learned_addr learned my addr 172.21.15.73:0/177415992 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55a3d6640 1 -- 172.21.15.73:0/177415992 >> v2:172.21.15.150:3300/0 conn(0x7fe55406c3d0 msgr2=0x7fe55415fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55a3d6640 1 --2- 172.21.15.73:0/177415992 >> v2:172.21.15.150:3300/0 conn(0x7fe55406c3d0 0x7fe55415fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55a3d6640 1 -- 172.21.15.73:0/177415992 >> v1:172.21.15.150:6789/0 conn(0x7fe5540b40c0 legacy=0x7fe55406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55a3d6640 1 -- 172.21.15.73:0/177415992 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5540b5f10 con 0x7fe55415e450 2024-09-12T03:38:30.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55abd7640 1 --2- 172.21.15.73:0/177415992 >> v2:172.21.15.150:3300/0 conn(0x7fe55406c3d0 0x7fe55415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:38:30.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55a3d6640 1 --2- 172.21.15.73:0/177415992 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe55409aa00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe544009870 tx=0x7fe54401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62c2a33226009fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe5593d4640 1 -- 172.21.15.73:0/177415992 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5440b1070 con 0x7fe55415e450 2024-09-12T03:38:30.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe5593d4640 1 -- 172.21.15.73:0/177415992 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5440a8050 con 0x7fe55415e450 2024-09-12T03:38:30.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe5593d4640 1 -- 172.21.15.73:0/177415992 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5440ac860 con 0x7fe55415e450 2024-09-12T03:38:30.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 -- 172.21.15.73:0/177415992 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 msgr2=0x7fe55409aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 --2- 172.21.15.73:0/177415992 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe55409aa00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe544009870 tx=0x7fe54401c4d0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 -- 172.21.15.73:0/177415992 shutdown_connections 2024-09-12T03:38:30.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 --2- 172.21.15.73:0/177415992 >> v2:172.21.15.150:3300/0 conn(0x7fe55406c3d0 0x7fe55415fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 --2- 172.21.15.73:0/177415992 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe55409aa00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 -- 172.21.15.73:0/177415992 >> 172.21.15.73:0/177415992 conn(0x7fe5540b6800 msgr2=0x7fe5540b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:30.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 -- 172.21.15.73:0/177415992 shutdown_connections 2024-09-12T03:38:30.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.005+0000 7fe55c63a640 1 -- 172.21.15.73:0/177415992 wait complete. 2024-09-12T03:38:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 Processor -- start 2024-09-12T03:38:30.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 -- start start 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55406c3d0 0x7fe554150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5540b40c0 0x7fe55414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe5541546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe554162d00 con 0x7fe55406c3d0 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe554162b80 con 0x7fe5540b40c0 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe554162e80 con 0x7fe55415e450 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55406c3d0 0x7fe554150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55406c3d0 0x7fe554150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58412/0 (socket says 172.21.15.73:58412) 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 -- 172.21.15.73:0/4289090802 learned_addr learned my addr 172.21.15.73:0/4289090802 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55abd7640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe5541546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe559bd5640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5540b40c0 0x7fe55414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 -- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 msgr2=0x7fe5541546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe5541546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 -- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5540b40c0 msgr2=0x7fe55414f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5540b40c0 0x7fe55414f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 -- 172.21.15.73:0/4289090802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe554150e20 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe559bd5640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5540b40c0 0x7fe55414f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55a3d6640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55406c3d0 0x7fe554150760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe54401a100 tx=0x7fe544019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe54affd640 1 -- 172.21.15.73:0/4289090802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5440bd070 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe54affd640 1 -- 172.21.15.73:0/4289090802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5440b7630 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe554153be0 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe54affd640 1 -- 172.21.15.73:0/4289090802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5440b1040 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5541541a0 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55415fc60 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.009+0000 7fe54affd640 1 -- 172.21.15.73:0/4289090802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe5440b7a20 con 0x7fe55406c3d0 2024-09-12T03:38:30.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.013+0000 7fe54affd640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5380678c0 0x7fe538069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.013+0000 7fe54affd640 1 -- 172.21.15.73:0/4289090802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7fe54411fa40 con 0x7fe55406c3d0 2024-09-12T03:38:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.013+0000 7fe559bd5640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5380678c0 0x7fe538069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.013+0000 7fe559bd5640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5380678c0 0x7fe538069d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe55415a730 tx=0x7fe550009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.017+0000 7fe54affd640 1 -- 172.21.15.73:0/4289090802 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe544016150 con 0x7fe55406c3d0 2024-09-12T03:38:30.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.213+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe554151800 con 0x7fe55406c3d0 2024-09-12T03:38:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe54affd640 1 -- 172.21.15.73:0/4289090802 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7fe54411fe20 con 0x7fe55406c3d0 2024-09-12T03:38:30.217 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:30.217 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"btime":"2024-09-12T03:38:14:379931+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5521,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2804939638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2804939638},{"type":"v1","addr":"172.21.15.150:6833","nonce":2804939638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2609449242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2609449242},{"type":"v1","addr":"172.21.15.150:6835","nonce":2609449242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3463752136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3463752136},{"type":"v1","addr":"172.21.15.73:6835","nonce":3463752136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:38:10.712259+0000","modified":"2024-09-12T03:38:13.741150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3586054053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3586054053},{"type":"v1","addr":"172.21.15.73:6837","nonce":3586054053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6579,"qdb_cluster":[6579]},"id":7}]} 2024-09-12T03:38:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 56 2024-09-12T03:38:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5380678c0 msgr2=0x7fe538069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5380678c0 0x7fe538069d80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe55415a730 tx=0x7fe550009040 comp rx=0 tx=0).stop 2024-09-12T03:38:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55406c3d0 msgr2=0x7fe554150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55406c3d0 0x7fe554150760 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fe54401a100 tx=0x7fe544019270 comp rx=0 tx=0).stop 2024-09-12T03:38:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 shutdown_connections 2024-09-12T03:38:30.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe5380678c0 0x7fe538069d80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe55415e450 0x7fe5541546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5540b40c0 0x7fe55414f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 --2- 172.21.15.73:0/4289090802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55406c3d0 0x7fe554150760 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 >> 172.21.15.73:0/4289090802 conn(0x7fe5540b6800 msgr2=0x7fe5540ca440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 shutdown_connections 2024-09-12T03:38:30.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.217+0000 7fe55c63a640 1 -- 172.21.15.73:0/4289090802 wait complete. 2024-09-12T03:38:30.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:38:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc36d5f3640 1 Processor -- start 2024-09-12T03:38:30.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc36d5f3640 1 -- start start 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc36d5f3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc36815e5f0 0x7fc36806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc36d5f3640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc3680ce9d0 0x7fc3680cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc36d5f3640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36806d9c0 con 0x7fc3680cf920 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc36d5f3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc3680cfd90 con 0x7fc36815e5f0 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc36d5f3640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fc36806dca0 con 0x7fc3680ce9d0 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc366ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc36815e5f0 0x7fc36806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc366ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc36815e5f0 0x7fc36806d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58416/0 (socket says 172.21.15.73:58416) 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc366ffd640 1 -- 172.21.15.73:0/284638858 learned_addr learned my addr 172.21.15.73:0/284638858 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc3667fc640 1 --2- 172.21.15.73:0/284638858 >> v2:172.21.15.150:3300/0 conn(0x7fc3680ce9d0 0x7fc3680cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc366ffd640 1 -- 172.21.15.73:0/284638858 >> v2:172.21.15.150:3300/0 conn(0x7fc3680ce9d0 msgr2=0x7fc3680cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:30.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc366ffd640 1 --2- 172.21.15.73:0/284638858 >> v2:172.21.15.150:3300/0 conn(0x7fc3680ce9d0 0x7fc3680cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc366ffd640 1 -- 172.21.15.73:0/284638858 >> v1:172.21.15.150:6789/0 conn(0x7fc3680cf920 legacy=0x7fc3680d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:30.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc366ffd640 1 -- 172.21.15.73:0/284638858 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36806df80 con 0x7fc36815e5f0 2024-09-12T03:38:30.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.353+0000 7fc3667fc640 1 --2- 172.21.15.73:0/284638858 >> v2:172.21.15.150:3300/0 conn(0x7fc3680ce9d0 0x7fc3680cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc366ffd640 1 --2- 172.21.15.73:0/284638858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36815e5f0 0x7fc36806d090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc3680ce980 tx=0x7fc36001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17edc8339858a1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc365ffb640 1 -- 172.21.15.73:0/284638858 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600b1070 con 0x7fc36815e5f0 2024-09-12T03:38:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc365ffb640 1 -- 172.21.15.73:0/284638858 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3600ac640 con 0x7fc36815e5f0 2024-09-12T03:38:30.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc365ffb640 1 -- 172.21.15.73:0/284638858 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600aca10 con 0x7fc36815e5f0 2024-09-12T03:38:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- 172.21.15.73:0/284638858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36815e5f0 msgr2=0x7fc36806d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/284638858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36815e5f0 0x7fc36806d090 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fc3680ce980 tx=0x7fc36001c4e0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- 172.21.15.73:0/284638858 shutdown_connections 2024-09-12T03:38:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/284638858 >> v2:172.21.15.150:3300/0 conn(0x7fc3680ce9d0 0x7fc3680cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/284638858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36815e5f0 0x7fc36806d090 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- 172.21.15.73:0/284638858 >> 172.21.15.73:0/284638858 conn(0x7fc368074030 msgr2=0x7fc36809d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- 172.21.15.73:0/284638858 shutdown_connections 2024-09-12T03:38:30.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- 172.21.15.73:0/284638858 wait complete. 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 Processor -- start 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- start start 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3680cf920 0x7fc36814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc368158770 0x7fc3680b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36814be60 0x7fc368156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc36816b120 con 0x7fc36814be60 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fc36816afa0 con 0x7fc368158770 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc36d5f3640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fc36816b2a0 con 0x7fc3680cf920 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36814be60 0x7fc368156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36814be60 0x7fc368156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58426/0 (socket says 172.21.15.73:58426) 2024-09-12T03:38:30.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 -- 172.21.15.73:0/1067526300 learned_addr learned my addr 172.21.15.73:0/1067526300 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3667fc640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc368158770 0x7fc3680b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc366ffd640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3680cf920 0x7fc36814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 -- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3680cf920 msgr2=0x7fc36814dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3680cf920 0x7fc36814dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 -- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc368158770 msgr2=0x7fc3680b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc368158770 0x7fc3680b9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 -- 172.21.15.73:0/1067526300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3680b7370 con 0x7fc36814be60 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3667fc640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc368158770 0x7fc3680b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:30.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc366ffd640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3680cf920 0x7fc36814dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.357+0000 7fc3677fe640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36814be60 0x7fc368156070 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c7e0 tx=0x7fc35800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc35f7fe640 1 -- 172.21.15.73:0/1067526300 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358004b80 con 0x7fc36814be60 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc35f7fe640 1 -- 172.21.15.73:0/1067526300 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc358004d40 con 0x7fc36814be60 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36814d240 con 0x7fc36814be60 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc35f7fe640 1 -- 172.21.15.73:0/1067526300 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc358005270 con 0x7fc36814be60 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36814d800 con 0x7fc36814be60 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3680b4160 con 0x7fc36814be60 2024-09-12T03:38:30.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc35f7fe640 1 -- 172.21.15.73:0/1067526300 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc358005410 con 0x7fc36814be60 2024-09-12T03:38:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc35f7fe640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3480678f0 0x7fc348069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc35f7fe640 1 -- 172.21.15.73:0/1067526300 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7fc358085f40 con 0x7fc36814be60 2024-09-12T03:38:30.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc366ffd640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3480678f0 0x7fc348069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.361+0000 7fc366ffd640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3480678f0 0x7fc348069db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3600ae000 tx=0x7fc360008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.365+0000 7fc35f7fe640 1 -- 172.21.15.73:0/1067526300 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc358020070 con 0x7fc36814be60 2024-09-12T03:38:30.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.529+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3680b3e80 con 0x7fc36814be60 2024-09-12T03:38:30.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.533+0000 7fc35f7fe640 1 -- 172.21.15.73:0/1067526300 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16996 (secure 0 0 0) 0x7fc3580568d0 con 0x7fc36814be60 2024-09-12T03:38:30.535 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:30.535 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":100,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:38:21.917601+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:38:08.420270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T03:38:09.709269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.22","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:38:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3480678f0 msgr2=0x7fc348069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3480678f0 0x7fc348069db0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3600ae000 tx=0x7fc360008040 comp rx=0 tx=0).stop 2024-09-12T03:38:30.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36814be60 msgr2=0x7fc368156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36814be60 0x7fc368156070 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c7e0 tx=0x7fc35800cca0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 shutdown_connections 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fc3480678f0 0x7fc348069db0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc36814be60 0x7fc368156070 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc368158770 0x7fc3680b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 --2- 172.21.15.73:0/1067526300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fc3680cf920 0x7fc36814dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 >> 172.21.15.73:0/1067526300 conn(0x7fc3680ce9d0 msgr2=0x7fc3680b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 shutdown_connections 2024-09-12T03:38:30.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.537+0000 7fc36d5f3640 1 -- 172.21.15.73:0/1067526300 wait complete. 2024-09-12T03:38:30.555 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:38:30.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:38:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.661+0000 7f42604b7640 1 Processor -- start 2024-09-12T03:38:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.661+0000 7f42604b7640 1 -- start start 2024-09-12T03:38:30.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f425815bec0 0x7f42580ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f425815c2a0 0x7f42580aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42580b3290 con 0x7f42580af2a0 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f42580b3570 con 0x7f425815bec0 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f42580b3850 con 0x7f425815c2a0 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f425815bec0 0x7f42580ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f425815bec0 0x7f42580ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58428/0 (socket says 172.21.15.73:58428) 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 -- 172.21.15.73:0/577963016 learned_addr learned my addr 172.21.15.73:0/577963016 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 -- 172.21.15.73:0/577963016 >> v2:172.21.15.150:3300/0 conn(0x7f425815c2a0 msgr2=0x7f42580aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 --2- 172.21.15.73:0/577963016 >> v2:172.21.15.150:3300/0 conn(0x7f425815c2a0 0x7f42580aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 -- 172.21.15.73:0/577963016 >> v1:172.21.15.150:6789/0 conn(0x7f42580af2a0 legacy=0x7f425815fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:30.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 -- 172.21.15.73:0/577963016 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42580b3b30 con 0x7f425815bec0 2024-09-12T03:38:30.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425e253640 1 --2- 172.21.15.73:0/577963016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815bec0 0x7f42580ad200 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f42580ae510 tx=0x7f425401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5d4a66040a1448 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425d251640 1 -- 172.21.15.73:0/577963016 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42540aa610 con 0x7f425815bec0 2024-09-12T03:38:30.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425d251640 1 -- 172.21.15.73:0/577963016 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42540af070 con 0x7f425815bec0 2024-09-12T03:38:30.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f425d251640 1 -- 172.21.15.73:0/577963016 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42540aa9d0 con 0x7f425815bec0 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 -- 172.21.15.73:0/577963016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815bec0 msgr2=0x7f42580ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 --2- 172.21.15.73:0/577963016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815bec0 0x7f42580ad200 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f42580ae510 tx=0x7f425401c4b0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 -- 172.21.15.73:0/577963016 shutdown_connections 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 --2- 172.21.15.73:0/577963016 >> v2:172.21.15.150:3300/0 conn(0x7f425815c2a0 0x7f42580aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 --2- 172.21.15.73:0/577963016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815bec0 0x7f42580ad200 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.665+0000 7f42604b7640 1 -- 172.21.15.73:0/577963016 >> 172.21.15.73:0/577963016 conn(0x7f42580b1f90 msgr2=0x7f42580b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- 172.21.15.73:0/577963016 shutdown_connections 2024-09-12T03:38:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- 172.21.15.73:0/577963016 wait complete. 2024-09-12T03:38:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 Processor -- start 2024-09-12T03:38:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- start start 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42580af2a0 0x7f4258157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f425815bec0 0x7f425814f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815c2a0 0x7f4258156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42580ad740 con 0x7f425815c2a0 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f42580af710 con 0x7f425815bec0 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f4258169000 con 0x7f42580af2a0 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815c2a0 0x7f4258156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815c2a0 0x7f4258156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58444/0 (socket says 172.21.15.73:58444) 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 -- 172.21.15.73:0/2359276981 learned_addr learned my addr 172.21.15.73:0/2359276981 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425da52640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f425815bec0 0x7f425814f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425e253640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42580af2a0 0x7f4258157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 -- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42580af2a0 msgr2=0x7f4258157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42580af2a0 0x7f4258157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 -- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f425815bec0 msgr2=0x7f425814f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f425815bec0 0x7f425814f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 -- 172.21.15.73:0/2359276981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4258158530 con 0x7f425815c2a0 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425e253640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42580af2a0 0x7f4258157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f425ea54640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815c2a0 0x7f4258156ca0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f425000c7b0 tx=0x7f425000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f424effd640 1 -- 172.21.15.73:0/2359276981 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250017070 con 0x7f425815c2a0 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f424effd640 1 -- 172.21.15.73:0/2359276981 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4250003db0 con 0x7f425815c2a0 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425814ecd0 con 0x7f425815c2a0 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f424effd640 1 -- 172.21.15.73:0/2359276981 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42500052b0 con 0x7f425815c2a0 2024-09-12T03:38:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425814fcf0 con 0x7f425815c2a0 2024-09-12T03:38:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.669+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42580ad200 con 0x7f425815c2a0 2024-09-12T03:38:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.673+0000 7f424effd640 1 -- 172.21.15.73:0/2359276981 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f425001a070 con 0x7f425815c2a0 2024-09-12T03:38:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.673+0000 7f424effd640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f423c0678f0 0x7f423c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.673+0000 7f424effd640 1 -- 172.21.15.73:0/2359276981 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7f4250085410 con 0x7f425815c2a0 2024-09-12T03:38:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.673+0000 7f425e253640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f423c0678f0 0x7f423c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.673+0000 7f425e253640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f423c0678f0 0x7f423c069db0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f42540ae000 tx=0x7f4254008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.677+0000 7f424effd640 1 -- 172.21.15.73:0/2359276981 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4250055da0 con 0x7f425815c2a0 2024-09-12T03:38:30.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.873+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f425806fcd0 con 0x7f425815c2a0 2024-09-12T03:38:30.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.873+0000 7f424effd640 1 -- 172.21.15.73:0/2359276981 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f42500556a0 con 0x7f425815c2a0 2024-09-12T03:38:30.874 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:30.875 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"btime":"2024-09-12T03:38:14:379931+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5521,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2804939638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2804939638},{"type":"v1","addr":"172.21.15.150:6833","nonce":2804939638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2609449242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2609449242},{"type":"v1","addr":"172.21.15.150:6835","nonce":2609449242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3463752136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3463752136},{"type":"v1","addr":"172.21.15.73:6835","nonce":3463752136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:38:10.712259+0000","modified":"2024-09-12T03:38:13.741150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3586054053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3586054053},{"type":"v1","addr":"172.21.15.73:6837","nonce":3586054053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6579,"qdb_cluster":[6579]},"id":7}]} 2024-09-12T03:38:30.875 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 56 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.873+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f423c0678f0 msgr2=0x7f423c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.873+0000 7f42604b7640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f423c0678f0 0x7f423c069db0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f42540ae000 tx=0x7f4254008040 comp rx=0 tx=0).stop 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.873+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815c2a0 msgr2=0x7f4258156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.873+0000 7f42604b7640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815c2a0 0x7f4258156ca0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f425000c7b0 tx=0x7f425000cc70 comp rx=0 tx=0).stop 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 shutdown_connections 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f423c0678f0 0x7f423c069db0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f425815c2a0 0x7f4258156ca0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f425815bec0 0x7f425814f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 --2- 172.21.15.73:0/2359276981 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f42580af2a0 0x7f4258157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 >> 172.21.15.73:0/2359276981 conn(0x7f42580b1f90 msgr2=0x7f42581597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:30.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 shutdown_connections 2024-09-12T03:38:30.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:30.877+0000 7f42604b7640 1 -- 172.21.15.73:0/2359276981 wait complete. 2024-09-12T03:38:30.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:38:31.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.001+0000 7f2159ac7640 1 Processor -- start 2024-09-12T03:38:31.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.001+0000 7f2159ac7640 1 -- start start 2024-09-12T03:38:31.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2159ac7640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f21540d2ef0 0x7f21540d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2159ac7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d4080 0x7f21540d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2159ac7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21540d1690 con 0x7f21540cf900 2024-09-12T03:38:31.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2159ac7640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f21540d1c50 con 0x7f21540d2ef0 2024-09-12T03:38:31.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2159ac7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f21540cf470 con 0x7f21540d4080 2024-09-12T03:38:31.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2153fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d4080 0x7f21540d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f21537fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f21540d2ef0 0x7f21540d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2153fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d4080 0x7f21540d44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:33616/0 (socket says 172.21.15.73:33616) 2024-09-12T03:38:31.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f2153fff640 1 -- 172.21.15.73:0/1548050512 learned_addr learned my addr 172.21.15.73:0/1548050512 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f21537fe640 1 -- 172.21.15.73:0/1548050512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d4080 msgr2=0x7f21540d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:31.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f21537fe640 1 --2- 172.21.15.73:0/1548050512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d4080 0x7f21540d44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f21537fe640 1 -- 172.21.15.73:0/1548050512 >> v1:172.21.15.150:6789/0 conn(0x7f21540cf900 legacy=0x7f21540cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.005+0000 7f21537fe640 1 -- 172.21.15.73:0/1548050512 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21540d1970 con 0x7f21540d2ef0 2024-09-12T03:38:31.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f21537fe640 1 --2- 172.21.15.73:0/1548050512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540d2ef0 0x7f21540d1f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f21440097c0 tx=0x7f214401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c00e1910bc3cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f21527fc640 1 -- 172.21.15.73:0/1548050512 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440b0070 con 0x7f21540d2ef0 2024-09-12T03:38:31.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f21527fc640 1 -- 172.21.15.73:0/1548050512 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21440ab600 con 0x7f21540d2ef0 2024-09-12T03:38:31.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f21527fc640 1 -- 172.21.15.73:0/1548050512 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21440ab9d0 con 0x7f21540d2ef0 2024-09-12T03:38:31.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 -- 172.21.15.73:0/1548050512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540d2ef0 msgr2=0x7f21540d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 --2- 172.21.15.73:0/1548050512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540d2ef0 0x7f21540d1f40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f21440097c0 tx=0x7f214401c4a0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 -- 172.21.15.73:0/1548050512 shutdown_connections 2024-09-12T03:38:31.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 --2- 172.21.15.73:0/1548050512 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d4080 0x7f21540d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 --2- 172.21.15.73:0/1548050512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540d2ef0 0x7f21540d1f40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 -- 172.21.15.73:0/1548050512 >> 172.21.15.73:0/1548050512 conn(0x7f215409d710 msgr2=0x7f215408bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:31.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 -- 172.21.15.73:0/1548050512 shutdown_connections 2024-09-12T03:38:31.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 -- 172.21.15.73:0/1548050512 wait complete. 2024-09-12T03:38:31.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 Processor -- start 2024-09-12T03:38:31.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 -- start start 2024-09-12T03:38:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.009+0000 7f2159ac7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540cf900 0x7f215415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d2ef0 0x7f21541540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21540d4080 0x7f2154154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f21540d2600 con 0x7f21540d4080 2024-09-12T03:38:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f21540d2480 con 0x7f21540cf900 2024-09-12T03:38:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f21540d1170 con 0x7f21540d2ef0 2024-09-12T03:38:31.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21540d4080 0x7f2154154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21540d4080 0x7f2154154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58450/0 (socket says 172.21.15.73:58450) 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 -- 172.21.15.73:0/3494235477 learned_addr learned my addr 172.21.15.73:0/3494235477 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f21537fe640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540cf900 0x7f215415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2152ffd640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d2ef0 0x7f21541540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 -- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d2ef0 msgr2=0x7f21541540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d2ef0 0x7f21541540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 -- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540cf900 msgr2=0x7f215415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540cf900 0x7f215415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 -- 172.21.15.73:0/3494235477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2154075470 con 0x7f21540d4080 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2152ffd640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d2ef0 0x7f21541540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:31.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2153fff640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21540d4080 0x7f2154154630 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f214c00ec40 tx=0x7f214c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f213bfff640 1 -- 172.21.15.73:0/3494235477 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c00cd20 con 0x7f21540d4080 2024-09-12T03:38:31.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f213bfff640 1 -- 172.21.15.73:0/3494235477 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f214c00ee50 con 0x7f21540d4080 2024-09-12T03:38:31.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2154159c40 con 0x7f21540d4080 2024-09-12T03:38:31.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f213bfff640 1 -- 172.21.15.73:0/3494235477 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c003be0 con 0x7f21540d4080 2024-09-12T03:38:31.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215415bab0 con 0x7f21540d4080 2024-09-12T03:38:31.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21540b6400 con 0x7f21540d4080 2024-09-12T03:38:31.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f213bfff640 1 -- 172.21.15.73:0/3494235477 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f214c012050 con 0x7f21540d4080 2024-09-12T03:38:31.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f213bfff640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f21400678f0 0x7f2140069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f213bfff640 1 -- 172.21.15.73:0/3494235477 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7f214c0861d0 con 0x7f21540d4080 2024-09-12T03:38:31.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f21537fe640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f21400678f0 0x7f2140069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.013+0000 7f21537fe640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f21400678f0 0x7f2140069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f21440ad000 tx=0x7f21440a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.017+0000 7f213bfff640 1 -- 172.21.15.73:0/3494235477 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f21540b6400 con 0x7f21540d4080 2024-09-12T03:38:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.209+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21540d1f40 con 0x7f21540d4080 2024-09-12T03:38:31.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.209+0000 7f213bfff640 1 -- 172.21.15.73:0/3494235477 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f214c022020 con 0x7f21540d4080 2024-09-12T03:38:31.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:31.212 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":56,"btime":"2024-09-12T03:38:14:379931+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5521,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2804939638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2804939638},{"type":"v1","addr":"172.21.15.150:6833","nonce":2804939638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2609449242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2609449242},{"type":"v1","addr":"172.21.15.150:6835","nonce":2609449242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3463752136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3463752136},{"type":"v1","addr":"172.21.15.73:6835","nonce":3463752136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T03:38:10.712259+0000","modified":"2024-09-12T03:38:13.741150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6579":{"gid":6579,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/3586054053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3586054053},{"type":"v1","addr":"172.21.15.73:6837","nonce":3586054053}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6579,"qdb_cluster":[6579]},"id":7}]} 2024-09-12T03:38:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 56 2024-09-12T03:38:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f21400678f0 msgr2=0x7f2140069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f21400678f0 0x7f2140069db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f21440ad000 tx=0x7f21440a6000 comp rx=0 tx=0).stop 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21540d4080 msgr2=0x7f2154154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21540d4080 0x7f2154154630 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f214c00ec40 tx=0x7f214c00c490 comp rx=0 tx=0).stop 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 shutdown_connections 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f21400678f0 0x7f2140069db0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21540d4080 0x7f2154154630 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f21540d2ef0 0x7f21541540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 --2- 172.21.15.73:0/3494235477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f21540cf900 0x7f215415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 >> 172.21.15.73:0/3494235477 conn(0x7f215409d710 msgr2=0x7f21541606a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 shutdown_connections 2024-09-12T03:38:31.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.213+0000 7f2159ac7640 1 -- 172.21.15.73:0/3494235477 wait complete. 2024-09-12T03:38:31.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 Processor -- start 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 -- start start 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3f6015bec0 0x7f3f600ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 0x7f3f600aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f600af2a0 0x7f3f6015fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3f600b3290 con 0x7f3f600af2a0 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f3f600b3570 con 0x7f3f6015bec0 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f680dd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3f600b3850 con 0x7f3f6015c2a0 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f6667a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f600af2a0 0x7f3f6015fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f6667a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3f600af2a0 0x7f3f6015fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58466/0 (socket says 172.21.15.73:58466) 2024-09-12T03:38:31.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f6667a640 1 -- 172.21.15.73:0/2222329490 learned_addr learned my addr 172.21.15.73:0/2222329490 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f6667a640 1 -- 172.21.15.73:0/2222329490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 msgr2=0x7f3f600aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:31.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.333+0000 7f3f6667a640 1 --2- 172.21.15.73:0/2222329490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 0x7f3f600aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f6667a640 1 -- 172.21.15.73:0/2222329490 >> v2:172.21.15.150:3300/0 conn(0x7f3f6015bec0 msgr2=0x7f3f600ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:31.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f6667a640 1 --2- 172.21.15.73:0/2222329490 >> v2:172.21.15.150:3300/0 conn(0x7f3f6015bec0 0x7f3f600ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f6667a640 1 -- 172.21.15.73:0/2222329490 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f600b3b30 con 0x7f3f600af2a0 2024-09-12T03:38:31.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f6667a640 1 --2- 172.21.15.73:0/2222329490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f600af2a0 0x7f3f6015fc60 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3f60071710 tx=0x7f3f5801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7436c18f9e8297 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f64e77640 1 -- 172.21.15.73:0/2222329490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a5580 con 0x7f3f600af2a0 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f64e77640 1 -- 172.21.15.73:0/2222329490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f580a5720 con 0x7f3f600af2a0 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f64e77640 1 -- 172.21.15.73:0/2222329490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a5af0 con 0x7f3f600af2a0 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 -- 172.21.15.73:0/2222329490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f600af2a0 msgr2=0x7f3f6015fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2222329490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f600af2a0 0x7f3f6015fc60 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3f60071710 tx=0x7f3f5801c700 comp rx=0 tx=0).stop 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 -- 172.21.15.73:0/2222329490 shutdown_connections 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2222329490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f600af2a0 0x7f3f6015fc60 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2222329490 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 0x7f3f600aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2222329490 >> v2:172.21.15.150:3300/0 conn(0x7f3f6015bec0 0x7f3f600ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 -- 172.21.15.73:0/2222329490 >> 172.21.15.73:0/2222329490 conn(0x7f3f600b1f90 msgr2=0x7f3f600b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 -- 172.21.15.73:0/2222329490 shutdown_connections 2024-09-12T03:38:31.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 -- 172.21.15.73:0/2222329490 wait complete. 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 Processor -- start 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.337+0000 7f3f680dd640 1 -- start start 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600af2a0 0x7f3f60151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6015bec0 0x7f3f6015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 0x7f3f600cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f600ad740 con 0x7f3f6015bec0 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f3f600afc90 con 0x7f3f600af2a0 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f3f6006e000 con 0x7f3f6015c2a0 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6015bec0 0x7f3f6015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6015bec0 0x7f3f6015d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58482/0 (socket says 172.21.15.73:58482) 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 -- 172.21.15.73:0/2250901977 learned_addr learned my addr 172.21.15.73:0/2250901977 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65e79640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600af2a0 0x7f3f60151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 -- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 msgr2=0x7f3f600cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 0x7f3f600cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 -- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600af2a0 msgr2=0x7f3f60151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600af2a0 0x7f3f60151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 -- 172.21.15.73:0/2250901977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f601f85b0 con 0x7f3f6015bec0 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65e79640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600af2a0 0x7f3f60151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65678640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6015bec0 0x7f3f6015d530 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000b440 tx=0x7f3f5000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f567fc640 1 -- 172.21.15.73:0/2250901977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50015020 con 0x7f3f6015bec0 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f567fc640 1 -- 172.21.15.73:0/2250901977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f500118b0 con 0x7f3f6015bec0 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f60154b00 con 0x7f3f6015bec0 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f567fc640 1 -- 172.21.15.73:0/2250901977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f50011ca0 con 0x7f3f6015bec0 2024-09-12T03:38:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6015ca50 con 0x7f3f6015bec0 2024-09-12T03:38:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f600ad200 con 0x7f3f6015bec0 2024-09-12T03:38:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f567fc640 1 -- 172.21.15.73:0/2250901977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f50018020 con 0x7f3f6015bec0 2024-09-12T03:38:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f567fc640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f440678c0 0x7f3f44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65e79640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f440678c0 0x7f3f44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f567fc640 1 -- 172.21.15.73:0/2250901977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7f3f50085fb0 con 0x7f3f6015bec0 2024-09-12T03:38:31.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.341+0000 7f3f65e79640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f440678c0 0x7f3f44069d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00a8b0 tx=0x7f3f5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.345+0000 7f3f567fc640 1 -- 172.21.15.73:0/2250901977 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3f5001f020 con 0x7f3f6015bec0 2024-09-12T03:38:31.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.497+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f600d09d0 con 0x7f3f6015bec0 2024-09-12T03:38:31.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.501+0000 7f3f567fc640 1 -- 172.21.15.73:0/2250901977 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16996 (secure 0 0 0) 0x7f3f601f85b0 con 0x7f3f6015bec0 2024-09-12T03:38:31.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:31.503 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":100,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:38:21.917601+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-12T03:38:08.420270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-12T03:38:09.709269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.22","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:38:31.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f440678c0 msgr2=0x7f3f44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f440678c0 0x7f3f44069d80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00a8b0 tx=0x7f3f5c008040 comp rx=0 tx=0).stop 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6015bec0 msgr2=0x7f3f6015d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6015bec0 0x7f3f6015d530 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000b440 tx=0x7f3f5000b900 comp rx=0 tx=0).stop 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 shutdown_connections 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f3f440678c0 0x7f3f44069d80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f6015bec0 0x7f3f6015d530 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f3f6015c2a0 0x7f3f600cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 --2- 172.21.15.73:0/2250901977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3f600af2a0 0x7f3f60151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 >> 172.21.15.73:0/2250901977 conn(0x7f3f600b1f90 msgr2=0x7f3f6015a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 shutdown_connections 2024-09-12T03:38:31.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.505+0000 7f3f680dd640 1 -- 172.21.15.73:0/2250901977 wait complete. 2024-09-12T03:38:31.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T03:38:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.629+0000 7fb601e9f640 1 Processor -- start 2024-09-12T03:38:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.629+0000 7fb601e9f640 1 -- start start 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb601e9f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc0b3790 0x7fb5fc06d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb601e9f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5fc09b110 0x7fb5fc0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb601e9f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc06dd30 con 0x7fb5fc06d890 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb601e9f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb5fc06e5d0 con 0x7fb5fc09b110 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb601e9f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc0b5ca0 con 0x7fb5fc0b3790 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5fc09b110 0x7fb5fc0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb5fc09b110 0x7fb5fc0b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58496/0 (socket says 172.21.15.73:58496) 2024-09-12T03:38:31.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 -- 172.21.15.73:0/1130752846 learned_addr learned my addr 172.21.15.73:0/1130752846 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fb7fe640 1 --2- 172.21.15.73:0/1130752846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc0b3790 0x7fb5fc06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 -- 172.21.15.73:0/1130752846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc0b3790 msgr2=0x7fb5fc06d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 --2- 172.21.15.73:0/1130752846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc0b3790 0x7fb5fc06d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 -- 172.21.15.73:0/1130752846 >> v1:172.21.15.150:6789/0 conn(0x7fb5fc06d890 legacy=0x7fb5fc09aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 -- 172.21.15.73:0/1130752846 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc06e010 con 0x7fb5fc09b110 2024-09-12T03:38:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fb7fe640 1 --2- 172.21.15.73:0/1130752846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc0b3790 0x7fb5fc06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fbfff640 1 --2- 172.21.15.73:0/1130752846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc09b110 0x7fb5fc0b6420 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009e50 tx=0x7fb5f401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd77eb71a250775 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fa7fc640 1 -- 172.21.15.73:0/1130752846 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a5840 con 0x7fb5fc09b110 2024-09-12T03:38:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fa7fc640 1 -- 172.21.15.73:0/1130752846 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40a59e0 con 0x7fb5fc09b110 2024-09-12T03:38:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.633+0000 7fb5fa7fc640 1 -- 172.21.15.73:0/1130752846 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a5db0 con 0x7fb5fc09b110 2024-09-12T03:38:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/1130752846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc09b110 msgr2=0x7fb5fc0b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 --2- 172.21.15.73:0/1130752846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc09b110 0x7fb5fc0b6420 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009e50 tx=0x7fb5f401c9c0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/1130752846 shutdown_connections 2024-09-12T03:38:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 --2- 172.21.15.73:0/1130752846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc09b110 0x7fb5fc0b6420 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 --2- 172.21.15.73:0/1130752846 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc0b3790 0x7fb5fc06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/1130752846 >> 172.21.15.73:0/1130752846 conn(0x7fb5fc0b78d0 msgr2=0x7fb5fc0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:31.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/1130752846 shutdown_connections 2024-09-12T03:38:31.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/1130752846 wait complete. 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 Processor -- start 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- start start 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5fc06d890 0x7fb5fc152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc09b110 0x7fb5fc14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc0b3790 0x7fb5fc14bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc15f7e0 con 0x7fb5fc0b3790 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb5fc15f660 con 0x7fb5fc06d890 2024-09-12T03:38:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb5fc0b7170 con 0x7fb5fc09b110 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc0b3790 0x7fb5fc14bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc0b3790 0x7fb5fc14bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58498/0 (socket says 172.21.15.73:58498) 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 -- 172.21.15.73:0/457676548 learned_addr learned my addr 172.21.15.73:0/457676548 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fb7fe640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5fc06d890 0x7fb5fc152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 -- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc09b110 msgr2=0x7fb5fc14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5faffd640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc09b110 0x7fb5fc14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc09b110 0x7fb5fc14b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 -- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5fc06d890 msgr2=0x7fb5fc152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5fc06d890 0x7fb5fc152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 -- 172.21.15.73:0/457676548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc152740 con 0x7fb5fc0b3790 2024-09-12T03:38:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5fbfff640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc0b3790 0x7fb5fc14bc00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40af040 tx=0x7fb5f4019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5e3fff640 1 -- 172.21.15.73:0/457676548 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b8670 con 0x7fb5fc0b3790 2024-09-12T03:38:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5e3fff640 1 -- 172.21.15.73:0/457676548 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f40be070 con 0x7fb5fc0b3790 2024-09-12T03:38:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc150620 con 0x7fb5fc0b3790 2024-09-12T03:38:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb5e3fff640 1 -- 172.21.15.73:0/457676548 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40b8a70 con 0x7fb5fc0b3790 2024-09-12T03:38:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5fc150be0 con 0x7fb5fc0b3790 2024-09-12T03:38:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.637+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5fc0b7550 con 0x7fb5fc0b3790 2024-09-12T03:38:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.641+0000 7fb5e3fff640 1 -- 172.21.15.73:0/457676548 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb5f40b8c10 con 0x7fb5fc0b3790 2024-09-12T03:38:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.641+0000 7fb5e3fff640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5e80678c0 0x7fb5e8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.641+0000 7fb5e3fff640 1 -- 172.21.15.73:0/457676548 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6130+0+0 (secure 0 0 0) 0x7fb5f4121d50 con 0x7fb5fc0b3790 2024-09-12T03:38:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.641+0000 7fb5fb7fe640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5e80678c0 0x7fb5e8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.641+0000 7fb5fb7fe640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5e80678c0 0x7fb5e8069d80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc151a10 tx=0x7fb5ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.645+0000 7fb5e3fff640 1 -- 172.21.15.73:0/457676548 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb5f40165e0 con 0x7fb5fc0b3790 2024-09-12T03:38:31.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.825+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb5fc09bc50 con 0x7fb5fc0b3790 2024-09-12T03:38:31.829 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-09-12T03:38:31.829+0000 7fe1c1027640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T03:38:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.829+0000 7fb5e3fff640 1 -- 172.21.15.73:0/457676548 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7fb5f40f26c0 con 0x7fb5fc0b3790 2024-09-12T03:38:31.831 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T03:38:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5e80678c0 msgr2=0x7fb5e8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5e80678c0 0x7fb5e8069d80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc151a10 tx=0x7fb5ec008040 comp rx=0 tx=0).stop 2024-09-12T03:38:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc0b3790 msgr2=0x7fb5fc14bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc0b3790 0x7fb5fc14bc00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40af040 tx=0x7fb5f4019760 comp rx=0 tx=0).stop 2024-09-12T03:38:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 shutdown_connections 2024-09-12T03:38:31.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb5e80678c0 0x7fb5e8069d80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5fc0b3790 0x7fb5fc14bc00 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb5fc09b110 0x7fb5fc14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 --2- 172.21.15.73:0/457676548 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb5fc06d890 0x7fb5fc152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 >> 172.21.15.73:0/457676548 conn(0x7fb5fc0b78d0 msgr2=0x7fb5fc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 shutdown_connections 2024-09-12T03:38:31.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.833+0000 7fb601e9f640 1 -- 172.21.15.73:0/457676548 wait complete. 2024-09-12T03:38:31.852 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T03:38:31.888 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-09-12T03:38:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.965+0000 7f10f63da640 1 Processor -- start 2024-09-12T03:38:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.965+0000 7f10f63da640 1 -- start start 2024-09-12T03:38:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f63da640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f01520a0 0x7f10f006f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f63da640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10f015f3a0 0x7f10f00adc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f63da640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10f0070250 con 0x7f10f006fe50 2024-09-12T03:38:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f63da640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f10f0152480 con 0x7f10f015f3a0 2024-09-12T03:38:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f63da640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f10f00aede0 con 0x7f10f01520a0 2024-09-12T03:38:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10effff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f01520a0 0x7f10f006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f4977640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10f015f3a0 0x7f10f00adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10effff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f01520a0 0x7f10f006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:33702/0 (socket says 172.21.15.73:33702) 2024-09-12T03:38:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f4977640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10f015f3a0 0x7f10f00adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:45478/0 (socket says 172.21.15.73:45478) 2024-09-12T03:38:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10effff640 1 -- 172.21.15.73:0/1506762433 learned_addr learned my addr 172.21.15.73:0/1506762433 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f4977640 1 -- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f01520a0 msgr2=0x7f10f006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f4977640 1 --2- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f01520a0 0x7f10f006f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f4977640 1 -- 172.21.15.73:0/1506762433 >> v1:172.21.15.150:6789/0 conn(0x7f10f006fe50 legacy=0x7f10f015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10f4977640 1 -- 172.21.15.73:0/1506762433 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f015fa10 con 0x7f10f015f3a0 2024-09-12T03:38:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.969+0000 7f10effff640 1 --2- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f01520a0 0x7f10f006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:38:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f4977640 1 --2- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 0x7f10f00adc80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009d90 tx=0x7f10e801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a6fcbdcf9a3b3b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10ef7fe640 1 -- 172.21.15.73:0/1506762433 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e80b2070 con 0x7f10f015f3a0 2024-09-12T03:38:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10ef7fe640 1 -- 172.21.15.73:0/1506762433 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e80a5a30 con 0x7f10f015f3a0 2024-09-12T03:38:31.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10ef7fe640 1 -- 172.21.15.73:0/1506762433 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e80a5e00 con 0x7f10f015f3a0 2024-09-12T03:38:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 msgr2=0x7f10f00adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 --2- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 0x7f10f00adc80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009d90 tx=0x7f10e801c970 comp rx=0 tx=0).stop 2024-09-12T03:38:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- 172.21.15.73:0/1506762433 shutdown_connections 2024-09-12T03:38:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 --2- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 0x7f10f00adc80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 --2- 172.21.15.73:0/1506762433 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f01520a0 0x7f10f006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- 172.21.15.73:0/1506762433 >> 172.21.15.73:0/1506762433 conn(0x7f10f00b1f90 msgr2=0x7f10f00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- 172.21.15.73:0/1506762433 shutdown_connections 2024-09-12T03:38:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- 172.21.15.73:0/1506762433 wait complete. 2024-09-12T03:38:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 Processor -- start 2024-09-12T03:38:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- start start 2024-09-12T03:38:31.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f006fe50 0x7f10f014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f01520a0 0x7f10f01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 0x7f10f0099810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f10f0073d30 con 0x7f10f01520a0 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f10f0073a50 con 0x7f10f015f3a0 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10f63da640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f10f006e800 con 0x7f10f006fe50 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f01520a0 0x7f10f01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f01520a0 0x7f10f01519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58512/0 (socket says 172.21.15.73:58512) 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.973+0000 7f10e77fe640 1 -- 172.21.15.73:0/2440568048 learned_addr learned my addr 172.21.15.73:0/2440568048 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10effff640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f006fe50 0x7f10f014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10f4977640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 0x7f10f0099810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10e77fe640 1 -- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f006fe50 msgr2=0x7f10f014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10e77fe640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f006fe50 0x7f10f014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10e77fe640 1 -- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 msgr2=0x7f10f0099810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10e77fe640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 0x7f10f0099810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10e77fe640 1 -- 172.21.15.73:0/2440568048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f014fae0 con 0x7f10f01520a0 2024-09-12T03:38:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10e77fe640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f01520a0 0x7f10f01519e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c340 tx=0x7f10d800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10ed7fa640 1 -- 172.21.15.73:0/2440568048 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d80052d0 con 0x7f10f01520a0 2024-09-12T03:38:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10ed7fa640 1 -- 172.21.15.73:0/2440568048 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8005470 con 0x7f10f01520a0 2024-09-12T03:38:31.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f014fdc0 con 0x7f10f01520a0 2024-09-12T03:38:31.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10ed7fa640 1 -- 172.21.15.73:0/2440568048 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8007260 con 0x7f10f01520a0 2024-09-12T03:38:31.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f0150380 con 0x7f10f01520a0 2024-09-12T03:38:31.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f00adc80 con 0x7f10f01520a0 2024-09-12T03:38:31.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10ed7fa640 1 -- 172.21.15.73:0/2440568048 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f10d8007400 con 0x7f10f01520a0 2024-09-12T03:38:31.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10ed7fa640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f10d00678f0 0x7f10d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:31.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10effff640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f10d00678f0 0x7f10d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:31.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10ed7fa640 1 -- 172.21.15.73:0/2440568048 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6216+0+0 (secure 0 0 0) 0x7f10d80852a0 con 0x7f10f01520a0 2024-09-12T03:38:31.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.977+0000 7f10effff640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f10d00678f0 0x7f10d0069db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009630 tx=0x7f10e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:31.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:31.981+0000 7f10ed7fa640 1 -- 172.21.15.73:0/2440568048 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f10d8055be0 con 0x7f10f01520a0 2024-09-12T03:38:32.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.169+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f10f006e540 con 0x7f10f01520a0 2024-09-12T03:38:32.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10ed7fa640 1 -- 172.21.15.73:0/2440568048 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) ==== 104+0+0 (secure 0 0 0) 0x7f10d80554e0 con 0x7f10f01520a0 2024-09-12T03:38:32.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f10d00678f0 msgr2=0x7f10d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:32.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f10d00678f0 0x7f10d0069db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009630 tx=0x7f10e0008040 comp rx=0 tx=0).stop 2024-09-12T03:38:32.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f01520a0 msgr2=0x7f10f01519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f01520a0 0x7f10f01519e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c340 tx=0x7f10d800c800 comp rx=0 tx=0).stop 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 shutdown_connections 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f10d00678f0 0x7f10d0069db0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10f01520a0 0x7f10f01519e0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10f015f3a0 0x7f10f0099810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 --2- 172.21.15.73:0/2440568048 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f10f006fe50 0x7f10f014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 >> 172.21.15.73:0/2440568048 conn(0x7f10f00b1f90 msgr2=0x7f10f014b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 shutdown_connections 2024-09-12T03:38:32.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:32.841+0000 7f10f63da640 1 -- 172.21.15.73:0/2440568048 wait complete. 2024-09-12T03:38:32.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T03:38:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe7b7b640 1 Processor -- start 2024-09-12T03:38:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe7b7b640 1 -- start start 2024-09-12T03:38:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe7b7b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 0x7f0fe00b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe7b7b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0fe00b0d30 0x7f0fe015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe7b7b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fe009ae60 con 0x7f0fe015b170 2024-09-12T03:38:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe7b7b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0fe00b11e0 con 0x7f0fe00b0d30 2024-09-12T03:38:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe7b7b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe00ae8b0 con 0x7f0fe009aa00 2024-09-12T03:38:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe6118640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0fe00b0d30 0x7f0fe015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe6118640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0fe00b0d30 0x7f0fe015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58520/0 (socket says 172.21.15.73:58520) 2024-09-12T03:38:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe6118640 1 -- 172.21.15.73:0/2040376317 learned_addr learned my addr 172.21.15.73:0/2040376317 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe6118640 1 -- 172.21.15.73:0/2040376317 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 msgr2=0x7f0fe00b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe6118640 1 --2- 172.21.15.73:0/2040376317 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 0x7f0fe00b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe6118640 1 -- 172.21.15.73:0/2040376317 >> v1:172.21.15.150:6789/0 conn(0x7f0fe015b170 legacy=0x7f0fe00af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:33.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.045+0000 7f0fe6118640 1 -- 172.21.15.73:0/2040376317 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe00aeb90 con 0x7f0fe00b0d30 2024-09-12T03:38:33.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe6118640 1 --2- 172.21.15.73:0/2040376317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe015ee20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009870 tx=0x7f0fdc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54abd064654f0800 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:33.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe4915640 1 -- 172.21.15.73:0/2040376317 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0aa610 con 0x7f0fe00b0d30 2024-09-12T03:38:33.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe4915640 1 -- 172.21.15.73:0/2040376317 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fdc0af070 con 0x7f0fe00b0d30 2024-09-12T03:38:33.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe4915640 1 -- 172.21.15.73:0/2040376317 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0aa9d0 con 0x7f0fe00b0d30 2024-09-12T03:38:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/2040376317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 msgr2=0x7f0fe015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/2040376317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe015ee20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc009870 tx=0x7f0fdc01c4f0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/2040376317 shutdown_connections 2024-09-12T03:38:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/2040376317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe015ee20 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/2040376317 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 0x7f0fe00b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/2040376317 >> 172.21.15.73:0/2040376317 conn(0x7f0fe00b6800 msgr2=0x7f0fe00b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/2040376317 shutdown_connections 2024-09-12T03:38:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/2040376317 wait complete. 2024-09-12T03:38:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 Processor -- start 2024-09-12T03:38:33.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- start start 2024-09-12T03:38:33.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 0x7f0fe014a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:33.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe00704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:33.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe015b170 0x7f0fe00b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe015b550 con 0x7f0fe00b0d30 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe00b0060 con 0x7f0fe015b170 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe7b7b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0fe015b6d0 con 0x7f0fe009aa00 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe5116640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe00704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe5116640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe00704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58534/0 (socket says 172.21.15.73:58534) 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.049+0000 7f0fe5116640 1 -- 172.21.15.73:0/202382535 learned_addr learned my addr 172.21.15.73:0/202382535 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe6118640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe015b170 0x7f0fe00b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5917640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 0x7f0fe014a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5116640 1 -- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 msgr2=0x7f0fe014a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5116640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 0x7f0fe014a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5116640 1 -- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe015b170 msgr2=0x7f0fe00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5116640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe015b170 0x7f0fe00b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5116640 1 -- 172.21.15.73:0/202382535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe014ad30 con 0x7f0fe00b0d30 2024-09-12T03:38:33.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5116640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe00704b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000b480 tx=0x7f0fd000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:33.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fd67fc640 1 -- 172.21.15.73:0/202382535 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0014070 con 0x7f0fe00b0d30 2024-09-12T03:38:33.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fd67fc640 1 -- 172.21.15.73:0/202382535 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fd0010890 con 0x7f0fe00b0d30 2024-09-12T03:38:33.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fd67fc640 1 -- 172.21.15.73:0/202382535 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0010c80 con 0x7f0fe00b0d30 2024-09-12T03:38:33.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe0159a10 con 0x7f0fe00b0d30 2024-09-12T03:38:33.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe0159fd0 con 0x7f0fe00b0d30 2024-09-12T03:38:33.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fe00b07f0 con 0x7f0fe00b0d30 2024-09-12T03:38:33.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fd67fc640 1 -- 172.21.15.73:0/202382535 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0fd0017070 con 0x7f0fe00b0d30 2024-09-12T03:38:33.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fd67fc640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0fc40678f0 0x7f0fc4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:33.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fd67fc640 1 -- 172.21.15.73:0/202382535 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6216+0+0 (secure 0 0 0) 0x7f0fd0085d10 con 0x7f0fe00b0d30 2024-09-12T03:38:33.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5917640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0fc40678f0 0x7f0fc4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:33.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.053+0000 7f0fe5917640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0fc40678f0 0x7f0fc4069db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00b3540 tx=0x7f0fd80072f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:33.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.057+0000 7f0fd67fc640 1 -- 172.21.15.73:0/202382535 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0fd008b020 con 0x7f0fe00b0d30 2024-09-12T03:38:33.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.209+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0fe006e7c0 con 0x7f0fe00b0d30 2024-09-12T03:38:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.961+0000 7f0fd67fc640 1 -- 172.21.15.73:0/202382535 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) ==== 181+0+0 (secure 0 0 0) 0x7f0fd0010e20 con 0x7f0fe00b0d30 2024-09-12T03:38:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0fc40678f0 msgr2=0x7f0fc4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0fc40678f0 0x7f0fc4069db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00b3540 tx=0x7f0fd80072f0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 msgr2=0x7f0fe00704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe00704b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000b480 tx=0x7f0fd000b940 comp rx=0 tx=0).stop 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 shutdown_connections 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0fc40678f0 0x7f0fc4069db0 secure :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0fe00b3540 tx=0x7f0fd80072f0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fe00b0d30 0x7f0fe00704b0 secure :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000b480 tx=0x7f0fd000b940 comp rx=0 tx=0).stop 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0fe015b170 0x7f0fe00b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 --2- 172.21.15.73:0/202382535 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0fe009aa00 0x7f0fe014a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:33.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 >> 172.21.15.73:0/202382535 conn(0x7f0fe00b6800 msgr2=0x7f0fe00af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:33.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 shutdown_connections 2024-09-12T03:38:33.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:33.973+0000 7f0fe7b7b640 1 -- 172.21.15.73:0/202382535 wait complete. 2024-09-12T03:38:33.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T03:38:34.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f89915c8640 1 Processor -- start 2024-09-12T03:38:34.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f89915c8640 1 -- start start 2024-09-12T03:38:34.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f89915c8640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f898c15bec0 0x7f898c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f89915c8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898c0b3290 con 0x7f898c15c2a0 2024-09-12T03:38:34.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f89915c8640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898c0b3570 con 0x7f898c0af470 2024-09-12T03:38:34.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f89915c8640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f898c0b3850 con 0x7f898c15bec0 2024-09-12T03:38:34.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898a7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f898c15c2a0 0x7f898c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50234/0 (socket says 172.21.15.73:50234) 2024-09-12T03:38:34.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898a7fc640 1 -- 172.21.15.73:0/2710902704 learned_addr learned my addr 172.21.15.73:0/2710902704 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:34.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086535687 0 0) 0x7f898c0b3290 con 0x7f898c15c2a0 2024-09-12T03:38:34.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8974003530 con 0x7f898c15c2a0 2024-09-12T03:38:34.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898affd640 1 --2- 172.21.15.73:0/2710902704 >> v2:172.21.15.150:3300/0 conn(0x7f898c15bec0 0x7f898c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:34.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1531225431 0 0) 0x7f8974003530 con 0x7f898c15c2a0 2024-09-12T03:38:34.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 >> v2:172.21.15.150:3300/0 conn(0x7f898c15bec0 msgr2=0x7f898c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 --2- 172.21.15.73:0/2710902704 >> v2:172.21.15.150:3300/0 conn(0x7f898c15bec0 0x7f898c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 >> v1:172.21.15.150:6789/0 conn(0x7f898c0af470 legacy=0x7f898c06e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c0b3b30 con 0x7f898c15c2a0 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f8980001680 con 0x7f898c15c2a0 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 >> v1:172.21.15.73:6789/0 conn(0x7f898c15c2a0 legacy=0x7f898c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8974003a10 0x7f8974003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8974004810 0x7f8974004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740051d0 0x7f897400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f898c0b3850 con 0x7f89740051d0 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f897400c0d0 con 0x7f8974003a10 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f897400c2d0 con 0x7f8974004810 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898b7fe640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740051d0 0x7f897400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:34.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898affd640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8974003a10 0x7f8974003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:34.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898b7fe640 1 -- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8974004810 msgr2=0x7f8974004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:34.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898b7fe640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8974004810 0x7f8974004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898b7fe640 1 -- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8974003a10 msgr2=0x7f8974003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:34.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898b7fe640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8974003a10 0x7f8974003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898b7fe640 1 -- 172.21.15.73:0/2710902704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8974003530 con 0x7f89740051d0 2024-09-12T03:38:34.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.117+0000 7f898affd640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8974003a10 0x7f8974003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:34.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f898b7fe640 1 -- 172.21.15.73:0/2710902704 reap_dead start 2024-09-12T03:38:34.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f898b7fe640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740051d0 0x7f897400b9d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8984001e70 tx=0x7f898401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3576366d72067e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:34.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8984001a90 con 0x7f89740051d0 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8984003bc0 con 0x7f89740051d0 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f8989ffb640 1 -- 172.21.15.73:0/2710902704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8984005020 con 0x7f89740051d0 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 -- 172.21.15.73:0/2710902704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740051d0 msgr2=0x7f897400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740051d0 0x7f897400b9d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8984001e70 tx=0x7f898401c780 comp rx=0 tx=0).stop 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 -- 172.21.15.73:0/2710902704 shutdown_connections 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 --2- 172.21.15.73:0/2710902704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89740051d0 0x7f897400b9d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 -- 172.21.15.73:0/2710902704 >> 172.21.15.73:0/2710902704 conn(0x7f898c0b1f90 msgr2=0x7f898c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 -- 172.21.15.73:0/2710902704 shutdown_connections 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 -- 172.21.15.73:0/2710902704 wait complete. 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 Processor -- start 2024-09-12T03:38:34.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.121+0000 7f89915c8640 1 -- start start 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89740051d0 0x7f898c14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898c09a280 0x7f898c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f898c15f180 0x7f898c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f898c0afc90 con 0x7f898c09a280 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f898c0b40f0 con 0x7f89740051d0 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f898c0aed60 con 0x7f898c15f180 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898c09a280 0x7f898c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898c09a280 0x7f898c15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58554/0 (socket says 172.21.15.73:58554) 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 -- 172.21.15.73:0/3401820580 learned_addr learned my addr 172.21.15.73:0/3401820580 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898affd640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89740051d0 0x7f898c14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898b7fe640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f898c15f180 0x7f898c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:34.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 -- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f898c15f180 msgr2=0x7f898c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f898c15f180 0x7f898c0cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 -- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89740051d0 msgr2=0x7f898c14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89740051d0 0x7f898c14f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 -- 172.21.15.73:0/3401820580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c15f9e0 con 0x7f898c09a280 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898affd640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89740051d0 0x7f898c14f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898a7fc640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898c09a280 0x7f898c15ec40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f898000c730 tx=0x7f898000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89737fe640 1 -- 172.21.15.73:0/3401820580 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980018070 con 0x7f898c09a280 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89737fe640 1 -- 172.21.15.73:0/3401820580 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89800072d0 con 0x7f898c09a280 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c15f620 con 0x7f898c09a280 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89737fe640 1 -- 172.21.15.73:0/3401820580 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89800047f0 con 0x7f898c09a280 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c150690 con 0x7f898c09a280 2024-09-12T03:38:34.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c0af0f0 con 0x7f898c09a280 2024-09-12T03:38:34.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89737fe640 1 -- 172.21.15.73:0/3401820580 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f898001b070 con 0x7f898c09a280 2024-09-12T03:38:34.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89737fe640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89780678c0 0x7f8978069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:34.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f89737fe640 1 -- 172.21.15.73:0/3401820580 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5778+0+0 (secure 0 0 0) 0x7f8980085110 con 0x7f898c09a280 2024-09-12T03:38:34.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898affd640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89780678c0 0x7f8978069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:34.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.125+0000 7f898affd640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89780678c0 0x7f8978069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f898c06fa80 tx=0x7f897c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:34.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.129+0000 7f89737fe640 1 -- 172.21.15.73:0/3401820580 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8980055c90 con 0x7f898c09a280 2024-09-12T03:38:34.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.281+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f898c06fcd0 con 0x7f898c09a280 2024-09-12T03:38:34.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.965+0000 7f89737fe640 1 -- 172.21.15.73:0/3401820580 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) ==== 169+0+0 (secure 0 0 0) 0x7f8980055590 con 0x7f898c09a280 2024-09-12T03:38:34.967 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-09-12T03:38:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.969+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89780678c0 msgr2=0x7f8978069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.969+0000 7f89915c8640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89780678c0 0x7f8978069d80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f898c06fa80 tx=0x7f897c008040 comp rx=0 tx=0).stop 2024-09-12T03:38:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.969+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898c09a280 msgr2=0x7f898c15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.969+0000 7f89915c8640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898c09a280 0x7f898c15ec40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f898000c730 tx=0x7f898000cb30 comp rx=0 tx=0).stop 2024-09-12T03:38:34.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 shutdown_connections 2024-09-12T03:38:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f89780678c0 0x7f8978069d80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f898c09a280 0x7f898c15ec40 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f898c15f180 0x7f898c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 --2- 172.21.15.73:0/3401820580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f89740051d0 0x7f898c14f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 >> 172.21.15.73:0/3401820580 conn(0x7f898c0b1f90 msgr2=0x7f898c1597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 shutdown_connections 2024-09-12T03:38:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:34.973+0000 7f89915c8640 1 -- 172.21.15.73:0/3401820580 wait complete. 2024-09-12T03:38:35.000 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T03:38:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.117+0000 7f30ac567640 1 Processor -- start 2024-09-12T03:38:35.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.117+0000 7f30ac567640 1 -- start start 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.117+0000 7f30ac567640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30a41520a0 0x7f30a406f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30a415f1d0 0x7f30a4071f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f30a4152480 con 0x7f30a41520a0 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f30a4070250 con 0x7f30a415f1d0 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f30a40aede0 con 0x7f30a406fe50 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30a41520a0 0x7f30a406f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30a41520a0 0x7f30a406f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47314/0 (socket says 172.21.15.73:47314) 2024-09-12T03:38:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 -- 172.21.15.73:0/856009023 learned_addr learned my addr 172.21.15.73:0/856009023 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30a9b02640 1 --2- 172.21.15.73:0/856009023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 -- 172.21.15.73:0/856009023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 msgr2=0x7f30a415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 --2- 172.21.15.73:0/856009023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aab04640 1 --2- 172.21.15.73:0/856009023 >> v2:172.21.15.150:3300/0 conn(0x7f30a415f1d0 0x7f30a4071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 -- 172.21.15.73:0/856009023 >> v2:172.21.15.150:3300/0 conn(0x7f30a415f1d0 msgr2=0x7f30a4071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 --2- 172.21.15.73:0/856009023 >> v2:172.21.15.150:3300/0 conn(0x7f30a415f1d0 0x7f30a4071f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 -- 172.21.15.73:0/856009023 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a415fa10 con 0x7f30a41520a0 2024-09-12T03:38:35.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aab04640 1 --2- 172.21.15.73:0/856009023 >> v2:172.21.15.150:3300/0 conn(0x7f30a415f1d0 0x7f30a4071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30aa303640 1 --2- 172.21.15.73:0/856009023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a406f910 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f30a406e250 tx=0x7f309c01e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68c9185131bd779 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30a9301640 1 -- 172.21.15.73:0/856009023 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0b4070 con 0x7f30a41520a0 2024-09-12T03:38:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30a9301640 1 -- 172.21.15.73:0/856009023 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c0a79a0 con 0x7f30a41520a0 2024-09-12T03:38:35.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30a9301640 1 -- 172.21.15.73:0/856009023 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c0a7d70 con 0x7f30a41520a0 2024-09-12T03:38:35.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- 172.21.15.73:0/856009023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 msgr2=0x7f30a406f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 --2- 172.21.15.73:0/856009023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a406f910 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f30a406e250 tx=0x7f309c01e910 comp rx=0 tx=0).stop 2024-09-12T03:38:35.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- 172.21.15.73:0/856009023 shutdown_connections 2024-09-12T03:38:35.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 --2- 172.21.15.73:0/856009023 >> v2:172.21.15.150:3300/0 conn(0x7f30a415f1d0 0x7f30a4071f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 --2- 172.21.15.73:0/856009023 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 --2- 172.21.15.73:0/856009023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a406f910 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- 172.21.15.73:0/856009023 >> 172.21.15.73:0/856009023 conn(0x7f30a40b1f90 msgr2=0x7f30a40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- 172.21.15.73:0/856009023 shutdown_connections 2024-09-12T03:38:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.121+0000 7f30ac567640 1 -- 172.21.15.73:0/856009023 wait complete. 2024-09-12T03:38:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 Processor -- start 2024-09-12T03:38:35.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 -- start start 2024-09-12T03:38:35.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a40cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a409b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a415f1d0 0x7f30a414e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f30a4073d30 con 0x7f30a41520a0 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f30a4073a50 con 0x7f30a415f1d0 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f30a415f5e0 con 0x7f30a406fe50 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a409b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a409b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47328/0 (socket says 172.21.15.73:47328) 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 -- 172.21.15.73:0/1724217675 learned_addr learned my addr 172.21.15.73:0/1724217675 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30aa303640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a40cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30aab04640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a415f1d0 0x7f30a414e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 -- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 msgr2=0x7f30a40cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a40cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 -- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a415f1d0 msgr2=0x7f30a414e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a415f1d0 0x7f30a414e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 -- 172.21.15.73:0/1724217675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a414e5b0 con 0x7f30a41520a0 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30aa303640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a40cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30aab04640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a415f1d0 0x7f30a414e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30a9b02640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a409b780 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f309800cbc0 tx=0x7f309800a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f3096ffd640 1 -- 172.21.15.73:0/1724217675 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309800ae10 con 0x7f30a41520a0 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f3096ffd640 1 -- 172.21.15.73:0/1724217675 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30980039a0 con 0x7f30a41520a0 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a414eab0 con 0x7f30a41520a0 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f3096ffd640 1 -- 172.21.15.73:0/1724217675 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098003d70 con 0x7f30a41520a0 2024-09-12T03:38:35.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a40cee70 con 0x7f30a41520a0 2024-09-12T03:38:35.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.125+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a415ec90 con 0x7f30a41520a0 2024-09-12T03:38:35.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.129+0000 7f3096ffd640 1 -- 172.21.15.73:0/1724217675 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3098004030 con 0x7f30a41520a0 2024-09-12T03:38:35.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.129+0000 7f3096ffd640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f30880678c0 0x7f3088069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.129+0000 7f3096ffd640 1 -- 172.21.15.73:0/1724217675 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f3098086740 con 0x7f30a41520a0 2024-09-12T03:38:35.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.129+0000 7f30aa303640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f30880678c0 0x7f3088069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.129+0000 7f30aa303640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f30880678c0 0x7f3088069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f309c0b1000 tx=0x7f309c0a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:35.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.133+0000 7f3096ffd640 1 -- 172.21.15.73:0/1724217675 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f30a414eab0 con 0x7f30a41520a0 2024-09-12T03:38:35.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.293+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f30a406e540 con 0x7f30a41520a0 2024-09-12T03:38:35.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.301+0000 7f3096ffd640 1 -- 172.21.15.73:0/1724217675 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f3098015020 con 0x7f30a41520a0 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f30880678c0 msgr2=0x7f3088069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f30880678c0 0x7f3088069d80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f309c0b1000 tx=0x7f309c0a9070 comp rx=0 tx=0).stop 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 msgr2=0x7f30a409b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a409b780 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f309800cbc0 tx=0x7f309800a500 comp rx=0 tx=0).stop 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 shutdown_connections 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f30880678c0 0x7f3088069d80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a41520a0 0x7f30a409b780 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a415f1d0 0x7f30a414e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 --2- 172.21.15.73:0/1724217675 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f30a406fe50 0x7f30a40cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 >> 172.21.15.73:0/1724217675 conn(0x7f30a40b1f90 msgr2=0x7f30a406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 shutdown_connections 2024-09-12T03:38:35.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.305+0000 7f30ac567640 1 -- 172.21.15.73:0/1724217675 wait complete. 2024-09-12T03:38:35.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write' 2024-09-12T03:38:35.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.449+0000 7f85a3522640 1 Processor -- start 2024-09-12T03:38:35.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.449+0000 7f85a3522640 1 -- start start 2024-09-12T03:38:35.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a3522640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f859c15bec0 0x7f859c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a3522640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15c2a0 0x7f859c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a3522640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859c0b3290 con 0x7f859c0af2a0 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a3522640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f859c0b3570 con 0x7f859c15bec0 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a3522640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f859c0b3850 con 0x7f859c15c2a0 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f859c15bec0 0x7f859c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f859c15bec0 0x7f859c0ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47334/0 (socket says 172.21.15.73:47334) 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 -- 172.21.15.73:0/2078912975 learned_addr learned my addr 172.21.15.73:0/2078912975 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a0abd640 1 --2- 172.21.15.73:0/2078912975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15c2a0 0x7f859c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 -- 172.21.15.73:0/2078912975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15c2a0 msgr2=0x7f859c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 --2- 172.21.15.73:0/2078912975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15c2a0 0x7f859c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 -- 172.21.15.73:0/2078912975 >> v1:172.21.15.150:6789/0 conn(0x7f859c0af2a0 legacy=0x7f859c15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 -- 172.21.15.73:0/2078912975 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c0b3b30 con 0x7f859c15bec0 2024-09-12T03:38:35.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a0abd640 1 --2- 172.21.15.73:0/2078912975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15c2a0 0x7f859c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:35.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f85a12be640 1 --2- 172.21.15.73:0/2078912975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c15bec0 0x7f859c0ad200 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8598009870 tx=0x7f859801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f8fbd40ad902d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:35.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f8593fff640 1 -- 172.21.15.73:0/2078912975 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85980aa610 con 0x7f859c15bec0 2024-09-12T03:38:35.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f8593fff640 1 -- 172.21.15.73:0/2078912975 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85980af070 con 0x7f859c15bec0 2024-09-12T03:38:35.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.453+0000 7f8593fff640 1 -- 172.21.15.73:0/2078912975 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85980aa9d0 con 0x7f859c15bec0 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- 172.21.15.73:0/2078912975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c15bec0 msgr2=0x7f859c0ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 --2- 172.21.15.73:0/2078912975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c15bec0 0x7f859c0ad200 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8598009870 tx=0x7f859801c4f0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- 172.21.15.73:0/2078912975 shutdown_connections 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 --2- 172.21.15.73:0/2078912975 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15c2a0 0x7f859c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 --2- 172.21.15.73:0/2078912975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c15bec0 0x7f859c0ad200 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- 172.21.15.73:0/2078912975 >> 172.21.15.73:0/2078912975 conn(0x7f859c0b1f90 msgr2=0x7f859c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- 172.21.15.73:0/2078912975 shutdown_connections 2024-09-12T03:38:35.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- 172.21.15.73:0/2078912975 wait complete. 2024-09-12T03:38:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 Processor -- start 2024-09-12T03:38:35.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- start start 2024-09-12T03:38:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c0af2a0 0x7f859c1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15bec0 0x7f859c1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f859c15c2a0 0x7f859c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0ad740 con 0x7f859c0af2a0 2024-09-12T03:38:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0afc90 con 0x7f859c15c2a0 2024-09-12T03:38:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f859c169000 con 0x7f859c15bec0 2024-09-12T03:38:35.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c0af2a0 0x7f859c1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c0af2a0 0x7f859c1479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47342/0 (socket says 172.21.15.73:47342) 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 -- 172.21.15.73:0/2149787473 learned_addr learned my addr 172.21.15.73:0/2149787473 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a1abf640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f859c15c2a0 0x7f859c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a0abd640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15bec0 0x7f859c1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 -- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15bec0 msgr2=0x7f859c1574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15bec0 0x7f859c1574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 -- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f859c15c2a0 msgr2=0x7f859c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f859c15c2a0 0x7f859c157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 -- 172.21.15.73:0/2149787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c070820 con 0x7f859c0af2a0 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a1abf640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f859c15c2a0 0x7f859c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a12be640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c0af2a0 0x7f859c1479c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f85980ac040 tx=0x7f859801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f8591ffb640 1 -- 172.21.15.73:0/2149787473 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85980b3600 con 0x7f859c0af2a0 2024-09-12T03:38:35.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f8591ffb640 1 -- 172.21.15.73:0/2149787473 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85980b37c0 con 0x7f859c0af2a0 2024-09-12T03:38:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c147f00 con 0x7f859c0af2a0 2024-09-12T03:38:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f8591ffb640 1 -- 172.21.15.73:0/2149787473 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85980b3bb0 con 0x7f859c0af2a0 2024-09-12T03:38:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.457+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c158980 con 0x7f859c0af2a0 2024-09-12T03:38:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.461+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c0b2ce0 con 0x7f859c0af2a0 2024-09-12T03:38:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.461+0000 7f8591ffb640 1 -- 172.21.15.73:0/2149787473 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f85980c6440 con 0x7f859c0af2a0 2024-09-12T03:38:35.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.461+0000 7f8591ffb640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85800678c0 0x7f8580069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.461+0000 7f8591ffb640 1 -- 172.21.15.73:0/2149787473 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f8598120660 con 0x7f859c0af2a0 2024-09-12T03:38:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.461+0000 7f85a0abd640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85800678c0 0x7f8580069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:35.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.461+0000 7f85a0abd640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85800678c0 0x7f8580069d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f858c006fd0 tx=0x7f858c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:35.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.465+0000 7f8591ffb640 1 -- 172.21.15.73:0/2149787473 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f85980a7070 con 0x7f859c0af2a0 2024-09-12T03:38:35.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.685+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]} v 0) -- 0x7f859c06fcd0 con 0x7f859c0af2a0 2024-09-12T03:38:35.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f8591ffb640 1 -- 172.21.15.73:0/2149787473 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_remote_update_write"]}]=0 v231) ==== 137+0+0 (secure 0 0 0) 0x7f8598016110 con 0x7f859c0af2a0 2024-09-12T03:38:35.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85800678c0 msgr2=0x7f8580069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85800678c0 0x7f8580069d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f858c006fd0 tx=0x7f858c008040 comp rx=0 tx=0).stop 2024-09-12T03:38:35.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c0af2a0 msgr2=0x7f859c1479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:35.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c0af2a0 0x7f859c1479c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f85980ac040 tx=0x7f859801ad30 comp rx=0 tx=0).stop 2024-09-12T03:38:35.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 shutdown_connections 2024-09-12T03:38:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f85800678c0 0x7f8580069d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f859c15c2a0 0x7f859c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f859c15bec0 0x7f859c1574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 --2- 172.21.15.73:0/2149787473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f859c0af2a0 0x7f859c1479c0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 >> 172.21.15.73:0/2149787473 conn(0x7f859c0b1f90 msgr2=0x7f859c152170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 shutdown_connections 2024-09-12T03:38:35.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:35.981+0000 7f85a3522640 1 -- 172.21.15.73:0/2149787473 wait complete. 2024-09-12T03:38:36.006 INFO:tasks.cephfs_test_runner:That when a client modifies the quota on a directory used ... ok 2024-09-12T03:38:36.006 INFO:tasks.cephfs_test_runner: 2024-09-12T03:38:36.007 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T03:38:36.007 INFO:tasks.cephfs_test_runner:Ran 6 tests in 203.978s 2024-09-12T03:38:36.007 INFO:tasks.cephfs_test_runner: 2024-09-12T03:38:36.007 INFO:tasks.cephfs_test_runner:OK 2024-09-12T03:38:36.008 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-12T03:38:36.018 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-12T03:38:36.025 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-12T03:38:36.026 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:38:36.026 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:36.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:38:36.032 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-12T03:38:36.032 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:36.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336408k,nr_inodes=4084102,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18278 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274668k,nr_inodes=818667,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274672k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T03:38:36.086 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:36.086 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:36.093 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:38:36.093 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-09-12T03:38:36.093 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T03:38:36.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336476k,nr_inodes=4084119,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17002 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274684k,nr_inodes=818671,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274684k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T03:38:36.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.144 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-09-12T03:38:36.149 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T03:38:36.150 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T03:38:36.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T03:38:36.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T03:38:36.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-09-12T03:38:36.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.487 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2024-09-12T03:38:36.493 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T03:38:36.493 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T03:38:36.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.494 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T03:38:36.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.549 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T03:38:36.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T03:38:36.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2024-09-12T03:38:36.805 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T03:38:36.815 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T03:38:36.815 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:36.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6fccc640 1 Processor -- start 2024-09-12T03:38:36.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6fccc640 1 -- start start 2024-09-12T03:38:36.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6fccc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d6815bec0 0x7f2d680ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:36.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6fccc640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f2d680af470 0x7f2d6806e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:36.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6fccc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d680b3290 con 0x7f2d6815c2a0 2024-09-12T03:38:36.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6fccc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2d680b3570 con 0x7f2d6815bec0 2024-09-12T03:38:36.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6fccc640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f2d680b3850 con 0x7f2d680af470 2024-09-12T03:38:36.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6d267640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2d6815c2a0 0x7f2d680aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42566/0 (socket says 172.21.15.73:42566) 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6d267640 1 -- 172.21.15.73:0/838838017 learned_addr learned my addr 172.21.15.73:0/838838017 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6da68640 1 --2- 172.21.15.73:0/838838017 >> v2:172.21.15.73:3300/0 conn(0x7f2d6815bec0 0x7f2d680ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6ca66640 1 -- 172.21.15.73:0/838838017 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967897318 0 0) 0x7f2d680b3290 con 0x7f2d6815c2a0 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6e269640 1 --2- 172.21.15.73:0/838838017 >> v2:172.21.15.150:3300/0 conn(0x7f2d680af470 0x7f2d6806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6ca66640 1 -- 172.21.15.73:0/838838017 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d54003530 con 0x7f2d6815c2a0 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6da68640 1 -- 172.21.15.73:0/838838017 >> v2:172.21.15.150:3300/0 conn(0x7f2d680af470 msgr2=0x7f2d6806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6da68640 1 --2- 172.21.15.73:0/838838017 >> v2:172.21.15.150:3300/0 conn(0x7f2d680af470 0x7f2d6806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6ca66640 1 -- 172.21.15.73:0/838838017 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2567514516 0 0) 0x7f2d54003530 con 0x7f2d6815c2a0 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6da68640 1 -- 172.21.15.73:0/838838017 >> v1:172.21.15.73:6789/0 conn(0x7f2d6815c2a0 legacy=0x7f2d680aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:36.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.945+0000 7f2d6da68640 1 -- 172.21.15.73:0/838838017 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d680b3b30 con 0x7f2d6815bec0 2024-09-12T03:38:36.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6da68640 1 --2- 172.21.15.73:0/838838017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d680ad200 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2d680b2fb0 tx=0x7f2d6401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412bc36bbba7c905 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:36.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6ca66640 1 -- 172.21.15.73:0/838838017 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640b0070 con 0x7f2d6815bec0 2024-09-12T03:38:36.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6ca66640 1 -- 172.21.15.73:0/838838017 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d640ab400 con 0x7f2d6815bec0 2024-09-12T03:38:36.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6ca66640 1 -- 172.21.15.73:0/838838017 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58001680 con 0x7f2d6815bec0 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 -- 172.21.15.73:0/838838017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 msgr2=0x7f2d680ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/838838017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d680ad200 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2d680b2fb0 tx=0x7f2d6401c370 comp rx=0 tx=0).stop 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 -- 172.21.15.73:0/838838017 shutdown_connections 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/838838017 >> v2:172.21.15.150:3300/0 conn(0x7f2d680af470 0x7f2d6806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/838838017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d680ad200 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 -- 172.21.15.73:0/838838017 >> 172.21.15.73:0/838838017 conn(0x7f2d680b1f90 msgr2=0x7f2d680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 -- 172.21.15.73:0/838838017 shutdown_connections 2024-09-12T03:38:36.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.949+0000 7f2d6fccc640 1 -- 172.21.15.73:0/838838017 wait complete. 2024-09-12T03:38:36.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 Processor -- start 2024-09-12T03:38:36.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 -- start start 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d680af470 0x7f2d6814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d68073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d6815c2a0 0x7f2d68150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6806ed50 con 0x7f2d6815bec0 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f2d680ad740 con 0x7f2d6815c2a0 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6806eed0 con 0x7f2d680af470 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d68073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d68073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47356/0 (socket says 172.21.15.73:47356) 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 -- 172.21.15.73:0/1062254756 learned_addr learned my addr 172.21.15.73:0/1062254756 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:36.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6e269640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d6815c2a0 0x7f2d68150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6da68640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d680af470 0x7f2d6814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 -- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d680af470 msgr2=0x7f2d6814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d680af470 0x7f2d6814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 -- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d6815c2a0 msgr2=0x7f2d68150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d6815c2a0 0x7f2d68150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 -- 172.21.15.73:0/1062254756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d68158140 con 0x7f2d6815bec0 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6e269640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d6815c2a0 0x7f2d68150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6da68640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d680af470 0x7f2d6814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6d267640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d68073870 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2d580011f0 tx=0x7f2d5800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d5e7fc640 1 -- 172.21.15.73:0/1062254756 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58005ae0 con 0x7f2d6815bec0 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d5e7fc640 1 -- 172.21.15.73:0/1062254756 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d58005c80 con 0x7f2d6815bec0 2024-09-12T03:38:36.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d5e7fc640 1 -- 172.21.15.73:0/1062254756 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58007290 con 0x7f2d6815bec0 2024-09-12T03:38:36.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d681578a0 con 0x7f2d6815bec0 2024-09-12T03:38:36.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d68157e60 con 0x7f2d6815bec0 2024-09-12T03:38:36.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6806e000 con 0x7f2d6815bec0 2024-09-12T03:38:36.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.953+0000 7f2d5e7fc640 1 -- 172.21.15.73:0/1062254756 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d58007430 con 0x7f2d6815bec0 2024-09-12T03:38:36.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.957+0000 7f2d5e7fc640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2d4c0678c0 0x7f2d4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:36.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.957+0000 7f2d6da68640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2d4c0678c0 0x7f2d4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:36.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.957+0000 7f2d5e7fc640 1 -- 172.21.15.73:0/1062254756 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f2d580857e0 con 0x7f2d6815bec0 2024-09-12T03:38:36.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.957+0000 7f2d6da68640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2d4c0678c0 0x7f2d4c069d80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2d640ad000 tx=0x7f2d64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:36.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:36.961+0000 7f2d5e7fc640 1 -- 172.21.15.73:0/1062254756 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2d58010300 con 0x7f2d6815bec0 2024-09-12T03:38:37.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.121+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d6806fcd0 con 0x7f2d4c0678c0 2024-09-12T03:38:37.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.121+0000 7f2d5e7fc640 1 -- 172.21.15.73:0/1062254756 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13519 (secure 0 0 0) 0x7f2d6806fcd0 con 0x7f2d4c0678c0 2024-09-12T03:38:37.124 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:37.124 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2d4c0678c0 msgr2=0x7f2d4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2d4c0678c0 0x7f2d4c069d80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2d640ad000 tx=0x7f2d64008040 comp rx=0 tx=0).stop 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 msgr2=0x7f2d68073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d68073870 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2d580011f0 tx=0x7f2d5800cbe0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 shutdown_connections 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f2d4c0678c0 0x7f2d4c069d80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d6815bec0 0x7f2d68073870 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d6815c2a0 0x7f2d68150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 --2- 172.21.15.73:0/1062254756 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f2d680af470 0x7f2d6814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 >> 172.21.15.73:0/1062254756 conn(0x7f2d680b1f90 msgr2=0x7f2d681598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:37.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 shutdown_connections 2024-09-12T03:38:37.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.125+0000 7f2d6fccc640 1 -- 172.21.15.73:0/1062254756 wait complete. 2024-09-12T03:38:37.143 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-12T03:38:35.860149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":265192,"kb_used_data":15696,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709528,"statfs":{"total":773094113280,"available":772822556672,"internally_reserved":0,"allocated":16072704,"data_stored":10491688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12587041,"num_objects":-37,"num_object_clones":0,"num_object_copies":-74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001898"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-12T03:38:31.839991+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:31.839991+0000","last_peered":"2024-09-12T03:38:31.839991+0000","last_clean":"2024-09-12T03:38:31.839991+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:31.839991+0000","last_undegraded":"2024-09-12T03:38:31.839991+0000","last_fullsized":"2024-09-12T03:38:31.839991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1880064,"data_stored":1163737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":566705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":573301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":573782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":566735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34732,"kb_used_data":3544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337108,"statfs":{"total":96636764160,"available":96601198592,"internally_reserved":0,"allocated":3629056,"data_stored":2932536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34748,"kb_used_data":3560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337092,"statfs":{"total":96636764160,"available":96601182208,"internally_reserved":0,"allocated":3645440,"data_stored":2938928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1871872,"data_stored":1175964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:37.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:37.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcefa497640 1 Processor -- start 2024-09-12T03:38:37.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcefa497640 1 -- start start 2024-09-12T03:38:37.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcefa497640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fcef415c2a0 0x7fcef40aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcefa497640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef40b3290 con 0x7fcef40af2a0 2024-09-12T03:38:37.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcefa497640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef40b3570 con 0x7fcef415bec0 2024-09-12T03:38:37.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcefa497640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fcef40b3850 con 0x7fcef415c2a0 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcef40af2a0 0x7fcef406e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42574/0 (socket says 172.21.15.73:42574) 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 -- 172.21.15.73:0/772872561 learned_addr learned my addr 172.21.15.73:0/772872561 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef37fe640 1 --2- 172.21.15.73:0/772872561 >> v2:172.21.15.150:3300/0 conn(0x7fcef415c2a0 0x7fcef40aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274891547 0 0) 0x7fcef40b3290 con 0x7fcef40af2a0 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcedc003530 con 0x7fcef40af2a0 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1818535102 0 0) 0x7fcedc003530 con 0x7fcef40af2a0 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 >> v2:172.21.15.150:3300/0 conn(0x7fcef415c2a0 msgr2=0x7fcef40aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 --2- 172.21.15.73:0/772872561 >> v2:172.21.15.150:3300/0 conn(0x7fcef415c2a0 0x7fcef40aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 >> v1:172.21.15.150:6789/0 conn(0x7fcef415bec0 legacy=0x7fcef40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef40b3b30 con 0x7fcef40af2a0 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fceec001a00 con 0x7fcef40af2a0 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 >> v1:172.21.15.73:6789/0 conn(0x7fcef40af2a0 legacy=0x7fcef406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcedc0039c0 0x7fcedc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc004810 0x7fcedc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcedc0051d0 0x7fcedc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcef40b3850 con 0x7fcedc0051d0 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc00c070 con 0x7fcedc004810 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcedc00c270 con 0x7fcedc0039c0 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcedc0051d0 0x7fcedc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef37fe640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc004810 0x7fcedc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef3fff640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcedc0039c0 0x7fcedc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 -- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcedc0039c0 msgr2=0x7fcedc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:37.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcedc0039c0 0x7fcedc003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 -- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc004810 msgr2=0x7fcedc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:37.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc004810 0x7fcedc004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.265+0000 7fcef8a34640 1 -- 172.21.15.73:0/772872561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc003530 con 0x7fcedc0051d0 2024-09-12T03:38:37.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef8a34640 1 -- 172.21.15.73:0/772872561 reap_dead start 2024-09-12T03:38:37.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef8a34640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcedc0051d0 0x7fcedc00b9d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fceec00a840 tx=0x7fceec01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bbc107f40fa7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec00a460 con 0x7fcedc0051d0 2024-09-12T03:38:37.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceec0ac640 con 0x7fcedc0051d0 2024-09-12T03:38:37.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef2ffd640 1 -- 172.21.15.73:0/772872561 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec0aca30 con 0x7fcedc0051d0 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- 172.21.15.73:0/772872561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcedc0051d0 msgr2=0x7fcedc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcedc0051d0 0x7fcedc00b9d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fceec00a840 tx=0x7fceec01d360 comp rx=0 tx=0).stop 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- 172.21.15.73:0/772872561 shutdown_connections 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 --2- 172.21.15.73:0/772872561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcedc0051d0 0x7fcedc00b9d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- 172.21.15.73:0/772872561 >> 172.21.15.73:0/772872561 conn(0x7fcef40b1f90 msgr2=0x7fcef40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- 172.21.15.73:0/772872561 shutdown_connections 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- 172.21.15.73:0/772872561 wait complete. 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 Processor -- start 2024-09-12T03:38:37.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- start start 2024-09-12T03:38:37.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc0051d0 0x7fcef4151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef414cb40 0x7fcef4151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef415d410 0x7fcef415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcef40afc90 con 0x7fcef414cb40 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fcef40b40f0 con 0x7fcedc0051d0 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcefa497640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fcef40af710 con 0x7fcef415d410 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef414cb40 0x7fcef4151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef414cb40 0x7fcef4151e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47380/0 (socket says 172.21.15.73:47380) 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.269+0000 7fcef37fe640 1 -- 172.21.15.73:0/2439596492 learned_addr learned my addr 172.21.15.73:0/2439596492 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef3fff640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc0051d0 0x7fcef4151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef8a34640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef415d410 0x7fcef415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef37fe640 1 -- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef415d410 msgr2=0x7fcef415d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef37fe640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef415d410 0x7fcef415d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef37fe640 1 -- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc0051d0 msgr2=0x7fcef4151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef37fe640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc0051d0 0x7fcef4151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef37fe640 1 -- 172.21.15.73:0/2439596492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef415b280 con 0x7fcef414cb40 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef37fe640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef414cb40 0x7fcef4151e80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fcee8010850 tx=0x7fcee8010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef0ff9640 1 -- 172.21.15.73:0/2439596492 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee800f040 con 0x7fcef414cb40 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef0ff9640 1 -- 172.21.15.73:0/2439596492 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee800eb60 con 0x7fcef414cb40 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef414c880 con 0x7fcef414cb40 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef0ff9640 1 -- 172.21.15.73:0/2439596492 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee801c400 con 0x7fcef414cb40 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef415c930 con 0x7fcef414cb40 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef40aed60 con 0x7fcef414cb40 2024-09-12T03:38:37.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef0ff9640 1 -- 172.21.15.73:0/2439596492 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcee801c5a0 con 0x7fcef414cb40 2024-09-12T03:38:37.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef0ff9640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcee00678f0 0x7fcee0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef3fff640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcee00678f0 0x7fcee0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef0ff9640 1 -- 172.21.15.73:0/2439596492 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7fcee80861c0 con 0x7fcef414cb40 2024-09-12T03:38:37.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.273+0000 7fcef3fff640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcee00678f0 0x7fcee0069db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000f70 tx=0x7fcee4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.277+0000 7fcef0ff9640 1 -- 172.21.15.73:0/2439596492 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcee8018030 con 0x7fcef414cb40 2024-09-12T03:38:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.437+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcef406fcd0 con 0x7fcee00678f0 2024-09-12T03:38:37.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcef0ff9640 1 -- 172.21.15.73:0/2439596492 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13519 (secure 0 0 0) 0x7fcef406fcd0 con 0x7fcee00678f0 2024-09-12T03:38:37.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcee00678f0 msgr2=0x7fcee0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcee00678f0 0x7fcee0069db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000f70 tx=0x7fcee4009040 comp rx=0 tx=0).stop 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef414cb40 msgr2=0x7fcef4151e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef414cb40 0x7fcef4151e80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fcee8010850 tx=0x7fcee8010d10 comp rx=0 tx=0).stop 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 shutdown_connections 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fcee00678f0 0x7fcee0069db0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef414cb40 0x7fcef4151e80 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fcef415d410 0x7fcef415d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 --2- 172.21.15.73:0/2439596492 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcedc0051d0 0x7fcef4151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 >> 172.21.15.73:0/2439596492 conn(0x7fcef40b1f90 msgr2=0x7fcef41597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 shutdown_connections 2024-09-12T03:38:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.441+0000 7fcefa497640 1 -- 172.21.15.73:0/2439596492 wait complete. 2024-09-12T03:38:37.460 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-12T03:38:35.860149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":265192,"kb_used_data":15696,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709528,"statfs":{"total":773094113280,"available":772822556672,"internally_reserved":0,"allocated":16072704,"data_stored":10491688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12587041,"num_objects":-37,"num_object_clones":0,"num_object_copies":-74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001898"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-12T03:38:31.839991+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:31.839991+0000","last_peered":"2024-09-12T03:38:31.839991+0000","last_clean":"2024-09-12T03:38:31.839991+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:31.839991+0000","last_undegraded":"2024-09-12T03:38:31.839991+0000","last_fullsized":"2024-09-12T03:38:31.839991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1880064,"data_stored":1163737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":566705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":573301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":573782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":566735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34732,"kb_used_data":3544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337108,"statfs":{"total":96636764160,"available":96601198592,"internally_reserved":0,"allocated":3629056,"data_stored":2932536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34748,"kb_used_data":3560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337092,"statfs":{"total":96636764160,"available":96601182208,"internally_reserved":0,"allocated":3645440,"data_stored":2938928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1871872,"data_stored":1175964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:37.461 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T03:38:37.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:37.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.577+0000 7f5ad8f80640 1 Processor -- start 2024-09-12T03:38:37.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.577+0000 7f5ad8f80640 1 -- start start 2024-09-12T03:38:37.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad8f80640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ad41457a0 0x7f5ad40d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad8f80640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad40b4510 0x7f5ad40d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad8f80640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad40d27a0 con 0x7f5ad40cf800 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad8f80640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad40d2a80 con 0x7f5ad41457a0 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad8f80640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad40d2d60 con 0x7f5ad40b4510 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad2d9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad40b4510 0x7f5ad40d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad259c640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5ad41457a0 0x7f5ad40d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad1d9b640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5ad40cf800 0x7f5ad40b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44760/0 (socket says 172.21.15.73:44760) 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad1d9b640 1 -- 172.21.15.73:0/3612344463 learned_addr learned my addr 172.21.15.73:0/3612344463 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:37.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad2d9d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad40b4510 0x7f5ad40d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:57854/0 (socket says 172.21.15.73:57854) 2024-09-12T03:38:37.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad259c640 1 -- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad40b4510 msgr2=0x7f5ad40d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:37.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad259c640 1 --2- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad40b4510 0x7f5ad40d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad259c640 1 -- 172.21.15.73:0/3612344463 >> v1:172.21.15.150:6789/0 conn(0x7f5ad40cf800 legacy=0x7f5ad40b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad259c640 1 -- 172.21.15.73:0/3612344463 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad40d01f0 con 0x7f5ad41457a0 2024-09-12T03:38:37.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.581+0000 7f5ad2d9d640 1 --2- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad40b4510 0x7f5ad40d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:38:37.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad259c640 1 --2- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad41457a0 0x7f5ad40d1ea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40097c0 tx=0x7f5ac401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0d6f13c9b977a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad159a640 1 -- 172.21.15.73:0/3612344463 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40b0070 con 0x7f5ad41457a0 2024-09-12T03:38:37.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad159a640 1 -- 172.21.15.73:0/3612344463 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac40ab600 con 0x7f5ad41457a0 2024-09-12T03:38:37.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad159a640 1 -- 172.21.15.73:0/3612344463 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40ab9d0 con 0x7f5ad41457a0 2024-09-12T03:38:37.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad41457a0 msgr2=0x7f5ad40d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad41457a0 0x7f5ad40d1ea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40097c0 tx=0x7f5ac401c410 comp rx=0 tx=0).stop 2024-09-12T03:38:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3612344463 shutdown_connections 2024-09-12T03:38:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad40b4510 0x7f5ad40d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3612344463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad41457a0 0x7f5ad40d1ea0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3612344463 >> 172.21.15.73:0/3612344463 conn(0x7f5ad406bcc0 msgr2=0x7f5ad406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3612344463 shutdown_connections 2024-09-12T03:38:37.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3612344463 wait complete. 2024-09-12T03:38:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 Processor -- start 2024-09-12T03:38:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- start start 2024-09-12T03:38:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad40b4510 0x7f5ad413da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40cf800 0x7f5ad41662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad41457a0 0x7f5ad41667f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad41690b0 con 0x7f5ad40cf800 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad40d1670 con 0x7f5ad40b4510 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad8f80640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad4169230 con 0x7f5ad41457a0 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40cf800 0x7f5ad41662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40cf800 0x7f5ad41662b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47388/0 (socket says 172.21.15.73:47388) 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.585+0000 7f5ad1d9b640 1 -- 172.21.15.73:0/3388177982 learned_addr learned my addr 172.21.15.73:0/3388177982 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad259c640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad40b4510 0x7f5ad413da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad2d9d640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad41457a0 0x7f5ad41667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad1d9b640 1 -- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad41457a0 msgr2=0x7f5ad41667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad1d9b640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad41457a0 0x7f5ad41667f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad1d9b640 1 -- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad40b4510 msgr2=0x7f5ad413da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad1d9b640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad40b4510 0x7f5ad413da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad1d9b640 1 -- 172.21.15.73:0/3388177982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad4137d10 con 0x7f5ad40cf800 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad2d9d640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad41457a0 0x7f5ad41667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad1d9b640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40cf800 0x7f5ad41662b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00c450 tx=0x7f5abc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5acaffd640 1 -- 172.21.15.73:0/3388177982 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc017070 con 0x7f5ad40cf800 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5acaffd640 1 -- 172.21.15.73:0/3388177982 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5abc005cf0 con 0x7f5ad40cf800 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5acaffd640 1 -- 172.21.15.73:0/3388177982 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5abc007290 con 0x7f5ad40cf800 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad4166d30 con 0x7f5ad40cf800 2024-09-12T03:38:37.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad4137f80 con 0x7f5ad40cf800 2024-09-12T03:38:37.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad40d0710 con 0x7f5ad40cf800 2024-09-12T03:38:37.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5acaffd640 1 -- 172.21.15.73:0/3388177982 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5abc01a070 con 0x7f5ad40cf800 2024-09-12T03:38:37.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5acaffd640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5ab40678c0 0x7f5ab4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5acaffd640 1 -- 172.21.15.73:0/3388177982 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f5abc084dd0 con 0x7f5ad40cf800 2024-09-12T03:38:37.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad259c640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5ab40678c0 0x7f5ab4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.589+0000 7f5ad259c640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5ab40678c0 0x7f5ab4069d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40ad000 tx=0x7f5ac40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.593+0000 7f5acaffd640 1 -- 172.21.15.73:0/3388177982 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5abc055b10 con 0x7f5ad40cf800 2024-09-12T03:38:37.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.741+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ad413f730 con 0x7f5ab40678c0 2024-09-12T03:38:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.741+0000 7f5acaffd640 1 -- 172.21.15.73:0/3388177982 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13519 (secure 0 0 0) 0x7f5ad413f730 con 0x7f5ab40678c0 2024-09-12T03:38:37.743 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:37.743 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5ab40678c0 msgr2=0x7f5ab4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5ab40678c0 0x7f5ab4069d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40ad000 tx=0x7f5ac40a6000 comp rx=0 tx=0).stop 2024-09-12T03:38:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40cf800 msgr2=0x7f5ad41662b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40cf800 0x7f5ad41662b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f5abc00c450 tx=0x7f5abc00c910 comp rx=0 tx=0).stop 2024-09-12T03:38:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 shutdown_connections 2024-09-12T03:38:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f5ab40678c0 0x7f5ab4069d80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ad40cf800 0x7f5ad41662b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f5ad41457a0 0x7f5ad41667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 --2- 172.21.15.73:0/3388177982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ad40b4510 0x7f5ad413da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 >> 172.21.15.73:0/3388177982 conn(0x7f5ad406bcc0 msgr2=0x7f5ad40b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 shutdown_connections 2024-09-12T03:38:37.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.745+0000 7f5ad8f80640 1 -- 172.21.15.73:0/3388177982 wait complete. 2024-09-12T03:38:37.760 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-09-12T03:38:35.860149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":265192,"kb_used_data":15696,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709528,"statfs":{"total":773094113280,"available":772822556672,"internally_reserved":0,"allocated":16072704,"data_stored":10491688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12587041,"num_objects":-37,"num_object_clones":0,"num_object_copies":-74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-62,"num_write_kb":-12317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001898"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-12T03:38:31.839991+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:31.839991+0000","last_peered":"2024-09-12T03:38:31.839991+0000","last_clean":"2024-09-12T03:38:31.839991+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:31.839991+0000","last_undegraded":"2024-09-12T03:38:31.839991+0000","last_fullsized":"2024-09-12T03:38:31.839991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1880064,"data_stored":1163737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509494,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":566705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1282048,"data_stored":573301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":573782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":566735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34732,"kb_used_data":3544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337108,"statfs":{"total":96636764160,"available":96601198592,"internally_reserved":0,"allocated":3629056,"data_stored":2932536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34748,"kb_used_data":3560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337092,"statfs":{"total":96636764160,"available":96601182208,"internally_reserved":0,"allocated":3645440,"data_stored":2938928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1871872,"data_stored":1175964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:37.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T03:38:37.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.877+0000 7f99699a2640 1 Processor -- start 2024-09-12T03:38:37.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.877+0000 7f99699a2640 1 -- start start 2024-09-12T03:38:37.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9964161a60 0x7f99640d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99640d2e90 0x7f99640cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99640d32b0 con 0x7f99640cf450 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f99640d0300 con 0x7f99640d2e90 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f996406e6c0 con 0x7f9964161a60 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99640d2e90 0x7f99640cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99640d2e90 0x7f99640cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47394/0 (socket says 172.21.15.73:47394) 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 -- 172.21.15.73:0/1112135712 learned_addr learned my addr 172.21.15.73:0/1112135712 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f9962ffd640 1 --2- 172.21.15.73:0/1112135712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9964161a60 0x7f99640d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 -- 172.21.15.73:0/1112135712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9964161a60 msgr2=0x7f99640d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 --2- 172.21.15.73:0/1112135712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9964161a60 0x7f99640d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 -- 172.21.15.73:0/1112135712 >> v1:172.21.15.150:6789/0 conn(0x7f99640cf450 legacy=0x7f99640d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:37.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 -- 172.21.15.73:0/1112135712 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99640b0f60 con 0x7f99640d2e90 2024-09-12T03:38:37.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99627fc640 1 --2- 172.21.15.73:0/1112135712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99640d2e90 0x7f99640cef10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9958009870 tx=0x7f995801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2330220dce016d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f9961ffb640 1 -- 172.21.15.73:0/1112135712 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99640d1930 con 0x7f99640d2e90 2024-09-12T03:38:37.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f9961ffb640 1 -- 172.21.15.73:0/1112135712 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99580b0070 con 0x7f99640d2e90 2024-09-12T03:38:37.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f9961ffb640 1 -- 172.21.15.73:0/1112135712 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99580ab840 con 0x7f99640d2e90 2024-09-12T03:38:37.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- 172.21.15.73:0/1112135712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99640d2e90 msgr2=0x7f99640cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 --2- 172.21.15.73:0/1112135712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99640d2e90 0x7f99640cef10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9958009870 tx=0x7f995801c460 comp rx=0 tx=0).stop 2024-09-12T03:38:37.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- 172.21.15.73:0/1112135712 shutdown_connections 2024-09-12T03:38:37.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 --2- 172.21.15.73:0/1112135712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99640d2e90 0x7f99640cef10 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 --2- 172.21.15.73:0/1112135712 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9964161a60 0x7f99640d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- 172.21.15.73:0/1112135712 >> 172.21.15.73:0/1112135712 conn(0x7f996408bf90 msgr2=0x7f996409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:37.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- 172.21.15.73:0/1112135712 shutdown_connections 2024-09-12T03:38:37.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.881+0000 7f99699a2640 1 -- 172.21.15.73:0/1112135712 wait complete. 2024-09-12T03:38:37.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 Processor -- start 2024-09-12T03:38:37.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 -- start start 2024-09-12T03:38:37.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99640cf450 0x7f9964150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99640d2e90 0x7f99640b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9964161a60 0x7f996415f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f99640cf900 con 0x7f9964161a60 2024-09-12T03:38:37.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f996406d190 con 0x7f99640cf450 2024-09-12T03:38:37.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f99640cfa80 con 0x7f99640d2e90 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9964161a60 0x7f996415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9964161a60 0x7f996415f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47398/0 (socket says 172.21.15.73:47398) 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 -- 172.21.15.73:0/3556840338 learned_addr learned my addr 172.21.15.73:0/3556840338 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99627fc640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99640d2e90 0x7f99640b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f9962ffd640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99640cf450 0x7f9964150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 -- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99640d2e90 msgr2=0x7f99640b99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99640d2e90 0x7f99640b99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 -- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99640cf450 msgr2=0x7f9964150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99640cf450 0x7f9964150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 -- 172.21.15.73:0/3556840338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99641508b0 con 0x7f9964161a60 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99637fe640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9964161a60 0x7f996415f360 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f995c00b970 tx=0x7f995c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f994bfff640 1 -- 172.21.15.73:0/3556840338 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c019070 con 0x7f9964161a60 2024-09-12T03:38:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f994bfff640 1 -- 172.21.15.73:0/3556840338 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c00cb40 con 0x7f9964161a60 2024-09-12T03:38:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f994bfff640 1 -- 172.21.15.73:0/3556840338 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c014440 con 0x7f9964161a60 2024-09-12T03:38:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99640b67c0 con 0x7f9964161a60 2024-09-12T03:38:37.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99640b7f30 con 0x7f9964161a60 2024-09-12T03:38:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.885+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99640cef10 con 0x7f9964161a60 2024-09-12T03:38:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.889+0000 7f994bfff640 1 -- 172.21.15.73:0/3556840338 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f995c01c070 con 0x7f9964161a60 2024-09-12T03:38:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.889+0000 7f994bfff640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99500678c0 0x7f9950069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.889+0000 7f994bfff640 1 -- 172.21.15.73:0/3556840338 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f995c085990 con 0x7f9964161a60 2024-09-12T03:38:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.889+0000 7f9962ffd640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99500678c0 0x7f9950069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:37.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.889+0000 7f9962ffd640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99500678c0 0x7f9950069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f995400a970 tx=0x7f9954008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:37.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:37.893+0000 7f994bfff640 1 -- 172.21.15.73:0/3556840338 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f995c0560d0 con 0x7f9964161a60 2024-09-12T03:38:37.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:38:37.947 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:38:38.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.049+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99640cb8c0 con 0x7f9964161a60 2024-09-12T03:38:38.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.049+0000 7f994bfff640 1 -- 172.21.15.73:0/3556840338 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+13319 (secure 0 0 0) 0x7f995c05a3d0 con 0x7f9964161a60 2024-09-12T03:38:38.051 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:38.051 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":103,"fsid":"7f20e802-78a7-4f58-bc5b-05a554b3f603","created":"2024-09-12T03:34:15.113312+0000","modified":"2024-09-12T03:38:34.966548+0000","last_up_change":"2024-09-12T03:34:26.916417+0000","last_in_change":"2024-09-12T03:34:17.464191+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T03:34:25.956292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e1c2cdf0-ccb0-4631-999b-d09d433decec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6809","nonce":1396670758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6811","nonce":1396670758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6815","nonce":1396670758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1396670758},{"type":"v1","addr":"172.21.15.73:6813","nonce":1396670758}]},"public_addr":"172.21.15.73:6809/1396670758","cluster_addr":"172.21.15.73:6811/1396670758","heartbeat_back_addr":"172.21.15.73:6815/1396670758","heartbeat_front_addr":"172.21.15.73:6813/1396670758","state":["exists","up"]},{"osd":1,"uuid":"0cc94582-3332-4869-b0d4-216908b0991e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6825","nonce":2248843894}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6827","nonce":2248843894}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6831","nonce":2248843894}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2248843894},{"type":"v1","addr":"172.21.15.73:6829","nonce":2248843894}]},"public_addr":"172.21.15.73:6825/2248843894","cluster_addr":"172.21.15.73:6827/2248843894","heartbeat_back_addr":"172.21.15.73:6831/2248843894","heartbeat_front_addr":"172.21.15.73:6829/2248843894","state":["exists","up"]},{"osd":2,"uuid":"6627cbc3-87f9-4320-84d2-4c6d4f2adf34","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6801","nonce":2107491151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6803","nonce":2107491151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6807","nonce":2107491151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2107491151},{"type":"v1","addr":"172.21.15.73:6805","nonce":2107491151}]},"public_addr":"172.21.15.73:6801/2107491151","cluster_addr":"172.21.15.73:6803/2107491151","heartbeat_back_addr":"172.21.15.73:6807/2107491151","heartbeat_front_addr":"172.21.15.73:6805/2107491151","state":["exists","up"]},{"osd":3,"uuid":"e679e61d-caf2-4250-b9bb-7df985b49c9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6817","nonce":3982759394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6819","nonce":3982759394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6823","nonce":3982759394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3982759394},{"type":"v1","addr":"172.21.15.73:6821","nonce":3982759394}]},"public_addr":"172.21.15.73:6817/3982759394","cluster_addr":"172.21.15.73:6819/3982759394","heartbeat_back_addr":"172.21.15.73:6823/3982759394","heartbeat_front_addr":"172.21.15.73:6821/3982759394","state":["exists","up"]},{"osd":4,"uuid":"8e02f987-c7f5-4f86-b278-4588336953aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6817","nonce":2236431337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6819","nonce":2236431337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6823","nonce":2236431337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":2236431337},{"type":"v1","addr":"172.21.15.150:6821","nonce":2236431337}]},"public_addr":"172.21.15.150:6817/2236431337","cluster_addr":"172.21.15.150:6819/2236431337","heartbeat_back_addr":"172.21.15.150:6823/2236431337","heartbeat_front_addr":"172.21.15.150:6821/2236431337","state":["exists","up"]},{"osd":5,"uuid":"0d11e705-899d-426f-91f2-b2a8d1900c20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6825","nonce":260644045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6827","nonce":260644045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6831","nonce":260644045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":260644045},{"type":"v1","addr":"172.21.15.150:6829","nonce":260644045}]},"public_addr":"172.21.15.150:6825/260644045","cluster_addr":"172.21.15.150:6827/260644045","heartbeat_back_addr":"172.21.15.150:6831/260644045","heartbeat_front_addr":"172.21.15.150:6829/260644045","state":["exists","up"]},{"osd":6,"uuid":"1e797bfd-8a8c-4732-ae90-a807e7da2bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6801","nonce":4177266046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6803","nonce":4177266046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6807","nonce":4177266046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":4177266046},{"type":"v1","addr":"172.21.15.150:6805","nonce":4177266046}]},"public_addr":"172.21.15.150:6801/4177266046","cluster_addr":"172.21.15.150:6803/4177266046","heartbeat_back_addr":"172.21.15.150:6807/4177266046","heartbeat_front_addr":"172.21.15.150:6805/4177266046","state":["exists","up"]},{"osd":7,"uuid":"28d562a5-358c-4df8-8a9a-af42ab17731a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6809","nonce":1242295682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6811","nonce":1242295682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6815","nonce":1242295682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":1242295682},{"type":"v1","addr":"172.21.15.150:6813","nonce":1242295682}]},"public_addr":"172.21.15.150:6809/1242295682","cluster_addr":"172.21.15.150:6811/1242295682","heartbeat_back_addr":"172.21.15.150:6815/1242295682","heartbeat_front_addr":"172.21.15.150:6813/1242295682","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.787041+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.281517+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.835669+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.807328+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:24.357854+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.872306+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.800514+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T03:34:23.961868+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/3586054053":"2024-09-13T03:38:31.831012+0000","172.21.15.73:6836/3586054053":"2024-09-13T03:38:31.831012+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T03:38:38.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99500678c0 msgr2=0x7f9950069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:38.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99500678c0 0x7f9950069d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f995400a970 tx=0x7f9954008040 comp rx=0 tx=0).stop 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9964161a60 msgr2=0x7f996415f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9964161a60 0x7f996415f360 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f995c00b970 tx=0x7f995c00be30 comp rx=0 tx=0).stop 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 shutdown_connections 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f99500678c0 0x7f9950069d80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9964161a60 0x7f996415f360 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f99640d2e90 0x7f99640b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 --2- 172.21.15.73:0/3556840338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99640cf450 0x7f9964150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 >> 172.21.15.73:0/3556840338 conn(0x7f996408bf90 msgr2=0x7f99640b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 shutdown_connections 2024-09-12T03:38:38.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:38.053+0000 7f99699a2640 1 -- 172.21.15.73:0/3556840338 wait complete. 2024-09-12T03:38:39.070 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T03:38:39.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:39.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb949fa8640 1 Processor -- start 2024-09-12T03:38:39.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb949fa8640 1 -- start start 2024-09-12T03:38:39.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb949fa8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb94415e5f0 0x7fb94406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb949fa8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9440cfaf0 0x7fb9440d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb949fa8640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb94406d9c0 con 0x7fb9440ce9d0 2024-09-12T03:38:39.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb949fa8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb94406dca0 con 0x7fb9440cfaf0 2024-09-12T03:38:39.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb949fa8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb94406df80 con 0x7fb94415e5f0 2024-09-12T03:38:39.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb943fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9440cfaf0 0x7fb9440d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb943fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9440cfaf0 0x7fb9440d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47406/0 (socket says 172.21.15.73:47406) 2024-09-12T03:38:39.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb943fff640 1 -- 172.21.15.73:0/909164284 learned_addr learned my addr 172.21.15.73:0/909164284 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:39.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb9437fe640 1 --2- 172.21.15.73:0/909164284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb94415e5f0 0x7fb94406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb943fff640 1 -- 172.21.15.73:0/909164284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb94415e5f0 msgr2=0x7fb94406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:39.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb943fff640 1 --2- 172.21.15.73:0/909164284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb94415e5f0 0x7fb94406d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb943fff640 1 -- 172.21.15.73:0/909164284 >> v1:172.21.15.150:6789/0 conn(0x7fb9440ce9d0 legacy=0x7fb9440cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.213+0000 7fb943fff640 1 -- 172.21.15.73:0/909164284 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94406e260 con 0x7fb9440cfaf0 2024-09-12T03:38:39.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb943fff640 1 --2- 172.21.15.73:0/909164284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440d2b60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009e50 tx=0x7fb93c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99a29a029e04788 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9427fc640 1 -- 172.21.15.73:0/909164284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0a5810 con 0x7fb9440cfaf0 2024-09-12T03:38:39.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9427fc640 1 -- 172.21.15.73:0/909164284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93c0a59b0 con 0x7fb9440cfaf0 2024-09-12T03:38:39.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9427fc640 1 -- 172.21.15.73:0/909164284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0a5d80 con 0x7fb9440cfaf0 2024-09-12T03:38:39.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- 172.21.15.73:0/909164284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 msgr2=0x7fb9440d2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 --2- 172.21.15.73:0/909164284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440d2b60 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009e50 tx=0x7fb93c01ca30 comp rx=0 tx=0).stop 2024-09-12T03:38:39.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- 172.21.15.73:0/909164284 shutdown_connections 2024-09-12T03:38:39.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 --2- 172.21.15.73:0/909164284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440d2b60 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 --2- 172.21.15.73:0/909164284 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb94415e5f0 0x7fb94406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- 172.21.15.73:0/909164284 >> 172.21.15.73:0/909164284 conn(0x7fb944074030 msgr2=0x7fb94409d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:39.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- 172.21.15.73:0/909164284 shutdown_connections 2024-09-12T03:38:39.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- 172.21.15.73:0/909164284 wait complete. 2024-09-12T03:38:39.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 Processor -- start 2024-09-12T03:38:39.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- start start 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9440b9460 0x7fb94414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9441562c0 0x7fb944156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440d3c40 con 0x7fb9440cfaf0 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440d3ac0 con 0x7fb9441562c0 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb949fa8640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fb94416afa0 con 0x7fb9440b9460 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440b8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47414/0 (socket says 172.21.15.73:47414) 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 -- 172.21.15.73:0/4117085874 learned_addr learned my addr 172.21.15.73:0/4117085874 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb943fff640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9441562c0 0x7fb944156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb942ffd640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9440b9460 0x7fb94414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 -- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9440b9460 msgr2=0x7fb94414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9440b9460 0x7fb94414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 -- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9441562c0 msgr2=0x7fb944156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9441562c0 0x7fb944156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb9437fe640 1 -- 172.21.15.73:0/4117085874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9440b9200 con 0x7fb9440cfaf0 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb942ffd640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fb9440b9460 0x7fb94414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.217+0000 7fb943fff640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb9441562c0 0x7fb944156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb9437fe640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440b8cc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb93400d620 tx=0x7fb93400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93400b620 con 0x7fb9440cfaf0 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb934019070 con 0x7fb9440cfaf0 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9440b9a00 con 0x7fb9440cfaf0 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93400ba20 con 0x7fb9440cfaf0 2024-09-12T03:38:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9440b9fc0 con 0x7fb9440cfaf0 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb9440d2b60 con 0x7fb9440cfaf0 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb93400bbc0 con 0x7fb9440cfaf0 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9240678c0 0x7fb924069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7fb934086980 con 0x7fb9440cfaf0 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb942ffd640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9240678c0 0x7fb924069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7fb92406dd60 0x7fb9240701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 --> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb924070870 con 0x7fb92406dd60 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fb934086e10 con 0x7fb9440cfaf0 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb943fff640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7fb92406dd60 0x7fb9240701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb942ffd640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9240678c0 0x7fb924069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb94414e720 tx=0x7fb92c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.221+0000 7fb943fff640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7fb92406dd60 0x7fb9240701a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.225+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== osd.0 v2:172.21.15.73:6808/1396670758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb924070870 con 0x7fb92406dd60 2024-09-12T03:38:39.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 --> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb9440cb450 con 0x7fb92406dd60 2024-09-12T03:38:39.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb93bfff640 1 -- 172.21.15.73:0/4117085874 <== osd.0 v2:172.21.15.73:6808/1396670758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb9440cb450 con 0x7fb92406dd60 2024-09-12T03:38:39.238 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:39.238 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:39.238 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7fb92406dd60 msgr2=0x7fb9240701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6808/1396670758,v1:172.21.15.73:6809/1396670758] conn(0x7fb92406dd60 0x7fb9240701a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9240678c0 msgr2=0x7fb924069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fb9240678c0 0x7fb924069d80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb94414e720 tx=0x7fb92c009040 comp rx=0 tx=0).stop 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 msgr2=0x7fb9440b8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 --2- 172.21.15.73:0/4117085874 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9440cfaf0 0x7fb9440b8cc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb93400d620 tx=0x7fb93400dae0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb943fff640 1 -- 172.21.15.73:0/4117085874 reap_dead start 2024-09-12T03:38:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 shutdown_connections 2024-09-12T03:38:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 >> 172.21.15.73:0/4117085874 conn(0x7fb9440ce9d0 msgr2=0x7fb9440d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 shutdown_connections 2024-09-12T03:38:39.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.237+0000 7fb949fa8640 1 -- 172.21.15.73:0/4117085874 wait complete. 2024-09-12T03:38:39.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T03:38:39.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e4a9f7640 1 Processor -- start 2024-09-12T03:38:39.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e4a9f7640 1 -- start start 2024-09-12T03:38:39.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e4a9f7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e4415bec0 0x7f0e440ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e4a9f7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e440af470 0x7f0e4406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e4a9f7640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e440b3290 con 0x7f0e4415c2a0 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e4a9f7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0e440b3570 con 0x7f0e4415bec0 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e4a9f7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0e440b3850 con 0x7f0e440af470 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e43fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e4415bec0 0x7f0e440ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e43fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e4415bec0 0x7f0e440ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47426/0 (socket says 172.21.15.73:47426) 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e43fff640 1 -- 172.21.15.73:0/1294753263 learned_addr learned my addr 172.21.15.73:0/1294753263 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e48f94640 1 --2- 172.21.15.73:0/1294753263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e440af470 0x7f0e4406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e43fff640 1 -- 172.21.15.73:0/1294753263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e440af470 msgr2=0x7f0e4406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e43fff640 1 --2- 172.21.15.73:0/1294753263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e440af470 0x7f0e4406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e43fff640 1 -- 172.21.15.73:0/1294753263 >> v1:172.21.15.150:6789/0 conn(0x7f0e4415c2a0 legacy=0x7f0e440aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.365+0000 7f0e43fff640 1 -- 172.21.15.73:0/1294753263 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e440b3b30 con 0x7f0e4415bec0 2024-09-12T03:38:39.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e43fff640 1 --2- 172.21.15.73:0/1294753263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e440ad200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009870 tx=0x7f0e3401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95d02be0d4cbfd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1294753263 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e340ab620 con 0x7f0e4415bec0 2024-09-12T03:38:39.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1294753263 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e340b0070 con 0x7f0e4415bec0 2024-09-12T03:38:39.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1294753263 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e340ab9e0 con 0x7f0e4415bec0 2024-09-12T03:38:39.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/1294753263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 msgr2=0x7f0e440ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/1294753263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e440ad200 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009870 tx=0x7f0e3401c460 comp rx=0 tx=0).stop 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/1294753263 shutdown_connections 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/1294753263 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e440af470 0x7f0e4406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/1294753263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e440ad200 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/1294753263 >> 172.21.15.73:0/1294753263 conn(0x7f0e440b1f90 msgr2=0x7f0e440b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/1294753263 shutdown_connections 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/1294753263 wait complete. 2024-09-12T03:38:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 Processor -- start 2024-09-12T03:38:39.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.369+0000 7f0e4a9f7640 1 -- start start 2024-09-12T03:38:39.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e440af470 0x7f0e4414b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e44150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e4415c2a0 0x7f0e44150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e4406ed50 con 0x7f0e4415bec0 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0e440ad740 con 0x7f0e440af470 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0e4406eed0 con 0x7f0e4415c2a0 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e44150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e44150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47440/0 (socket says 172.21.15.73:47440) 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 -- 172.21.15.73:0/4071913271 learned_addr learned my addr 172.21.15.73:0/4071913271 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e43fff640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e440af470 0x7f0e4414b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e48f94640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e4415c2a0 0x7f0e44150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 -- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e4415c2a0 msgr2=0x7f0e44150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e4415c2a0 0x7f0e44150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 -- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e440af470 msgr2=0x7f0e4414b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e440af470 0x7f0e4414b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 -- 172.21.15.73:0/4071913271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e4415ea80 con 0x7f0e4415bec0 2024-09-12T03:38:39.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e437fe640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e44150620 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b410 tx=0x7f0e3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e40ff9640 1 -- 172.21.15.73:0/4071913271 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38015030 con 0x7f0e4415bec0 2024-09-12T03:38:39.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e40ff9640 1 -- 172.21.15.73:0/4071913271 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e38004020 con 0x7f0e4415bec0 2024-09-12T03:38:39.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e40ff9640 1 -- 172.21.15.73:0/4071913271 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38004410 con 0x7f0e4415bec0 2024-09-12T03:38:39.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e4415ed60 con 0x7f0e4415bec0 2024-09-12T03:38:39.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e441647d0 con 0x7f0e4415bec0 2024-09-12T03:38:39.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e4406f280 con 0x7f0e4415bec0 2024-09-12T03:38:39.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e40ff9640 1 -- 172.21.15.73:0/4071913271 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0e38018070 con 0x7f0e4415bec0 2024-09-12T03:38:39.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e40ff9640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0e300678c0 0x7f0e30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e40ff9640 1 -- 172.21.15.73:0/4071913271 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f0e38085710 con 0x7f0e4415bec0 2024-09-12T03:38:39.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e43fff640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0e300678c0 0x7f0e30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.373+0000 7f0e43fff640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0e300678c0 0x7f0e30069d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e340af000 tx=0x7f0e34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.377+0000 7f0e40ff9640 1 -- 172.21.15.73:0/4071913271 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0e380563c0 con 0x7f0e4415bec0 2024-09-12T03:38:39.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.529+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0e4406fcd0 con 0x7f0e300678c0 2024-09-12T03:38:39.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.529+0000 7f0e40ff9640 1 -- 172.21.15.73:0/4071913271 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0e4406fcd0 con 0x7f0e300678c0 2024-09-12T03:38:39.531 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0e300678c0 msgr2=0x7f0e30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0e300678c0 0x7f0e30069d80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0e340af000 tx=0x7f0e34008040 comp rx=0 tx=0).stop 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 msgr2=0x7f0e44150620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e44150620 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b410 tx=0x7f0e3800b8d0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 shutdown_connections 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0e300678c0 0x7f0e30069d80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e4415bec0 0x7f0e44150620 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0e4415c2a0 0x7f0e44150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 --2- 172.21.15.73:0/4071913271 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0e440af470 0x7f0e4414b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 >> 172.21.15.73:0/4071913271 conn(0x7f0e440b1f90 msgr2=0x7f0e441597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:39.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 shutdown_connections 2024-09-12T03:38:39.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.533+0000 7f0e4a9f7640 1 -- 172.21.15.73:0/4071913271 wait complete. 2024-09-12T03:38:39.548 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T03:38:39.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:39.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d7dac640 1 Processor -- start 2024-09-12T03:38:39.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d7dac640 1 -- start start 2024-09-12T03:38:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d7dac640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd7d015bec0 0x7fd7d00ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d7dac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d015c2a0 0x7fd7d00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d7dac640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d00b3290 con 0x7fd7d00af2a0 2024-09-12T03:38:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d7dac640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd7d00b3570 con 0x7fd7d015bec0 2024-09-12T03:38:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d7dac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d00b3850 con 0x7fd7d015c2a0 2024-09-12T03:38:39.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d5b48640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd7d015bec0 0x7fd7d00ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d5347640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d015c2a0 0x7fd7d00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d6349640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fd7d00af2a0 0x7fd7d015fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44794/0 (socket says 172.21.15.73:44794) 2024-09-12T03:38:39.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d6349640 1 -- 172.21.15.73:0/3821628297 learned_addr learned my addr 172.21.15.73:0/3821628297 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:39.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d5b48640 1 -- 172.21.15.73:0/3821628297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d015c2a0 msgr2=0x7fd7d00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d5b48640 1 --2- 172.21.15.73:0/3821628297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d015c2a0 0x7fd7d00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d5b48640 1 -- 172.21.15.73:0/3821628297 >> v1:172.21.15.150:6789/0 conn(0x7fd7d00af2a0 legacy=0x7fd7d015fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.673+0000 7fd7d5b48640 1 -- 172.21.15.73:0/3821628297 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d00b3b30 con 0x7fd7d015bec0 2024-09-12T03:38:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d5b48640 1 --2- 172.21.15.73:0/3821628297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 0x7fd7d00ad200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097c0 tx=0x7fd7c001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1b84a87ad6cabbf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d4b46640 1 -- 172.21.15.73:0/3821628297 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00a7070 con 0x7fd7d015bec0 2024-09-12T03:38:39.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d4b46640 1 -- 172.21.15.73:0/3821628297 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c00b0070 con 0x7fd7d015bec0 2024-09-12T03:38:39.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d4b46640 1 -- 172.21.15.73:0/3821628297 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00ab890 con 0x7fd7d015bec0 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 -- 172.21.15.73:0/3821628297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 msgr2=0x7fd7d00ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 --2- 172.21.15.73:0/3821628297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 0x7fd7d00ad200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00097c0 tx=0x7fd7c001c470 comp rx=0 tx=0).stop 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 -- 172.21.15.73:0/3821628297 shutdown_connections 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 --2- 172.21.15.73:0/3821628297 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d015c2a0 0x7fd7d00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 --2- 172.21.15.73:0/3821628297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 0x7fd7d00ad200 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 -- 172.21.15.73:0/3821628297 >> 172.21.15.73:0/3821628297 conn(0x7fd7d00b1f90 msgr2=0x7fd7d00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 -- 172.21.15.73:0/3821628297 shutdown_connections 2024-09-12T03:38:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 -- 172.21.15.73:0/3821628297 wait complete. 2024-09-12T03:38:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 Processor -- start 2024-09-12T03:38:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.677+0000 7fd7d7dac640 1 -- start start 2024-09-12T03:38:39.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d00af2a0 0x7fd7d01554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 0x7fd7d0155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d015c2a0 0x7fd7d015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d00af6b0 con 0x7fd7d015c2a0 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d00ad740 con 0x7fd7d015bec0 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d0169000 con 0x7fd7d00af2a0 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d015c2a0 0x7fd7d015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d015c2a0 0x7fd7d015cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47444/0 (socket says 172.21.15.73:47444) 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 -- 172.21.15.73:0/1751608143 learned_addr learned my addr 172.21.15.73:0/1751608143 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d5347640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 0x7fd7d0155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d5b48640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d00af2a0 0x7fd7d01554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 -- 172.21.15.73:0/1751608143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d00af2a0 msgr2=0x7fd7d01554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd7d00af2a0 0x7fd7d01554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 -- 172.21.15.73:0/1751608143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 msgr2=0x7fd7d0155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd7d015bec0 0x7fd7d0155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 -- 172.21.15.73:0/1751608143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d00b4a60 con 0x7fd7d015c2a0 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d6349640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d015c2a0 0x7fd7d015cdd0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800cbc0 tx=0x7fd7c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8017070 con 0x7fd7d015c2a0 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c800ad40 con 0x7fd7d015c2a0 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d01f5680 con 0x7fd7d015c2a0 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8012600 con 0x7fd7d015c2a0 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d01f9600 con 0x7fd7d015c2a0 2024-09-12T03:38:39.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7d00ad200 con 0x7fd7d015c2a0 2024-09-12T03:38:39.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd7c801a070 con 0x7fd7d015c2a0 2024-09-12T03:38:39.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd7b40678c0 0x7fd7b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7fd7c8085f80 con 0x7fd7d015c2a0 2024-09-12T03:38:39.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d5b48640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd7b40678c0 0x7fd7b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fd7b406dd60 0x7fd7b40701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 --> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7b4070870 con 0x7fd7b406dd60 2024-09-12T03:38:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fd7c8086410 con 0x7fd7d015c2a0 2024-09-12T03:38:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.681+0000 7fd7d5347640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fd7b406dd60 0x7fd7b40701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.685+0000 7fd7d5b48640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd7b40678c0 0x7fd7b4069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00af000 tx=0x7fd7c00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.685+0000 7fd7d5347640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fd7b406dd60 0x7fd7b40701a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.685+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== osd.1 v2:172.21.15.73:6824/2248843894 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7b4070870 con 0x7fd7b406dd60 2024-09-12T03:38:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 --> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd7d006fcd0 con 0x7fd7b406dd60 2024-09-12T03:38:39.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7c67fc640 1 -- 172.21.15.73:0/1751608143 <== osd.1 v2:172.21.15.73:6824/2248843894 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd7d006fcd0 con 0x7fd7b406dd60 2024-09-12T03:38:39.699 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:39.699 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:39.699 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:39.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fd7b406dd60 msgr2=0x7fd7b40701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6824/2248843894,v1:172.21.15.73:6825/2248843894] conn(0x7fd7b406dd60 0x7fd7b40701a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd7b40678c0 msgr2=0x7fd7b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd7b40678c0 0x7fd7b4069d80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00af000 tx=0x7fd7c00a7000 comp rx=0 tx=0).stop 2024-09-12T03:38:39.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d015c2a0 msgr2=0x7fd7d015cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 --2- 172.21.15.73:0/1751608143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d015c2a0 0x7fd7d015cdd0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800cbc0 tx=0x7fd7c800a430 comp rx=0 tx=0).stop 2024-09-12T03:38:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d6349640 1 -- 172.21.15.73:0/1751608143 reap_dead start 2024-09-12T03:38:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 shutdown_connections 2024-09-12T03:38:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 >> 172.21.15.73:0/1751608143 conn(0x7fd7d00b1f90 msgr2=0x7fd7d00cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 shutdown_connections 2024-09-12T03:38:39.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.697+0000 7fd7d7dac640 1 -- 172.21.15.73:0/1751608143 wait complete. 2024-09-12T03:38:39.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T03:38:39.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 Processor -- start 2024-09-12T03:38:39.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 -- start start 2024-09-12T03:38:39.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15bec0 0x7f311c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f311c15c2a0 0x7f311c0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f311c0af2a0 0x7f311c15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f311c0b3290 con 0x7f311c0af2a0 2024-09-12T03:38:39.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f311c0b3570 con 0x7f311c15c2a0 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f3121a1f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f311c0b3850 con 0x7f311c15bec0 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f311c0af2a0 0x7f311c15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f311c0af2a0 0x7f311c15fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47448/0 (socket says 172.21.15.73:47448) 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 -- 172.21.15.73:0/780003103 learned_addr learned my addr 172.21.15.73:0/780003103 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311a7fc640 1 --2- 172.21.15.73:0/780003103 >> v2:172.21.15.150:3300/0 conn(0x7f311c15c2a0 0x7f311c0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311affd640 1 --2- 172.21.15.73:0/780003103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15bec0 0x7f311c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 -- 172.21.15.73:0/780003103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15bec0 msgr2=0x7f311c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 --2- 172.21.15.73:0/780003103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15bec0 0x7f311c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 -- 172.21.15.73:0/780003103 >> v2:172.21.15.150:3300/0 conn(0x7f311c15c2a0 msgr2=0x7f311c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 --2- 172.21.15.73:0/780003103 >> v2:172.21.15.150:3300/0 conn(0x7f311c15c2a0 0x7f311c0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311b7fe640 1 -- 172.21.15.73:0/780003103 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c0b3b30 con 0x7f311c0af2a0 2024-09-12T03:38:39.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311affd640 1 --2- 172.21.15.73:0/780003103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15bec0 0x7f311c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:39.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.829+0000 7f311a7fc640 1 --2- 172.21.15.73:0/780003103 >> v2:172.21.15.150:3300/0 conn(0x7f311c15c2a0 0x7f311c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:39.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f311b7fe640 1 --2- 172.21.15.73:0/780003103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c15fc60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f311c06de20 tx=0x7f311401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f228c6f1dd9b227c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3119ffb640 1 -- 172.21.15.73:0/780003103 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31140a5580 con 0x7f311c0af2a0 2024-09-12T03:38:39.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3119ffb640 1 -- 172.21.15.73:0/780003103 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31140a5720 con 0x7f311c0af2a0 2024-09-12T03:38:39.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3119ffb640 1 -- 172.21.15.73:0/780003103 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31140a5af0 con 0x7f311c0af2a0 2024-09-12T03:38:39.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 -- 172.21.15.73:0/780003103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 msgr2=0x7f311c15fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 --2- 172.21.15.73:0/780003103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c15fc60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f311c06de20 tx=0x7f311401c700 comp rx=0 tx=0).stop 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 -- 172.21.15.73:0/780003103 shutdown_connections 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 --2- 172.21.15.73:0/780003103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c15fc60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 --2- 172.21.15.73:0/780003103 >> v2:172.21.15.150:3300/0 conn(0x7f311c15c2a0 0x7f311c0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 --2- 172.21.15.73:0/780003103 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15bec0 0x7f311c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 -- 172.21.15.73:0/780003103 >> 172.21.15.73:0/780003103 conn(0x7f311c0b1f90 msgr2=0x7f311c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 -- 172.21.15.73:0/780003103 shutdown_connections 2024-09-12T03:38:39.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 -- 172.21.15.73:0/780003103 wait complete. 2024-09-12T03:38:39.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 Processor -- start 2024-09-12T03:38:39.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.833+0000 7f3121a1f640 1 -- start start 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15bec0 0x7f311c06eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15c2a0 0x7f311c06f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f311c0ad740 con 0x7f311c0af2a0 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f311c0afc90 con 0x7f311c15bec0 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f311c06e000 con 0x7f311c15c2a0 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47456/0 (socket says 172.21.15.73:47456) 2024-09-12T03:38:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 -- 172.21.15.73:0/2887239369 learned_addr learned my addr 172.21.15.73:0/2887239369 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311b7fe640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15c2a0 0x7f311c06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311a7fc640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15bec0 0x7f311c06eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 -- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15c2a0 msgr2=0x7f311c06f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15c2a0 0x7f311c06f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 -- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15bec0 msgr2=0x7f311c06eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15bec0 0x7f311c06eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 -- 172.21.15.73:0/2887239369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c165e30 con 0x7f311c0af2a0 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311a7fc640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15bec0 0x7f311c06eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311affd640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c073a70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c7c0 tx=0x7f310c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3103fff640 1 -- 172.21.15.73:0/2887239369 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c007a30 con 0x7f311c0af2a0 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3103fff640 1 -- 172.21.15.73:0/2887239369 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c007bd0 con 0x7f311c0af2a0 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c166110 con 0x7f311c0af2a0 2024-09-12T03:38:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3103fff640 1 -- 172.21.15.73:0/2887239369 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0113f0 con 0x7f311c0af2a0 2024-09-12T03:38:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1666d0 con 0x7f311c0af2a0 2024-09-12T03:38:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311c0ad200 con 0x7f311c0af2a0 2024-09-12T03:38:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3103fff640 1 -- 172.21.15.73:0/2887239369 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f310c011590 con 0x7f311c0af2a0 2024-09-12T03:38:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3103fff640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f3103fff640 1 -- 172.21.15.73:0/2887239369 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f310c085ca0 con 0x7f311c0af2a0 2024-09-12T03:38:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311a7fc640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.837+0000 7f311a7fc640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f311c15a6c0 tx=0x7f3110008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:39.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:39.841+0000 7f3103fff640 1 -- 172.21.15.73:0/2887239369 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f310c015020 con 0x7f311c0af2a0 2024-09-12T03:38:40.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.009+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f311c159fe0 con 0x7f31080678c0 2024-09-12T03:38:40.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.009+0000 7f3103fff640 1 -- 172.21.15.73:0/2887239369 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f311c159fe0 con 0x7f31080678c0 2024-09-12T03:38:40.011 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 msgr2=0x7f3108069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f311c15a6c0 tx=0x7f3110008040 comp rx=0 tx=0).stop 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 msgr2=0x7f311c073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c073a70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c7c0 tx=0x7f310c00cc80 comp rx=0 tx=0).stop 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 shutdown_connections 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f31080678c0 0x7f3108069d80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f311c15c2a0 0x7f311c06f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f311c15bec0 0x7f311c06eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 --2- 172.21.15.73:0/2887239369 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f311c0af2a0 0x7f311c073a70 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 >> 172.21.15.73:0/2887239369 conn(0x7f311c0b1f90 msgr2=0x7f311c15a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 shutdown_connections 2024-09-12T03:38:40.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.013+0000 7f3121a1f640 1 -- 172.21.15.73:0/2887239369 wait complete. 2024-09-12T03:38:40.031 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T03:38:40.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:40.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc478b640 1 Processor -- start 2024-09-12T03:38:40.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc478b640 1 -- start start 2024-09-12T03:38:40.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc478b640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0cbc0d0590 0x7f0cbc0cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc478b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cbc0cf4f0 con 0x7f0cbc0704c0 2024-09-12T03:38:40.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc478b640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cbc0cf7d0 con 0x7f0cbc154cd0 2024-09-12T03:38:40.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc478b640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0cbc0cfab0 con 0x7f0cbc0d0590 2024-09-12T03:38:40.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0cbc0704c0 0x7f0cbc0b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42578/0 (socket says 172.21.15.73:42578) 2024-09-12T03:38:40.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 -- 172.21.15.73:0/1216776972 learned_addr learned my addr 172.21.15.73:0/1216776972 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:40.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1d26640 1 --2- 172.21.15.73:0/1216776972 >> v2:172.21.15.150:3300/0 conn(0x7f0cbc0d0590 0x7f0cbc0cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273155263 0 0) 0x7f0cbc0cf4f0 con 0x7f0cbc0704c0 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca8003530 con 0x7f0cbc0704c0 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2577925830 0 0) 0x7f0ca8003530 con 0x7f0cbc0704c0 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 >> v2:172.21.15.150:3300/0 conn(0x7f0cbc0d0590 msgr2=0x7f0cbc0cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 --2- 172.21.15.73:0/1216776972 >> v2:172.21.15.150:3300/0 conn(0x7f0cbc0d0590 0x7f0cbc0cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 >> v1:172.21.15.150:6789/0 conn(0x7f0cbc154cd0 legacy=0x7f0cbc15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc0cfd90 con 0x7f0cbc0704c0 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f0cb8001680 con 0x7f0cbc0704c0 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 >> v1:172.21.15.73:6789/0 conn(0x7f0cbc0704c0 legacy=0x7f0cbc0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca80039f0 0x7f0ca8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca8004810 0x7f0ca8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ca8005220 0x7f0ca800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc0cfab0 con 0x7f0ca8005220 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca800c150 con 0x7f0ca8004810 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca800c350 con 0x7f0ca80039f0 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ca8005220 0x7f0ca800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2527640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca80039f0 0x7f0ca8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 -- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca80039f0 msgr2=0x7f0ca8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca80039f0 0x7f0ca8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 -- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca8004810 msgr2=0x7f0ca8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca8004810 0x7f0ca8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2d28640 1 -- 172.21.15.73:0/1216776972 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca8003530 con 0x7f0ca8005220 2024-09-12T03:38:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.153+0000 7f0cc2527640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca80039f0 0x7f0ca8003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc2d28640 1 -- 172.21.15.73:0/1216776972 reap_dead start 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ca8005220 0x7f0ca800b9d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c240 tx=0x7f0cb801dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998a39101d2a594f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8007d40 con 0x7f0ca8005220 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb80aa070 con 0x7f0ca8005220 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc1525640 1 -- 172.21.15.73:0/1216776972 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80058e0 con 0x7f0ca8005220 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 -- 172.21.15.73:0/1216776972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ca8005220 msgr2=0x7f0ca800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ca8005220 0x7f0ca800b9d0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c240 tx=0x7f0cb801dd90 comp rx=0 tx=0).stop 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 -- 172.21.15.73:0/1216776972 shutdown_connections 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 --2- 172.21.15.73:0/1216776972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ca8005220 0x7f0ca800b9d0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 -- 172.21.15.73:0/1216776972 >> 172.21.15.73:0/1216776972 conn(0x7f0cbc073580 msgr2=0x7f0cbc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 -- 172.21.15.73:0/1216776972 shutdown_connections 2024-09-12T03:38:40.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 -- 172.21.15.73:0/1216776972 wait complete. 2024-09-12T03:38:40.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 Processor -- start 2024-09-12T03:38:40.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.157+0000 7f0cc478b640 1 -- start start 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca8005220 0x7f0cbc152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cbc150e90 0x7f0cbc14c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cbc1597c0 0x7f0cbc159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc155230 con 0x7f0cbc150e90 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc1550b0 con 0x7f0cbc1597c0 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc0cee50 con 0x7f0ca8005220 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cbc150e90 0x7f0cbc14c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cbc150e90 0x7f0cbc14c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47470/0 (socket says 172.21.15.73:47470) 2024-09-12T03:38:40.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 -- 172.21.15.73:0/3079330472 learned_addr learned my addr 172.21.15.73:0/3079330472 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2527640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca8005220 0x7f0cbc152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cbc1597c0 0x7f0cbc159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 -- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca8005220 msgr2=0x7f0cbc152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca8005220 0x7f0cbc152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 -- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cbc1597c0 msgr2=0x7f0cbc159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cbc1597c0 0x7f0cbc159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 -- 172.21.15.73:0/3079330472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc151310 con 0x7f0cbc150e90 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2527640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0ca8005220 0x7f0cbc152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0cbc1597c0 0x7f0cbc159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc1d26640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cbc150e90 0x7f0cbc14c490 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000d800 tx=0x7f0cb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0009640 con 0x7f0cbc150e90 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb0019070 con 0x7f0cbc150e90 2024-09-12T03:38:40.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cbc1515e0 con 0x7f0cbc150e90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0009a20 con 0x7f0cbc150e90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cbc151ba0 con 0x7f0cbc150e90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cbc14c9d0 con 0x7f0cbc150e90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0cb0009bc0 con 0x7f0cbc150e90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0ca00678f0 0x7f0ca0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f0cb0086810 con 0x7f0cbc150e90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2527640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0ca00678f0 0x7f0ca0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f0ca006dd90 0x7f0ca00701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 --> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ca00708a0 con 0x7f0ca006dd90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f0cb0086ca0 con 0x7f0cbc150e90 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f0ca006dd90 0x7f0ca00701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2527640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0ca00678f0 0x7f0ca0069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40044d0 tx=0x7f0cb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.161+0000 7f0cc2d28640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f0ca006dd90 0x7f0ca00701d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.165+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== osd.2 v2:172.21.15.73:6800/2107491151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ca00708a0 con 0x7f0ca006dd90 2024-09-12T03:38:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 --> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0cbc0cf1e0 con 0x7f0ca006dd90 2024-09-12T03:38:40.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0caeffd640 1 -- 172.21.15.73:0/3079330472 <== osd.2 v2:172.21.15.73:6800/2107491151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0cbc0cf1e0 con 0x7f0ca006dd90 2024-09-12T03:38:40.178 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:40.179 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:40.179 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f0ca006dd90 msgr2=0x7f0ca00701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6800/2107491151,v1:172.21.15.73:6801/2107491151] conn(0x7f0ca006dd90 0x7f0ca00701d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0ca00678f0 msgr2=0x7f0ca0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0ca00678f0 0x7f0ca0069db0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40044d0 tx=0x7f0cb4009040 comp rx=0 tx=0).stop 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cbc150e90 msgr2=0x7f0cbc14c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 --2- 172.21.15.73:0/3079330472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cbc150e90 0x7f0cbc14c490 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000d800 tx=0x7f0cb000dcc0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc2d28640 1 -- 172.21.15.73:0/3079330472 reap_dead start 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 shutdown_connections 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 >> 172.21.15.73:0/3079330472 conn(0x7f0cbc073580 msgr2=0x7f0cbc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 shutdown_connections 2024-09-12T03:38:40.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.177+0000 7f0cc478b640 1 -- 172.21.15.73:0/3079330472 wait complete. 2024-09-12T03:38:40.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T03:38:40.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.305+0000 7f8336541640 1 Processor -- start 2024-09-12T03:38:40.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.305+0000 7f8336541640 1 -- start start 2024-09-12T03:38:40.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8336541640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f833015f830 0x7f833006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8336541640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015eee0 0x7f833006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8336541640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833015fc10 con 0x7f833015d290 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8336541640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f833015da40 con 0x7f833015f830 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8336541640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f833015d800 con 0x7f833015eee0 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f83277fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f833015d290 0x7f833015fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42580/0 (socket says 172.21.15.73:42580) 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f83277fe640 1 -- 172.21.15.73:0/2964060256 learned_addr learned my addr 172.21.15.73:0/2964060256 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832ffff640 1 --2- 172.21.15.73:0/2964060256 >> v2:172.21.15.73:3300/0 conn(0x7f833015f830 0x7f833006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8334ade640 1 --2- 172.21.15.73:0/2964060256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015eee0 0x7f833006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832f7fe640 1 -- 172.21.15.73:0/2964060256 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415144433 0 0) 0x7f833015fc10 con 0x7f833015d290 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832f7fe640 1 -- 172.21.15.73:0/2964060256 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f831c003530 con 0x7f833015d290 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832ffff640 1 -- 172.21.15.73:0/2964060256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015eee0 msgr2=0x7f833006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832ffff640 1 --2- 172.21.15.73:0/2964060256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015eee0 0x7f833006c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832ffff640 1 -- 172.21.15.73:0/2964060256 >> v1:172.21.15.73:6789/0 conn(0x7f833015d290 legacy=0x7f833015fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832ffff640 1 -- 172.21.15.73:0/2964060256 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83300b3570 con 0x7f833015f830 2024-09-12T03:38:40.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832ffff640 1 --2- 172.21.15.73:0/2964060256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015f830 0x7f833006bcc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f83200097c0 tx=0x7f832001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f97f839261dbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832f7fe640 1 -- 172.21.15.73:0/2964060256 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200a7070 con 0x7f833015f830 2024-09-12T03:38:40.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832f7fe640 1 -- 172.21.15.73:0/2964060256 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83200b0070 con 0x7f833015f830 2024-09-12T03:38:40.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f832f7fe640 1 -- 172.21.15.73:0/2964060256 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200ab890 con 0x7f833015f830 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8336541640 1 -- 172.21.15.73:0/2964060256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015f830 msgr2=0x7f833006bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.309+0000 7f8336541640 1 --2- 172.21.15.73:0/2964060256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015f830 0x7f833006bcc0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f83200097c0 tx=0x7f832001c470 comp rx=0 tx=0).stop 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- 172.21.15.73:0/2964060256 shutdown_connections 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 --2- 172.21.15.73:0/2964060256 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015eee0 0x7f833006c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 --2- 172.21.15.73:0/2964060256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015f830 0x7f833006bcc0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- 172.21.15.73:0/2964060256 >> 172.21.15.73:0/2964060256 conn(0x7f83300b6800 msgr2=0x7f83300b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- 172.21.15.73:0/2964060256 shutdown_connections 2024-09-12T03:38:40.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- 172.21.15.73:0/2964060256 wait complete. 2024-09-12T03:38:40.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 Processor -- start 2024-09-12T03:38:40.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- start start 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015d290 0x7f83301496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f833015eee0 0x7f8330137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015f830 0x7f8330152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8330169390 con 0x7f833015d290 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8330169210 con 0x7f833015eee0 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8330169510 con 0x7f833015f830 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015d290 0x7f83301496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015d290 0x7f83301496c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47490/0 (socket says 172.21.15.73:47490) 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 -- 172.21.15.73:0/3267411130 learned_addr learned my addr 172.21.15.73:0/3267411130 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f83277fe640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f833015eee0 0x7f8330137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 -- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015f830 msgr2=0x7f8330152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8334ade640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015f830 0x7f8330152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015f830 0x7f8330152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 -- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f833015eee0 msgr2=0x7f8330137950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f833015eee0 0x7f8330137950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 -- 172.21.15.73:0/3267411130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8330146450 con 0x7f833015d290 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832ffff640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015d290 0x7f83301496c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8320009710 tx=0x7f832001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832d7fa640 1 -- 172.21.15.73:0/3267411130 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200bf610 con 0x7f833015d290 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832d7fa640 1 -- 172.21.15.73:0/3267411130 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83200bf7b0 con 0x7f833015d290 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8330146730 con 0x7f833015d290 2024-09-12T03:38:40.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f832d7fa640 1 -- 172.21.15.73:0/3267411130 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83200bfba0 con 0x7f833015d290 2024-09-12T03:38:40.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8330149c00 con 0x7f833015d290 2024-09-12T03:38:40.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.313+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833015fe70 con 0x7f833015d290 2024-09-12T03:38:40.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.317+0000 7f832d7fa640 1 -- 172.21.15.73:0/3267411130 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f83200bd020 con 0x7f833015d290 2024-09-12T03:38:40.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.317+0000 7f832d7fa640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83100678c0 0x7f8310069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.317+0000 7f83277fe640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83100678c0 0x7f8310069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.317+0000 7f832d7fa640 1 -- 172.21.15.73:0/3267411130 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f8320120460 con 0x7f833015d290 2024-09-12T03:38:40.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.317+0000 7f83277fe640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83100678c0 0x7f8310069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8318007fd0 tx=0x7f8318009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.321+0000 7f832d7fa640 1 -- 172.21.15.73:0/3267411130 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8320016090 con 0x7f833015d290 2024-09-12T03:38:40.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f8330074b30 con 0x7f83100678c0 2024-09-12T03:38:40.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f832d7fa640 1 -- 172.21.15.73:0/3267411130 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8330074b30 con 0x7f83100678c0 2024-09-12T03:38:40.478 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T03:38:40.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83100678c0 msgr2=0x7f8310069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83100678c0 0x7f8310069d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8318007fd0 tx=0x7f8318009040 comp rx=0 tx=0).stop 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015d290 msgr2=0x7f83301496c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015d290 0x7f83301496c0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f8320009710 tx=0x7f832001acb0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 shutdown_connections 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f83100678c0 0x7f8310069d80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f833015f830 0x7f8330152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f833015eee0 0x7f8330137950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 --2- 172.21.15.73:0/3267411130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f833015d290 0x7f83301496c0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 >> 172.21.15.73:0/3267411130 conn(0x7f83300b6800 msgr2=0x7f833015c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 shutdown_connections 2024-09-12T03:38:40.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.477+0000 7f8336541640 1 -- 172.21.15.73:0/3267411130 wait complete. 2024-09-12T03:38:40.496 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T03:38:40.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:40.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed9d20640 1 Processor -- start 2024-09-12T03:38:40.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed9d20640 1 -- start start 2024-09-12T03:38:40.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed9d20640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ed40b39a0 0x7f8ed406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed9d20640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed406ec60 con 0x7f8ed41587a0 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed9d20640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed406ef40 con 0x7f8ed406e4b0 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed9d20640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f8ed406f870 con 0x7f8ed40b39a0 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8ed41587a0 0x7f8ed40b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42590/0 (socket says 172.21.15.73:42590) 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed37fe640 1 -- 172.21.15.73:0/3383945108 learned_addr learned my addr 172.21.15.73:0/3383945108 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/3383945108 >> v2:172.21.15.150:3300/0 conn(0x7f8ed40b39a0 0x7f8ed406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928902644 0 0) 0x7f8ed406ec60 con 0x7f8ed41587a0 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ebc003530 con 0x7f8ed41587a0 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3235701982 0 0) 0x7f8ebc003530 con 0x7f8ed41587a0 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 >> v2:172.21.15.150:3300/0 conn(0x7f8ed40b39a0 msgr2=0x7f8ed406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 --2- 172.21.15.73:0/3383945108 >> v2:172.21.15.150:3300/0 conn(0x7f8ed40b39a0 0x7f8ed406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 >> v1:172.21.15.150:6789/0 conn(0x7f8ed406e4b0 legacy=0x7f8ed4072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed406f220 con 0x7f8ed41587a0 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f8ec8001680 con 0x7f8ed41587a0 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 >> v1:172.21.15.73:6789/0 conn(0x7f8ed41587a0 legacy=0x7f8ed40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0039c0 0x7f8ebc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc004810 0x7f8ebc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc0051d0 0x7f8ebc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed406f870 con 0x7f8ebc004810 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc00c0a0 con 0x7f8ebc0039c0 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ebc00c2a0 con 0x7f8ebc0051d0 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc004810 0x7f8ebc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed37fe640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0039c0 0x7f8ebc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed2ffd640 1 -- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc0051d0 msgr2=0x7f8ebc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc0051d0 0x7f8ebc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed2ffd640 1 -- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0039c0 msgr2=0x7f8ebc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0039c0 0x7f8ebc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed2ffd640 1 -- 172.21.15.73:0/3383945108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc003530 con 0x7f8ebc004810 2024-09-12T03:38:40.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed3fff640 1 -- 172.21.15.73:0/3383945108 reap_dead start 2024-09-12T03:38:40.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.609+0000 7f8ed37fe640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ebc0039c0 0x7f8ebc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc004810 0x7f8ebc004c90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009ae0 tx=0x7f8ec401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cf5e7c3f4d8da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40b2070 con 0x7f8ebc004810 2024-09-12T03:38:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec40a5680 con 0x7f8ebc004810 2024-09-12T03:38:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed27fc640 1 -- 172.21.15.73:0/3383945108 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec40096b0 con 0x7f8ebc004810 2024-09-12T03:38:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- 172.21.15.73:0/3383945108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc004810 msgr2=0x7f8ebc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc004810 0x7f8ebc004c90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009ae0 tx=0x7f8ec401ca90 comp rx=0 tx=0).stop 2024-09-12T03:38:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- 172.21.15.73:0/3383945108 shutdown_connections 2024-09-12T03:38:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 --2- 172.21.15.73:0/3383945108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ebc004810 0x7f8ebc004c90 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- 172.21.15.73:0/3383945108 >> 172.21.15.73:0/3383945108 conn(0x7f8ed40b1f90 msgr2=0x7f8ed40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- 172.21.15.73:0/3383945108 shutdown_connections 2024-09-12T03:38:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- 172.21.15.73:0/3383945108 wait complete. 2024-09-12T03:38:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 Processor -- start 2024-09-12T03:38:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- start start 2024-09-12T03:38:40.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc004810 0x7f8ed41563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed409a620 0x7f8ed409aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ed41569e0 0x7f8ed4156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4158b80 con 0x7f8ed41569e0 2024-09-12T03:38:40.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed406e920 con 0x7f8ed409a620 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed9d20640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f8ed41457d0 con 0x7f8ebc004810 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ed41569e0 0x7f8ed4156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ed41569e0 0x7f8ed4156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47506/0 (socket says 172.21.15.73:47506) 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 -- 172.21.15.73:0/2811030268 learned_addr learned my addr 172.21.15.73:0/2811030268 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed409a620 0x7f8ed409aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed37fe640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc004810 0x7f8ed41563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 -- 172.21.15.73:0/2811030268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc004810 msgr2=0x7f8ed41563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc004810 0x7f8ed41563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 -- 172.21.15.73:0/2811030268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed409a620 msgr2=0x7f8ed409aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed409a620 0x7f8ed409aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed3fff640 1 -- 172.21.15.73:0/2811030268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed409b0e0 con 0x7f8ed41569e0 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.613+0000 7f8ed37fe640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f8ebc004810 0x7f8ed41563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:40.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed3fff640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ed41569e0 0x7f8ed4156e60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4161d90 tx=0x7f8ecc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc017070 con 0x7f8ed41569e0 2024-09-12T03:38:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ecc005d70 con 0x7f8ed41569e0 2024-09-12T03:38:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed409b3c0 con 0x7f8ed41569e0 2024-09-12T03:38:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ecc00a850 con 0x7f8ed41569e0 2024-09-12T03:38:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed409b980 con 0x7f8ed41569e0 2024-09-12T03:38:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ed4070080 con 0x7f8ed41569e0 2024-09-12T03:38:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ecc01a070 con 0x7f8ed41569e0 2024-09-12T03:38:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ec00678c0 0x7f8ec0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f8ecc085550 con 0x7f8ed41569e0 2024-09-12T03:38:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed37fe640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ec00678c0 0x7f8ec0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f8ec006dd60 0x7f8ec00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 --> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ec0070870 con 0x7f8ec006dd60 2024-09-12T03:38:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f8ecc0859b0 con 0x7f8ed41569e0 2024-09-12T03:38:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f8ec006dd60 0x7f8ec00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed37fe640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ec00678c0 0x7f8ec0069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80017f0 tx=0x7f8ec8000f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ed2ffd640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f8ec006dd60 0x7f8ec00701a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.617+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== osd.3 v2:172.21.15.73:6816/3982759394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ec0070870 con 0x7f8ec006dd60 2024-09-12T03:38:40.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 --> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8ed40ae6d0 con 0x7f8ec006dd60 2024-09-12T03:38:40.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ebbfff640 1 -- 172.21.15.73:0/2811030268 <== osd.3 v2:172.21.15.73:6816/3982759394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8ed40ae6d0 con 0x7f8ec006dd60 2024-09-12T03:38:40.633 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:40.633 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:40.633 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f8ec006dd60 msgr2=0x7f8ec00701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6816/3982759394,v1:172.21.15.73:6817/3982759394] conn(0x7f8ec006dd60 0x7f8ec00701a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ec00678c0 msgr2=0x7f8ec0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f8ec00678c0 0x7f8ec0069d80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80017f0 tx=0x7f8ec8000f40 comp rx=0 tx=0).stop 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ed41569e0 msgr2=0x7f8ed4156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 --2- 172.21.15.73:0/2811030268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ed41569e0 0x7f8ed4156e60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4161d90 tx=0x7f8ecc00cb90 comp rx=0 tx=0).stop 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed3fff640 1 -- 172.21.15.73:0/2811030268 reap_dead start 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 shutdown_connections 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 >> 172.21.15.73:0/2811030268 conn(0x7f8ed40b1f90 msgr2=0x7f8ed40d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 shutdown_connections 2024-09-12T03:38:40.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.633+0000 7f8ed9d20640 1 -- 172.21.15.73:0/2811030268 wait complete. 2024-09-12T03:38:40.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T03:38:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 Processor -- start 2024-09-12T03:38:40.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 -- start start 2024-09-12T03:38:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbbd0073e60 0x7fbbd006e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd006fef0 0x7fbbd015b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbbd006df70 0x7fbbd00b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbbd015bda0 con 0x7fbbd006df70 2024-09-12T03:38:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fbbd006ee50 con 0x7fbbd0073e60 2024-09-12T03:38:40.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd6dfa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd006f130 con 0x7fbbd006fef0 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbbd006df70 0x7fbbd00b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbbd006df70 0x7fbbd00b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47520/0 (socket says 172.21.15.73:47520) 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 -- 172.21.15.73:0/4141667608 learned_addr learned my addr 172.21.15.73:0/4141667608 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbcffff640 1 --2- 172.21.15.73:0/4141667608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd006fef0 0x7fbbd015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd4b96640 1 --2- 172.21.15.73:0/4141667608 >> v2:172.21.15.150:3300/0 conn(0x7fbbd0073e60 0x7fbbd006e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 -- 172.21.15.73:0/4141667608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd006fef0 msgr2=0x7fbbd015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 --2- 172.21.15.73:0/4141667608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd006fef0 0x7fbbd015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 -- 172.21.15.73:0/4141667608 >> v2:172.21.15.150:3300/0 conn(0x7fbbd0073e60 msgr2=0x7fbbd006e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 --2- 172.21.15.73:0/4141667608 >> v2:172.21.15.150:3300/0 conn(0x7fbbd0073e60 0x7fbbd006e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbd5397640 1 -- 172.21.15.73:0/4141667608 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd006f410 con 0x7fbbd006df70 2024-09-12T03:38:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.757+0000 7fbbcffff640 1 --2- 172.21.15.73:0/4141667608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd006fef0 0x7fbbd015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd5397640 1 --2- 172.21.15.73:0/4141667608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006df70 0x7fbbd00b3d50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0070340 tx=0x7fbbc801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595cc0bdcb72532f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcf7fe640 1 -- 172.21.15.73:0/4141667608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80a5670 con 0x7fbbd006df70 2024-09-12T03:38:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcf7fe640 1 -- 172.21.15.73:0/4141667608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc80a5810 con 0x7fbbd006df70 2024-09-12T03:38:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcf7fe640 1 -- 172.21.15.73:0/4141667608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80a5be0 con 0x7fbbd006df70 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/4141667608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006df70 msgr2=0x7fbbd00b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/4141667608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006df70 0x7fbbd00b3d50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0070340 tx=0x7fbbc801c960 comp rx=0 tx=0).stop 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/4141667608 shutdown_connections 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/4141667608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006df70 0x7fbbd00b3d50 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/4141667608 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd006fef0 0x7fbbd015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/4141667608 >> v2:172.21.15.150:3300/0 conn(0x7fbbd0073e60 0x7fbbd006e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/4141667608 >> 172.21.15.73:0/4141667608 conn(0x7fbbd00b1f90 msgr2=0x7fbbd00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/4141667608 shutdown_connections 2024-09-12T03:38:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/4141667608 wait complete. 2024-09-12T03:38:40.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 Processor -- start 2024-09-12T03:38:40.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- start start 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd006df70 0x7fbbd014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006fef0 0x7fbbd0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd0073e60 0x7fbbd00b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd015efa0 con 0x7fbbd006fef0 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd015ee20 con 0x7fbbd006df70 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd6dfa640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd015f120 con 0x7fbbd0073e60 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006fef0 0x7fbbd0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006fef0 0x7fbbd0150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47526/0 (socket says 172.21.15.73:47526) 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 -- 172.21.15.73:0/1839023245 learned_addr learned my addr 172.21.15.73:0/1839023245 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 -- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd0073e60 msgr2=0x7fbbd00b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd4b96640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd006df70 0x7fbbd014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbd5397640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd0073e60 0x7fbbd00b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd0073e60 0x7fbbd00b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 -- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd006df70 msgr2=0x7fbbd014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd006df70 0x7fbbd014a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.761+0000 7fbbcffff640 1 -- 172.21.15.73:0/1839023245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd00b08a0 con 0x7fbbd006fef0 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbcffff640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006fef0 0x7fbbd0150e60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c7f0 tx=0x7fbbc000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbcd7fa640 1 -- 172.21.15.73:0/1839023245 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0015070 con 0x7fbbd006fef0 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbcd7fa640 1 -- 172.21.15.73:0/1839023245 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc0007a30 con 0x7fbbd006fef0 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd00ae860 con 0x7fbbd006fef0 2024-09-12T03:38:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbcd7fa640 1 -- 172.21.15.73:0/1839023245 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0007e00 con 0x7fbbd006fef0 2024-09-12T03:38:40.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd00aee20 con 0x7fbbd006fef0 2024-09-12T03:38:40.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd015b860 con 0x7fbbd006fef0 2024-09-12T03:38:40.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbcd7fa640 1 -- 172.21.15.73:0/1839023245 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbbc0018070 con 0x7fbbd006fef0 2024-09-12T03:38:40.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbcd7fa640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbbb00678c0 0x7fbbb0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:40.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbcd7fa640 1 -- 172.21.15.73:0/1839023245 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7fbbc00859d0 con 0x7fbbd006fef0 2024-09-12T03:38:40.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbd4b96640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbbb00678c0 0x7fbbb0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:40.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.765+0000 7fbbd4b96640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbbb00678c0 0x7fbbb0069d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800b800 tx=0x7fbbb8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:40.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.769+0000 7fbbcd7fa640 1 -- 172.21.15.73:0/1839023245 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbbc0056710 con 0x7fbbd006fef0 2024-09-12T03:38:40.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.929+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fbbd014e830 con 0x7fbbb00678c0 2024-09-12T03:38:40.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.929+0000 7fbbcd7fa640 1 -- 172.21.15.73:0/1839023245 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbbd014e830 con 0x7fbbb00678c0 2024-09-12T03:38:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbbb00678c0 msgr2=0x7fbbb0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbbb00678c0 0x7fbbb0069d80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800b800 tx=0x7fbbb8008040 comp rx=0 tx=0).stop 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006fef0 msgr2=0x7fbbd0150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006fef0 0x7fbbd0150e60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c7f0 tx=0x7fbbc000ccb0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 shutdown_connections 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbbb00678c0 0x7fbbb0069d80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbd006fef0 0x7fbbd0150e60 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbbd0073e60 0x7fbbd00b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 --2- 172.21.15.73:0/1839023245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbbd006df70 0x7fbbd014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 >> 172.21.15.73:0/1839023245 conn(0x7fbbd00b1f90 msgr2=0x7fbbd015d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 shutdown_connections 2024-09-12T03:38:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:40.933+0000 7fbbd6dfa640 1 -- 172.21.15.73:0/1839023245 wait complete. 2024-09-12T03:38:40.950 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T03:38:40.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:41.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f002c1ed640 1 Processor -- start 2024-09-12T03:38:41.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f002c1ed640 1 -- start start 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f002c1ed640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f00240d3060 0x7f00240cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f002c1ed640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00240d0300 con 0x7f0024161a60 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f002c1ed640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00240b0f60 con 0x7f00240cf450 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f002c1ed640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f00240cfd40 con 0x7f00240d3060 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0029f89640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0024161a60 0x7f00240d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42594/0 (socket says 172.21.15.73:42594) 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0029f89640 1 -- 172.21.15.73:0/3312883931 learned_addr learned my addr 172.21.15.73:0/3312883931 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429890946 0 0) 0x7f0020001120 con 0x7f0024161a60 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0010003530 con 0x7f0024161a60 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0029788640 1 --2- 172.21.15.73:0/3312883931 >> v2:172.21.15.150:3300/0 conn(0x7f00240d3060 0x7f00240cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4212628439 0 0) 0x7f0010003530 con 0x7f0024161a60 2024-09-12T03:38:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 >> v2:172.21.15.150:3300/0 conn(0x7f00240d3060 msgr2=0x7f00240cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 --2- 172.21.15.73:0/3312883931 >> v2:172.21.15.150:3300/0 conn(0x7f00240d3060 0x7f00240cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 >> v1:172.21.15.150:6789/0 conn(0x7f00240cf450 legacy=0x7f002406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00240d0020 con 0x7f0024161a60 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f0020001850 con 0x7f0024161a60 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 >> v1:172.21.15.73:6789/0 conn(0x7f0024161a60 legacy=0x7f00240d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00100039c0 0x7f0010003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0010004810 0x7f0010004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00100052f0 0x7f001000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00240cfd40 con 0x7f0010004810 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f001000c1a0 con 0x7f00100052f0 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f001000c3a0 con 0x7f00100039c0 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f0029788640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0010004810 0x7f0010004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0029f89640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00100039c0 0x7f0010003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.065+0000 7f002a78a640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00100052f0 0x7f001000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0029788640 1 -- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00100039c0 msgr2=0x7f0010003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0029788640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00100039c0 0x7f0010003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0029788640 1 -- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00100052f0 msgr2=0x7f001000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0029788640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00100052f0 0x7f001000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0029788640 1 -- 172.21.15.73:0/3312883931 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0010003530 con 0x7f0010004810 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002a78a640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00100052f0 0x7f001000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002a78a640 1 -- 172.21.15.73:0/3312883931 reap_dead start 2024-09-12T03:38:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0029788640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0010004810 0x7f0010004c90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f001400ba00 tx=0x7f001401c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd87c2b341f39d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00140b2070 con 0x7f0010004810 2024-09-12T03:38:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00140ad630 con 0x7f0010004810 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f0028f87640 1 -- 172.21.15.73:0/3312883931 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001400b600 con 0x7f0010004810 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 -- 172.21.15.73:0/3312883931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0010004810 msgr2=0x7f0010004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0010004810 0x7f0010004c90 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f001400ba00 tx=0x7f001401c630 comp rx=0 tx=0).stop 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 -- 172.21.15.73:0/3312883931 shutdown_connections 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 --2- 172.21.15.73:0/3312883931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0010004810 0x7f0010004c90 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 -- 172.21.15.73:0/3312883931 >> 172.21.15.73:0/3312883931 conn(0x7f002408bf90 msgr2=0x7f002409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 -- 172.21.15.73:0/3312883931 shutdown_connections 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 -- 172.21.15.73:0/3312883931 wait complete. 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 Processor -- start 2024-09-12T03:38:41.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.069+0000 7f002c1ed640 1 -- start start 2024-09-12T03:38:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0010004810 0x7f002415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00240cd0a0 0x7f0024159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00240cba40 0x7f0024159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00240cfa20 con 0x7f00240cba40 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f00240cf8a0 con 0x7f0010004810 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f00240d1220 con 0x7f00240cd0a0 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00240cba40 0x7f0024159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00240cba40 0x7f0024159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47538/0 (socket says 172.21.15.73:47538) 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 -- 172.21.15.73:0/3316512107 learned_addr learned my addr 172.21.15.73:0/3316512107 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f0029788640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00240cd0a0 0x7f0024159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f0029f89640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0010004810 0x7f002415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 -- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00240cd0a0 msgr2=0x7f0024159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00240cd0a0 0x7f0024159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 -- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0010004810 msgr2=0x7f002415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0010004810 0x7f002415a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 -- 172.21.15.73:0/3316512107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002415aaa0 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f0029f89640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0010004810 0x7f002415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f0029788640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f00240cd0a0 0x7f0024159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002a78a640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00240cba40 0x7f0024159840 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f001c00d4d0 tx=0x7f001c00d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c006b60 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001c006d20 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c012840 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00240cc000 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00240cc5c0 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00240ccc80 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f001c01b020 con 0x7f00240cba40 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00080678c0 0x7f0008069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f001c085b20 con 0x7f00240cba40 2024-09-12T03:38:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f0029f89640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00080678c0 0x7f0008069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f000806dd60 0x7f00080701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 --> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f001c0020c0 con 0x7f000806dd60 2024-09-12T03:38:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.073+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f001c085fb0 con 0x7f00240cba40 2024-09-12T03:38:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.077+0000 7f0029f89640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00080678c0 0x7f0008069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f00200079a0 tx=0x7f0020009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.077+0000 7f0029788640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f000806dd60 0x7f00080701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.077+0000 7f0029788640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f000806dd60 0x7f00080701a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.077+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== osd.4 v2:172.21.15.150:6816/2236431337 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f001c0020c0 con 0x7f000806dd60 2024-09-12T03:38:41.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.089+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 --> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0024068ce0 con 0x7f000806dd60 2024-09-12T03:38:41.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f001a7fc640 1 -- 172.21.15.73:0/3316512107 <== osd.4 v2:172.21.15.150:6816/2236431337 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0024068ce0 con 0x7f000806dd60 2024-09-12T03:38:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:41.093 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:41.093 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f000806dd60 msgr2=0x7f00080701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.150:6816/2236431337,v1:172.21.15.150:6817/2236431337] conn(0x7f000806dd60 0x7f00080701a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00080678c0 msgr2=0x7f0008069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f00080678c0 0x7f0008069d80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f00200079a0 tx=0x7f0020009040 comp rx=0 tx=0).stop 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00240cba40 msgr2=0x7f0024159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 --2- 172.21.15.73:0/3316512107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00240cba40 0x7f0024159840 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f001c00d4d0 tx=0x7f001c00d990 comp rx=0 tx=0).stop 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002a78a640 1 -- 172.21.15.73:0/3316512107 reap_dead start 2024-09-12T03:38:41.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 shutdown_connections 2024-09-12T03:38:41.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 >> 172.21.15.73:0/3316512107 conn(0x7f002408bf90 msgr2=0x7f00240b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 shutdown_connections 2024-09-12T03:38:41.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.093+0000 7f002c1ed640 1 -- 172.21.15.73:0/3316512107 wait complete. 2024-09-12T03:38:41.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T03:38:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958f204640 1 Processor -- start 2024-09-12T03:38:41.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958f204640 1 -- start start 2024-09-12T03:38:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958f204640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160900 0x7f958815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958f204640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9588071e60 0x7f958815cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958f204640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95880d0d70 con 0x7f9588160520 2024-09-12T03:38:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958f204640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f95880d1640 con 0x7f9588071e60 2024-09-12T03:38:41.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958f204640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f958815d390 con 0x7f9588160900 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f9587fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160900 0x7f958815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958d7a1640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9588071e60 0x7f958815cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958d7a1640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f9588071e60 0x7f958815cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:36530/0 (socket says 172.21.15.73:36530) 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958cfa0640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f9588160520 0x7f9588071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44838/0 (socket says 172.21.15.73:44838) 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f9587fff640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160900 0x7f958815c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:58060/0 (socket says 172.21.15.73:58060) 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f958d7a1640 1 -- 172.21.15.73:0/391904940 learned_addr learned my addr 172.21.15.73:0/391904940 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f9587fff640 1 -- 172.21.15.73:0/391904940 >> v2:172.21.15.150:3300/0 conn(0x7f9588071e60 msgr2=0x7f958815cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f9587fff640 1 --2- 172.21.15.73:0/391904940 >> v2:172.21.15.150:3300/0 conn(0x7f9588071e60 0x7f958815cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f9587fff640 1 -- 172.21.15.73:0/391904940 >> v1:172.21.15.150:6789/0 conn(0x7f9588160520 legacy=0x7f9588071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.213+0000 7f9587fff640 1 -- 172.21.15.73:0/391904940 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95880d0ff0 con 0x7f9588160900 2024-09-12T03:38:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f9587fff640 1 --2- 172.21.15.73:0/391904940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160900 0x7f958815c5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6a427a0abbe549c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f95877fe640 1 -- 172.21.15.73:0/391904940 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0b0070 con 0x7f9588160900 2024-09-12T03:38:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f95877fe640 1 -- 172.21.15.73:0/391904940 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c0ab600 con 0x7f9588160900 2024-09-12T03:38:41.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f95877fe640 1 -- 172.21.15.73:0/391904940 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0ab9d0 con 0x7f9588160900 2024-09-12T03:38:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 -- 172.21.15.73:0/391904940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160900 msgr2=0x7f958815c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 --2- 172.21.15.73:0/391904940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160900 0x7f958815c5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c01c410 comp rx=0 tx=0).stop 2024-09-12T03:38:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 -- 172.21.15.73:0/391904940 shutdown_connections 2024-09-12T03:38:41.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 --2- 172.21.15.73:0/391904940 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160900 0x7f958815c5f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 --2- 172.21.15.73:0/391904940 >> v2:172.21.15.150:3300/0 conn(0x7f9588071e60 0x7f958815cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 -- 172.21.15.73:0/391904940 >> 172.21.15.73:0/391904940 conn(0x7f958806c0c0 msgr2=0x7f958806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 -- 172.21.15.73:0/391904940 shutdown_connections 2024-09-12T03:38:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.217+0000 7f958f204640 1 -- 172.21.15.73:0/391904940 wait complete. 2024-09-12T03:38:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 Processor -- start 2024-09-12T03:38:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 -- start start 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9588071e60 0x7f9588139ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160520 0x7f95880b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9588160900 0x7f95880b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9588141190 con 0x7f9588071e60 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f958815d070 con 0x7f9588160900 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f9588141310 con 0x7f9588160520 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9588071e60 0x7f9588139ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9588071e60 0x7f9588139ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47550/0 (socket says 172.21.15.73:47550) 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 -- 172.21.15.73:0/1413210177 learned_addr learned my addr 172.21.15.73:0/1413210177 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f9587fff640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160520 0x7f95880b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958d7a1640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9588160900 0x7f95880b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 -- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160520 msgr2=0x7f95880b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160520 0x7f95880b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 -- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9588160900 msgr2=0x7f95880b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9588160900 0x7f95880b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 -- 172.21.15.73:0/1413210177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958815b7b0 con 0x7f9588071e60 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958cfa0640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9588071e60 0x7f9588139ed0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f957800c420 tx=0x7f957800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f95857fa640 1 -- 172.21.15.73:0/1413210177 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95780074e0 con 0x7f9588071e60 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f95857fa640 1 -- 172.21.15.73:0/1413210177 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9578007680 con 0x7f9588071e60 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958815ba70 con 0x7f9588071e60 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f95857fa640 1 -- 172.21.15.73:0/1413210177 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9578004a30 con 0x7f9588071e60 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958813a9c0 con 0x7f9588071e60 2024-09-12T03:38:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95880008e0 con 0x7f9588071e60 2024-09-12T03:38:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.221+0000 7f95857fa640 1 -- 172.21.15.73:0/1413210177 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f957801a020 con 0x7f9588071e60 2024-09-12T03:38:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.225+0000 7f95857fa640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95740678c0 0x7f9574069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.225+0000 7f9587fff640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95740678c0 0x7f9574069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.225+0000 7f95857fa640 1 -- 172.21.15.73:0/1413210177 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f9578085b90 con 0x7f9588071e60 2024-09-12T03:38:41.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.225+0000 7f9587fff640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95740678c0 0x7f9574069d80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f957c0ad000 tx=0x7f957c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.225+0000 7f95857fa640 1 -- 172.21.15.73:0/1413210177 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9578021070 con 0x7f9588071e60 2024-09-12T03:38:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.373+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f958813a410 con 0x7f95740678c0 2024-09-12T03:38:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.373+0000 7f95857fa640 1 -- 172.21.15.73:0/1413210177 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f958813a410 con 0x7f95740678c0 2024-09-12T03:38:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T03:38:41.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95740678c0 msgr2=0x7f9574069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95740678c0 0x7f9574069d80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f957c0ad000 tx=0x7f957c0a6000 comp rx=0 tx=0).stop 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9588071e60 msgr2=0x7f9588139ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9588071e60 0x7f9588139ed0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f957800c420 tx=0x7f957800c8e0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 shutdown_connections 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f95740678c0 0x7f9574069d80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9588160900 0x7f95880b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f9588160520 0x7f95880b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 --2- 172.21.15.73:0/1413210177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9588071e60 0x7f9588139ed0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 >> 172.21.15.73:0/1413210177 conn(0x7f958806c0c0 msgr2=0x7f958815ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 shutdown_connections 2024-09-12T03:38:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.377+0000 7f958f204640 1 -- 172.21.15.73:0/1413210177 wait complete. 2024-09-12T03:38:41.393 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T03:38:41.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:41.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f57103ba640 1 Processor -- start 2024-09-12T03:38:41.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f57103ba640 1 -- start start 2024-09-12T03:38:41.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f57103ba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 0x7f570806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f57103ba640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5708070250 con 0x7f570815f3a0 2024-09-12T03:38:41.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f57103ba640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57080aede0 con 0x7f570806fe50 2024-09-12T03:38:41.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f57103ba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5708152480 con 0x7f57081520a0 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f570815f3a0 0x7f57080adc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42608/0 (socket says 172.21.15.73:42608) 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 -- 172.21.15.73:0/4111958300 learned_addr learned my addr 172.21.15.73:0/4111958300 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e156640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 0x7f570806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464411202 0 0) 0x7f5708070250 con 0x7f570815f3a0 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f4003530 con 0x7f570815f3a0 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3581738965 0 0) 0x7f56f4003530 con 0x7f570815f3a0 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 msgr2=0x7f570806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 0x7f570806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 >> v1:172.21.15.150:6789/0 conn(0x7f570806fe50 legacy=0x7f570815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570815fa10 con 0x7f570815f3a0 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7f5700001a00 con 0x7f570815f3a0 2024-09-12T03:38:41.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e156640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 0x7f570806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 >> v1:172.21.15.73:6789/0 conn(0x7f570815f3a0 legacy=0x7f57080adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 0x7f56f40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f4003fe0 0x7f56f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f4004d50 0x7f56f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56f400bb00 con 0x7f56f4004d50 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f56f400bcb0 con 0x7f56f4003fe0 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f56f400beb0 con 0x7f57081520a0 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f4004d50 0x7f56f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e156640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 0x7f56f40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d955640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f4003fe0 0x7f56f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 -- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 msgr2=0x7f56f40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f57081520a0 0x7f56f40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 -- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f4003fe0 msgr2=0x7f56f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f4003fe0 0x7f56f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570e957640 1 -- 172.21.15.73:0/4111958300 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f4003530 con 0x7f56f4004d50 2024-09-12T03:38:41.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.505+0000 7f570d955640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56f4003fe0 0x7f56f4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570e957640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f4004d50 0x7f56f40051d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f570000a840 tx=0x7f570001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106c4f192bc8fab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570000a460 con 0x7f56f4004d50 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57000ad650 con 0x7f56f4004d50 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570d154640 1 -- 172.21.15.73:0/4111958300 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000ada80 con 0x7f56f4004d50 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- 172.21.15.73:0/4111958300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f4004d50 msgr2=0x7f56f40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 --2- 172.21.15.73:0/4111958300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f4004d50 0x7f56f40051d0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f570000a840 tx=0x7f570001d360 comp rx=0 tx=0).stop 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570e957640 1 -- 172.21.15.73:0/4111958300 reap_dead start 2024-09-12T03:38:41.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- 172.21.15.73:0/4111958300 shutdown_connections 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- 172.21.15.73:0/4111958300 >> 172.21.15.73:0/4111958300 conn(0x7f57080b1f90 msgr2=0x7f57080b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- 172.21.15.73:0/4111958300 shutdown_connections 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- 172.21.15.73:0/4111958300 wait complete. 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 Processor -- start 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- start start 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56f4004d50 0x7f5708098e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570815e2b0 0x7f57080b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5708099620 0x7f57080b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5708073770 con 0x7f5708099620 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f5708073490 con 0x7f570815e2b0 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f57103ba640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f5708073a50 con 0x7f56f4004d50 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570e957640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5708099620 0x7f57080b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570e957640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5708099620 0x7f57080b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47570/0 (socket says 172.21.15.73:47570) 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.509+0000 7f570e957640 1 -- 172.21.15.73:0/2365710527 learned_addr learned my addr 172.21.15.73:0/2365710527 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e156640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56f4004d50 0x7f5708098e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570d955640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570815e2b0 0x7f57080b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e957640 1 -- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56f4004d50 msgr2=0x7f5708098e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e957640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f56f4004d50 0x7f5708098e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e957640 1 -- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570815e2b0 msgr2=0x7f57080b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e957640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570815e2b0 0x7f57080b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e957640 1 -- 172.21.15.73:0/2365710527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570806f930 con 0x7f5708099620 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570d955640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f570815e2b0 0x7f57080b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e957640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5708099620 0x7f57080b1280 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f570001dc00 tx=0x7f56f4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000b2040 con 0x7f5708099620 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57000ad430 con 0x7f5708099620 2024-09-12T03:38:41.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57081536b0 con 0x7f5708099620 2024-09-12T03:38:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700001fc0 con 0x7f5708099620 2024-09-12T03:38:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5708153200 con 0x7f5708099620 2024-09-12T03:38:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f570806f6e0 con 0x7f5708099620 2024-09-12T03:38:41.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f57000be020 con 0x7f5708099620 2024-09-12T03:38:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56ec0678c0 0x7f56ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f57001207e0 con 0x7f5708099620 2024-09-12T03:38:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e156640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56ec0678c0 0x7f56ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7f56ec06dd60 0x7f56ec0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 --> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57000bee80 con 0x7f56ec06dd60 2024-09-12T03:38:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f5700120c70 con 0x7f5708099620 2024-09-12T03:38:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570e156640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56ec0678c0 0x7f56ec069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f570400e880 tx=0x7f5704008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570d955640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7f56ec06dd60 0x7f56ec0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.513+0000 7f570d955640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7f56ec06dd60 0x7f56ec0701a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.517+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== osd.5 v2:172.21.15.150:6824/260644045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f57000bee80 con 0x7f56ec06dd60 2024-09-12T03:38:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 --> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5708153490 con 0x7f56ec06dd60 2024-09-12T03:38:41.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f56feffd640 1 -- 172.21.15.73:0/2365710527 <== osd.5 v2:172.21.15.150:6824/260644045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5708153490 con 0x7f56ec06dd60 2024-09-12T03:38:41.531 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:41.531 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:41.531 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7f56ec06dd60 msgr2=0x7f56ec0701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.150:6824/260644045,v1:172.21.15.150:6825/260644045] conn(0x7f56ec06dd60 0x7f56ec0701a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56ec0678c0 msgr2=0x7f56ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f56ec0678c0 0x7f56ec069d80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f570400e880 tx=0x7f5704008040 comp rx=0 tx=0).stop 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5708099620 msgr2=0x7f57080b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 --2- 172.21.15.73:0/2365710527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5708099620 0x7f57080b1280 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f570001dc00 tx=0x7f56f4005840 comp rx=0 tx=0).stop 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f570e957640 1 -- 172.21.15.73:0/2365710527 reap_dead start 2024-09-12T03:38:41.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 shutdown_connections 2024-09-12T03:38:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 >> 172.21.15.73:0/2365710527 conn(0x7f57080b1f90 msgr2=0x7f57080cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 shutdown_connections 2024-09-12T03:38:41.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.529+0000 7f57103ba640 1 -- 172.21.15.73:0/2365710527 wait complete. 2024-09-12T03:38:41.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T03:38:41.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa702e9640 1 Processor -- start 2024-09-12T03:38:41.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa702e9640 1 -- start start 2024-09-12T03:38:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa702e9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6806f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa702e9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa6806fe50 0x7faa6815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa702e9640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa68070250 con 0x7faa6815f1d0 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa702e9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7faa68152480 con 0x7faa6806fe50 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa702e9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faa680aede0 con 0x7faa681520a0 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6d884640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa6806fe50 0x7faa6815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6d884640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa6806fe50 0x7faa6815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47580/0 (socket says 172.21.15.73:47580) 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6d884640 1 -- 172.21.15.73:0/2740573447 learned_addr learned my addr 172.21.15.73:0/2740573447 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6e085640 1 --2- 172.21.15.73:0/2740573447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6d884640 1 -- 172.21.15.73:0/2740573447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 msgr2=0x7faa6806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6d884640 1 --2- 172.21.15.73:0/2740573447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6d884640 1 -- 172.21.15.73:0/2740573447 >> v1:172.21.15.150:6789/0 conn(0x7faa6815f1d0 legacy=0x7faa68071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6d884640 1 -- 172.21.15.73:0/2740573447 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6815fa10 con 0x7faa6806fe50 2024-09-12T03:38:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.649+0000 7faa6e085640 1 --2- 172.21.15.73:0/2740573447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6d884640 1 --2- 172.21.15.73:0/2740573447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa6815ec90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7faa58009870 tx=0x7faa5801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0ffc964ae37939 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6d083640 1 -- 172.21.15.73:0/2740573447 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa580ab660 con 0x7faa6806fe50 2024-09-12T03:38:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6d083640 1 -- 172.21.15.73:0/2740573447 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa580b0070 con 0x7faa6806fe50 2024-09-12T03:38:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6d083640 1 -- 172.21.15.73:0/2740573447 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa580aba20 con 0x7faa6806fe50 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- 172.21.15.73:0/2740573447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 msgr2=0x7faa6815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 --2- 172.21.15.73:0/2740573447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa6815ec90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7faa58009870 tx=0x7faa5801c540 comp rx=0 tx=0).stop 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- 172.21.15.73:0/2740573447 shutdown_connections 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 --2- 172.21.15.73:0/2740573447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa6815ec90 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 --2- 172.21.15.73:0/2740573447 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- 172.21.15.73:0/2740573447 >> 172.21.15.73:0/2740573447 conn(0x7faa680b1f90 msgr2=0x7faa680b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- 172.21.15.73:0/2740573447 shutdown_connections 2024-09-12T03:38:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- 172.21.15.73:0/2740573447 wait complete. 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 Processor -- start 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- start start 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa680998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6809adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa6815f1d0 0x7faa680b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faa68073d30 con 0x7faa6806fe50 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7faa68073a50 con 0x7faa6815f1d0 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7faa6815f600 con 0x7faa681520a0 2024-09-12T03:38:41.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa680998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa680998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47594/0 (socket says 172.21.15.73:47594) 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 -- 172.21.15.73:0/2331110649 learned_addr learned my addr 172.21.15.73:0/2331110649 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 -- 172.21.15.73:0/2331110649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 msgr2=0x7faa6809adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6809adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 -- 172.21.15.73:0/2331110649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa6815f1d0 msgr2=0x7faa680b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa6815f1d0 0x7faa680b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 -- 172.21.15.73:0/2331110649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6809b6b0 con 0x7faa6806fe50 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa6e085640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa680998d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c7c0 tx=0x7faa6400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa5effd640 1 -- 172.21.15.73:0/2331110649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64007a30 con 0x7faa6806fe50 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa5effd640 1 -- 172.21.15.73:0/2331110649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa64007bd0 con 0x7faa6806fe50 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6809b990 con 0x7faa6806fe50 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa5effd640 1 -- 172.21.15.73:0/2331110649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa640113f0 con 0x7faa6806fe50 2024-09-12T03:38:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.653+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa680ce610 con 0x7faa6806fe50 2024-09-12T03:38:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.657+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6815ec90 con 0x7faa6806fe50 2024-09-12T03:38:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.657+0000 7faa5effd640 1 -- 172.21.15.73:0/2331110649 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7faa64011590 con 0x7faa6806fe50 2024-09-12T03:38:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.657+0000 7faa5effd640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faa4c0678c0 0x7faa4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.657+0000 7faa5effd640 1 -- 172.21.15.73:0/2331110649 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7faa64085ce0 con 0x7faa6806fe50 2024-09-12T03:38:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.657+0000 7faa6d884640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faa4c0678c0 0x7faa4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.657+0000 7faa6d884640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faa4c0678c0 0x7faa4c069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faa580af000 tx=0x7faa58004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.661+0000 7faa5effd640 1 -- 172.21.15.73:0/2331110649 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7faa64015020 con 0x7faa6806fe50 2024-09-12T03:38:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7faa6815ada0 con 0x7faa4c0678c0 2024-09-12T03:38:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa5effd640 1 -- 172.21.15.73:0/2331110649 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa6815ada0 con 0x7faa4c0678c0 2024-09-12T03:38:41.821 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T03:38:41.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faa4c0678c0 msgr2=0x7faa4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faa4c0678c0 0x7faa4c069d80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faa580af000 tx=0x7faa58004740 comp rx=0 tx=0).stop 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 msgr2=0x7faa680998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa680998d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c7c0 tx=0x7faa6400cc80 comp rx=0 tx=0).stop 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 shutdown_connections 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7faa4c0678c0 0x7faa4c069d80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa6815f1d0 0x7faa680b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7faa681520a0 0x7faa6809adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 --2- 172.21.15.73:0/2331110649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa6806fe50 0x7faa680998d0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 >> 172.21.15.73:0/2331110649 conn(0x7faa680b1f90 msgr2=0x7faa681640d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 shutdown_connections 2024-09-12T03:38:41.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.821+0000 7faa702e9640 1 -- 172.21.15.73:0/2331110649 wait complete. 2024-09-12T03:38:41.840 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T03:38:41.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:41.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6e1503640 1 Processor -- start 2024-09-12T03:38:41.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6e1503640 1 -- start start 2024-09-12T03:38:41.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6e1503640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd6dc0b3c40 0x7fd6dc15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6e1503640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 0x7fd6dc160290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6e1503640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6dc0b4620 con 0x7fd6dc1567e0 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6e1503640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fd6dc0b4900 con 0x7fd6dc0b3c40 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6e1503640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b4be0 con 0x7fd6dc0b40d0 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd6dc1567e0 0x7fd6dc0b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42618/0 (socket says 172.21.15.73:42618) 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 -- 172.21.15.73:0/124423761 learned_addr learned my addr 172.21.15.73:0/124423761 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6da7fc640 1 --2- 172.21.15.73:0/124423761 >> v2:172.21.15.150:3300/0 conn(0x7fd6dc0b3c40 0x7fd6dc15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6db7fe640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 0x7fd6dc160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859771523 0 0) 0x7fd6dc0b4620 con 0x7fd6dc1567e0 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c8003530 con 0x7fd6dc1567e0 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164875077 0 0) 0x7fd6c8003530 con 0x7fd6dc1567e0 2024-09-12T03:38:41.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 msgr2=0x7fd6dc160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 0x7fd6dc160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 >> v2:172.21.15.150:3300/0 conn(0x7fd6dc0b3c40 msgr2=0x7fd6dc15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 --2- 172.21.15.73:0/124423761 >> v2:172.21.15.150:3300/0 conn(0x7fd6dc0b3c40 0x7fd6dc15fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc0b4ec0 con 0x7fd6dc1567e0 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 398931817 0 0) 0x7fd6cc001a00 con 0x7fd6dc1567e0 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6da7fc640 1 --2- 172.21.15.73:0/124423761 >> v2:172.21.15.150:3300/0 conn(0x7fd6dc0b3c40 0x7fd6dc15fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 >> v1:172.21.15.73:6789/0 conn(0x7fd6dc1567e0 legacy=0x7fd6dc0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 0x7fd6c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8004d50 0x7fd6c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b4900 con 0x7fd6c80039c0 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b4be0 con 0x7fd6c8004d50 2024-09-12T03:38:41.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c800bb30 con 0x7fd6dc0b40d0 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6db7fe640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8004d50 0x7fd6c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6da7fc640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 0x7fd6c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 -- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 msgr2=0x7fd6c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 0x7fd6c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 -- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8004d50 msgr2=0x7fd6c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8004d50 0x7fd6c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6daffd640 1 -- 172.21.15.73:0/124423761 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8003530 con 0x7fd6c80039c0 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6da7fc640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc0b40d0 0x7fd6c8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.965+0000 7fd6db7fe640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6c8004d50 0x7fd6c80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:41.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6daffd640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6c8003de0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00a860 tx=0x7fd6cc01d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3806f929c62bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00a480 con 0x7fd6c80039c0 2024-09-12T03:38:41.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0ad630 con 0x7fd6c80039c0 2024-09-12T03:38:41.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6d9ffb640 1 -- 172.21.15.73:0/124423761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0ada40 con 0x7fd6c80039c0 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 -- 172.21.15.73:0/124423761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 msgr2=0x7fd6c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 --2- 172.21.15.73:0/124423761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6c8003de0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00a860 tx=0x7fd6cc01d350 comp rx=0 tx=0).stop 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6db7fe640 1 -- 172.21.15.73:0/124423761 reap_dead start 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 -- 172.21.15.73:0/124423761 shutdown_connections 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 -- 172.21.15.73:0/124423761 >> 172.21.15.73:0/124423761 conn(0x7fd6dc073580 msgr2=0x7fd6dc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 -- 172.21.15.73:0/124423761 shutdown_connections 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 -- 172.21.15.73:0/124423761 wait complete. 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 Processor -- start 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.969+0000 7fd6e1503640 1 -- start start 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6dc14ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc1637a0 0x7fd6dc163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc154cd0 0x7fd6dc155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc15e130 con 0x7fd6c80039c0 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc160be0 con 0x7fd6dc154cd0 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc15e2b0 con 0x7fd6dc1637a0 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6dc14ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6dc14ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47600/0 (socket says 172.21.15.73:47600) 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 -- 172.21.15.73:0/469600807 learned_addr learned my addr 172.21.15.73:0/469600807 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6db7fe640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc154cd0 0x7fd6dc155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 -- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc1637a0 msgr2=0x7fd6dc163c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fd6dc1637a0 0x7fd6dc163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 -- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc154cd0 msgr2=0x7fd6dc155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd6dc154cd0 0x7fd6dc155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 -- 172.21.15.73:0/469600807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc14b340 con 0x7fd6c80039c0 2024-09-12T03:38:41.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6daffd640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6dc14ae00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00a860 tx=0x7fd6c8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0bc020 con 0x7fd6c80039c0 2024-09-12T03:38:41.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0b3040 con 0x7fd6c80039c0 2024-09-12T03:38:41.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6dc1642f0 con 0x7fd6c80039c0 2024-09-12T03:38:41.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00a480 con 0x7fd6c80039c0 2024-09-12T03:38:41.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6dc1648b0 con 0x7fd6c80039c0 2024-09-12T03:38:41.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6dc15fd50 con 0x7fd6c80039c0 2024-09-12T03:38:41.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd6cc0bf020 con 0x7fd6c80039c0 2024-09-12T03:38:41.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7fd6cc120d00 con 0x7fd6c80039c0 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6da7fc640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fd6bc06dd90 0x7fd6bc0701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 --> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6bc0708a0 con 0x7fd6bc06dd90 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fd6cc121190 con 0x7fd6c80039c0 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6da7fc640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4006f10 tx=0x7fd6c4006e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.973+0000 7fd6db7fe640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fd6bc06dd90 0x7fd6bc0701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.977+0000 7fd6db7fe640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fd6bc06dd90 0x7fd6bc0701d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.977+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== osd.6 v2:172.21.15.150:6800/4177266046 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6bc0708a0 con 0x7fd6bc06dd90 2024-09-12T03:38:41.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.989+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 --> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6dc155690 con 0x7fd6bc06dd90 2024-09-12T03:38:41.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6d37fe640 1 -- 172.21.15.73:0/469600807 <== osd.6 v2:172.21.15.150:6800/4177266046 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6dc155690 con 0x7fd6bc06dd90 2024-09-12T03:38:41.992 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:41.992 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:41.993 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:41.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fd6bc06dd90 msgr2=0x7fd6bc0701d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.150:6800/4177266046,v1:172.21.15.150:6801/4177266046] conn(0x7fd6bc06dd90 0x7fd6bc0701d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:41.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 msgr2=0x7fd6bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fd6bc0678f0 0x7fd6bc069db0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4006f10 tx=0x7fd6c4006e20 comp rx=0 tx=0).stop 2024-09-12T03:38:41.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 msgr2=0x7fd6dc14ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:41.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 --2- 172.21.15.73:0/469600807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6c80039c0 0x7fd6dc14ae00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00a860 tx=0x7fd6c8005840 comp rx=0 tx=0).stop 2024-09-12T03:38:41.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6db7fe640 1 -- 172.21.15.73:0/469600807 reap_dead start 2024-09-12T03:38:41.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 shutdown_connections 2024-09-12T03:38:41.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 >> 172.21.15.73:0/469600807 conn(0x7fd6dc073580 msgr2=0x7fd6dc074fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 shutdown_connections 2024-09-12T03:38:41.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:41.993+0000 7fd6e1503640 1 -- 172.21.15.73:0/469600807 wait complete. 2024-09-12T03:38:42.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T03:38:42.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31b68f640 1 Processor -- start 2024-09-12T03:38:42.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31b68f640 1 -- start start 2024-09-12T03:38:42.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31b68f640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe31415c2a0 0x7fe3140aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31b68f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31b68f640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3140b3290 con 0x7fe31415bec0 2024-09-12T03:38:42.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31b68f640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fe3140b3570 con 0x7fe31415c2a0 2024-09-12T03:38:42.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31b68f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe3140b3850 con 0x7fe3140af2a0 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe319c2c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe318c2a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe31415c2a0 0x7fe3140aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe319c2c640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3301/0 says I am v2:172.21.15.73:58134/0 (socket says 172.21.15.73:58134) 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe31942b640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe31415bec0 0x7fe3140ad200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44878/0 (socket says 172.21.15.73:44878) 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe318c2a640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe31415c2a0 0x7fe3140aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.73:36594/0 (socket says 172.21.15.73:36594) 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe319c2c640 1 -- 172.21.15.73:0/1786911181 learned_addr learned my addr 172.21.15.73:0/1786911181 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe318c2a640 1 -- 172.21.15.73:0/1786911181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 msgr2=0x7fe31406e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe318c2a640 1 --2- 172.21.15.73:0/1786911181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31406e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe318c2a640 1 -- 172.21.15.73:0/1786911181 >> v1:172.21.15.150:6789/0 conn(0x7fe31415bec0 legacy=0x7fe3140ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.113+0000 7fe318c2a640 1 -- 172.21.15.73:0/1786911181 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3140b3b30 con 0x7fe31415c2a0 2024-09-12T03:38:42.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe318c2a640 1 --2- 172.21.15.73:0/1786911181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 0x7fe3140aed60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe3080097c0 tx=0x7fe30801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3f824aee083a1ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe313fff640 1 -- 172.21.15.73:0/1786911181 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3080a7070 con 0x7fe31415c2a0 2024-09-12T03:38:42.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe313fff640 1 -- 172.21.15.73:0/1786911181 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3080b0070 con 0x7fe31415c2a0 2024-09-12T03:38:42.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe313fff640 1 -- 172.21.15.73:0/1786911181 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3080ab890 con 0x7fe31415c2a0 2024-09-12T03:38:42.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 -- 172.21.15.73:0/1786911181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 msgr2=0x7fe3140aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 --2- 172.21.15.73:0/1786911181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 0x7fe3140aed60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe3080097c0 tx=0x7fe30801c470 comp rx=0 tx=0).stop 2024-09-12T03:38:42.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 -- 172.21.15.73:0/1786911181 shutdown_connections 2024-09-12T03:38:42.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 --2- 172.21.15.73:0/1786911181 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31406e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 --2- 172.21.15.73:0/1786911181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 0x7fe3140aed60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 -- 172.21.15.73:0/1786911181 >> 172.21.15.73:0/1786911181 conn(0x7fe3140b1f90 msgr2=0x7fe3140b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:42.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 -- 172.21.15.73:0/1786911181 shutdown_connections 2024-09-12T03:38:42.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 -- 172.21.15.73:0/1786911181 wait complete. 2024-09-12T03:38:42.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 Processor -- start 2024-09-12T03:38:42.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.117+0000 7fe31b68f640 1 -- start start 2024-09-12T03:38:42.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31414a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe31415bec0 0x7fe314157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 0x7fe314148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe31406ed50 con 0x7fe31415bec0 2024-09-12T03:38:42.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fe3140af6b0 con 0x7fe31415c2a0 2024-09-12T03:38:42.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fe31406eed0 con 0x7fe3140af2a0 2024-09-12T03:38:42.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe31415bec0 0x7fe314157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe31415bec0 0x7fe314157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47602/0 (socket says 172.21.15.73:47602) 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 -- 172.21.15.73:0/830209392 learned_addr learned my addr 172.21.15.73:0/830209392 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe319c2c640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 0x7fe314148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31942b640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31414a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 -- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 msgr2=0x7fe31414a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31414a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 -- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 msgr2=0x7fe314148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 0x7fe314148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 -- 172.21.15.73:0/830209392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe314155c90 con 0x7fe31415bec0 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe318c2a640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe31415bec0 0x7fe314157a10 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe30801ab20 tx=0x7fe308019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe311ffb640 1 -- 172.21.15.73:0/830209392 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3080abb90 con 0x7fe31415bec0 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe311ffb640 1 -- 172.21.15.73:0/830209392 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3080abd30 con 0x7fe31415bec0 2024-09-12T03:38:42.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe314158080 con 0x7fe31415bec0 2024-09-12T03:38:42.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe311ffb640 1 -- 172.21.15.73:0/830209392 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3080bf690 con 0x7fe31415bec0 2024-09-12T03:38:42.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe314154050 con 0x7fe31415bec0 2024-09-12T03:38:42.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe31406e000 con 0x7fe31415bec0 2024-09-12T03:38:42.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe311ffb640 1 -- 172.21.15.73:0/830209392 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe3080bf830 con 0x7fe31415bec0 2024-09-12T03:38:42.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe311ffb640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3000678f0 0x7fe300069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe31942b640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3000678f0 0x7fe300069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.121+0000 7fe311ffb640 1 -- 172.21.15.73:0/830209392 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7fe308120280 con 0x7fe31415bec0 2024-09-12T03:38:42.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.125+0000 7fe31942b640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3000678f0 0x7fe300069db0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe304000f70 tx=0x7fe304007cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.129+0000 7fe311ffb640 1 -- 172.21.15.73:0/830209392 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe308016090 con 0x7fe31415bec0 2024-09-12T03:38:42.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe31406fcd0 con 0x7fe3000678f0 2024-09-12T03:38:42.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe311ffb640 1 -- 172.21.15.73:0/830209392 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe31406fcd0 con 0x7fe3000678f0 2024-09-12T03:38:42.277 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3000678f0 msgr2=0x7fe300069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3000678f0 0x7fe300069db0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe304000f70 tx=0x7fe304007cd0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe31415bec0 msgr2=0x7fe314157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe31415bec0 0x7fe314157a10 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe30801ab20 tx=0x7fe308019210 comp rx=0 tx=0).stop 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 shutdown_connections 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fe3000678f0 0x7fe300069db0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe31415bec0 0x7fe314157a10 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe31415c2a0 0x7fe314148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 --2- 172.21.15.73:0/830209392 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fe3140af2a0 0x7fe31414a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 >> 172.21.15.73:0/830209392 conn(0x7fe3140b1f90 msgr2=0x7fe3141599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 shutdown_connections 2024-09-12T03:38:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.277+0000 7fe31b68f640 1 -- 172.21.15.73:0/830209392 wait complete. 2024-09-12T03:38:42.295 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T03:38:42.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T03:38:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c5b843640 1 Processor -- start 2024-09-12T03:38:42.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c5b843640 1 -- start start 2024-09-12T03:38:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c5b843640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c54161a60 0x7f1c540d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c5b843640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c540d32b0 con 0x7f1c540d2e90 2024-09-12T03:38:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c5b843640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c540d0300 con 0x7f1c540cf620 2024-09-12T03:38:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c5b843640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1c540cfa90 con 0x7f1c54161a60 2024-09-12T03:38:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c595df640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c54161a60 0x7f1c540d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c58dde640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1c540d2e90 0x7f1c540cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42632/0 (socket says 172.21.15.73:42632) 2024-09-12T03:38:42.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c58dde640 1 -- 172.21.15.73:0/4085099687 learned_addr learned my addr 172.21.15.73:0/4085099687 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c595df640 1 -- 172.21.15.73:0/4085099687 >> v1:172.21.15.150:6789/0 conn(0x7f1c540cf620 legacy=0x7f1c5406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c595df640 1 -- 172.21.15.73:0/4085099687 >> v1:172.21.15.73:6789/0 conn(0x7f1c540d2e90 legacy=0x7f1c540cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c595df640 1 -- 172.21.15.73:0/4085099687 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c540b0f60 con 0x7f1c54161a60 2024-09-12T03:38:42.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.421+0000 7f1c4bfff640 1 -- 172.21.15.73:0/4085099687 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851159129 0 0) 0x7f1c540d32b0 con 0x7f1c540d2e90 2024-09-12T03:38:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c595df640 1 --2- 172.21.15.73:0/4085099687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540d2950 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097c0 tx=0x7f1c5001c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef6b101afe49896 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c4bfff640 1 -- 172.21.15.73:0/4085099687 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c500b0070 con 0x7f1c54161a60 2024-09-12T03:38:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c4bfff640 1 -- 172.21.15.73:0/4085099687 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c500a4e50 con 0x7f1c54161a60 2024-09-12T03:38:42.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c4bfff640 1 -- 172.21.15.73:0/4085099687 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c500ab820 con 0x7f1c54161a60 2024-09-12T03:38:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- 172.21.15.73:0/4085099687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 msgr2=0x7f1c540d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 --2- 172.21.15.73:0/4085099687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540d2950 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097c0 tx=0x7f1c5001c1c0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- 172.21.15.73:0/4085099687 shutdown_connections 2024-09-12T03:38:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 --2- 172.21.15.73:0/4085099687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540d2950 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- 172.21.15.73:0/4085099687 >> 172.21.15.73:0/4085099687 conn(0x7f1c5408bf90 msgr2=0x7f1c5409d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- 172.21.15.73:0/4085099687 shutdown_connections 2024-09-12T03:38:42.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- 172.21.15.73:0/4085099687 wait complete. 2024-09-12T03:38:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 Processor -- start 2024-09-12T03:38:42.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- start start 2024-09-12T03:38:42.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c540cf620 0x7f1c54153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c540d2e90 0x7f1c540b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5416bf30 con 0x7f1c54161a60 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5406d190 con 0x7f1c540d2e90 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c5b843640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f1c5416c0b0 con 0x7f1c540cf620 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47622/0 (socket says 172.21.15.73:47622) 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 -- 172.21.15.73:0/225011698 learned_addr learned my addr 172.21.15.73:0/225011698 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:42.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 -- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c540cf620 msgr2=0x7f1c54153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f1c540cf620 0x7f1c54153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 -- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c540d2e90 msgr2=0x7f1c540b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c540d2e90 0x7f1c540b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 -- 172.21.15.73:0/225011698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c540b99c0 con 0x7f1c54161a60 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.425+0000 7f1c59de0640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540b3d40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c780 tx=0x7f1c4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c004b70 con 0x7f1c54161a60 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c4c004d10 con 0x7f1c54161a60 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c540b9ca0 con 0x7f1c54161a60 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c00aa90 con 0x7f1c54161a60 2024-09-12T03:38:42.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c54157b40 con 0x7f1c54161a60 2024-09-12T03:38:42.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c540d1550 con 0x7f1c54161a60 2024-09-12T03:38:42.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c4c00ac30 con 0x7f1c54161a60 2024-09-12T03:38:42.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f1c4c0864a0 con 0x7f1c54161a60 2024-09-12T03:38:42.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c595df640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1c380678c0 0x7f1c38069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f1c3806dd60 0x7f1c380701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 --> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c38070870 con 0x7f1c3806dd60 2024-09-12T03:38:42.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f1c4c086930 con 0x7f1c54161a60 2024-09-12T03:38:42.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c595df640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1c380678c0 0x7f1c38069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c500ad000 tx=0x7f1c50008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c58dde640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f1c3806dd60 0x7f1c380701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.429+0000 7f1c58dde640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f1c3806dd60 0x7f1c380701a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.433+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== osd.7 v2:172.21.15.150:6808/1242295682 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c38070870 con 0x7f1c3806dd60 2024-09-12T03:38:42.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 --> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1c540d1270 con 0x7f1c3806dd60 2024-09-12T03:38:42.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c49ffb640 1 -- 172.21.15.73:0/225011698 <== osd.7 v2:172.21.15.150:6808/1242295682 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1c540d1270 con 0x7f1c3806dd60 2024-09-12T03:38:42.447 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-12T03:38:42.447 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T03:38:42.447 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f1c3806dd60 msgr2=0x7f1c380701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.150:6808/1242295682,v1:172.21.15.150:6809/1242295682] conn(0x7f1c3806dd60 0x7f1c380701a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1c380678c0 msgr2=0x7f1c38069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f1c380678c0 0x7f1c38069d80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c500ad000 tx=0x7f1c50008040 comp rx=0 tx=0).stop 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 msgr2=0x7f1c540b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 --2- 172.21.15.73:0/225011698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c54161a60 0x7f1c540b3d40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c780 tx=0x7f1c4c00cc40 comp rx=0 tx=0).stop 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c59de0640 1 -- 172.21.15.73:0/225011698 reap_dead start 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 shutdown_connections 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 >> 172.21.15.73:0/225011698 conn(0x7f1c5408bf90 msgr2=0x7f1c540cef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 shutdown_connections 2024-09-12T03:38:42.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.445+0000 7f1c5b843640 1 -- 172.21.15.73:0/225011698 wait complete. 2024-09-12T03:38:42.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T03:38:42.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e2833640 1 Processor -- start 2024-09-12T03:38:42.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e2833640 1 -- start start 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e2833640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f29dc071e40 0x7f29dc141350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e2833640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29dc141890 0x7f29dc141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e2833640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc072380 con 0x7f29dc140f70 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e2833640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc072660 con 0x7f29dc141890 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e2833640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f29dc0d15e0 con 0x7f29dc071e40 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29dbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f29dc140f70 0x7f29dc071730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:42642/0 (socket says 172.21.15.73:42642) 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29dbfff640 1 -- 172.21.15.73:0/1500394150 learned_addr learned my addr 172.21.15.73:0/1500394150 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29e0dd0640 1 --2- 172.21.15.73:0/1500394150 >> v2:172.21.15.73:3300/0 conn(0x7f29dc141890 0x7f29dc141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.581+0000 7f29db7fe640 1 --2- 172.21.15.73:0/1500394150 >> v2:172.21.15.150:3300/0 conn(0x7f29dc071e40 0x7f29dc141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e0dd0640 1 -- 172.21.15.73:0/1500394150 >> v2:172.21.15.150:3300/0 conn(0x7f29dc071e40 msgr2=0x7f29dc141350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:42.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e0dd0640 1 --2- 172.21.15.73:0/1500394150 >> v2:172.21.15.150:3300/0 conn(0x7f29dc071e40 0x7f29dc141350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e0dd0640 1 -- 172.21.15.73:0/1500394150 >> v1:172.21.15.73:6789/0 conn(0x7f29dc140f70 legacy=0x7f29dc071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e0dd0640 1 -- 172.21.15.73:0/1500394150 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0d0f90 con 0x7f29dc141890 2024-09-12T03:38:42.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29db7fe640 1 --2- 172.21.15.73:0/1500394150 >> v2:172.21.15.150:3300/0 conn(0x7f29dc071e40 0x7f29dc141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:42.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e0dd0640 1 --2- 172.21.15.73:0/1500394150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc141890 0x7f29dc141ce0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0d2e50 tx=0x7f29d401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae6fb3d795782b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29daffd640 1 -- 172.21.15.73:0/1500394150 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40b2070 con 0x7f29dc141890 2024-09-12T03:38:42.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29daffd640 1 -- 172.21.15.73:0/1500394150 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d40a5900 con 0x7f29dc141890 2024-09-12T03:38:42.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29daffd640 1 -- 172.21.15.73:0/1500394150 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d40a5cd0 con 0x7f29dc141890 2024-09-12T03:38:42.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 -- 172.21.15.73:0/1500394150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc141890 msgr2=0x7f29dc141ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 --2- 172.21.15.73:0/1500394150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc141890 0x7f29dc141ce0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0d2e50 tx=0x7f29d401c930 comp rx=0 tx=0).stop 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 -- 172.21.15.73:0/1500394150 shutdown_connections 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 --2- 172.21.15.73:0/1500394150 >> v2:172.21.15.150:3300/0 conn(0x7f29dc071e40 0x7f29dc141350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 --2- 172.21.15.73:0/1500394150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc141890 0x7f29dc141ce0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 -- 172.21.15.73:0/1500394150 >> 172.21.15.73:0/1500394150 conn(0x7f29dc0b3e70 msgr2=0x7f29dc0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 -- 172.21.15.73:0/1500394150 shutdown_connections 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.585+0000 7f29e2833640 1 -- 172.21.15.73:0/1500394150 wait complete. 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 Processor -- start 2024-09-12T03:38:42.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 -- start start 2024-09-12T03:38:42.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29dc071e40 0x7f29dc15aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc140f70 0x7f29dc13e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29dc141890 0x7f29dc1f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0d2670 con 0x7f29dc140f70 2024-09-12T03:38:42.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc0d24f0 con 0x7f29dc071e40 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f29dc0d27f0 con 0x7f29dc141890 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc140f70 0x7f29dc13e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc140f70 0x7f29dc13e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47628/0 (socket says 172.21.15.73:47628) 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 -- 172.21.15.73:0/708336997 learned_addr learned my addr 172.21.15.73:0/708336997 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e0dd0640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29dc141890 0x7f29dc1f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29dbfff640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29dc071e40 0x7f29dc15aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 -- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29dc141890 msgr2=0x7f29dc1f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29dc141890 0x7f29dc1f4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 -- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29dc071e40 msgr2=0x7f29dc15aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29dc071e40 0x7f29dc15aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 -- 172.21.15.73:0/708336997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc15de40 con 0x7f29dc140f70 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29db7fe640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc140f70 0x7f29dc13e790 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c7f0 tx=0x7f29d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29d8ff9640 1 -- 172.21.15.73:0/708336997 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0015070 con 0x7f29dc140f70 2024-09-12T03:38:42.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29d8ff9640 1 -- 172.21.15.73:0/708336997 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0007a30 con 0x7f29dc140f70 2024-09-12T03:38:42.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc15e120 con 0x7f29dc140f70 2024-09-12T03:38:42.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29d8ff9640 1 -- 172.21.15.73:0/708336997 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0007e20 con 0x7f29dc140f70 2024-09-12T03:38:42.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29dc15e6e0 con 0x7f29dc140f70 2024-09-12T03:38:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc141350 con 0x7f29dc140f70 2024-09-12T03:38:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29d8ff9640 1 -- 172.21.15.73:0/708336997 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29d0018070 con 0x7f29dc140f70 2024-09-12T03:38:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29d8ff9640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29c80678c0 0x7f29c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29d8ff9640 1 -- 172.21.15.73:0/708336997 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f29d0085e30 con 0x7f29dc140f70 2024-09-12T03:38:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.589+0000 7f29dbfff640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29c80678c0 0x7f29c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.593+0000 7f29dbfff640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29c80678c0 0x7f29c8069d80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f29cc000f70 tx=0x7f29cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.593+0000 7f29d8ff9640 1 -- 172.21.15.73:0/708336997 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f29d0056c50 con 0x7f29dc140f70 2024-09-12T03:38:42.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.757+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f29dc15a1f0 con 0x7f29c80678c0 2024-09-12T03:38:42.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.757+0000 7f29d8ff9640 1 -- 172.21.15.73:0/708336997 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f29dc15a1f0 con 0x7f29c80678c0 2024-09-12T03:38:42.759 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29c80678c0 msgr2=0x7f29c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29c80678c0 0x7f29c8069d80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f29cc000f70 tx=0x7f29cc009040 comp rx=0 tx=0).stop 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc140f70 msgr2=0x7f29dc13e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc140f70 0x7f29dc13e790 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c7f0 tx=0x7f29d000ccb0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 shutdown_connections 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f29c80678c0 0x7f29c8069d80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29dc140f70 0x7f29dc13e790 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f29dc141890 0x7f29dc1f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 --2- 172.21.15.73:0/708336997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29dc071e40 0x7f29dc15aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 >> 172.21.15.73:0/708336997 conn(0x7f29dc0b3e70 msgr2=0x7f29dc144850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:42.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 shutdown_connections 2024-09-12T03:38:42.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.761+0000 7f29e2833640 1 -- 172.21.15.73:0/708336997 wait complete. 2024-09-12T03:38:42.777 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:38:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc2a50d640 1 Processor -- start 2024-09-12T03:38:42.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc2a50d640 1 -- start start 2024-09-12T03:38:42.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc2a50d640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc240b39a0 0x7fbc2406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc2a50d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc2406e4b0 0x7fbc24072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc2a50d640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2406ec60 con 0x7fbc241587a0 2024-09-12T03:38:42.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc2a50d640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7fbc2406f870 con 0x7fbc240b39a0 2024-09-12T03:38:42.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc2a50d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2406ef40 con 0x7fbc2406e4b0 2024-09-12T03:38:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc28aaa640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc2406e4b0 0x7fbc24072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc237fe640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fbc240b39a0 0x7fbc2406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc23fff640 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fbc241587a0 0x7fbc240b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.73:44888/0 (socket says 172.21.15.73:44888) 2024-09-12T03:38:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc23fff640 1 -- 172.21.15.73:0/1471698223 learned_addr learned my addr 172.21.15.73:0/1471698223 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:38:42.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc28aaa640 1 -- 172.21.15.73:0/1471698223 >> v2:172.21.15.150:3300/0 conn(0x7fbc240b39a0 msgr2=0x7fbc2406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:38:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc28aaa640 1 --2- 172.21.15.73:0/1471698223 >> v2:172.21.15.150:3300/0 conn(0x7fbc240b39a0 0x7fbc2406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc28aaa640 1 -- 172.21.15.73:0/1471698223 >> v1:172.21.15.150:6789/0 conn(0x7fbc241587a0 legacy=0x7fbc240b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc28aaa640 1 -- 172.21.15.73:0/1471698223 --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2406f220 con 0x7fbc2406e4b0 2024-09-12T03:38:42.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.893+0000 7fbc237fe640 1 --2- 172.21.15.73:0/1471698223 >> v2:172.21.15.150:3300/0 conn(0x7fbc240b39a0 0x7fbc2406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T03:38:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc28aaa640 1 --2- 172.21.15.73:0/1471698223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc2406e4b0 0x7fbc24072160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009d90 tx=0x7fbc1c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f542ac6d8385addd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc22ffd640 1 -- 172.21.15.73:0/1471698223 <== mon.2 v2:172.21.15.150:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0b2070 con 0x7fbc2406e4b0 2024-09-12T03:38:42.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc22ffd640 1 -- 172.21.15.73:0/1471698223 <== mon.2 v2:172.21.15.150:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0a5960 con 0x7fbc2406e4b0 2024-09-12T03:38:42.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc22ffd640 1 -- 172.21.15.73:0/1471698223 <== mon.2 v2:172.21.15.150:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0a5d30 con 0x7fbc2406e4b0 2024-09-12T03:38:42.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 -- 172.21.15.73:0/1471698223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc2406e4b0 msgr2=0x7fbc24072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/1471698223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc2406e4b0 0x7fbc24072160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009d90 tx=0x7fbc1c01c940 comp rx=0 tx=0).stop 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 -- 172.21.15.73:0/1471698223 shutdown_connections 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/1471698223 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc2406e4b0 0x7fbc24072160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/1471698223 >> v2:172.21.15.150:3300/0 conn(0x7fbc240b39a0 0x7fbc2406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 -- 172.21.15.73:0/1471698223 >> 172.21.15.73:0/1471698223 conn(0x7fbc240b1f90 msgr2=0x7fbc240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 -- 172.21.15.73:0/1471698223 shutdown_connections 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 -- 172.21.15.73:0/1471698223 wait complete. 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 Processor -- start 2024-09-12T03:38:42.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 -- start start 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc2406e4b0 0x7fbc2414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.897+0000 7fbc2a50d640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc240b39a0 0x7fbc2414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc2a50d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc241587a0 0x7fbc24145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc2a50d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc24073030 con 0x7fbc241587a0 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc2a50d640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7fbc24072eb0 con 0x7fbc2406e4b0 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc2a50d640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7fbc240731b0 con 0x7fbc240b39a0 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc241587a0 0x7fbc24145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc241587a0 0x7fbc24145b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47644/0 (socket says 172.21.15.73:47644) 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 -- 172.21.15.73:0/2672406366 learned_addr learned my addr 172.21.15.73:0/2672406366 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc23fff640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc2406e4b0 0x7fbc2414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc237fe640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc240b39a0 0x7fbc2414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 -- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc240b39a0 msgr2=0x7fbc2414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc240b39a0 0x7fbc2414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 -- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc2406e4b0 msgr2=0x7fbc2414f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc2406e4b0 0x7fbc2414f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 -- 172.21.15.73:0/2672406366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2414c6e0 con 0x7fbc241587a0 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc237fe640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc240b39a0 0x7fbc2414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc28aaa640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc241587a0 0x7fbc24145b60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0b0040 tx=0x7fbc1c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc20ff9640 1 -- 172.21.15.73:0/2672406366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0b2050 con 0x7fbc241587a0 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc20ff9640 1 -- 172.21.15.73:0/2672406366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0be070 con 0x7fbc241587a0 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2414c9c0 con 0x7fbc241587a0 2024-09-12T03:38:42.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc20ff9640 1 -- 172.21.15.73:0/2672406366 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0ada90 con 0x7fbc241587a0 2024-09-12T03:38:42.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc241460a0 con 0x7fbc241587a0 2024-09-12T03:38:42.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc24072160 con 0x7fbc241587a0 2024-09-12T03:38:42.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc20ff9640 1 -- 172.21.15.73:0/2672406366 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbc1c0adc30 con 0x7fbc241587a0 2024-09-12T03:38:42.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc20ff9640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbc100678f0 0x7fbc10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:38:42.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc20ff9640 1 -- 172.21.15.73:0/2672406366 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7fbc1c121800 con 0x7fbc241587a0 2024-09-12T03:38:42.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc23fff640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbc100678f0 0x7fbc10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:38:42.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.901+0000 7fbc23fff640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbc100678f0 0x7fbc10069db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc18000f70 tx=0x7fbc18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:38:42.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:42.905+0000 7fbc20ff9640 1 -- 172.21.15.73:0/2672406366 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbc1c016560 con 0x7fbc241587a0 2024-09-12T03:38:43.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.065+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc2414c490 con 0x7fbc100678f0 2024-09-12T03:38:43.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.065+0000 7fbc20ff9640 1 -- 172.21.15.73:0/2672406366 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13480 (secure 0 0 0) 0x7fbc2414c490 con 0x7fbc100678f0 2024-09-12T03:38:43.066 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:38:43.067 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbc100678f0 msgr2=0x7fbc10069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbc100678f0 0x7fbc10069db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc18000f70 tx=0x7fbc18009040 comp rx=0 tx=0).stop 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc241587a0 msgr2=0x7fbc24145b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc241587a0 0x7fbc24145b60 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0b0040 tx=0x7fbc1c0196e0 comp rx=0 tx=0).stop 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 shutdown_connections 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7fbc100678f0 0x7fbc10069db0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc241587a0 0x7fbc24145b60 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7fbc240b39a0 0x7fbc2414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 --2- 172.21.15.73:0/2672406366 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbc2406e4b0 0x7fbc2414f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 >> 172.21.15.73:0/2672406366 conn(0x7fbc240b1f90 msgr2=0x7fbc240adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:38:43.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 shutdown_connections 2024-09-12T03:38:43.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:38:43.069+0000 7fbc2a50d640 1 -- 172.21.15.73:0/2672406366 wait complete. 2024-09-12T03:38:43.085 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-09-12T03:38:41.861186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260668,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714052,"statfs":{"total":773094113280,"available":772827189248,"internally_reserved":0,"allocated":11411456,"data_stored":5865504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2636995,"num_objects":-47,"num_object_clones":0,"num_object_copies":-94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-223,"num_write_kb":-23159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001948"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":317,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T03:38:35.352730+0000","last_change":"2024-09-12T03:34:28.072202+0000","last_active":"2024-09-12T03:38:35.352730+0000","last_peered":"2024-09-12T03:38:35.352730+0000","last_clean":"2024-09-12T03:38:35.352730+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:35.352730+0000","last_undegraded":"2024-09-12T03:38:35.352730+0000","last_fullsized":"2024-09-12T03:38:35.352730+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T03:34:26.916417+0000","last_clean_scrub_stamp":"2024-09-12T03:34:26.916417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:46:44.488924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509495,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1871872,"data_stored":1175964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32436,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32436,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1871872,"data_stored":1175964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:38:43.089 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T03:34:26.916417+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=3, tm_min=34, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=3, tm_min=38, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T03:38:43.089 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T03:39:03.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T03:39:03.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f7948308640 1 Processor -- start 2024-09-12T03:39:03.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f7948308640 1 -- start start 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f7948308640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79400cf620 0x7f7940168f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f7948308640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79400d0300 con 0x7f7940161a60 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f7948308640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794006e6c0 con 0x7f79400d3060 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f7948308640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f79400cfa90 con 0x7f79400cf620 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79460a4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7940161a60 0x7f79400d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43470/0 (socket says 172.21.15.73:43470) 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79460a4640 1 -- 172.21.15.73:0/3451038 learned_addr learned my addr 172.21.15.73:0/3451038 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79468a5640 1 --2- 172.21.15.73:0/3451038 >> v2:172.21.15.73:3300/0 conn(0x7f79400cf620 0x7f7940168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79450a2640 1 -- 172.21.15.73:0/3451038 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789784957 0 0) 0x7f793c001120 con 0x7f7940161a60 2024-09-12T03:39:03.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79450a2640 1 -- 172.21.15.73:0/3451038 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f792c003530 con 0x7f7940161a60 2024-09-12T03:39:03.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79468a5640 1 -- 172.21.15.73:0/3451038 >> v1:172.21.15.150:6789/0 conn(0x7f79400d3060 legacy=0x7f79400cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:39:03.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79468a5640 1 -- 172.21.15.73:0/3451038 >> v1:172.21.15.73:6789/0 conn(0x7f7940161a60 legacy=0x7f79400d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.225+0000 7f79468a5640 1 -- 172.21.15.73:0/3451038 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79400b0f60 con 0x7f79400cf620 2024-09-12T03:39:03.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79468a5640 1 --2- 172.21.15.73:0/3451038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400cf620 0x7f7940168f10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7938009d90 tx=0x7f793801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf24695222a5bde server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79450a2640 1 -- 172.21.15.73:0/3451038 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79380b2070 con 0x7f79400cf620 2024-09-12T03:39:03.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79450a2640 1 -- 172.21.15.73:0/3451038 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79380a5930 con 0x7f79400cf620 2024-09-12T03:39:03.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79450a2640 1 -- 172.21.15.73:0/3451038 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79380a5ce0 con 0x7f79400cf620 2024-09-12T03:39:03.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- 172.21.15.73:0/3451038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400cf620 msgr2=0x7f7940168f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 --2- 172.21.15.73:0/3451038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400cf620 0x7f7940168f10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7938009d90 tx=0x7f793801c870 comp rx=0 tx=0).stop 2024-09-12T03:39:03.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- 172.21.15.73:0/3451038 shutdown_connections 2024-09-12T03:39:03.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 --2- 172.21.15.73:0/3451038 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400cf620 0x7f7940168f10 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- 172.21.15.73:0/3451038 >> 172.21.15.73:0/3451038 conn(0x7f794008bf90 msgr2=0x7f794009d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:39:03.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- 172.21.15.73:0/3451038 shutdown_connections 2024-09-12T03:39:03.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- 172.21.15.73:0/3451038 wait complete. 2024-09-12T03:39:03.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 Processor -- start 2024-09-12T03:39:03.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- start start 2024-09-12T03:39:03.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79400cf620 0x7f79400b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400d3060 0x7f7940150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7940161a60 0x7f79400b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f794016bc70 con 0x7f79400d3060 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f794006d190 con 0x7f7940161a60 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f7948308640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f794016bdf0 con 0x7f79400cf620 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400d3060 0x7f7940150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400d3060 0x7f7940150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57314/0 (socket says 172.21.15.73:57314) 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 -- 172.21.15.73:0/1888603215 learned_addr learned my addr 172.21.15.73:0/1888603215 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79468a5640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7940161a60 0x7f79400b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79460a4640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79400cf620 0x7f79400b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 -- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79400cf620 msgr2=0x7f79400b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79400cf620 0x7f79400b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 -- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7940161a60 msgr2=0x7f79400b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7940161a60 0x7f79400b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.229+0000 7f79458a3640 1 -- 172.21.15.73:0/1888603215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79400b76e0 con 0x7f79400d3060 2024-09-12T03:39:03.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f79458a3640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400d3060 0x7f7940150ef0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f793000c450 tx=0x7f793000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7936ffd640 1 -- 172.21.15.73:0/1888603215 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930012830 con 0x7f79400d3060 2024-09-12T03:39:03.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7936ffd640 1 -- 172.21.15.73:0/1888603215 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7930017070 con 0x7f79400d3060 2024-09-12T03:39:03.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79400b97b0 con 0x7f79400d3060 2024-09-12T03:39:03.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7936ffd640 1 -- 172.21.15.73:0/1888603215 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930012c30 con 0x7f79400d3060 2024-09-12T03:39:03.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79400b9d70 con 0x7f79400d3060 2024-09-12T03:39:03.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7940157a30 con 0x7f79400d3060 2024-09-12T03:39:03.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7936ffd640 1 -- 172.21.15.73:0/1888603215 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f793001c460 con 0x7f79400d3060 2024-09-12T03:39:03.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7936ffd640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f79240678c0 0x7f7924069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f7936ffd640 1 -- 172.21.15.73:0/1888603215 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f7930085770 con 0x7f79400d3060 2024-09-12T03:39:03.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f79460a4640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f79240678c0 0x7f7924069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.233+0000 7f79460a4640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f79240678c0 0x7f7924069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f793c005890 tx=0x7f793c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.237+0000 7f7936ffd640 1 -- 172.21.15.73:0/1888603215 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7930055e60 con 0x7f79400d3060 2024-09-12T03:39:03.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.397+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 --> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79400b3570 con 0x7f79240678c0 2024-09-12T03:39:03.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.397+0000 7f7936ffd640 1 -- 172.21.15.73:0/1888603215 <== mgr.4101 v2:172.21.15.73:6832/1640828206 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f79400b3570 con 0x7f79240678c0 2024-09-12T03:39:03.398 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:39:03.398 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-12T03:39:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.397+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f79240678c0 msgr2=0x7f7924069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.397+0000 7f7948308640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f79240678c0 0x7f7924069d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f793c005890 tx=0x7f793c009040 comp rx=0 tx=0).stop 2024-09-12T03:39:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.397+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400d3060 msgr2=0x7f7940150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.397+0000 7f7948308640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400d3060 0x7f7940150ef0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f793000c450 tx=0x7f793000c910 comp rx=0 tx=0).stop 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 shutdown_connections 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f79240678c0 0x7f7924069d80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79400d3060 0x7f7940150ef0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7940161a60 0x7f79400b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 --2- 172.21.15.73:0/1888603215 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f79400cf620 0x7f79400b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 >> 172.21.15.73:0/1888603215 conn(0x7f794008bf90 msgr2=0x7f79400b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 shutdown_connections 2024-09-12T03:39:03.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.401+0000 7f7948308640 1 -- 172.21.15.73:0/1888603215 wait complete. 2024-09-12T03:39:03.417 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2024-09-12T03:39:01.866416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260656,"kb_used_data":11144,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714064,"statfs":{"total":773094113280,"available":772827201536,"internally_reserved":0,"allocated":11411456,"data_stored":5865504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":255315507},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003175"},"pg_stats":[{"pgid":"1.0","version":"103'119","reported_seq":328,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T03:38:43.545860+0000","last_change":"2024-09-12T03:38:43.545927+0000","last_active":"2024-09-12T03:38:43.545860+0000","last_peered":"2024-09-12T03:38:43.545860+0000","last_clean":"2024-09-12T03:38:43.545860+0000","last_became_active":"2024-09-12T03:34:28.070401+0000","last_became_peered":"2024-09-12T03:34:28.070401+0000","last_unstale":"2024-09-12T03:38:43.545860+0000","last_undegraded":"2024-09-12T03:38:43.545860+0000","last_fullsized":"2024-09-12T03:38:43.545860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'119","last_scrub_stamp":"2024-09-12T03:38:43.545702+0000","last_deep_scrub":"103'119","last_deep_scrub_stamp":"2024-09-12T03:38:43.545702+0000","last_clean_scrub_stamp":"2024-09-12T03:38:43.545702+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:47.155545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33012,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338828,"statfs":{"total":96636764160,"available":96602959872,"internally_reserved":0,"allocated":1871872,"data_stored":1175964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32436,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32436,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":585596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33012,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338828,"statfs":{"total":96636764160,"available":96602959872,"internally_reserved":0,"allocated":1871872,"data_stored":1175964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T03:39:03.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T03:39:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.541+0000 7f0aa72a6640 1 Processor -- start 2024-09-12T03:39:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.541+0000 7f0aa72a6640 1 -- start start 2024-09-12T03:39:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.541+0000 7f0aa72a6640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0aa01587a0 0x7f0aa00b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.541+0000 7f0aa72a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0aa006e680 0x7f0aa0072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.541+0000 7f0aa72a6640 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aa006ec60 con 0x7f0aa00b37d0 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.541+0000 7f0aa72a6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0aa00b3c40 con 0x7f0aa006e680 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.541+0000 7f0aa72a6640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f0aa006f870 con 0x7f0aa01587a0 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0aa006e680 0x7f0aa0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0aa006e680 0x7f0aa0072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57318/0 (socket says 172.21.15.73:57318) 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 -- 172.21.15.73:0/3986523606 learned_addr learned my addr 172.21.15.73:0/3986523606 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5042640 1 --2- 172.21.15.73:0/3986523606 >> v2:172.21.15.150:3300/0 conn(0x7f0aa01587a0 0x7f0aa00b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 -- 172.21.15.73:0/3986523606 >> v2:172.21.15.150:3300/0 conn(0x7f0aa01587a0 msgr2=0x7f0aa00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 --2- 172.21.15.73:0/3986523606 >> v2:172.21.15.150:3300/0 conn(0x7f0aa01587a0 0x7f0aa00b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 -- 172.21.15.73:0/3986523606 >> v1:172.21.15.150:6789/0 conn(0x7f0aa00b37d0 legacy=0x7f0aa006df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 -- 172.21.15.73:0/3986523606 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa006ef40 con 0x7f0aa006e680 2024-09-12T03:39:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5042640 1 --2- 172.21.15.73:0/3986523606 >> v2:172.21.15.150:3300/0 conn(0x7f0aa01587a0 0x7f0aa00b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T03:39:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa5843640 1 --2- 172.21.15.73:0/3986523606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa0072160 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0071710 tx=0x7f0a9801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3035ef4d8944b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0a97fff640 1 -- 172.21.15.73:0/3986523606 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a980a5880 con 0x7f0aa006e680 2024-09-12T03:39:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0a97fff640 1 -- 172.21.15.73:0/3986523606 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a980a5a20 con 0x7f0aa006e680 2024-09-12T03:39:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0a97fff640 1 -- 172.21.15.73:0/3986523606 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a980a5df0 con 0x7f0aa006e680 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa72a6640 1 -- 172.21.15.73:0/3986523606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 msgr2=0x7f0aa0072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/3986523606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa0072160 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0071710 tx=0x7f0a9801c9c0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa72a6640 1 -- 172.21.15.73:0/3986523606 shutdown_connections 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/3986523606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa0072160 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/3986523606 >> v2:172.21.15.150:3300/0 conn(0x7f0aa01587a0 0x7f0aa00b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.545+0000 7f0aa72a6640 1 -- 172.21.15.73:0/3986523606 >> 172.21.15.73:0/3986523606 conn(0x7f0aa00b1f90 msgr2=0x7f0aa00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- 172.21.15.73:0/3986523606 shutdown_connections 2024-09-12T03:39:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- 172.21.15.73:0/3986523606 wait complete. 2024-09-12T03:39:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 Processor -- start 2024-09-12T03:39:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- start start 2024-09-12T03:39:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa00aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0aa00b37d0 0x7f0aa015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0aa01587a0 0x7f0aa015d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa0073030 con 0x7f0aa006e680 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa0072eb0 con 0x7f0aa01587a0 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f0aa00731b0 con 0x7f0aa00b37d0 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa00aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa00aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57332/0 (socket says 172.21.15.73:57332) 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 -- 172.21.15.73:0/1465597100 learned_addr learned my addr 172.21.15.73:0/1465597100 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5843640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0aa01587a0 0x7f0aa015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 -- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0aa00b37d0 msgr2=0x7f0aa015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa4841640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0aa00b37d0 0x7f0aa015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0aa00b37d0 0x7f0aa015cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 -- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0aa01587a0 msgr2=0x7f0aa015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0aa01587a0 0x7f0aa015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 -- 172.21.15.73:0/1465597100 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa009d090 con 0x7f0aa006e680 2024-09-12T03:39:03.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5843640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0aa01587a0 0x7f0aa015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:39:03.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa5042640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa00aee10 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00d830 tx=0x7f0a9c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c018020 con 0x7f0aa006e680 2024-09-12T03:39:03.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0096c0 con 0x7f0aa006e680 2024-09-12T03:39:03.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa009d370 con 0x7f0aa006e680 2024-09-12T03:39:03.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c009ab0 con 0x7f0aa006e680 2024-09-12T03:39:03.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa009d930 con 0x7f0aa006e680 2024-09-12T03:39:03.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.549+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa0072160 con 0x7f0aa006e680 2024-09-12T03:39:03.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.553+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0a9c01b020 con 0x7f0aa006e680 2024-09-12T03:39:03.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.553+0000 7f0a95ffb640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a840678c0 0x7f0a84069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.553+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f0a9c0865f0 con 0x7f0aa006e680 2024-09-12T03:39:03.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.553+0000 7f0aa4841640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a840678c0 0x7f0a84069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.553+0000 7f0aa4841640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a840678c0 0x7f0a84069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007fd0 tx=0x7f0a90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.557+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a9c022020 con 0x7f0aa006e680 2024-09-12T03:39:03.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.717+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0aa0070080 con 0x7f0aa006e680 2024-09-12T03:39:03.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.721+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7f0a9c057410 con 0x7f0aa006e680 2024-09-12T03:39:03.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0a95ffb640 1 -- 172.21.15.73:0/1465597100 <== mon.0 v2:172.21.15.73:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0a9c056d10 con 0x7f0aa006e680 2024-09-12T03:39:03.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a840678c0 msgr2=0x7f0a84069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a840678c0 0x7f0a84069d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007fd0 tx=0x7f0a90009040 comp rx=0 tx=0).stop 2024-09-12T03:39:03.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 msgr2=0x7f0aa00aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa00aee10 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00d830 tx=0x7f0a9c00dcf0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 shutdown_connections 2024-09-12T03:39:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f0a840678c0 0x7f0a84069d80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0aa01587a0 0x7f0aa015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f0aa00b37d0 0x7f0aa015cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 --2- 172.21.15.73:0/1465597100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa006e680 0x7f0aa00aee10 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 >> 172.21.15.73:0/1465597100 conn(0x7f0aa00b1f90 msgr2=0x7f0aa01605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:39:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 shutdown_connections 2024-09-12T03:39:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.725+0000 7f0aa72a6640 1 -- 172.21.15.73:0/1465597100 wait complete. 2024-09-12T03:39:03.745 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T03:39:03.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T03:39:03.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63fe0af640 1 Processor -- start 2024-09-12T03:39:03.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63fe0af640 1 -- start start 2024-09-12T03:39:03.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63fe0af640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63f8161a60 0x7f63f80d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63fe0af640 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f63f80cf620 0x7f63f806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63fe0af640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63f80d32b0 con 0x7f63f80d2e90 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63fe0af640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f63f80d0300 con 0x7f63f8161a60 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63fe0af640 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 -- 0x7f63f80cfa90 con 0x7f63f80cf620 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63f8161a60 0x7f63f80d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63f8161a60 0x7f63f80d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57344/0 (socket says 172.21.15.73:57344) 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 -- 172.21.15.73:0/358748519 learned_addr learned my addr 172.21.15.73:0/358748519 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f6ffd640 1 --1- 172.21.15.73:0/358748519 >> v1:172.21.15.73:6789/0 conn(0x7f63f80d2e90 0x7f63f80cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43480/0 (socket says 172.21.15.73:43480) 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f7fff640 1 --2- 172.21.15.73:0/358748519 >> v2:172.21.15.150:3300/0 conn(0x7f63f80cf620 0x7f63f806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 -- 172.21.15.73:0/358748519 >> v2:172.21.15.150:3300/0 conn(0x7f63f80cf620 msgr2=0x7f63f806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 --2- 172.21.15.73:0/358748519 >> v2:172.21.15.150:3300/0 conn(0x7f63f80cf620 0x7f63f806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 -- 172.21.15.73:0/358748519 >> v1:172.21.15.73:6789/0 conn(0x7f63f80d2e90 legacy=0x7f63f80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 -- 172.21.15.73:0/358748519 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f80b0f60 con 0x7f63f8161a60 2024-09-12T03:39:03.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.861+0000 7f63f77fe640 1 --2- 172.21.15.73:0/358748519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f80d2950 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f63f80ce950 tx=0x7f63e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0c4f98d24afebc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f67fc640 1 -- 172.21.15.73:0/358748519 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80ab660 con 0x7f63f8161a60 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f67fc640 1 -- 172.21.15.73:0/358748519 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f63e80b0070 con 0x7f63f8161a60 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f67fc640 1 -- 172.21.15.73:0/358748519 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e80aba40 con 0x7f63f8161a60 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- 172.21.15.73:0/358748519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 msgr2=0x7f63f80d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 --2- 172.21.15.73:0/358748519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f80d2950 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f63f80ce950 tx=0x7f63e801c460 comp rx=0 tx=0).stop 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- 172.21.15.73:0/358748519 shutdown_connections 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 --2- 172.21.15.73:0/358748519 >> v2:172.21.15.150:3300/0 conn(0x7f63f80cf620 0x7f63f806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 --2- 172.21.15.73:0/358748519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f80d2950 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- 172.21.15.73:0/358748519 >> 172.21.15.73:0/358748519 conn(0x7f63f808bf90 msgr2=0x7f63f809d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- 172.21.15.73:0/358748519 shutdown_connections 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- 172.21.15.73:0/358748519 wait complete. 2024-09-12T03:39:03.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 Processor -- start 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- start start 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 --2- >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63f80cf620 0x7f63f8154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f80d2e90 0x7f63f8155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f81606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f63f806e400 con 0x7f63f8161a60 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 -- 0x7f63f806d190 con 0x7f63f80d2e90 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63fe0af640 1 -- --> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] -- mon_getmap magic: 0 -- 0x7f63f806e580 con 0x7f63f80cf620 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f81606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f81606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57360/0 (socket says 172.21.15.73:57360) 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f7fff640 1 -- 172.21.15.73:0/3811301068 learned_addr learned my addr 172.21.15.73:0/3811301068 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f77fe640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63f80cf620 0x7f63f8154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f6ffd640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f80d2e90 0x7f63f8155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f7fff640 1 -- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63f80cf620 msgr2=0x7f63f8154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.865+0000 7f63f7fff640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63f80cf620 0x7f63f8154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63f7fff640 1 -- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f80d2e90 msgr2=0x7f63f8155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63f7fff640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f80d2e90 0x7f63f8155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63f7fff640 1 -- 172.21.15.73:0/3811301068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63f80b9030 con 0x7f63f8161a60 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63f6ffd640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f80d2e90 0x7f63f8155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63f7fff640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f81606e0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f63f000cc60 tx=0x7f63f000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63dffff640 1 -- 172.21.15.73:0/3811301068 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00039a0 con 0x7f63f8161a60 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63dffff640 1 -- 172.21.15.73:0/3811301068 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f63f0003b40 con 0x7f63f8161a60 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63f80b9310 con 0x7f63f8161a60 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63dffff640 1 -- 172.21.15.73:0/3811301068 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0004020 con 0x7f63f8161a60 2024-09-12T03:39:03.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63f80b98d0 con 0x7f63f8161a60 2024-09-12T03:39:03.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63f806d6b0 con 0x7f63f8161a60 2024-09-12T03:39:03.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63dffff640 1 -- 172.21.15.73:0/3811301068 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63f00041c0 con 0x7f63f8161a60 2024-09-12T03:39:03.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63dffff640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63e40678c0 0x7f63e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T03:39:03.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63dffff640 1 -- 172.21.15.73:0/3811301068 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5335+0+0 (secure 0 0 0) 0x7f63f00860b0 con 0x7f63f8161a60 2024-09-12T03:39:03.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63f77fe640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63e40678c0 0x7f63e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T03:39:03.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.869+0000 7f63f77fe640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63e40678c0 0x7f63e4069d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f63e80af000 tx=0x7f63e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T03:39:03.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:03.873+0000 7f63dffff640 1 -- 172.21.15.73:0/3811301068 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63f0014030 con 0x7f63f8161a60 2024-09-12T03:39:04.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.065+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63f80c7c40 con 0x7f63f8161a60 2024-09-12T03:39:04.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63dffff640 1 -- 172.21.15.73:0/3811301068 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+3917 (secure 0 0 0) 0x7f63f0056cd0 con 0x7f63f8161a60 2024-09-12T03:39:04.070 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-12T03:39:04.070 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"btime":"2024-09-12T03:38:32:834746+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5521,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/2804939638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":2804939638},{"type":"v1","addr":"172.21.15.150:6833","nonce":2804939638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":5530,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2609449242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2609449242},{"type":"v1","addr":"172.21.15.150:6835","nonce":2609449242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6573,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3463752136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3463752136},{"type":"v1","addr":"172.21.15.73:6835","nonce":3463752136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6816,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1963940952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1963940952},{"type":"v1","addr":"172.21.15.73:6837","nonce":1963940952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[]} 2024-09-12T03:39:04.070 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 58 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63e40678c0 msgr2=0x7f63e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63e40678c0 0x7f63e4069d80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f63e80af000 tx=0x7f63e8008040 comp rx=0 tx=0).stop 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 msgr2=0x7f63f81606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f81606e0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f63f000cc60 tx=0x7f63f000a5c0 comp rx=0 tx=0).stop 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 shutdown_connections 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:6832/1640828206,v1:172.21.15.73:6833/1640828206] conn(0x7f63e40678c0 0x7f63e4069d80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f8161a60 0x7f63f81606e0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:04.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63f80d2e90 0x7f63f8155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 --2- 172.21.15.73:0/3811301068 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x7f63f80cf620 0x7f63f8154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T03:39:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 >> 172.21.15.73:0/3811301068 conn(0x7f63f808bf90 msgr2=0x7f63f80b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T03:39:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 shutdown_connections 2024-09-12T03:39:04.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-12T03:39:04.069+0000 7f63fe0af640 1 -- 172.21.15.73:0/3811301068 wait complete. 2024-09-12T03:39:04.087 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-12T03:39:04.088 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T03:39:04.088 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T03:39:04.088 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.104 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T03:39:04.104 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T03:39:04.105 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.164 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T03:39:04.164 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T03:39:04.164 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.184 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T03:39:04.185 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T03:39:04.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.246 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T03:39:04.246 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T03:39:04.246 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T03:39:04.246 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.320 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T03:39:04.321 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T03:39:04.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.419 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T03:39:04.420 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T03:39:04.420 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-12T03:39:04.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-12T03:39:04.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-12T03:39:04.504 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T03:39:04.504 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T03:39:04.504 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.583 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T03:39:04.583 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T03:39:04.583 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.671 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T03:39:04.671 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T03:39:04.671 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.761 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T03:39:04.761 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T03:39:04.761 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.854 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T03:39:04.854 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T03:39:04.855 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.932 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T03:39:04.932 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T03:39:04.932 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T03:39:04.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.961 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T03:39:04.962 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T03:39:04.962 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:04.989 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T03:39:04.990 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T03:39:04.991 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T03:39:04.991 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:05.018 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T03:39:05.018 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T03:39:05.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:05.050 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T03:39:05.051 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T03:39:05.051 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T03:39:05.114 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T03:39:05.115 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T03:39:05.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T03:39:05.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:39:05.134 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T03:39:05.442 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:39:05.442 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T03:39:05.660 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:39:05.660 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T03:39:05.859 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:39:05.859 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T03:39:06.051 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:39:06.051 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T03:39:06.216 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:39:06.216 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T03:39:06.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:39:06.375 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T03:39:06.509 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:39:06.509 DEBUG:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T03:39:06.659 INFO:tasks.ceph:Archiving mon data... 2024-09-12T03:39:06.661 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/data/mon.a.tgz 2024-09-12T03:39:06.662 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-12T03:39:06.668 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.8SyNZhcWJ5 2024-09-12T03:39:06.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8SyNZhcWJ5 2024-09-12T03:39:06.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.8SyNZhcWJ5 2024-09-12T03:39:06.889 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.8SyNZhcWJ5 is 473KB 2024-09-12T03:39:06.951 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.8SyNZhcWJ5 2024-09-12T03:39:06.956 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/data/mon.b.tgz 2024-09-12T03:39:06.956 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-12T03:39:06.962 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.vX1ufusDr8 2024-09-12T03:39:06.962 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.vX1ufusDr8 2024-09-12T03:39:07.148 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.vX1ufusDr8 2024-09-12T03:39:07.210 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.vX1ufusDr8 is 617KB 2024-09-12T03:39:07.273 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.vX1ufusDr8 2024-09-12T03:39:07.277 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/data/mon.c.tgz 2024-09-12T03:39:07.278 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2024-09-12T03:39:07.323 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.VTfUK3jdR2 2024-09-12T03:39:07.323 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VTfUK3jdR2 2024-09-12T03:39:07.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.VTfUK3jdR2 2024-09-12T03:39:07.576 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.VTfUK3jdR2 is 618KB 2024-09-12T03:39:07.638 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.VTfUK3jdR2 2024-09-12T03:39:07.643 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T03:39:07.643 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T03:39:07.645 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T03:39:07.705 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T03:39:07.751 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T03:39:07.752 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T03:39:07.753 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/remote/smithi073/crash 2024-09-12T03:39:07.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T03:39:07.768 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/remote/smithi150/crash 2024-09-12T03:39:07.769 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T03:39:07.807 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T03:39:07.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:39:07.813 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T03:39:07.888 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T03:39:07.909 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T03:39:07.943 INFO:tasks.ceph:Compressing logs... 2024-09-12T03:39:07.943 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T03:39:07.953 DEBUG:teuthology.orchestra.run.smithi150:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T03:39:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-09-12T03:39:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35457.log 2024-09-12T03:39:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38377.log 2024-09-12T03:39:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43958.log: /var/log/ceph/ceph-client.admin.35457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2024-09-12T03:39:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2024-09-12T03:39:07.977 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35457.log.gz 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38377.log.gz 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34289.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2024-09-12T03:39:07.978 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36517.log 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39597.log 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36517.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34942.log 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36517.log.gz 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39597.log.gz 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38247.log 2024-09-12T03:39:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.37056.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44073.log 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34942.log.gz 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38247.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 88.7% 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38247.log.gz 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43324.log 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.y.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44073.log.gz 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42207.log 2024-09-12T03:39:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41344.log 2024-09-12T03:39:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43324.log: /var/log/ceph/ceph-client.admin.42207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42911.log 2024-09-12T03:39:07.986 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43324.log.gz 2024-09-12T03:39:07.986 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42207.log.gz 2024-09-12T03:39:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2024-09-12T03:39:07.986 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41344.log.gz 2024-09-12T03:39:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35046.log 2024-09-12T03:39:07.986 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.44882.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38072.log 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42911.log.gz 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45318.log 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38072.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35046.log.gz 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35247.log 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38072.log.gz 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35237.log 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37213.log 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45318.log.gz 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35237.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35247.log.gz 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36296.log 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35237.log.gz 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36628.log 2024-09-12T03:39:07.987 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36296.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37213.log.gz 2024-09-12T03:39:07.988 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36732.log 2024-09-12T03:39:07.988 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36628.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36296.log.gz 2024-09-12T03:39:07.988 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38759.log 2024-09-12T03:39:07.988 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36628.log.gz 2024-09-12T03:39:07.988 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44785.log 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38759.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36732.log.gz 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38098.log 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44785.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38759.log.gz 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44785.log.gz 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38436.log 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45162.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38098.log.gz 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37621.log 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38436.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37383.log 2024-09-12T03:39:07.999 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38436.log.gz 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.37621.log: -- /var/log/ceph/ceph-client.admin.42963.log 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45030.log 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37621.log.gz 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37383.log.gz 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42963.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42963.log.gz 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37465.log/var/log/ceph/ceph-client.admin.45030.log: 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36015.log 2024-09-12T03:39:08.000 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45030.log.gz 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37465.log.gz 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.36015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38995.log 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.0.36015.log.gz 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gz 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40940.log 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39258.log 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38995.log.gz 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41200.log 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41532.log 2024-09-12T03:39:08.001 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39258.log.gz 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40940.log.gz 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38176.log 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41200.log: /var/log/ceph/ceph-client.admin.41532.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41200.log.gz 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42051.log 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41532.log.gz 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41226.log 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45292.log 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42051.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38176.log.gz 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34438.log 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42051.log.gz 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41226.log.gz 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34885.log 2024-09-12T03:39:08.002 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34438.log: 89.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.45292.log.gz --verbose -- /var/log/ceph/ceph-client.admin.43093.log 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34438.log.gz 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37108.log 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43093.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34885.log.gz 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41688.log 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37108.log.gz 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43776.log 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43093.log.gz 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37595.log 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41688.log: /var/log/ceph/ceph-client.admin.43776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41957.log 2024-09-12T03:39:08.003 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41688.log.gz 2024-09-12T03:39:08.004 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43776.log.gz 2024-09-12T03:39:08.004 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2024-09-12T03:39:08.019 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35297.log 2024-09-12T03:39:08.019 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T03:39:08.019 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.35297.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T03:39:08.019 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35645.log 2024-09-12T03:39:08.019 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34473.log 2024-09-12T03:39:08.020 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.35645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29066.log 2024-09-12T03:39:08.036 INFO:teuthology.orchestra.run.smithi150.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.1.35297.log.gz 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29138.log 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.34473.log: /var/log/ceph/ceph-client.admin.29066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29018.log 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr: 88.8%/var/log/ceph/ceph-client.admin.29138.log: -- replaced with /var/log/ceph/ceph-client.1.34473.log.gz 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29066.log.gz 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29138.log.gz 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34594.log 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29018.log.gz 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.3.34594.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35207.log 2024-09-12T03:39:08.037 INFO:teuthology.orchestra.run.smithi150.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.3.34594.log.gz/var/log/ceph/ceph.log: 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29162.log 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.1.35207.log: /var/log/ceph/ceph-mon.c.log: 87.8% -- replaced with /var/log/ceph/ceph-client.1.35207.log.gz 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34902.log 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35055.log 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29162.log: /var/log/ceph/ceph-client.1.34902.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29162.log.gz 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29090.log 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.1.34902.log.gz/var/log/ceph/ceph-client.1.35055.log: 2024-09-12T03:39:08.038 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29090.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.1.35055.log.gz 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29090.log.gz 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29042.log 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35468.log 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29042.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr: 87.6%/var/log/ceph/ceph-client.1.35468.log: -- replaced with /var/log/ceph/ceph-client.admin.29042.log.gz 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.1.35468.log.gz 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29114.log 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34750.log 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-client.admin.29114.log: /var/log/ceph/ceph-client.1.34750.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29114.log.gz 2024-09-12T03:39:08.039 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T03:39:08.040 INFO:teuthology.orchestra.run.smithi150.stderr: 87.4%/var/log/ceph/ceph-mds.b.log: -- replaced with /var/log/ceph/ceph-client.1.34750.log.gz 2024-09-12T03:39:08.040 INFO:teuthology.orchestra.run.smithi150.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T03:39:08.040 INFO:teuthology.orchestra.run.smithi150.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T03:39:08.042 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29186.log 2024-09-12T03:39:08.050 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36571.log 2024-09-12T03:39:08.050 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41957.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37595.log.gz 2024-09-12T03:39:08.050 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37649.log 2024-09-12T03:39:08.050 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41957.log.gz 2024-09-12T03:39:08.050 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34968.log 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36571.log.gz 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37649.log.gz 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34968.log.gz 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42832.log: -- /var/log/ceph/ceph-client.admin.42331.log 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45474.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45396.log 2024-09-12T03:39:08.051 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43015.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35253.log 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45396.log.gz 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38534.log 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35253.log.gz 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40888.log 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38534.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz /var/log/ceph/ceph-client.admin.37934.log 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38534.log.gz 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38403.log 2024-09-12T03:39:08.052 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37934.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40888.log.gz 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40294.log 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37934.log.gz 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43874.log 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37082.log 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38403.log.gz 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40294.log: /var/log/ceph/ceph-client.admin.43874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35463.log 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40294.log.gz 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43874.log.gz 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40028.log 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37082.log.gz 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34197.log 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40028.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35463.log.gz 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35256.log 2024-09-12T03:39:08.053 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40028.log.gz 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37727.log 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43717.log 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35256.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34197.log.gz 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40817.log 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35256.log.gz 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43717.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.37727.log.gz 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43717.log.gz 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37491.log 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43067.log 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40817.log.gz 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40713.log 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37491.log.gz 2024-09-12T03:39:08.054 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39675.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40992.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40713.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43067.log.gz 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38560.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40713.log.gz 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39675.log.gz 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45448.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40992.log.gz 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38560.log: /var/log/ceph/ceph-client.admin.45448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38560.log.gz 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45448.log.gz 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39911.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39859.log 2024-09-12T03:39:08.055 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35020.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45500.log 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39911.log.gz 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43405.log 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42526.log 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39859.log.gz 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43405.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45500.log.gz 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38811.log 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41926.log 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43405.log.gz 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42526.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42526.log.gz 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39047.log 2024-09-12T03:39:08.056 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41926.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38811.log.gz 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41610.log 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41926.log.gz 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43665.log: -- /var/log/ceph/ceph-client.admin.38586.log 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39047.log.gz 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41610.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44960.log 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40268.log 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38586.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41610.log.gz 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44960.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38586.log.gz 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2024-09-12T03:39:08.057 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44960.log.gz 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40268.log.gz 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45266.log: -- /var/log/ceph/ceph-client.0.44495.log 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37322.log 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.44495.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36959.log 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42305.log 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4%/var/log/ceph/ceph-client.admin.36959.log: -- replaced with /var/log/ceph/ceph-client.admin.37322.log.gz 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36210.log 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36959.log.gz 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42305.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42305.log.gz 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42754.log 2024-09-12T03:39:08.058 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36598.log 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36210.log.gz/var/log/ceph/ceph-client.admin.42754.log: 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36400.log 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.44495.log.gz 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42754.log.gz 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36598.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36598.log.gz 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35644.log 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39344.log 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36400.log.gz 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42728.log 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39500.log 2024-09-12T03:39:08.059 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39344.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35644.log.gz 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42728.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39344.log.gz 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35150.log 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42728.log.gz 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40739.log 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39500.log: /var/log/ceph/ceph-client.admin.35150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40601.log 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39500.log.gz 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43353.log 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35150.log.gz 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40739.log.gz 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40601.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40601.log.gz 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34648.log 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40532.log 2024-09-12T03:39:08.060 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43353.log.gz 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42494.log 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39885.log 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr: 91.2%/var/log/ceph/ceph-client.admin.42494.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40532.log.gz 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41018.log 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42494.log.gz 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39885.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39885.log.gz 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36758.log 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35800.log 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41018.log.gz 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36543.log 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36758.log.gz 2024-09-12T03:39:08.061 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36543.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35800.log.gz 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36374.log 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36543.log.gz 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45056.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42435.log 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38785.log 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42435.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36374.log.gz 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38785.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42435.log.gz -- 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.37187.log 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8%/var/log/ceph/ceph-client.admin.36991.log: -- replaced with /var/log/ceph/ceph-client.admin.38785.log.gz 2024-09-12T03:39:08.062 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34698.log 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37187.log: /var/log/ceph/ceph-client.admin.37569.log 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37187.log.gz 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4%/var/log/ceph/ceph-client.admin.37569.log: -- replaced with /var/log/ceph/ceph-client.admin.34698.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34994.log 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37569.log.gz 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43930.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.24011.log 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37777.log 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34994.log: /var/log/ceph/ceph.tmp-client.admin.24011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.24011.log.gz 2024-09-12T03:39:08.063 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34994.log.gz 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37777.log.gz 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36654.log 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34518.log 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34622.log: /var/log/ceph/ceph-client.admin.36654.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gz -5 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38614.log 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8%/var/log/ceph/ceph-client.admin.34518.log: -- replaced with /var/log/ceph/ceph-client.admin.36654.log.gz 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41135.log 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34518.log.gz 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34912.log 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33999.log 2024-09-12T03:39:08.064 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38614.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41135.log: /var/log/ceph/ceph-client.admin.34912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37517.log 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41135.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.33999.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34912.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38221.log 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33999.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39289.log 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37517.log: /var/log/ceph/ceph-client.admin.38221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43535.log 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1%/var/log/ceph/ceph-client.admin.39289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44549.log 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37517.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38221.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39289.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43535.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43535.log.gz 2024-09-12T03:39:08.065 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35774.log 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44549.log.gz 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40861.log 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35774.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41874.log 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35774.log.gz 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40861.log: /var/log/ceph/ceph-client.admin.41874.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41454.log 2024-09-12T03:39:08.066 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40861.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41874.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36270.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43691.log 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41252.log 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43691.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41454.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:gzip 88.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.44311.log 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43691.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41252.log: /var/log/ceph/ceph-client.admin.35462.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41252.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5%/var/log/ceph/ceph-client.admin.39760.log: -- replaced with /var/log/ceph/ceph-client.admin.44311.log.gz 2024-09-12T03:39:08.067 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2024-09-12T03:39:08.068 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-09-12T03:39:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42409.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2024-09-12T03:39:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40372.log 2024-09-12T03:39:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2024-09-12T03:39:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40372.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2024-09-12T03:39:08.068 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38124.log 2024-09-12T03:39:08.070 INFO:teuthology.orchestra.run.smithi150.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.29186.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29186.log.gz 2024-09-12T03:39:08.070 INFO:teuthology.orchestra.run.smithi150.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T03:39:08.070 INFO:teuthology.orchestra.run.smithi150.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.1.35645.log.gz 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40422.log 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44733.log: /var/log/ceph/ceph-client.admin.38124.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40372.log.gz 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38124.log.gz 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42461.log 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42780.log 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42461.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40422.log.gz 2024-09-12T03:39:08.092 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35464.log 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37701.log 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42780.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42461.log.gz 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35464.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42780.log.gz 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41506.log 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41281.log 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37701.log.gz/var/log/ceph/ceph-client.admin.41506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41506.log.gz 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41281.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41281.log.gz 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40110.log 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45526.log 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40110.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2024-09-12T03:39:08.093 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37833.log 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43639.log 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40110.log.gz/var/log/ceph/ceph-client.admin.45526.log: 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.37833.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45526.log.gz 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36862.log 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42155.log 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7%/var/log/ceph/ceph-client.admin.36862.log: -- replaced with /var/log/ceph/ceph-client.admin.43639.log.gz 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36862.log.gz 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.37833.log.gz 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39967.log 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42155.log: /var/log/ceph/ceph-client.admin.44837.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42155.log.gz 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T03:39:08.094 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36322.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.39967.log.gz 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44908.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36322.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36322.log.gz 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39792.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28952.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44908.log: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39792.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44908.log.gz 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36784.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39792.log.gz 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39571.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28952.log.gz 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36784.log: /var/log/ceph/ceph-client.admin.39571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39649.log 2024-09-12T03:39:08.095 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36784.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39571.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35255.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39097.log 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40084.log 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39097.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35445.log 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39649.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39097.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38917.log 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35445.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41636.log 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35445.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41309.log 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38917.log.gz 2024-09-12T03:39:08.096 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41309.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41636.log.gz 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35670.log 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41309.log.gz 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37135.log: /var/log/ceph/ceph-client.admin.44934.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38839.log 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40216.log 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38839.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36238.log 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35670.log.gz 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38839.log.gz 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36160.log 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40216.log.gz 2024-09-12T03:39:08.097 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37265.log 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.2.36160.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36238.log.gz 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38642.log 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42618.log 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37265.log: /var/log/ceph/ceph-client.admin.38642.log: 89.7% -- replaced with /var/log/ceph/ceph-client.2.36160.log.gz 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37265.log.gz 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38642.log.gz 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37965.log 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35176.log 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42618.log: /var/log/ceph/ceph-client.admin.37965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41428.log 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35176.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42618.log.gz 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37965.log.gz 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35176.log.gz 2024-09-12T03:39:08.098 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34544.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44389.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41428.log.gz/var/log/ceph/ceph-client.admin.45110.log: 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34544.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34544.log.gz 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35246.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34466.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44389.log: /var/log/ceph/ceph-client.admin.35246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38865.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34466.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35246.log.gz 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44389.log.gz 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34466.log.gz 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39396.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44811.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38865.log: /var/log/ceph/ceph-client.admin.39396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41370.log 2024-09-12T03:39:08.099 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44811.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38865.log.gz 2024-09-12T03:39:08.100 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39396.log.gz 2024-09-12T03:39:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35456.log 2024-09-12T03:39:08.100 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44811.log.gz 2024-09-12T03:39:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41370.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41370.log.gz 2024-09-12T03:39:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40966.log 2024-09-12T03:39:08.100 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34826.log 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35456.log: /var/log/ceph/ceph-client.admin.40966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40478.log 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34826.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35456.log.gz 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40966.log.gz 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41558.log 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41480.log 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.40478.log: /var/log/ceph/ceph-client.admin.41558.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41558.log.gz 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.34826.log.gz 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-09-12T03:39:08.101 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38046.log 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41480.log: 94.2%/var/log/ceph/ceph-client.admin.35826.log: -- replaced with /var/log/ceph/ceph-client.0.40478.log.gz 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41480.log.gz 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37161.log 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41991.log 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37409.log 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38046.log.gz 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37161.log: /var/log/ceph/ceph-client.admin.41991.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37409.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41991.log.gz 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37161.log.gz 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37409.log.gz 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose --/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.42279.log 2024-09-12T03:39:08.102 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44047.log 2024-09-12T03:39:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43561.log: /var/log/ceph/ceph-client.admin.42279.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41396.log 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42279.log.gz 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44047.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.42592.log 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44047.log.gz 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40320.log 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42592.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41396.log.gz 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40914.log 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42103.log 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40320.log: /var/log/ceph/ceph-client.admin.40914.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40320.log.gz 2024-09-12T03:39:08.123 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40914.log.gz 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40164.log 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44337.log 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42103.log: /var/log/ceph/ceph-client.admin.40164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41584.log 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40164.log.gz 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42103.log.gz 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40190.log 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44337.log.gz 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.41584.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39448.log 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40190.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.38351.log 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41584.log.gz 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40190.log.gz 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39448.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-09-12T03:39:08.124 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39448.log.gz 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37887.log 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38351.log.gz 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37887.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39153.log 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44285.log: gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.37887.log.gz -- 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.38325.log 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.39153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44021.log 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44259.log 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44021.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38325.log.gz 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44021.log.gz 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43379.log 2024-09-12T03:39:08.125 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39318.log 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43379.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44259.log.gz 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% 92.3% -- replaced with /var/log/ceph/ceph-client.0.39153.log.gz 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43379.log.gz 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34263.log 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29045.log 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37439.log 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39318.log.gz 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34263.log.gz 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.29045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39021.log 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29045.log.gz 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38020.log 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37439.log.gz 2024-09-12T03:39:08.126 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39021.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39545.log 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38020.log: /var/log/ceph/ceph-client.admin.43743.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38020.log.gz 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37675.log 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39623.log 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39545.log: gzip -5/var/log/ceph/ceph-client.admin.37675.log: --verbose -- /var/log/ceph/ceph-client.admin.43431.log 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39623.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37675.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39545.log.gz 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39623.log.gz 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34408.log 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35072.log 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43431.log: /var/log/ceph/ceph-client.admin.34408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42937.log 2024-09-12T03:39:08.127 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35072.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43431.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34408.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35072.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28836.log 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42937.log: /var/log/ceph/ceph-client.admin.35722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.28836.log: 89.2% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42937.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28836.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44103.log 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42989.log: /var/log/ceph/ceph-client.admin.44155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40661.log 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44103.log: 88.9% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-09-12T03:39:08.128 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44103.log.gz 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39207.log 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40661.log: /var/log/ceph/ceph-client.admin.39207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43986.log 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35748.log: 88.6% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40661.log.gz 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39207.log.gz 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38468.log 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34373.log 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43986.log: /var/log/ceph/ceph-client.admin.38468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34373.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43986.log.gz 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38468.log.gz 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-09-12T03:39:08.129 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34373.log.gz 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38729.log 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38729.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38729.log.gz 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36907.log 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39474.log 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36907.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36907.log.gz 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39474.log.gz 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45552.log 2024-09-12T03:39:08.130 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43253.log 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40687.log: /var/log/ceph/ceph-client.admin.45552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38299.log 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45552.log.gz 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35461.log 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43253.log.gz 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38677.log 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38299.log: /var/log/ceph/ceph-client.admin.35461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35250.log 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38677.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38299.log.gz 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35461.log.gz 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38677.log.gz 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T03:39:08.131 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39370.log 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35250.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45188.log 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39370.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35250.log.gz 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39370.log.gz 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45188.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45188.log.gz 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39939.log 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.39939.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39939.log.gz 2024-09-12T03:39:08.135 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-09-12T03:39:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T03:39:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34570.log: /var/log/ceph/ceph-client.admin.41103.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-09-12T03:39:08.136 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44707.log 2024-09-12T03:39:08.136 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42357.log 2024-09-12T03:39:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44707.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44707.log.gz 2024-09-12T03:39:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38703.log 2024-09-12T03:39:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42357.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42357.log.gz 2024-09-12T03:39:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43587.log 2024-09-12T03:39:08.137 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38703.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38703.log.gz 2024-09-12T03:39:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45082.log 2024-09-12T03:39:08.138 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43587.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43587.log.gz 2024-09-12T03:39:08.139 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44594.log 2024-09-12T03:39:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45082.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45082.log.gz 2024-09-12T03:39:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-09-12T03:39:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44594.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44594.log.gz 2024-09-12T03:39:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40765.log 2024-09-12T03:39:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43457.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-09-12T03:39:08.143 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39701.log 2024-09-12T03:39:08.144 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40765.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40765.log.gz 2024-09-12T03:39:08.144 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34164.log 2024-09-12T03:39:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39701.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39701.log.gz 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34164.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34164.log.gz 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41070.log 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43143.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41070.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41070.log.gz 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40002.log 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37994.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-09-12T03:39:08.151 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42022.log 2024-09-12T03:39:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40002.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40002.log.gz 2024-09-12T03:39:08.152 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42383.log 2024-09-12T03:39:08.153 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42022.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42022.log.gz 2024-09-12T03:39:08.153 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45214.log 2024-09-12T03:39:08.154 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42383.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42383.log.gz 2024-09-12T03:39:08.155 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35124.log 2024-09-12T03:39:08.156 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45214.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45214.log.gz 2024-09-12T03:39:08.156 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43041.log 2024-09-12T03:39:08.157 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35124.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35124.log.gz 2024-09-12T03:39:08.157 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39422.log 2024-09-12T03:39:08.158 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43041.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43041.log.gz 2024-09-12T03:39:08.159 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35252.log 2024-09-12T03:39:08.160 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39422.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39422.log.gz 2024-09-12T03:39:08.160 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42702.log 2024-09-12T03:39:08.161 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35252.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35252.log.gz 2024-09-12T03:39:08.161 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41714.log 2024-09-12T03:39:08.162 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42702.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42702.log.gz 2024-09-12T03:39:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36680.log 2024-09-12T03:39:08.164 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41714.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41714.log.gz 2024-09-12T03:39:08.165 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2024-09-12T03:39:08.165 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36680.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36680.log.gz 2024-09-12T03:39:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42885.log 2024-09-12T03:39:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44680.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2024-09-12T03:39:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2024-09-12T03:39:08.168 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42885.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42885.log.gz 2024-09-12T03:39:08.169 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-09-12T03:39:08.169 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45344.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gz 2024-09-12T03:39:08.170 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45136.log 2024-09-12T03:39:08.171 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44625.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2024-09-12T03:39:08.171 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36459.log 2024-09-12T03:39:08.172 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45136.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45136.log.gz 2024-09-12T03:39:08.172 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43199.log 2024-09-12T03:39:08.173 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36459.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36459.log.gz 2024-09-12T03:39:08.174 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42674.log 2024-09-12T03:39:08.176 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.43199.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.43199.log.gz 2024-09-12T03:39:08.177 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40138.log 2024-09-12T03:39:08.178 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42674.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42674.log.gz 2024-09-12T03:39:08.178 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35887.log 2024-09-12T03:39:08.179 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40138.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40138.log.gz 2024-09-12T03:39:08.179 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44439.log 2024-09-12T03:39:08.180 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35887.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35887.log.gz 2024-09-12T03:39:08.181 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39727.log 2024-09-12T03:39:08.182 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44439.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44439.log.gz 2024-09-12T03:39:08.182 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40346.log 2024-09-12T03:39:08.183 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.39727.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39727.log.gz 2024-09-12T03:39:08.183 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36836.log 2024-09-12T03:39:08.185 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40346.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40346.log.gz 2024-09-12T03:39:08.185 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40791.log 2024-09-12T03:39:08.186 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36836.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36836.log.gz 2024-09-12T03:39:08.186 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38969.log 2024-09-12T03:39:08.186 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T03:39:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43483.log 2024-09-12T03:39:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38969.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40791.log.gz 2024-09-12T03:39:08.187 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38969.log.gz 2024-09-12T03:39:08.188 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-09-12T03:39:08.189 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36706.log 2024-09-12T03:39:08.189 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43483.log.gz 2024-09-12T03:39:08.190 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37357.log 2024-09-12T03:39:08.190 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-09-12T03:39:08.190 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2024-09-12T03:39:08.190 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36706.log.gz 2024-09-12T03:39:08.191 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37357.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37357.log.gz 2024-09-12T03:39:08.191 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41820.log 2024-09-12T03:39:08.191 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2024-09-12T03:39:08.192 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44654.log: /var/log/ceph/ceph-client.0.41820.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2024-09-12T03:39:08.192 INFO:teuthology.orchestra.run.smithi150.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T03:39:08.193 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2024-09-12T03:39:08.193 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44759.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2024-09-12T03:39:08.194 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36933.log 2024-09-12T03:39:08.194 INFO:teuthology.orchestra.run.smithi073.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.41820.log.gz/var/log/ceph/ceph-client.admin.45576.log: 2024-09-12T03:39:08.195 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2024-09-12T03:39:08.195 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38273.log 2024-09-12T03:39:08.195 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40242.log 2024-09-12T03:39:08.195 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36933.log: /var/log/ceph/ceph-client.admin.38273.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36933.log.gz 2024-09-12T03:39:08.196 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38273.log.gz 2024-09-12T03:39:08.196 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41662.log 2024-09-12T03:39:08.197 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40242.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40242.log.gz 2024-09-12T03:39:08.197 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42129.log 2024-09-12T03:39:08.198 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2024-09-12T03:39:08.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.41662.log: /var/log/ceph/ceph-client.admin.42129.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41662.log.gz 2024-09-12T03:39:08.198 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42129.log.gz 2024-09-12T03:39:08.198 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36065.log 2024-09-12T03:39:08.199 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42077.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2024-09-12T03:39:08.199 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37239.log 2024-09-12T03:39:08.200 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36810.log 2024-09-12T03:39:08.202 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36065.log: /var/log/ceph/ceph-client.admin.37239.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36065.log.gz 2024-09-12T03:39:08.202 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37239.log.gz 2024-09-12T03:39:08.202 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36426.log 2024-09-12T03:39:08.202 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38891.log 2024-09-12T03:39:08.202 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.36810.log: /var/log/ceph/ceph-client.admin.36426.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36810.log.gz 2024-09-12T03:39:08.202 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36426.log.gz 2024-09-12T03:39:08.202 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42181.log 2024-09-12T03:39:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2024-09-12T03:39:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.38891.log: /var/log/ceph/ceph-client.admin.42181.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38891.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42181.log.gz 2024-09-12T03:39:08.204 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.204 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41764.log 2024-09-12T03:39:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40058.log 2024-09-12T03:39:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43808.log: /var/log/ceph/ceph-client.admin.41764.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2024-09-12T03:39:08.205 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41764.log.gz 2024-09-12T03:39:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42644.log 2024-09-12T03:39:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44207.log 2024-09-12T03:39:08.206 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.40058.log: /var/log/ceph/ceph-client.admin.42644.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2024-09-12T03:39:08.206 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42644.log.gz 2024-09-12T03:39:08.206 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45422.log 2024-09-12T03:39:08.206 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-09-12T03:39:08.207 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44207.log: /var/log/ceph/ceph-client.admin.45422.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44207.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45422.log.gz 2024-09-12T03:39:08.207 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:08.208 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35696.log 2024-09-12T03:39:08.208 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34492.log 2024-09-12T03:39:08.208 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35696.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-09-12T03:39:08.209 INFO:teuthology.orchestra.run.smithi150.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T03:39:08.209 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34315.log 2024-09-12T03:39:08.209 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35696.log.gz 2024-09-12T03:39:08.210 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34492.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34492.log.gz 2024-09-12T03:39:08.210 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38150.log 2024-09-12T03:39:08.211 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44233.log 2024-09-12T03:39:08.211 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.34315.log: /var/log/ceph/ceph-client.admin.38150.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34315.log.gz 2024-09-12T03:39:08.211 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38150.log.gz 2024-09-12T03:39:08.211 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40632.log 2024-09-12T03:39:08.212 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35459.log 2024-09-12T03:39:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44233.log: /var/log/ceph/ceph-client.admin.40632.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44233.log.gz 2024-09-12T03:39:08.213 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40632.log.gz 2024-09-12T03:39:08.213 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36348.log 2024-09-12T03:39:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35098.log 2024-09-12T03:39:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35459.log: /var/log/ceph/ceph-client.admin.36348.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35459.log.gz 2024-09-12T03:39:08.214 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36348.log.gz 2024-09-12T03:39:08.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.35098.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35098.log.gz 2024-09-12T03:39:08.359 INFO:teuthology.orchestra.run.smithi073.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T03:39:08.428 INFO:teuthology.orchestra.run.smithi073.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T03:39:08.934 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T03:39:08.965 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T03:39:08.967 INFO:teuthology.orchestra.run.smithi150.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T03:39:08.982 INFO:teuthology.orchestra.run.smithi073.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T03:39:09.006 INFO:teuthology.orchestra.run.smithi150.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T03:39:09.029 INFO:teuthology.orchestra.run.smithi150.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T03:39:09.031 INFO:teuthology.orchestra.run.smithi150.stderr: 2024-09-12T03:39:09.031 INFO:teuthology.orchestra.run.smithi150.stderr:real 0m1.039s 2024-09-12T03:39:09.031 INFO:teuthology.orchestra.run.smithi150.stderr:user 0m4.193s 2024-09-12T03:39:09.031 INFO:teuthology.orchestra.run.smithi150.stderr:sys 0m0.159s 2024-09-12T03:39:09.071 INFO:teuthology.orchestra.run.smithi073.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T03:39:09.088 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T03:39:09.090 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-12T03:39:09.090 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m1.134s 2024-09-12T03:39:09.090 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m5.016s 2024-09-12T03:39:09.090 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.241s 2024-09-12T03:39:09.090 INFO:tasks.ceph:Archiving logs... 2024-09-12T03:39:09.090 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/remote/smithi073/log 2024-09-12T03:39:09.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T03:39:09.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-12T03:39:09.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-12T03:39:09.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-12T03:39:09.915 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/remote/smithi150/log 2024-09-12T03:39:09.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T03:39:10.445 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T03:39:10.454 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T03:39:10.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T03:39:10.457 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T03:39:10.560 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T03:39:10.570 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T03:39:10.570 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:39:10.574 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T03:39:10.584 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T03:39:10.584 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-12T03:39:10.584 INFO:teuthology.orchestra.run.smithi073.stdout:+hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.080 +2.725 1.094 2024-09-12T03:39:10.584 INFO:teuthology.orchestra.run.smithi073.stdout:*hv02.front.sepi 63.231.80.2 3 u 26 64 377 0.094 -3.452 1.679 2024-09-12T03:39:10.584 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 31 64 377 0.062 -2.791 0.818 2024-09-12T03:39:10.584 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:39:10.588 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T03:39:10.588 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2024-09-12T03:39:10.588 INFO:teuthology.orchestra.run.smithi150.stdout:+hv01.front.sepi 67.205.162.81 3 u 31 64 377 0.067 +3.534 3.161 2024-09-12T03:39:10.588 INFO:teuthology.orchestra.run.smithi150.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.090 -1.715 2.891 2024-09-12T03:39:10.588 INFO:teuthology.orchestra.run.smithi150.stdout:*hv03.front.sepi 74.6.168.72 3 u 31 64 377 0.088 -1.298 3.769 2024-09-12T03:39:10.588 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T03:39:10.589 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T03:39:10.601 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T03:39:10.601 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T03:39:10.609 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T03:39:10.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T03:39:10.628 INFO:teuthology.task.internal:Duration was 945.508423 seconds 2024-09-12T03:39:10.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T03:39:10.636 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T03:39:10.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T03:39:10.638 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T03:39:10.676 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T03:39:10.676 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-12T03:39:10.677 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T03:39:10.730 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-09-12T03:39:10.730 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T03:39:10.740 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T03:39:10.740 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T03:39:10.777 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T03:39:10.809 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T03:39:10.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T03:39:10.849 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T03:39:10.915 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T03:39:10.925 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T03:39:10.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T03:39:10.938 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T03:39:10.950 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T03:39:10.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:39:10.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:39:10.990 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-12T03:39:11.009 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-09-12T03:39:11.019 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:39:11.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:39:11.048 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T03:39:11.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T03:39:11.070 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T03:39:11.080 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T03:39:11.081 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/remote/smithi073 2024-09-12T03:39:11.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T03:39:11.115 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901690/remote/smithi150 2024-09-12T03:39:11.116 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T03:39:11.135 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T03:39:11.135 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T03:39:11.157 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T03:39:11.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T03:39:11.189 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T03:39:11.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T03:39:11.199 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T03:39:11.199 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T03:39:11.205 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T03:39:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: 658614 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 03:39 /home/ubuntu/cephtest 2024-09-12T03:39:11.227 INFO:teuthology.orchestra.run.smithi150.stdout: 658472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 03:39 /home/ubuntu/cephtest 2024-09-12T03:39:11.229 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T03:39:11.239 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T03:39:11.261 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/quota} duration: 945.5084226131439 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T03:39:11.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T03:39:11.354 INFO:teuthology.run:pass